parsers

Documentation

Index

• type HTMLProvider
  • func (h *HTMLProvider) Parse(node *core.URLMap, baseURL *url.URL, t utils.Tracker) (*core.URLMap, []*url.URL)
• type PageProvider

Types

type HTMLProvider

type HTMLProvider struct {
}

HTMLProvider is for providing an HTML Page to the system

func (*HTMLProvider) Parse

func (h *HTMLProvider) Parse(node *core.URLMap, baseURL *url.URL, t utils.Tracker) (*core.URLMap, []*url.URL)

Parse parses an HTML node

type PageProvider

type PageProvider interface {
	Parse(core.URLMap) (core.URLMap, []*url.URL)
}

PageProvider provides the URLs from a page type