crawler

Documentation

Index

• type Crawler
  • func New(client *http.Client, u string, out io.Writer) *Crawler
  • func (c *Crawler) Crawl()
  • func (c *Crawler) Err() error

Types

type Crawler

type Crawler struct {
	// contains filtered or unexported fields
}

Crawler holds values needed to crawl a page

func New

func New(client *http.Client, u string, out io.Writer) *Crawler

New creates a new Crawler

func (*Crawler) Crawl

func (c *Crawler) Crawl()

Crawl performs page crawling for urls

func (*Crawler) Err

func (c *Crawler) Err() error

Err returns a crawling error