waitgroup

Documentation

Index

• func Crawl(sites []string) ([]int, error)
• func GetURL(url string) (*http.Response, error)
• type CrawlError
  • func (c *CrawlError) Add(err error)
  • func (c *CrawlError) Error() string
  • func (c *CrawlError) Valid() bool

Functions

func Crawl

func Crawl(sites []string) ([]int, error)

Crawl collects responses from a list of urls that are passed in. It waits for all requests to complete before returning.

func GetURL

func GetURL(url string) (*http.Response, error)

GetURL gets a url, and logs the time it took

Types

type CrawlError

type CrawlError struct {
	Errors []string
}

CrawlError is our custom error type for aggregating errors

func (*CrawlError) Add

func (c *CrawlError) Add(err error)

Add adds another error

func (*CrawlError) Error

func (c *CrawlError) Error() string

Error implements the error interface

func (*CrawlError) Valid

func (c *CrawlError) Valid() bool

Valid can be used to determine if we should return this