scraper

Documentation

Index

• type Scraper
  • func New() *Scraper
  • func (s *Scraper) Scrape(uri string) error

Types

type Scraper

type Scraper struct {
	Responses chan []string
}

Scraper is responsible for scraping a website

func New

func New() *Scraper

New will create a new scraper

func (*Scraper) Scrape

func (s *Scraper) Scrape(uri string) error

Scrape will perform a GET request to fetch an html page and scrape it for links. These links will be returned as a string array. If there was an error while requesting it will be returned as well