crawler

Documentation

Index

• type Crawler
• type MinCrawler
  • func NewMinCrawler(dirs []string) *MinCrawler
  • func (c *MinCrawler) Crawl()
• type RandomCrawler
  • func NewRandomCrawler(saveDir string, maxUsage int64, getter api.ImageGetter) *RandomCrawler
  • func (r *RandomCrawler) Crawl()

Types

type Crawler

type Crawler interface {
	Crawl()
}

Crawler interface

type MinCrawler

type MinCrawler struct {
	// contains filtered or unexported fields
}

MinCrawler minimifies images and save to distinct directory

func NewMinCrawler

func NewMinCrawler(dirs []string) *MinCrawler

NewMinCrawler creates new MinCrawler

func (*MinCrawler) Crawl

func (c *MinCrawler) Crawl()

Crawl imlementation

type RandomCrawler

type RandomCrawler struct {
	// contains filtered or unexported fields
}

RandomCrawler download random images from source

func NewRandomCrawler

func NewRandomCrawler(saveDir string, maxUsage int64, getter api.ImageGetter) *RandomCrawler

NewRandomCrawler create random crawler

func (*RandomCrawler) Crawl

func (r *RandomCrawler) Crawl()

Crawl implementation