downloader

Documentation

Index

• Variables
• type Downloader
• type Surfer
  • func (self *Surfer) Download(sp *spider.Spider, cReq *request.Request) *spider.Context

Variables

var (
	SurferDownloader = &Surfer{
		surf:    surfer.New(cookieJar),
		phantom: surfer.NewPhantom(config.PHANTOMJS, config.PHANTOMJS_TEMP, cookieJar),
	}
)

Types

type Downloader

type Downloader interface {
	Download(*spider.Spider, *request.Request) *spider.Context
}

The Downloader interface. You can implement the interface by implement function Download. Function Download need to return Page instance pointer that has request result downloaded from Request.

type Surfer

type Surfer struct {
	// contains filtered or unexported fields
}

func (*Surfer) Download

func (self *Surfer) Download(sp *spider.Spider, cReq *request.Request) *spider.Context