The highest tagged major version is v3.

extensions

package

v1.2.0 Latest Latest Go to latest Published: Feb 13, 2019 License: Apache-2.0 Imports: 3 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

gitee.com/zhangxinzx/colly

Links

Open Source Insights

Documentation ¶

Overview ¶

Package extensions implements various helper addons for Colly

Index ¶

func RandomUserAgent(c *colly.Collector)
func Referer(c *colly.Collector)
func URLLengthFilter(c *colly.Collector, URLLengthLimit int)

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func RandomUserAgent ¶

func RandomUserAgent(c *colly.Collector)

RandomUserAgent generates a random browser user agent on every request

func Referer ¶ added in v1.2.0

func Referer(c *colly.Collector)

Referer sets valid Referer HTTP header to requests. Warning: this extension works only if you use Request.Visit from callbacks instead of Collector.Visit.

func URLLengthFilter ¶

func URLLengthFilter(c *colly.Collector, URLLengthLimit int)

URLLengthFilter filters out requests with URLs longer than URLLengthLimit

Types ¶

This section is empty.

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL