Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type HTTPHeaderGenerator ¶
type HTTPHeaderGenerator struct {
// contains filtered or unexported fields
}
HTTPHeaderGenerator generates headers for http requests for scraping
func (*HTTPHeaderGenerator) AddHeaders ¶
func (h *HTTPHeaderGenerator) AddHeaders(header *http.Header)
AddHeaders ads the generated headers to the request headers
func (*HTTPHeaderGenerator) GetRandomUserAgent ¶
func (h *HTTPHeaderGenerator) GetRandomUserAgent() string
GetRandomUserAgent returns a random user agent
Click to show internal directories.
Click to hide internal directories.