Versions in this module Expand all Collapse all v0 v0.1.0 Mar 22, 2023 Changes in this version + type Config struct + Crawlers []Crawler + Database Database + func Init() (cfg Config) + type Crawler struct + Headers []Header + Iterator Iterator + Link string + Method string + Name string + OnError string + Paginator Paginator + Payload string + Type string + func (c *Crawler) GetPaginatorOrigin() string + type Database struct + Host string + Name string + Password string + Port int + Sslmode string + User string + type Header struct + Key string + Value string + type Iterator struct + CollectionPath string + IdentificatorPath string + Regexp string + Separator string + Type string + type Paginator struct + End int + Items []string + Key string + Sleep Sleep + Start int + Type string + type Sleep struct + Max string + Min string