Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security Policy
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

scrapemateapp

package

Go to main page

Versions in this module

v0

v0.9.1

Jan 25, 2025

Changes in this version

+ func WithUA(ua string) func(*jsOptions)

v0.9.0

Jan 19, 2025

Changes in this version

+ func WithBrowserReuseLimit(limit int) func(*Config) error

+ func WithPageReuseLimit(limit int) func(*Config) error

type Config

+ BrowserReuseLimit int

+ PageReuseLimit int

v0.8.5

Jan 18, 2025

v0.8.4

Jan 1, 2025

Changes in this version

type Config

+ StealthBrowser string

v0.8.3

Dec 15, 2024

Changes in this version

+ func WithStealth() func(*Config) error

type Config

+ UseStealth bool

v0.8.2

Nov 3, 2024

v0.8.1

Nov 3, 2024

v0.8.0

Nov 2, 2024

v0.7.1

Oct 20, 2024

v0.7.0

Oct 20, 2024

Changes in this version

+ func WithProxies(proxies []string) func(*Config) error

+ func WithProxyPassword(password string) func(*Config) error

+ func WithProxyUsername(username string) func(*Config) error

type Config

+ Proxies []string

+ ProxyPassword string

+ ProxyUsername string

v0.6.1

Oct 19, 2024

v0.6.0

May 1, 2024

Changes in this version

+ func DisableImages() func(*jsOptions)

v0.5.3

Nov 24, 2023

v0.5.2

Sep 8, 2023

v0.5.1

Sep 2, 2023

v0.5.0

Sep 1, 2023

Changes in this version

+ func WithExitOnInactivity(duration time.Duration) func(*Config) error

type Config

+ ExitOnInactivityDuration time.Duration

v0.4.3

May 14, 2023

Changes in this version

+ func WithInitJob(job scrapemate.IJob) func(*Config) error

type Config

+ InitJob scrapemate.IJob

v0.4.2

May 13, 2023

v0.4.1

May 13, 2023

v0.4.0

May 13, 2023

v0.3.0

May 7, 2023

Changes in this version

+ type Config struct

+ CachePath string

+ CacheType string

+ Concurrency int

+ JSOpts jsOptions

+ Provider scrapemate.JobProvider

+ UseJS bool

+ UseSession bool

+ Writers []scrapemate.ResultWriter

v0.2.2

May 7, 2023

Changes in this version

+ func Headfull() func(*jsOptions)

+ func WithUseSession() func(*config) error

v0.2.1

Apr 15, 2023

Changes in this version

+ const DefaultConcurrency

+ const DefaultProvider

+ func NewConfig(writers []scrapemate.ResultWriter, options ...func(*config) error) (*config, error)

+ func WithCache(cacheType, cachePath string) func(*config) error

+ func WithConcurrency(concurrency int) func(*config) error

+ func WithJS() func(*config) error

+ func WithProvider(provider scrapemate.JobProvider) func(*config) error

+ type ScrapemateApp struct

+ func NewScrapeMateApp(cfg *config) (*ScrapemateApp, error)

+ func (app *ScrapemateApp) Close() error

+ func (app *ScrapemateApp) Start(ctx context.Context, seedJobs ...scrapemate.IJob) error