Documentation
¶
Index ¶
- type Archiver
- func (archiver *Archiver) Archive(urls ...*url.URL) (*warc.File, error)
- func (archiver *Archiver) OnJobCompleted(job *pipeline.Job, records ...*warc.Record)
- func (archiver *Archiver) OnJobFailed(job *pipeline.Job, err error)
- func (archiver *Archiver) OnPerformJob(job *pipeline.Job)
- func (archiver *Archiver) Schedule(jobs ...*pipeline.Job)
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Archiver ¶
type Archiver struct { MaxDepth uint32 Render bool RenderQuality int ResolverAddress net.IP ResolverPort uint16 UserAgent string // contains filtered or unexported fields }
Archiver contains options for an archiver.
func NewArchiver ¶
NewArchiver creates a new archiver following best practices.
func (*Archiver) OnJobCompleted ¶
OnJobCompleted handles a completed job.
func (*Archiver) OnJobFailed ¶
OnJobFailed handles a failed job, potentially rescheduling it.
func (*Archiver) OnPerformJob ¶
OnPerformJob handles jobs before being performed.
Click to show internal directories.
Click to hide internal directories.