scraper

Documentation

Index

• type MinioScraper
  • func NewMinioScraper(endpoint, accessKeyID, secretAccessKey, location, token, bucket string, ...) *MinioScraper
  • func (s MinioScraper) Scrape(id string, directories []string) error
• type Scraper

Types

type MinioScraper

type MinioScraper struct {
	Endpoint, AccessKeyID, SecretAccessKey, Location, Token, Bucket string
	Ssl                                                             bool
}

MinioScraper manages getting artifacts from job pods

func NewMinioScraper

func NewMinioScraper(endpoint, accessKeyID, secretAccessKey, location, token, bucket string, ssl bool) *MinioScraper

NewMinioScraper returns a Minio implementation of the Scraper

func (MinioScraper) Scrape

func (s MinioScraper) Scrape(id string, directories []string) error

Scrape gets artifacts from pod based on execution ID and directories list

type Scraper

type Scraper interface {
	// Scrape gets artifacts from the directories present in the execution with executionID
	Scrape(executionID string, directories []string) error
}

Scraper is responsible for collecting and persisting the necessary artifacts