gcsloader

Documentation

Index

• func LoadFromBoltDB(pool *fuzzpool.FuzzPool, cache *fuzzcache.FuzzReportCache) error
• type GCSLoader
  • func New(s *storage.Client, c *fuzzcache.FuzzReportCache, p *fuzzpool.FuzzPool) *GCSLoader
  • func (g *GCSLoader) LoadFreshFromGoogleStorage() error
  • func (g *GCSLoader) LoadFuzzesFromGoogleStorage(whitelist []string) error

Functions

func LoadFromBoltDB

func LoadFromBoltDB(pool *fuzzpool.FuzzPool, cache *fuzzcache.FuzzReportCache) error

LoadFromBoltDB fills the given *fuzzpool.FuzzPool from FuzzReportCache associated with the given

hash. The data.FuzzReports will all be in the current part of the pool.

If a cache for the commit does not exist, or there are other problems with the retrieval, an error is returned. We do not need to deduplicate on extraction because the fuzzes were deduplicated on storage.

Types

type GCSLoader

type GCSLoader struct {
	Cache *fuzzcache.FuzzReportCache
	Pool  *fuzzpool.FuzzPool
	// contains filtered or unexported fields
}

GCSLoader is a struct that handles downloading fuzzes from Google Storage.

func New

func New(s *storage.Client, c *fuzzcache.FuzzReportCache, p *fuzzpool.FuzzPool) *GCSLoader

New creates a GCSLoader and returns it.

func (*GCSLoader) LoadFreshFromGoogleStorage

func (g *GCSLoader) LoadFreshFromGoogleStorage() error

LoadFreshFromGoogleStorage pulls all bad and grey fuzzes out of GCS and loads them into memory. The "fresh" in the name refers to the fact that all other loaded fuzzes (if any) are written over, including in the cache. Upon completion, the full results are cached to a boltDB instance and moved from staging to the current copy.

func (*GCSLoader) LoadFuzzesFromGoogleStorage

func (g *GCSLoader) LoadFuzzesFromGoogleStorage(whitelist []string) error

LoadFuzzesFromGoogleStorage pulls all fuzzes out of GCS that are on the given whitelist and loads them into memory (as staging). These fuzzes represent the newly found bad fuzzes that have been uploaded by the various generators/aggregators. After loading them, it updates the cache and moves them from staging to the current copy.