gcs

Documentation

Index

• type Source
  • func (s *Source) Chunks(ctx context.Context, chunksChan chan *sources.Chunk) error
  • func (s *Source) Init(aCtx context.Context, name string, id int64, sourceID int64, verify bool, ...) error
  • func (s *Source) JobID() int64
  • func (s *Source) SourceID() int64
  • func (s *Source) Type() sourcespb.SourceType

Types

type Source

type Source struct {
	sources.Progress // progress is not thread safe
	sources.CommonSourceUnitUnmarshaller
	// contains filtered or unexported fields
}

Source represents a GCS source.

func (*Source) Chunks

func (s *Source) Chunks(ctx context.Context, chunksChan chan *sources.Chunk) error

Chunks emits chunks of bytes over a channel.

func (*Source) Init

func (s *Source) Init(aCtx context.Context, name string, id int64, sourceID int64, verify bool, connection *anypb.Any, concurrency int) error

Init returns an initialized GCS source.

func (*Source) JobID

func (s *Source) JobID() int64

JobID number for GCS Source.

func (*Source) SourceID

func (s *Source) SourceID() int64

SourceID number for GCS Source.

func (*Source) Type

func (s *Source) Type() sourcespb.SourceType

Type returns the type of source. It is used for matching source types in configuration and job input.