gcs

Documentation

Index

• type BucketHandle
  • func GetBucket(ctx context.Context, sClient stiface.Client, bucketName string) (*BucketHandle, error)
  • func (bh *BucketHandle) GetFilesSince(ctx context.Context, prefix string, filter *regexp.Regexp, after time.Time) ([]*storage.ObjectAttrs, int64, error)
  • func (bh *BucketHandle) HasFiles(ctx context.Context, prefix string) (bool, error)

Types

type BucketHandle

type BucketHandle struct {
	stiface.BucketHandle
}

BucketHandle adds functionality to stiface.BucketHandle

func GetBucket

func GetBucket(ctx context.Context, sClient stiface.Client, bucketName string) (*BucketHandle, error)

GetBucket gets an enhanced BucketHandle

func (*BucketHandle) GetFilesSince

func (bh *BucketHandle) GetFilesSince(ctx context.Context, prefix string, filter *regexp.Regexp, after time.Time) ([]*storage.ObjectAttrs, int64, error)

GetFilesSince returns list of all normal file objects with prefix and mTime > after. prefix is the path not including gs://bucket-name/, including the final / Will retry iterator errors up to five total. returns (objects, byteCount, error) Performance: This takes about 5000 objects/second, including objects rejected by the regex and time cutoff.

func (*BucketHandle) HasFiles

func (bh *BucketHandle) HasFiles(ctx context.Context, prefix string) (bool, error)

HasFiles returns boolean indicating whether there are any file objects with the provided prefix. It may iterate over some objects if the first object isn't a file.