uploader

Documentation

Overview

Copyright 2018 Google, Inc. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Index

• type GCS
• type OS
• type Uploader
  • func New(ctx context.Context, gcs GCS, os OS, bucket, manifestObject string, ...) *Uploader
  • func (u *Uploader) Do(ctx context.Context, path string, info os.FileInfo) error
  • func (u *Uploader) Done(ctx context.Context) error

Types

type GCS

type GCS interface {
	NewWriter(ctx context.Context, bucket, object string) io.WriteCloser
}

GCS allows us to inject dependencies to facilitate testing.

type OS

type OS interface {
	EvalSymlinks(path string) (string, error)
	Stat(path string) (os.FileInfo, error)
}

OS allows us to inject dependencies to facilitate testing.

type Uploader

type Uploader struct {
	// contains filtered or unexported fields
}

Uploader encapsulates methods for uploading files incrementally and producing a source manifest.

func New

func New(ctx context.Context, gcs GCS, os OS, bucket, manifestObject string, numWorkers int) *Uploader

New returns a new Uploader.

func (*Uploader) Do

func (u *Uploader) Do(ctx context.Context, path string, info os.FileInfo) error

func (*Uploader) Done

func (u *Uploader) Done(ctx context.Context) error

Wait blocks until ongoing uploads are complete, or until an error is encountered.