sync

Documentation

Overview

Package sync provides utility functions similar to `git pull/push` for PFS

Index

• func Push(client *pachclient.APIClient, root string, commit *pfs.Commit, overwrite bool) error
• func PushObj(pachClient pachclient.APIClient, commit *pfs.Commit, objClient obj.Client, ...) error
• type Puller
  • func NewPuller() *Puller
  • func (p *Puller) CleanUp() error
  • func (p *Puller) Pull(client *pachclient.APIClient, root string, repo, commit, file string, ...) error

Functions

func Push

func Push(client *pachclient.APIClient, root string, commit *pfs.Commit, overwrite bool) error

Push puts files under root into an open commit.

func PushObj

func PushObj(pachClient pachclient.APIClient, commit *pfs.Commit, objClient obj.Client, root string) error

PushObj pushes data from commit to an object store.

Types

type Puller

type Puller struct {
	sync.Mutex
	// contains filtered or unexported fields
}

Puller as a struct for managing a Pull operation.

func NewPuller

func NewPuller() *Puller

NewPuller creates a new Puller struct.

func (*Puller) CleanUp

func (p *Puller) CleanUp() error

CleanUp cleans up blocked syscalls for pipes that were never opened. It also returns any errors that might have been encountered while trying to read data for the pipes. CleanUp should be called after all code that might access pipes has completed running, it should not be called concurrently.

func (*Puller) Pull

func (p *Puller) Pull(client *pachclient.APIClient, root string, repo, commit, file string, pipes bool, concurrency int) error

Pull clones an entire repo at a certain commit. root is the local path you want to clone to. fileInfo is the file/dir we are puuling. pipes causes the function to create named pipes in place of files, thus lazily downloading the data as it's needed.