pps

package

v1.5.0 Latest Latest Go to latest Published: Jul 7, 2017 License: Apache-2.0 Imports: 8 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This section is empty.

This section is empty.

func GetExpectedNumWorkers(kubeClient *kube.Client, spec *ppsclient.ParallelismSpec) (int, error)

GetExpectedNumWorkers computes the expected number of workers that pachyderm will start given the ParallelismSpec 'spec'.

This is only exported for testing

func JobRepo(job *ppsclient.Job) *pfs.Repo

JobRepo creates a pfs repo for a given job.

func PipelineRcName(name string, version uint64) string

PipelineRcName generates the name of the k8s replication controller that manages a pipeline's workers

func PipelineRepo(pipeline *ppsclient.Pipeline) *pfs.Repo

PipelineRepo creates a pfs repo for a given pipeline.

type Hasher struct {
	JobModulus      uint64
	PipelineModulus uint64
}

A Hasher represents a job/pipeline hasher.

func NewHasher(jobModulus uint64, pipelineModulus uint64) *Hasher

NewHasher creates a hasher.

func (s *Hasher) HashJob(jobID string) uint64

HashJob computes and returns the hash of a job.

func (s *Hasher) HashPipeline(pipelineName string) uint64

HashPipeline computes and returns the hash of a pipeline.