pps

Documentation

Index

• func GetExpectedNumWorkers(kubeClient *kube.Client, spec *ppsclient.ParallelismSpec) (int, error)
• func JobRepo(job *ppsclient.Job) *pfs.Repo
• func PipelineRcName(name string, version uint64) string
• func PipelineRepo(pipeline *ppsclient.Pipeline) *pfs.Repo
• type Hasher
  • func NewHasher(jobModulus uint64, pipelineModulus uint64) *Hasher
  • func (s *Hasher) HashJob(jobID string) uint64
  • func (s *Hasher) HashPipeline(pipelineName string) uint64

Functions

func GetExpectedNumWorkers

func GetExpectedNumWorkers(kubeClient *kube.Client, spec *ppsclient.ParallelismSpec) (int, error)

GetExpectedNumWorkers computes the expected number of workers that pachyderm will start given the ParallelismSpec 'spec'.

This is only exported for testing

func JobRepo

func JobRepo(job *ppsclient.Job) *pfs.Repo

JobRepo creates a pfs repo for a given job.

func PipelineRcName

func PipelineRcName(name string, version uint64) string

PipelineRcName generates the name of the k8s replication controller that manages a pipeline's workers

func PipelineRepo

func PipelineRepo(pipeline *ppsclient.Pipeline) *pfs.Repo

PipelineRepo creates a pfs repo for a given pipeline.

Types

type Hasher

type Hasher struct {
	JobModulus      uint64
	PipelineModulus uint64
}

A Hasher represents a job/pipeline hasher.

func NewHasher

func NewHasher(jobModulus uint64, pipelineModulus uint64) *Hasher

NewHasher creates a hasher.

func (*Hasher) HashJob

func (s *Hasher) HashJob(jobID string) uint64

HashJob computes and returns the hash of a job.

func (*Hasher) HashPipeline

func (s *Hasher) HashPipeline(pipelineName string) uint64

HashPipeline computes and returns the hash of a pipeline.