worker

Documentation

Index

• type Worker
  • func NewWorker(ctx context.Context, env serviceenv.ServiceEnv, pachClient *client.APIClient, ...) (*Worker, error)

Types

type Worker

type Worker struct {
	APIServer *server.APIServer // Provides rpcs for other nodes in the cluster
	// contains filtered or unexported fields
}

The Worker object represents

func NewWorker

func NewWorker(
	ctx context.Context,
	env serviceenv.ServiceEnv,
	pachClient *client.APIClient,
	pipelineInfo *pps.PipelineInfo,
	rootPath string,
) (*Worker, error)

NewWorker constructs a Worker object that provides all worker functionality:

1. a master goroutine that attempts to obtain the master lock for the pipeline workers and direct jobs
2. a worker goroutine that gets tasks from the master and processes them
3. an api server that serves requests for status or cross-worker communication
4. a driver that provides common functionality between the above components

The caller should ensure that the workerId field is being logged by the logger in the provided context.