lcm

Documentation

Index

• Constants
• Variables
• func GetVolumeClaim(volumeSize int64) (*v1core.PersistentVolumeClaim, error)
• func InitLogger(trainingID string, userID string) *log.Entry
• type Service
  • func NewService() (Service, error)
• type Training
  • func NewTraining(ctx context.Context, k8sClient kubernetes.Interface, ...) Training

Constants

const PodLevelJobDir = "/job"

PodLevelJobDir represents the place to store the job state indicator files, as well as the $BREAK_FILE and $EXITCODE_FILE.

const PodLevelLogDir = PodLevelJobDir + "/logs"

PodLevelLogDir represents the place to store the per-learner logs.

Variables

var (
	//NativeFrameworks which support native distribution
	NativeFrameworks = []string{"tensorflow", "caffe2", "mxnet", "horovod", "pytorch"}
)

Functions

func GetVolumeClaim

func GetVolumeClaim(volumeSize int64) (*v1core.PersistentVolumeClaim, error)

GetVolumeClaim returns a PersistentVolumeClaim struct for the given volume size (specified in bytes).

func InitLogger

func InitLogger(trainingID string, userID string) *log.Entry

InitLogger ... initializes new logger with trainingID and userID

Types

type Service

type Service interface {
	service.LifecycleManagerServer
	service.LifecycleHandler
	StopLCM()
}

Service LCM manages the lifecycle of the entire distributed deep learning job

func NewService

func NewService() (Service, error)

NewService is a constructor to initialize LCM

type Training

type Training interface {
	Start() error
}

Training ...

func NewTraining

func NewTraining(ctx context.Context, k8sClient kubernetes.Interface, req *service.JobDeploymentRequest, log *logger.LocLoggingEntry) Training

NewTraining ...