transferfiles

package
v2.24.1 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Nov 6, 2022 License: Apache-2.0 Imports: 45 Imported by: 0

Documentation

Index

Constants

View Source 
const (
	Repositories            TransferJobType = "Repositories"
	Files                   TransferJobType = "Files"
	TimeSlots               TransferJobType = "Time Slots"
	Note                    string          = "Note: "
	RetryFailureContentNote string          = "In Phase 3 and in subsequent executions, we'll retry transferring the failed files."
)
View Source 
const (
	DefaultAqlPaginationLimit = 10000
)
View Source 
const NumberOfPhases = 3
View Source 
const SyncErrorReason = "un-synchronized chunk status due to network issue"
View Source 
const SyncErrorStatusCode = 404

Variables

View Source 
var AqlPaginationLimit = DefaultAqlPaginationLimit

Functions

func GetThreads added in v2.19.0 

func GetThreads() int

func NewSrcUserPluginService 

func NewSrcUserPluginService(artDetails auth.ServiceDetails, client *jfroghttpclient.JfrogHttpClient) *srcUserPluginService

func ShouldStop added in v2.19.0 

func ShouldStop(phase *phaseBase, delayHelper *delayUploadHelper, errorsChannelMng *ErrorsChannelMng) bool

ShouldStop Stop transferring if one of the following happened: * Error occurred while handling errors (for example - not enough space in file system) * Error occurred during delayed artifacts handling * User interrupted the process (ctrl+c)

func ShowStatus added in v2.23.0 

func ShowStatus() error

Types

type ChunksLifeCycleManager added in v2.21.1 

type ChunksLifeCycleManager struct {
	// contains filtered or unexported fields
}

func (*ChunksLifeCycleManager) GetInProgressTokensSlice added in v2.21.1 

func (clcm *ChunksLifeCycleManager) GetInProgressTokensSlice() []api.ChunkId

func (*ChunksLifeCycleManager) GetInProgressTokensSliceByNodeId added in v2.21.1 

func (clcm *ChunksLifeCycleManager) GetInProgressTokensSliceByNodeId(nodeId nodeId) []api.ChunkId

type DelayedArtifactsChannelMng added in v2.18.2 

type DelayedArtifactsChannelMng struct {
	// contains filtered or unexported fields
}

DelayedArtifactsChannelMng is used when writing 'delayed artifacts' to a common channel. If an error occurs while handling the files - this message is used to stop adding elements to the channel.

type DelayedArtifactsFile 

type DelayedArtifactsFile struct {
	DelayedArtifacts []api.FileRepresentation `json:"delayed_artifacts,omitempty"`
}

type ErrorsChannelMng added in v2.18.2 

type ErrorsChannelMng struct {
	// contains filtered or unexported fields
}

ErrorsChannelMng handles the uploading errors and adds them to a common channel. Stops adding elements to the channel if an error occurs while handling the files.

type ExtendedFileUploadStatusResponse added in v2.18.7 

type ExtendedFileUploadStatusResponse struct {
	api.FileUploadStatusResponse
	Time string `json:"time,omitempty"`
}

type FilesErrors 

type FilesErrors struct {
	Errors []ExtendedFileUploadStatusResponse `json:"errors,omitempty"`
}

type InterruptionErr added in v2.19.0 

type InterruptionErr struct{}

func (*InterruptionErr) Error added in v2.19.0 

func (m *InterruptionErr) Error() string

type PollingTasksManager added in v2.18.2 

type PollingTasksManager struct {
	// contains filtered or unexported fields
}

type SplitContentWriter added in v2.23.2 

type SplitContentWriter struct {
	// contains filtered or unexported fields
}

SplitContentWriter writes to files a single JSON object that holds a list of records added as stream. It can limit the amount of records per file and splits the content to several files if needed.

type TransferDelayedArtifactsMng 

type TransferDelayedArtifactsMng struct {
	// contains filtered or unexported fields
}

TransferDelayedArtifactsMng takes care of the multi-threaded-writing of artifacts to be transferred, while maintaining the correct order of the deployment. This is needed because, for example, for maven repositories, pom file should be deployed last.

type TransferErrorsMng 

type TransferErrorsMng struct {
	// contains filtered or unexported fields
}

TransferErrorsMng manages multi threads writing errors. We want to create a file which contains all upload error statuses for each repository and phase. Those files will serve us in 2 cases: 1. Whenever we re-run 'transfer-files' command, we want to attempt to upload failed files again. 2. As part of the transfer process, we generate a csv file that contains all upload errors. In case an error occurs when creating those upload errors files, we would like to stop the transfer right away.

type TransferFilesCommand 

type TransferFilesCommand struct {
	// contains filtered or unexported fields
}

func NewTransferFilesCommand 

func NewTransferFilesCommand(sourceServer, targetServer *config.ServerDetails) (*TransferFilesCommand, error)

func (*TransferFilesCommand) CommandName 

func (tdc *TransferFilesCommand) CommandName() string

func (*TransferFilesCommand) Run 

func (tdc *TransferFilesCommand) Run() (err error)

func (*TransferFilesCommand) SetExcludeReposPatterns 

func (tdc *TransferFilesCommand) SetExcludeReposPatterns(excludeReposPatterns []string)

func (*TransferFilesCommand) SetFilestore 

func (tdc *TransferFilesCommand) SetFilestore(filestore bool)

func (*TransferFilesCommand) SetIgnoreState added in v2.20.3 

func (tdc *TransferFilesCommand) SetIgnoreState(ignoreState bool)

func (*TransferFilesCommand) SetIncludeReposPatterns 

func (tdc *TransferFilesCommand) SetIncludeReposPatterns(includeReposPatterns []string)

func (*TransferFilesCommand) SetProxyKey added in v2.21.0 

func (tdc *TransferFilesCommand) SetProxyKey(proxyKey string)

func (*TransferFilesCommand) SetStatus added in v2.23.0 

func (tdc *TransferFilesCommand) SetStatus(status bool)

type TransferJobType added in v2.20.0 

type TransferJobType string

func (TransferJobType) String added in v2.20.0 

func (tt TransferJobType) String() string

type TransferProgressMng added in v2.20.0 

type TransferProgressMng struct {
	// contains filtered or unexported fields
}

TransferProgressMng provides progress indication for the jf rt transfer-files command. Transferring one repository's data at a time.

func NewTransferProgressMng added in v2.20.0 

func NewTransferProgressMng(allSourceLocalRepos []string, timeEstMng *state.TimeEstimationManager, ignoreOldState bool) (*TransferProgressMng, error)

NewTransferProgressMng creates TransferProgressMng object. If the progress bar shouldn't be displayed returns nil.

func (*TransferProgressMng) AddPhase1 added in v2.20.0 

func (t *TransferProgressMng) AddPhase1(tasksPhase1 int64)

func (*TransferProgressMng) AddPhase2 added in v2.20.0 

func (t *TransferProgressMng) AddPhase2(tasksPhase2 int64)

func (*TransferProgressMng) AddPhase3 added in v2.21.0 

func (t *TransferProgressMng) AddPhase3(tasksPhase3 int64)

func (*TransferProgressMng) DonePhase added in v2.20.0 

func (t *TransferProgressMng) DonePhase(id int) error

func (*TransferProgressMng) IncrementPhase added in v2.20.0 

func (t *TransferProgressMng) IncrementPhase(id int) error

IncrementPhase increments completed tasks count for a specific phase by 1.

func (*TransferProgressMng) IncrementPhaseBy added in v2.20.0 

func (t *TransferProgressMng) IncrementPhaseBy(id int, n int) error

IncrementPhaseBy increments completed tasks count for a specific phase by n.

func (*TransferProgressMng) NewRepository added in v2.20.0 

func (t *TransferProgressMng) NewRepository(name string)

NewRepository adds new repository's progress details. Aborting previous repository if exists.

func (*TransferProgressMng) Quit added in v2.20.0 

func (t *TransferProgressMng) Quit() error

Quit terminate the TransferProgressMng process.

func (*TransferProgressMng) RemoveRepository added in v2.20.0 

func (t *TransferProgressMng) RemoveRepository()

func (*TransferProgressMng) SetRunningThreads added in v2.20.0 

func (t *TransferProgressMng) SetRunningThreads(n int)

func (*TransferProgressMng) ShouldDisplay added in v2.20.0 

func (t *TransferProgressMng) ShouldDisplay() bool

func (*TransferProgressMng) StopGracefully added in v2.20.0 

func (t *TransferProgressMng) StopGracefully()

type UploadedChunk added in v2.24.0 

type UploadedChunk struct {
	api.UploadChunkResponse
	UploadedChunkData
}

type UploadedChunkData added in v2.21.1 

type UploadedChunkData struct {
	ChunkFiles []api.FileRepresentation
	TimeSent   time.Time
}

type VerifyCompatibilityResponse added in v2.20.5 

type VerifyCompatibilityResponse struct {
	Version string `json:"version,omitempty"`
	Message string `json:"message,omitempty"`
}

Source Files

View all Source files

Directories

Path Synopsis

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.