ishard

package
v0.0.0-...-06fd100 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Feb 18, 2025 License: MIT Imports: 18 Imported by: 0

Documentation

Overview

Package ishard provides utility for shard the initial dataset

  • Copyright (c) 2025, NVIDIA CORPORATION. All rights reserved.

Package ishard provides utility for shard the initial dataset

  • Copyright (c) 2024-2025, NVIDIA CORPORATION. All rights reserved.

Package ishard provides utility for shard the initial dataset and integration with dsort

  • Copyright (c) 2024, NVIDIA CORPORATION. All rights reserved.

Index

Constants

View Source
const DsortDefaultTimeout = 6 * time.Minute

Variables

This section is empty.

Functions

This section is empty.

Types

type ISharder

type ISharder struct {
	// contains filtered or unexported fields
}

ISharder executes an initial sharding job with given configuration

func NewISharder

func NewISharder(cfg *config.Config) (is *ISharder, err error)

NewISharder instantiates an ISharder with the configuration if provided; otherwise, it loads config from CLI parameters.

func (*ISharder) Start

func (is *ISharder) Start() error

Directories

Path Synopsis
Package config provides types and functions to configure ishard executable.
Package config provides types and functions to configure ishard executable.
Package factory provides functions to create shards and track their creation progress
Package factory provides functions to create shards and track their creation progress

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL