implode

Documentation

Overview

Package implode wraps all needed logic to run a parallel job that will take a directory of tf records and implode them from their respective classes.

Index

• Variables
• func RunJob(nworkers int, args []string, wl *logger.WorkerLogger) error
• type Job

Variables

var (
	CLI = struct {
		// Command line args common to all commands
		inputDir  string
		outputDir string
		prefix    string // output prefix
		filter    string
		shardSize int
		maxCount  int

		// Private stuff
		numWorkers int
		classes    []int
	}{}
)

Functions

func RunJob

func RunJob(nworkers int, args []string, wl *logger.WorkerLogger) error

Types

type Job

type Job struct {
	// contains filtered or unexported fields
}