loader

Documentation

Index

• type Loader

Types

type Loader

type Loader interface {
	// DetectPageDups checks directory structure for errors and finds the number of
	// pages in the corpus.
	DetectPageDups() (Loader, error)

	// LoadItems walks BHL corpus directory, creates `items` in the database and
	// pushes created `*item.Item` to channel for furhter use.
	LoadItems(context.Context, chan<- *item.Item) error
}

Loader extracts metainformation from BHL file names and reads the content of text files into memory.