gcs

Documentation

Index

• func U64FromHex(src []byte) uint64
• type Builder
  • func NewBuilder(in *os.File, out io.Writer, probability uint64, indexGranularity uint64) *Builder
  • func (b *Builder) Process(skipWait bool) error
• type Reader
  • func NewReader(fileName string) *Reader
  • func (r *Reader) Exists(target uint64) (bool, error)
  • func (r *Reader) Initialize() error

Functions

func U64FromHex

func U64FromHex(src []byte) uint64

Types

type Builder

type Builder struct {
	// contains filtered or unexported fields
}

func NewBuilder

func NewBuilder(in *os.File, out io.Writer, probability uint64, indexGranularity uint64) *Builder

NewBuilder builder for a new GCS file database.

probability is the False positive rate for queries, 1-in-p. indexGranularity is the entries per index point (16 bytes each).

func (*Builder) Process

func (b *Builder) Process(skipWait bool) error

Process creates the gcs file using the inputs in the builder Concurrent file read inspired by https://marcellanz.com/post/file-read-challenge/

type Reader

type Reader struct {
	// contains filtered or unexported fields
}

func NewReader

func NewReader(fileName string) *Reader

func (*Reader) Exists

func (r *Reader) Exists(target uint64) (bool, error)

func (*Reader) Initialize

func (r *Reader) Initialize() error

Initialize only loads the database index into memory. This does not load the whole file in RAM.