bloomindex

README

go-bloomindex: bloom-filter based search index

godoc: http://godoc.org/github.com/dgryski/go-bloomindex

Documentation

Overview

Package bloomindex is a bloom-filter based search index

References:

"Reasoning about performance (in the context of search)"
Dan Luu
http://bitfunnel.org/strangeloop/

"Bloofi: Multidimensional Bloom Filters"
Adina Crainiceanu, Daniel Lemire
https://arxiv.org/abs/1501.01941

BitFunnel: Revisiting Signatures for Search
https://danluu.com/bitfunnel-sigir.pdf
https://www.youtube.com/watch?v=1-Xoy5w5ydM

Index

• type DocID
• type Index
  • func NewIndex(blockSize, metaSize int, hashes int) *Index
  • func (idx *Index) AddDocument(terms []uint32) DocID
  • func (idx *Index) Query(terms []uint32) []DocID
• type ShardedIndex
  • func NewShardedIndex(fprate float64, hashes int) *ShardedIndex
  • func (sh *ShardedIndex) AddDocument(terms []uint32) DocID
  • func (sh *ShardedIndex) Query(terms []uint32) []DocID

Types

type DocID

type DocID uint64

type Index

type Index struct {
	// contains filtered or unexported fields
}

func NewIndex

func NewIndex(blockSize, metaSize int, hashes int) *Index

func (*Index) AddDocument

func (idx *Index) AddDocument(terms []uint32) DocID

func (*Index) Query

func (idx *Index) Query(terms []uint32) []DocID

type ShardedIndex

type ShardedIndex struct {
	// contains filtered or unexported fields
}

func NewShardedIndex

func NewShardedIndex(fprate float64, hashes int) *ShardedIndex

func (*ShardedIndex) AddDocument

func (sh *ShardedIndex) AddDocument(terms []uint32) DocID

func (*ShardedIndex) Query

func (sh *ShardedIndex) Query(terms []uint32) []DocID