jivesearch

module

v0.0.0-...-73de0e8 Latest Latest Go to latest Published: Feb 2, 2018 License: Apache-2.0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/clanstyles/jivesearch

Links

Open Source Insights

README ¶

Jive Search is a completely open source search engine that respects your privacy.

Documentation

go get -u github.com/jivesearch/jivesearch

Crawler

cd $GOPATH/src/github.com/jivesearch/jivesearch/search/crawler && go run ./cmd/crawler.go --workers=75 --time=5m --debug=true

Frontend

cd $GOPATH/src/github.com/jivesearch/jivesearch/frontend && go run ./cmd/frontend.go --debug=true

Wikipedia Dump File

cd $GOPATH/src/github.com/jivesearch/jivesearch/wikipedia/cmd/dumper && go run dumper.go --workers=3 --dir=/path/to/wiki/files --text=true --data=true --truncate=400

Directories ¶

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL

Path	Synopsis
bangs Package bangs detects when queries should be redirected to 3rd party sites	Package bangs detects when queries should be redirected to 3rd party sites
cmd Sample bangs demonstrates how to run a simple !bangs server	Sample bangs demonstrates how to run a simple !bangs server
config Package config handles configuration settings	Package config handles configuration settings
frontend Package frontend provides the routing and middleware for the web app	Package frontend provides the routing and middleware for the web app
cmd Command frontend demonstrates how to run the web app	Command frontend demonstrates how to run the web app
instant Package instant provides instant answers	Package instant provides instant answers
cmd Sample instant demonstrates how to run a simple instant answers server.	Sample instant demonstrates how to run a simple instant answers server.
contributors Package contributors contains the contributors of the instant answers	Package contributors contains the contributors of the instant answers
log Package log handles logging for the crawler and frontend	Package log handles logging for the crawler and frontend
search Package search provides the core search results.	Package search provides the core search results.
crawler Package crawler is a distributed web crawler.	Package crawler is a distributed web crawler.
crawler/cmd Command crawler demonstrates how to run the crawler	Command crawler demonstrates how to run the crawler
crawler/queue Package queue manages the queue for a distributed crawler	Package queue manages the queue for a distributed crawler
crawler/robots Package robots handles caching robots.txt files	Package robots handles caching robots.txt files
document Package document parses URLs and the HTML of a webpage	Package document parses URLs and the HTML of a webpage
vote Package vote handles storing and retrieving user votes on urls	Package vote handles storing and retrieving user votes on urls
suggest Package suggest handles AutoComplete and Phrase Suggester (Did you mean?) queries	Package suggest handles AutoComplete and Phrase Suggester (Did you mean?) queries
wikipedia Package wikipedia fetches Wikipedia articles	Package wikipedia fetches Wikipedia articles
cmd/dumper Dumper downloads and dumps wikipedia/wikidata/wikiquotes data to a postgresql database.	Dumper downloads and dumps wikipedia/wikidata/wikiquotes data to a postgresql database.
cmd/wikipedia