local-rag

README

Local RAG

Run Example

• Ollama
• Docker Desktop

Start Ollama Server

$ ollama start

Download Mistral Model

$ ollama pull mistral
$ ollama pull nomic-embed-text

Start Example Application

docker compose up

Upload Documents

Category	Document Types
Text	.txt, .eml, .msg, .html, .md, .rst, .rtf
Images	.jpeg, .png
Documents	.doc, .docx, .ppt, .pptx, .pdf, .odt, .epub, .csv, .tsv, .xlsx

curl http://localhost:8080/v1/index/docs/unstructured \
  --header 'Content-Disposition: attachment; filename="presentation.pdf"' \
  --data-binary "@presentation.pdf"

go run . -url http://localhost:8080 -index docs -path $HOME/Documents

Open Web UI

$ open http://localhost:8501