From 92df33f0f0842af1453398fd0e761819b8b9fb6c Mon Sep 17 00:00:00 2001 From: Laurie Voss <github@seldo.com> Date: Wed, 20 Dec 2023 16:15:59 -0800 Subject: [PATCH] Basic README --- README.md | 26 ++++++++++++++++++++++++++ 1 file changed, 26 insertions(+) create mode 100644 README.md diff --git a/README.md b/README.md new file mode 100644 index 0000000..814f36d --- /dev/null +++ b/README.md @@ -0,0 +1,26 @@ +# Mixtral 8x7b and LlamaIndex + +This is a quick demo of how to get a fully local model up and running with Mixtral 8x7b and LlamaIndex; check out the accompanying [blog post](https://TKTKTK) for more details. + +## Install dependencies + +``` +poetry shell +poetry install +``` + +## 1_smoketest.py + +After you've downloaded [Ollama](https://ollama.ai/) and run `ollama run mixtral` run this to make sure everything is connected. + +## 2_index_data.py + +This will index the data in the `data` folder. You can run this as many times as you want, and it will only index new data. + +## 3_verify_index.py + +This demonstrates the working index without re-loading the documents. + +## app.py + +A very simple Flask app that demonstrates how to use the index in a web app. Note that `flask run` will not work; you must run `python app.py`. -- GitLab