-
- Downloads
Integrate mistral.rs LLM (#13105)
* Integrate * Changes based on comments * Run pants tailor * Properly extract and pass logprobs * Add a simple test * Add a usage section * Fix silly mistake * Add mistralrs as a dependancy * Fix extract logprobs and update api * Update for new version * Update version * Prettier * Fix typing * Remove unnecessary in docs BUILD
Showing
- llama-index-integrations/llms/llama-index-llms-mistral-rs/.gitignore 153 additions, 0 deletions...-integrations/llms/llama-index-llms-mistral-rs/.gitignore
- llama-index-integrations/llms/llama-index-llms-mistral-rs/BUILD 3 additions, 0 deletions...index-integrations/llms/llama-index-llms-mistral-rs/BUILD
- llama-index-integrations/llms/llama-index-llms-mistral-rs/Makefile 17 additions, 0 deletions...ex-integrations/llms/llama-index-llms-mistral-rs/Makefile
- llama-index-integrations/llms/llama-index-llms-mistral-rs/README.md 68 additions, 0 deletions...x-integrations/llms/llama-index-llms-mistral-rs/README.md
- llama-index-integrations/llms/llama-index-llms-mistral-rs/examples/plain.ipynb 69 additions, 0 deletions...ons/llms/llama-index-llms-mistral-rs/examples/plain.ipynb
- llama-index-integrations/llms/llama-index-llms-mistral-rs/examples/streaming.ipynb 72 additions, 0 deletions...llms/llama-index-llms-mistral-rs/examples/streaming.ipynb
- llama-index-integrations/llms/llama-index-llms-mistral-rs/examples/xlora_gguf.ipynb 70 additions, 0 deletions...lms/llama-index-llms-mistral-rs/examples/xlora_gguf.ipynb
- llama-index-integrations/llms/llama-index-llms-mistral-rs/llama_index/llms/mistral_rs/BUILD 1 addition, 0 deletions...a-index-llms-mistral-rs/llama_index/llms/mistral_rs/BUILD
- llama-index-integrations/llms/llama-index-llms-mistral-rs/llama_index/llms/mistral_rs/__init__.py 3 additions, 0 deletions...x-llms-mistral-rs/llama_index/llms/mistral_rs/__init__.py
- llama-index-integrations/llms/llama-index-llms-mistral-rs/llama_index/llms/mistral_rs/base.py 342 additions, 0 deletions...index-llms-mistral-rs/llama_index/llms/mistral_rs/base.py
- llama-index-integrations/llms/llama-index-llms-mistral-rs/pyproject.toml 59 additions, 0 deletions...egrations/llms/llama-index-llms-mistral-rs/pyproject.toml
- llama-index-integrations/llms/llama-index-llms-mistral-rs/tests/BUILD 1 addition, 0 deletions...integrations/llms/llama-index-llms-mistral-rs/tests/BUILD
- llama-index-integrations/llms/llama-index-llms-mistral-rs/tests/__init__.py 0 additions, 0 deletions...ations/llms/llama-index-llms-mistral-rs/tests/__init__.py
- llama-index-integrations/llms/llama-index-llms-mistral-rs/tests/test_llms_mistral-rs.py 7 additions, 0 deletions...llama-index-llms-mistral-rs/tests/test_llms_mistral-rs.py
Loading
Please register or sign in to comment
