Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

Llama Index
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

44848c37

Unverified Commit 44848c37 authored 1 year ago by Jeremy Dyer Committed by GitHub 1 year ago

Downloads
- Patches
- Plain Diff

Support for Nvidia Triton LLM (#9488)

parent 760bde46

No related branches found

No related tags found

No related merge requests found

Changes 7

Hide whitespace changes

Inline Side-by-side

Showing

.gitignore 3 additions, 0 deletions

.gitignore
docs/examples/llm/nvidia_triton.ipynb 136 additions, 0 deletions

docs/examples/llm/nvidia_triton.ipynb
docs/module_guides/models/llms/modules.md 9 additions, 0 deletions

docs/module_guides/models/llms/modules.md
llama_index/llms/__init__.py 2 additions, 0 deletions

llama_index/llms/__init__.py
llama_index/llms/nvidia_triton.py 242 additions, 0 deletions

llama_index/llms/nvidia_triton.py
llama_index/llms/nvidia_triton_utils.py 343 additions, 0 deletions

llama_index/llms/nvidia_triton_utils.py
poetry.lock 15 additions, 15 deletions

poetry.lock

with 750 additions and 15 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are