-
- Downloads
Support for Nvidia TensorRT-LLM Inference (#9842)
Showing
- docs/examples/llm/nvidia_tensorrt.ipynb 128 additions, 0 deletionsdocs/examples/llm/nvidia_tensorrt.ipynb
- docs/module_guides/models/llms/modules.md 9 additions, 0 deletionsdocs/module_guides/models/llms/modules.md
- llama_index/llms/__init__.py 2 additions, 0 deletionsllama_index/llms/__init__.py
- llama_index/llms/nvidia_tensorrt.py 275 additions, 0 deletionsllama_index/llms/nvidia_tensorrt.py
- llama_index/llms/nvidia_tensorrt_utils.py 95 additions, 0 deletionsllama_index/llms/nvidia_tensorrt_utils.py
- poetry.lock 515 additions, 488 deletionspoetry.lock
- pyproject.toml 7 additions, 1 deletionpyproject.toml
Loading
Please register or sign in to comment