Skip to content

GitLab

Explore

Sign in

Cortex.Tensorrt Llm

Project information

https://github.com/janhq/cortex.tensorrt-llm Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.

nvidia jan tensorrt

+ 2 more

74 Commits
48 Branches
19 Tags

README
Apache License 2.0

Created on

July 18, 2024

Copy SSH clone URLgit@gitlab.wolfspyre.io:mirrored_repos/machinelearning/janhq/cortex.tensorrt-llm.git
Copy HTTPS clone URLhttps://gitlab.wolfspyre.io/mirrored_repos/machinelearning/janhq/cortex.tensorrt-llm.git

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾