M
model-serving
Projects with this topic
-
https://github.com/lm-sys/FastChat An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Resources
Updated -
https://github.com/Lightning-AI/LitServe Lightning-fast serving engine for AI models. Flexible. Easy. Enterprise-scale.
🔗 https://lightning.ai/docs/litserveUpdated