llm
Projects with this topic
-
https://github.com/run-llama/LlamaIndexTS LlamaIndex is a data framework for your LLM applications
Updated -
https://github.com/run-llama/llama_index LlamaIndex is a data framework for your LLM applications
Updated -
https://github.com/Lightning-AI/litgpt 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
🔗 https://lightning.ai/Updated -
https://github.com/janhq/cortex Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers
👋 JanUpdated -
https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers
👋 JanUpdated -
https://github.com/joaomdmoura/crewAI Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
crewai.com
Updated -
https://github.com/lm-sys/FastChat An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Resources
Updated -
https://github.com/ComposioHQ/composio Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling
Updated -
https://github.com/distantmagic/resonance PHP Framework designed to build IO-intensive web applications.
🔗 http://resonance.distantmagic.com/Updated -
https://github.com/distantmagic/paddler Stateful load balancer custom-tailored for llama.cpp
Updated -
-
A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API. https://github.com/Portkey-AI/gateway
Updated -
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure. burr.dagworks.io
Updated -
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Updated -
-
https://github.com/mistralai/mistral-inference Official inference library for Mistral models
mistral.ai/
Updated -
-
https://github.com/InternLM/lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
🔗 lmdeploy.readthedocs.io/en/latest/Updated -
https://github.com/arcee-ai/mergekit Tools for merging pretrained large language models.
Updated -