llama

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/InternLM/lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs. 🔗 lmdeploy.readthedocs.io/en/latest/

🔧🔗https://github.com/meta-llama/llama-stack

Composable building blocks to build Llama Apps

https://github.com/homebrewltd/llama3-s Llama3.1 learns to Listen

https://github.com/Mozilla-Ocho/llamafile Distribute and run LLMs with a single file. llamafile.ai

A multi-user ChatGPT for any LLMs and vector database. Unlimited documents, messages, and storage in one privacy-focused app. Now available as a desktop application with a built-in LLM!

🔧🔗https://github.com/meta-llama/llama-models

Utilities intended for use with Llama models.

🔧🔗https://github.com/meta-llama/llama-stack-client-kotlin

Kotlin SDK for Llama Stack

🔧🔗https://github.com/meta-llama/llama-stack-apps

Agentic components of the Llama Stack APIs

🔧🔗https://github.com/meta-llama/llama-stack-client-python

Python SDK for Llama Stack

🔧🔗https://github.com/meta-llama/PurpleLlama

Set of tools to assess and improve LLM security.

https://github.com/arcee-ai/mergekit Tools for merging pretrained large language models.

https://github.com/janhq/cortex Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/fishaudio/fish-speech Brand new TTS solution

🔧🔗https://github.com/meta-llama/llama-stack-client-node

NodeJS library for Llama Stack

🔧🔗https://github.com/meta-llama/llama-stack-client-swift

llama-stack-client-swift brings the inference and agents APIs of Llama Stack to iOS.

🔧🔗https://github.com/meta-llama/codellama

Inference code for CodeLlama models

🔧🔗https://github.com/meta-llama/llama3

The official Meta Llama 3 GitHub site

https://github.com/mlc-ai/web-llm-chat Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

🔧🔗https://github.com/FoundationVision/LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation 🔗arxiv.org/abs/2406.06525