llama

https://github.com/InternLM/lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs. 🔗 lmdeploy.readthedocs.io/en/latest/

A multi-user ChatGPT for any LLMs and vector database. Unlimited documents, messages, and storage in one privacy-focused app. Now available as a desktop application with a built-in LLM!

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/janhq/cortex Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/homebrewltd/llama3-s Llama3.1 learns to Listen

https://github.com/mlc-ai/web-llm-chat Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

https://github.com/Mozilla-Ocho/llamafile Distribute and run LLMs with a single file. llamafile.ai

https://github.com/arcee-ai/mergekit Tools for merging pretrained large language models.

https://github.com/distantmagic/structured Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

The first RAG retriever tuned particularly for code and code Llama