Explore projects

cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

🔧🔗https://github.com/HumanSignal/Adala

Adala: Autonomous DAta (Labeling) Agent framework

🔧🔗 meta-llama/llama-recipes Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs.

https://github.com/mistralai/client-python Python client library for Mistral AI platform

This client is inspired from cohere-python

You can use the Mistral Python client to interact with the Mistral AI API.

Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source models

🔧🔗https://github.com/firecracker-microvm/firecracker

Secure and fast microVMs for serverless computing.

https://github.com/cohere-ai/cohere-toolkit Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.

🔧🔗https://github.com/cohere-ai/cohere-python Python Library for Accessing the Cohere API

🔧🔗https://github.com/lmstudio-ai/mlx-engine.git Apple MLX engine for LM Studio

https://github.com/Lightning-AI/lightning-thunder Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

https://github.com/janhq/nitro.git now: https://github.com/janhq/cortex.git Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan

https://github.com/awesome-selfhosted/awesome-selfhosted-data machine-readable data for https://awesome-selfhosted.net

TVM for Tenstorrent ASICs

🔧🔗https://github.com/yohasebe/monadic-chat 🤖 + 🐳 + 🐧 Monadic Chat is a locally hosted web app for creating intelligent chatbots, available for Mac, Windows, and Linux. It offers a Linux environment

🔧🔗https://github.com/lucidrains/transfusion-pytorch

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

https://github.com/run-llama/llama_index LlamaIndex is a data framework for your LLM applications

🔧🔗https://github.com/raspberrypi/rpi-sb-provisioner

A minimal-input automatic secure boot provisioning system for Raspberry Pi devices.

🔧🔗https://github.com/aurelio-labs/semantic-router

Superfast AI decision making and intelligent processing of multi-modal data.