pytorch

🔧🔗https://github.com/sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

🔧🔗https://github.com/speechbrain/speechbrain A PyTorch-based Speech Toolkit

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

🔧🔗https://github.com/vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

🔧🔗github hf diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

🕸️🔗huggingface.co/docs/diffusers

🔧🔗https://github.com/lucidrains/vector-quantize-pytorch Vector (and Scalar) Quantization, in Pytorch

🔧🔗https://github.com/pytorch/torchtune PyTorch native post-training library

🕸️🔗pytorch.org/torchtune/main/

🔧🔗https://github.com/flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

🕸️🔗flashinfer.ai

🔧🔗https://github.com/yandexdataschool/deep_vision_and_graphics

Course about deep learning for computer vision and graphics co-developed by YSDA and Skoltech.

https://github.com/Lightning-AI/torchmetrics Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications. 🔗 https://lightning.ai/docs/torchmetrics/

LLMs from scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step 🔧🔗https://github.com/rasbt/LLMs-from-scratch

ESPNet

🔧🔗https://github.com/espnet/espnet End-to-End Speech Processing Toolkit

Jarvis Tools

https://github.com/usnistgov/jarvis an open-source software package for data-driven atomistic materials design.

🔧🔗https://github.com/IAHispano/Applio

A simple, high-quality voice conversion tool focused on ease of use and performance

🔧🔗https://github.com/modelscope/data-juicer Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

🔧🔗https://github.com/NVIDIA/apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

https://github.com/Lightning-AI/pytorch-lightning 🔗 lightning.ai Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

https://github.com/roboflow/supervision We write your reusable computer vision tools. 💜

pyannote audio

🔧🔗https://github.com/pyannote/pyannote-audio Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker em

🔧🔗https://github.com/lucidrains/transfusion-pytorch

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI