https://github.com/mlc-ai/mlc-llm Universal LLM Deployment Engine with ML Compilation
https://github.com/mlc-ai/web-llm High-performance In-browser LLM Inference Engine