Dash Infer

Project information

🔧🔗https://github.com/modelscope/dash-infer

DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9.

modelscope cpu llm-inference Large Langua... native-engine

35 Commits
12 Branches
21 Tags

README
Apache License 2.0

Created on

December 09, 2024

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾