-
- Downloads
Merge pull request #96 from aurelio-labs/bogdan/local-llm
feat: Adds LlamaCpp LLM
Showing
- docs/05-local-execution.ipynb 699 additions, 0 deletionsdocs/05-local-execution.ipynb
- poetry.lock 73 additions, 41 deletionspoetry.lock
- pyproject.toml 2 additions, 1 deletionpyproject.toml
- semantic_router/llms/__init__.py 2 additions, 1 deletionsemantic_router/llms/__init__.py
- semantic_router/llms/base.py 73 additions, 1 deletionsemantic_router/llms/base.py
- semantic_router/llms/grammars/json.gbnf 25 additions, 0 deletionssemantic_router/llms/grammars/json.gbnf
- semantic_router/llms/llamacpp.py 76 additions, 0 deletionssemantic_router/llms/llamacpp.py
- semantic_router/route.py 2 additions, 2 deletionssemantic_router/route.py
- semantic_router/schema.py 3 additions, 0 deletionssemantic_router/schema.py
- semantic_router/utils/function_call.py 0 additions, 71 deletionssemantic_router/utils/function_call.py
- tests/unit/llms/test_llm_base.py 55 additions, 0 deletionstests/unit/llms/test_llm_base.py
- tests/unit/llms/test_llm_llamacpp.py 73 additions, 0 deletionstests/unit/llms/test_llm_llamacpp.py
Loading
Please register or sign in to comment