Skip to content
Snippets Groups Projects
Unverified Commit ca71efa9 authored by James Briggs's avatar James Briggs Committed by GitHub
Browse files

Merge pull request #211 from aurelio-labs/fix/local-llama-import

parents 12af7a50 f8caff1b
No related branches found
No related tags found
No related merge requests found
......@@ -41,8 +41,6 @@ class LlamaCppLLM(BaseLLM):
"`pip install 'semantic-router[local]'`"
)
self._llama_cpp = llama_cpp
llm = self._llama_cpp.Llama
grammar = self._llama_cpp.LlamaGrammar
self.llm = llm
self.temperature = temperature
self.max_tokens = max_tokens
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment