Skip to content
Snippets Groups Projects
Unverified Commit ca71efa9 authored by James Briggs's avatar James Briggs Committed by GitHub
Browse files

Merge pull request #211 from aurelio-labs/fix/local-llama-import

parents 12af7a50 f8caff1b
Branches
Tags
No related merge requests found
...@@ -41,8 +41,6 @@ class LlamaCppLLM(BaseLLM): ...@@ -41,8 +41,6 @@ class LlamaCppLLM(BaseLLM):
"`pip install 'semantic-router[local]'`" "`pip install 'semantic-router[local]'`"
) )
self._llama_cpp = llama_cpp self._llama_cpp = llama_cpp
llm = self._llama_cpp.Llama
grammar = self._llama_cpp.LlamaGrammar
self.llm = llm self.llm = llm
self.temperature = temperature self.temperature = temperature
self.max_tokens = max_tokens self.max_tokens = max_tokens
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment