Skip to content
Snippets Groups Projects
Commit 6dc36426 authored by timothycarambat's avatar timothycarambat
Browse files

Patch Groq preview models maxed to 8K tokens due to warning

parent 187f6ed9
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
server/utils/AiProviders/groq/index.js
+ 1
− 1
View file @ 6dc36426
...@@ -49,7 +49,7 @@ class GroqLLM { ...@@ -49,7 +49,7 @@ class GroqLLM {
return 8192; return 8192;
case "llama-3.1-70b-versatile": case "llama-3.1-70b-versatile":
case "llama-3.1-8b-instant": case "llama-3.1-8b-instant":
return 131072; return 8000;
case "mixtral-8x7b-32768": case "mixtral-8x7b-32768":
return 32768; return 32768;
default: default:
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment

:feet::heart: Strive to be the person your dogs believe you are :heart::feet: