Skip to content
Snippets Groups Projects
Commit 4a24e1de authored by Marcus Schiesser's avatar Marcus Schiesser
Browse files

fix: lower max tokens (so it works with gpt 3.5)

parent a9930be7
No related branches found
No related tags found
No related merge requests found
...@@ -44,7 +44,7 @@ export async function POST(request: NextRequest) { ...@@ -44,7 +44,7 @@ export async function POST(request: NextRequest) {
const llm = new OpenAI({ const llm = new OpenAI({
model: MODEL, model: MODEL,
maxTokens: 4096, maxTokens: 2048,
}); });
const chatEngine = await createChatEngine(llm); const chatEngine = await createChatEngine(llm);
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment