Skip to content
Snippets Groups Projects
Unverified Commit cf4892ff authored by Joel Gotsch's avatar Joel Gotsch Committed by GitHub
Browse files

Fix Token Counting of Completions for async calls (#12421)

parent c9eda14e
Branches
Tags
No related merge requests found
...@@ -260,7 +260,7 @@ def llm_completion_callback() -> Callable: ...@@ -260,7 +260,7 @@ def llm_completion_callback() -> Callable:
CBEventType.LLM, CBEventType.LLM,
payload={ payload={
EventPayload.PROMPT: args[0], EventPayload.PROMPT: args[0],
EventPayload.RESPONSE: f_return_val, EventPayload.COMPLETION: f_return_val,
}, },
event_id=event_id, event_id=event_id,
) )
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment