-
- Downloads
LLM performance metric tracking (#2825)
* WIP performance metric tracking
* fix: patch UI trying to .toFixed() null metric
Anthropic tracking migraiton
cleanup logs
* Apipie implmentation, not tested
* Cleanup Anthropic notes, Add support for AzureOpenAI tracking
* bedrock token metric tracking
* Cohere support
* feat: improve default stream handler to track for provider who are actually OpenAI compliant in usage reporting
add deepseek support
* feat: Add FireworksAI tracking reporting
fix: improve handler when usage:null is reported (why?)
* Add token reporting for GenericOpenAI
* token reporting for koboldcpp + lmstudio
* lint
* support Groq token tracking
* HF token tracking
* token tracking for togetherai
* LiteLLM token tracking
* linting + Mitral token tracking support
* XAI token metric reporting
* native provider runner
* LocalAI token tracking
* Novita token tracking
* OpenRouter token tracking
* Apipie stream metrics
* textwebgenui token tracking
* perplexity token reporting
* ollama token reporting
* lint
* put back comment
* Rip out LC ollama wrapper and use official library
* patch images with new ollama lib
* improve ollama offline message
* fix image handling in ollama llm provider
* lint
* NVIDIA NIM token tracking
* update openai compatbility responses
* UI/UX show/hide metrics on click for user preference
* update bedrock client
---------
Co-authored-by:
shatfield4 <seanhatfield5@gmail.com>
Showing
- frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/HistoricalMessage/Actions/RenderMetrics/index.jsx 118 additions, 0 deletions...History/HistoricalMessage/Actions/RenderMetrics/index.jsx
- frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/HistoricalMessage/Actions/index.jsx 3 additions, 0 deletions...Container/ChatHistory/HistoricalMessage/Actions/index.jsx
- frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/HistoricalMessage/index.jsx 2 additions, 0 deletions...hat/ChatContainer/ChatHistory/HistoricalMessage/index.jsx
- frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/index.jsx 1 addition, 0 deletions...ponents/WorkspaceChat/ChatContainer/ChatHistory/index.jsx
- frontend/src/components/WorkspaceChat/ChatContainer/ChatTooltips/index.jsx 6 additions, 0 deletions...onents/WorkspaceChat/ChatContainer/ChatTooltips/index.jsx
- frontend/src/components/WorkspaceChat/ChatContainer/index.jsx 11 additions, 8 deletions...tend/src/components/WorkspaceChat/ChatContainer/index.jsx
- frontend/src/utils/chat/index.js 38 additions, 11 deletionsfrontend/src/utils/chat/index.js
- server/.env.example 4 additions, 0 deletionsserver/.env.example
- server/endpoints/api/admin/index.js 20 additions, 28 deletionsserver/endpoints/api/admin/index.js
- server/utils/AiProviders/anthropic/index.js 61 additions, 18 deletionsserver/utils/AiProviders/anthropic/index.js
- server/utils/AiProviders/apipie/index.js 53 additions, 20 deletionsserver/utils/AiProviders/apipie/index.js
- server/utils/AiProviders/azureOpenAi/index.js 50 additions, 12 deletionsserver/utils/AiProviders/azureOpenAi/index.js
- server/utils/AiProviders/bedrock/index.js 57 additions, 18 deletionsserver/utils/AiProviders/bedrock/index.js
- server/utils/AiProviders/cohere/index.js 62 additions, 18 deletionsserver/utils/AiProviders/cohere/index.js
- server/utils/AiProviders/deepseek/index.js 40 additions, 17 deletionsserver/utils/AiProviders/deepseek/index.js
- server/utils/AiProviders/fireworksAi/index.js 35 additions, 13 deletionsserver/utils/AiProviders/fireworksAi/index.js
- server/utils/AiProviders/gemini/index.js 48 additions, 9 deletionsserver/utils/AiProviders/gemini/index.js
- server/utils/AiProviders/genericOpenAi/index.js 44 additions, 20 deletionsserver/utils/AiProviders/genericOpenAi/index.js
- server/utils/AiProviders/groq/index.js 42 additions, 17 deletionsserver/utils/AiProviders/groq/index.js
- server/utils/AiProviders/huggingface/index.js 40 additions, 14 deletionsserver/utils/AiProviders/huggingface/index.js
Loading
Please register or sign in to comment