* implement custom PDFLoader to remove LC dep

* remove unneeded comment

* remove pdfjs as dep and fix page splitting using pdf-parse

* linting + export rename for desktop compat

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

hide TTS and more actions on chat reset message

fix styles of limit messages per day

* fix assistant bg color data prop

* publish modified embed changes

* implement new settings sidebar v2

* store state of settings menu in localstorage to improve ux

* add tailwind color

* add missed admin translation

* fix admin pages showing on single user

* perms fix for manager role

* refactor permissions for options on sidebar

* minor refactor of menuoption

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

* implement new chat tools ui + bump phosphor icons package for new icons

* move TTS button below user image/fix styling

* Show tools on hover
update package deps

* patch styles for desktop

* fix more actions tooltip and disable hide/show on hover for mobile

* z-index on mobile patch

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

* implement delete message feature

* add new delete chat endpoint that just hides messages from ui and fix perms

* refactor: add delete-event hooks for delete so we dont need to pass so much
refactor: implmentation of delete endpoint PUT

* update animation
linting
remove element on animiation to prevent popin

* linting and cleanup imports

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

* enable support for generic openAI as Agent provider

* implement thread forking feature

* rename thread based on forked message

* refactor bulk message create for thread fork + bump prisma version

* revert prisma version bump

* add todo to bulkCreate function in workspace chats

* cast user input to expected type to prevent prisma injection

* refactor: update order of ops for thread fork

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

* WIP replace langchain pdfloader with pdfjs and add more context to each page

* remove extras from pdfjs and just replace langchain library

* remove unneeded dep

* fix console log in docs

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

implement custom confluence loader to extract code blocks properly from documents

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>

patch website depth data connector to work for other links that are not root url

Max. number of context snippets increased from 12 to 200. 
TODO: May remove restraint entirely

* Patch Embed styles with prefixing

* forgot files

Add type defs to helpers

fix query mode always responding with refusal message on develop api openai compatible endpoints

resolves #1777

WIP on migration to @lancedb/lancedb NodeJS SDK

patch parseChunkHeader bug

remove all references to users_can_delete_workspaces option

* add ollama automatic url detection in llm and embedder prefrences

* implement auto detection for lmstudio llm and embedder/improve performance of checking common urls

* fix modal not clearing

* fix lmstudio url check

* improve ux for ollama llm provider option

* improve ux for lm studio llm provider option

* improve ux for ollama embedder option

* improve ux for lmstudio embedder option

* ux improvement lmstudio embedder options

* refactor implementation to hook and use native timeout
Swap to promise.any for resolving of available endpoints

* implement useProviderEndpointAutoDiscovery hook for lmstudio and ollama provider options

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>

* fix: sanitize filename before writing

Fixes: https://github.com/Mintplex-Labs/anything-llm/issues/1737

* fixup

* fixup

remove azure url validation