feat: implements vectorised sparse BM25 encoder
fix: catch RuntimeError for missing torch import chore: update pyproject chore: fix numerical inconsistencies test: add tests for tokenizers chore: fit sparse encoders after route modifications in HybridRouter fix: remove decorator around the HybridRouter.__init__ fix: give the functional BM25 a distinct filename fix: fix route fitting for add/strategy fix: _async_encode should take a sparse encoding function fix: empty sparse embeddings fix: _encode / _async_encode match superclass signature
Showing
- coverage.xml 3730 additions, 1999 deletionscoverage.xml
- pyproject.toml 0 additions, 2 deletionspyproject.toml
- semantic_router/encoders/aurelio.py 28 additions, 11 deletionssemantic_router/encoders/aurelio.py
- semantic_router/encoders/base.py 26 additions, 11 deletionssemantic_router/encoders/base.py
- semantic_router/encoders/bm25.py 247 additions, 47 deletionssemantic_router/encoders/bm25.py
- semantic_router/encoders/huggingface.py 5 additions, 5 deletionssemantic_router/encoders/huggingface.py
- semantic_router/encoders/tfidf.py 18 additions, 1 deletionsemantic_router/encoders/tfidf.py
- semantic_router/routers/hybrid.py 45 additions, 30 deletionssemantic_router/routers/hybrid.py
- semantic_router/schema.py 1 addition, 1 deletionsemantic_router/schema.py
- semantic_router/tokenizers.py 169 additions, 0 deletionssemantic_router/tokenizers.py
- tests/functional/encoders/test_bm25_functional.py 55 additions, 0 deletionstests/functional/encoders/test_bm25_functional.py
- tests/unit/encoders/test_bm25.py 45 additions, 8 deletionstests/unit/encoders/test_bm25.py
- tests/unit/encoders/test_huggingface.py 3 additions, 1 deletiontests/unit/encoders/test_huggingface.py
- tests/unit/test_router.py 1 addition, 3 deletionstests/unit/test_router.py
- tests/unit/test_sync.py 1 addition, 3 deletionstests/unit/test_sync.py
- tests/unit/test_tokenizers.py 98 additions, 0 deletionstests/unit/test_tokenizers.py
- uv.lock 19 additions, 39 deletionsuv.lock
Loading
Please register or sign in to comment