Project 'mirrored_repos/machinelearning/thukeg/LongBench' was moved to 'mirrored_repos/machinelearning/THUDM/LongBench'. Please update any links and bookmarks that may still have the old path.

splitter.py

Document Processor v2 (#442)

Timothy Carambat authored Dec 14, 2023 and GitHub committed Dec 14, 2023

* wip: init refactor of document processor to JS

* add NodeJs PDF support

* wip: partity with python processor
feat: add pptx support

* fix: forgot files

* Remove python scripts totally

* wip:update docker to boot new collector

* add package.json support

* update dockerfile for new build

* update gitignore and linting

* add more protections on file lookup

* update package.json

* test build

* update docker commands to use cap-add=SYS_ADMIN so web scraper can run
update all scripts to reflect this
remove docker build for branch

719521c3

History

719521c3 Dec 14, 2023

History

Code owners

Assign users and groups as approvers for specific file changes. Learn more.