-
- Downloads
Auto-download MMLU data, add small datasets (#4)
* Remove unnecessary files
* Added lost datasets
* Remove GSM8K
* Automated download script
* Autodownload in eval script
---------
Co-authored-by:
Dmitrii Khizbullin <dmitrii.khizbullin@gmail.com>
Showing
- .gitmodules 0 additions, 3 deletions.gitmodules
- datasets/MMLU/.gitignore 5 additions, 0 deletionsdatasets/MMLU/.gitignore
- datasets/MMLU/download.py 27 additions, 0 deletionsdatasets/MMLU/download.py
- datasets/README.md 11 additions, 0 deletionsdatasets/README.md
- datasets/crosswords/mini0505.json 6398 additions, 0 deletionsdatasets/crosswords/mini0505.json
- datasets/crosswords/mini0505_0_100_5.json 822 additions, 0 deletionsdatasets/crosswords/mini0505_0_100_5.json
- datasets/demos/agi.txt 1 addition, 0 deletionsdatasets/demos/agi.txt
- datasets/demos/js.png 0 additions, 0 deletionsdatasets/demos/js.png
- datasets/demos/ppt.jpeg 0 additions, 0 deletionsdatasets/demos/ppt.jpeg
- datasets/gaia/format.py 14 additions, 0 deletionsdatasets/gaia/format.py
- datasets/gaia/utils/data_split.py 23 additions, 0 deletionsdatasets/gaia/utils/data_split.py
- datasets/gaia/utils/prefix_clean.py 12 additions, 0 deletionsdatasets/gaia/utils/prefix_clean.py
- datasets/humaneval/humaneval-py.jsonl 161 additions, 0 deletionsdatasets/humaneval/humaneval-py.jsonl
- experiments/run_mmlu.py 3 additions, 0 deletionsexperiments/run_mmlu.py
- test/DEVELOPMENT.md 0 additions, 61 deletionstest/DEVELOPMENT.md
- test/LICENSE 0 additions, 21 deletionstest/LICENSE
- test/README.md 0 additions, 139 deletionstest/README.md
- test/experiments/evaluator/test_mmlu_evaluator.py 10 additions, 3 deletionstest/experiments/evaluator/test_mmlu_evaluator.py
- test/pyproject.toml 0 additions, 37 deletionstest/pyproject.toml
- test/pytest.ini 0 additions, 8 deletionstest/pytest.ini
Loading
Please register or sign in to comment