benchmark

https://github.com/princeton-nlp/SWE-bench [ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues? 🔗 https://www.swebench.com/

Repository for AI Model Benchmarking

https://github.com/princeton-nlp/CharXiv CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

https://github.com/THUDM/LongCite LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

https://github.com/THUDM/LongBench [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

https://github.com/VictoriaMetrics/prometheus-benchmark Benchmark for Prometheus-compatible systems

https://github.com/VictoriaMetrics/billy Billy benchmarks for VictoriaMetrics