B

benchmark

🔧🔗https://github.com/tensorzero/llmgym LLM Gym is a unified environment interface for developing and benchmarking LLM applications that learn from feedback. Think gym for LLM agents.

As the space of benchmar

https://github.com/princeton-nlp/SWE-bench [ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues? 🔗 https://www.swebench.com/

https://github.com/VictoriaMetrics/prometheus-benchmark Benchmark for Prometheus-compatible systems

🔧🔗https://github.com/cirruslabs/XcodeBenchmark-ForRunners

XcodeBenchmark measures the compilation time of a large codebase on iMac, MacBook, and Mac Pro

🔧🔗https://github.com/vk-en/fioplot-bs

fioplot-bs is a utility that allows you to create graphs and xlsx tables based on the results of the performance testing utility - FIO.

🔧🔗https://github.com/xlucn/fio-cdm

CrystalDiskMark-style disk speed test with fio.

Python version

🔧🔗https://github.com/distributedOne/diskbench

A collection of fio tests for disk performance testing.

https://github.com/princeton-nlp/CharXiv CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

🔧🔗https://github.com/gin-gonic/FrameworkBenchmarks

Source code for the framework benchmarking project

🔧🔗https://github.com/gin-gonic/go-web-framework-benchmark ⚡ Go web framework benchmark

🔧🔗https://github.com/gin-gonic/go-http-routing-benchmark

Go HTTP request router and web framework benchmark

Repository for AI Model Benchmarking

🔧🔗https://github.com/alacritty/vtebench Generate benchmarks for terminal emulators

https://github.com/THUDM/LongBench [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

https://github.com/THUDM/LongCite LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

🔧🔗https://github.com/go101/go-benchmarks

Some benchmarks I wrote in writing the Go 101 book.

https://github.com/VictoriaMetrics/billy Billy benchmarks for VictoriaMetrics