B

benchmark

mdbench

https://github.com/tigrisdata/mdbench Simple filsystem metadata operations benchmark

Mint

https://github.com/tigrisdata/mint

Collection of tests to detect overall correctness of TigrisOS. Mint is a testing framework for S3 compatible object stores, available as a docker image. It runs correctness, benchmarking and stress tests.

DNSPyre

https://github.com/Tantalor93/dnspyre

CLI tool for a high QPS DNS benchmark

tantalor93.github.io/dnspyre/

go dns cli benchmark concurrency dns-over-https doh dns-over-tls dns-over-tcp dns-over-udp doq

https://github.com/princeton-nlp/SWE-bench [ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues? 🔗 https://www.swebench.com/

Vault Benchmark

https://github.com/hashicorp/vault-benchmark

A tool for benchmarking usage of Vault.

🔧🔗https://github.com/tensorzero/llmgym LLM Gym is a unified environment interface for developing and benchmarking LLM applications that learn from feedback. Think gym for LLM agents.

As the space of benchmar

https://github.com/VictoriaMetrics/prometheus-benchmark Benchmark for Prometheus-compatible systems

🔧🔗https://github.com/cirruslabs/XcodeBenchmark-ForRunners

XcodeBenchmark measures the compilation time of a large codebase on iMac, MacBook, and Mac Pro

🔧🔗https://github.com/vk-en/fioplot-bs

fioplot-bs is a utility that allows you to create graphs and xlsx tables based on the results of the performance testing utility - FIO.

🔧🔗https://github.com/xlucn/fio-cdm

CrystalDiskMark-style disk speed test with fio.

Python version

🔧🔗https://github.com/distributedOne/diskbench

A collection of fio tests for disk performance testing.

https://github.com/princeton-nlp/CharXiv CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

🔧🔗https://github.com/gin-gonic/FrameworkBenchmarks

Source code for the framework benchmarking project

🔧🔗https://github.com/gin-gonic/go-web-framework-benchmark ⚡ Go web framework benchmark

🔧🔗https://github.com/gin-gonic/go-http-routing-benchmark

Go HTTP request router and web framework benchmark

Repository for AI Model Benchmarking

🔧🔗https://github.com/alacritty/vtebench Generate benchmarks for terminal emulators

https://github.com/THUDM/LongBench [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

https://github.com/THUDM/LongCite LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

🔧🔗https://github.com/go101/go-benchmarks

Some benchmarks I wrote in writing the Go 101 book.