Metric & Benchmark
LiveBench
Continuously-updated benchmark that swaps tasks monthly to avoid training-data contamination.
Definition
LiveBench rotates its math, coding, reasoning and language tasks every month, making memorisation worthless. It has become a popular contamination-resistant leaderboard alongside Chatbot Arena and SWE-Bench Live.
Common use cases
- Contamination-free eval
- Frontier comparison