Arena leaderboards now include Price and Context.
- Price is shown as input / output cost per 1M tokens, and context shows the maximum context window.
00:16
4 Replies
12 Retweets
68 Likes
5,058 Views 
One Sentence Summary
The Arena leaderboards now feature model pricing (per 1M tokens) and maximum context window sizes to help users compare LLMs.
Summary
lmarena.ai (formerly LMSYS) has updated its benchmark leaderboards to include critical economic and technical metrics: input/output costs per million tokens and the maximum context window. This update allows developers and researchers to evaluate models not just on performance scores, but also on cost-efficiency and technical constraints relevant to specific use cases. This is a significant enhancement for the industry's most trusted crowdsourced LLM benchmark.
AI Score
84
Influence Score 14
Published At Yesterday
Language
English
Tags
LLM Benchmarking
LMSYS Arena
Model Pricing
Context Window
AI Infrastructure