Loading leaderboard data…
AutomationBench-AA: Agentic SaaS Workflow Benchmark
As of 29 Oct 2026 · 236 ranked rows · Original source ↗
Cost per Intelligence Index task uses Artificial Analysis profile values captured 29 Oct 2026, weighted across the Index evaluations. Workbook cost values mentioned in the source notes below are evaluation-specific.
AA Cost Chart Label is the displayed source value; Cost per Task (USD) is numeric. A bound such as <0.1¢ remains in the label while its numeric cell is blank; if both cells are blank, AA showed no plotted cost point for this model. GPT-6.1 Sol effort-variant rows use scores from Artificial Analysis model profiles captured 2026-09-30; insertion ranks are documented in docs/GPT-6.1-SOL-RANK-IMPACT.md. Values refreshed from the Artificial Analysis evaluation page captured 2026-10-29.
20 results
| 5 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) | 0.717688 | Sep 2026 | $10.02 |
| 7 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) | 0.695387 | Sep 2026 | $10.04 |
| 19 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback) | 0.655203 | Sep 2026 | $4.09 |
| 20 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback) | 0.649528 | Sep 2026 | $6.05 |
| 26 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, High Effort, Default Fallback) | 0.632068 | Sep 2026 | $3.46 |
| 34 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, Medium Effort, Default Fallback) | 0.612174 | Sep 2026 | $2.45 |
| 44 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, High Effort, Default Fallback) | 0.594292 | Sep 2026 | $1.64 |
| 45 | Anthropic | Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback) | 0.593759 | Sep 2026 | $13.04 |
| 54 | Anthropic | Claude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback) | 0.577724 | Sep 2026 | $10.89 |
| 64 | Anthropic | Claude Fable 5.1 (Adaptive Reasoning, High Effort, Default Fallback) | 0.553231 | Sep 2026 | $7.56 |
| 67 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, Medium Effort, Default Fallback) | 0.549096 | Sep 2026 | $0.78 |
| 68 | Anthropic | Claude Fable 5.1 (Adaptive Reasoning, Medium Effort, Default Fallback) | 0.54661 | Sep 2026 | $5.58 |
| 78 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, Low Effort, Default Fallback) | 0.529254 | Sep 2026 | $0.98 |
| 80 | Anthropic | Claude Fable 5.1 (Adaptive Reasoning, Low Effort, Default Fallback) | 0.522404 | Sep 2026 | $4.49 |
| 88 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, Low Effort, Default Fallback) | 0.494209 | Sep 2026 | $0.51 |
| 115 | Anthropic | Claude Haiku 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback) | 0.359539 | Oct 2026 | $0.25 |
| 118 | Anthropic | Claude Haiku 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) | 0.35411 | Oct 2026 | $0.41 |
| 122 | Anthropic | Claude Haiku 5.5 (Adaptive Reasoning, High Effort, Default Fallback) | 0.337269 | Oct 2026 | $0.16 |
| 127 | Anthropic | Claude Haiku 5.5 (Adaptive Reasoning, Medium Effort, Default Fallback) | 0.285896 | Oct 2026 | $0.09 |
| 140 | Anthropic | Claude Haiku 5.5 (Adaptive Reasoning, Low Effort, Default Fallback) | 0.229108 | Oct 2026 | $0.04 |