AutomationBench-AA: Agentic SaaS Workflow Benchmark
As of 29 Oct 2026 · 236 ranked rows · Original source ↗
Cost per Intelligence Index task uses Artificial Analysis profile values captured 29 Oct 2026, weighted across the Index evaluations. Workbook cost values mentioned in the source notes below are evaluation-specific.
AA Cost Chart Label is the displayed source value; Cost per Task (USD) is numeric. A bound such as <0.1¢ remains in the label while its numeric cell is blank; if both cells are blank, AA showed no plotted cost point for this model. GPT-6.1 Sol effort-variant rows use scores from Artificial Analysis model profiles captured 2026-09-30; insertion ranks are documented in docs/GPT-6.1-SOL-RANK-IMPACT.md. Values refreshed from the Artificial Analysis evaluation page captured 2026-10-29.
236 results
| 1 | Gemini 4 Carbon (High) | 0.778166 | Oct 2026 | $7.76 | |
| 2 | Gemini 4 Argon (High) | 0.775135 | Sep 2026 | $7.68 | |
| 3 | Kimi | Kimi K3.1 Pro | 0.732977 | Oct 2026 | $3.68 |
| 4 | MiniMax | MiniMax-M3.1-Flash | 0.725218 | Oct 2026 | $0.49 |
| 5 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) | 0.717688 | Sep 2026 | $10.02 |
| 6 | Meta | Muse Wonder Full (Max) | 0.713307 | Oct 2026 | — |
| 7 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) | 0.695387 | Sep 2026 | $10.04 |
| 8 | DeepSeek | DeepSeek V4.1 Flash (Max) | 0.68891 | Sep 2026 | — |
| 9 | OpenAI | GPT-6 Astra (Max) | 0.684917 | Sep 2026 | $6.24 |
| 10 | Meta | Muse Wonder (Max) | 0.680946 | Oct 2026 | $6.95 |
| 11 | InclusionAI | Ling 3.1 Flash 1019 | 0.675466 | Oct 2026 | $3.19 |
| 12 | OpenAI | GPT-6 Astra (Xhigh) | 0.671778 | Sep 2026 | $3.66 |
| 13 | SpaceXAI | Grok 4.6 (Xhigh) | 0.669974 | Aug 2026 | — |
| 14 | SpaceXAI | Grok 4.6 (High) | 0.666785 | Aug 2026 | — |
| 15 | DeepSeek | DeepSeek V4.1 Flash 1017 (Max) | 0.66641 | Oct 2026 | $0.60 |
| 16 | OpenAI | GPT-6 Astra (High) | 0.666122 | Sep 2026 | $3.24 |
| 17 | OpenAI | GPT-6.1 Sol (Xhigh) | 0.665737 | Sep 2026 | $0.76 |
| 18 | SpaceXAI | Grok 4.7 (Xhigh) | 0.655584 | Sep 2026 | $7.51 |
| 19 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback) | 0.655203 | Sep 2026 | $4.09 |
| 20 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback) | 0.649528 | Sep 2026 | $6.05 |
| 21 | OpenAI | GPT-6.1 Sol (Max) | 0.648684 | Sep 2026 | $1.27 |
| 22 | OpenAI | GPT-6 Astra (Medium) | 0.64595 | Sep 2026 | $2.73 |
| 23 | OpenAI | GPT-6.1 Sol (High) | 0.644952 | Sep 2026 | $0.59 |
| 24 | Xiaomi | MiMo-V2.6-Flash | 0.640517 | Sep 2026 | $0.13 |
| 25 | SpaceXAI | Grok 4.7 (High) | 0.635194 | Sep 2026 | $6.18 |
| 26 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, High Effort, Default Fallback) | 0.632068 | Sep 2026 | $3.46 |
| 27 | SpaceXAI | Grok 4.6 (Medium) | 0.631513 | Aug 2026 | — |
| 28 | OpenAI | GPT-6.1 Sol (Medium) | 0.625735 | Sep 2026 | $0.36 |
| 29 | Z AI | GLM-5.3 (Max) | 0.622029 | Aug 2026 | $5.01 |
| 30 | Gemini 3.7 Flash (High) | 0.620275 | Aug 2026 | — | |
| 31 | InclusionAI | Ling 3.1 Flash | 0.617437 | Oct 2026 | — |
| 32 | OpenAI | GPT-6 Sol (Xhigh) | 0.616942 | Sep 2026 | — |
| 33 | OpenAI | GPT-6 Sol (Max) | 0.616337 | Sep 2026 | — |
| 34 | Anthropic | Claude Opus 5.5 (Adaptive Reasoning, Medium Effort, Default Fallback) | 0.612174 | Sep 2026 | $2.45 |
| 35 | Gemini 3.8 Flash (Medium) | 0.6089 | Sep 2026 | $6.26 | |
| 36 | Z AI | GLM-5.3-Flash | 0.603686 | Aug 2026 | — |
| 37 | OpenAI | GPT-6.1 Terra (Max) | 0.601676 | Oct 2026 | $0.96 |
| 38 | OpenAI | GPT-6 Sol (High) | 0.601258 | Sep 2026 | — |
| 39 | OpenAI | GPT-5.6 Sol (Max) | 0.600811 | Jul 2026 | — |
| 40 | Gemini 3.8 Flash (High) | 0.599301 | Sep 2026 | $7.77 | |
| 41 | OpenAI | GPT-6.1 Terra (Xhigh) | 0.599286 | Oct 2026 | $0.40 |
| 42 | Mistral | Mistral Large 4 Preview | 0.599014 | Oct 2026 | $5.54 |
| 43 | OpenAI | GPT-5.6 Terra (Max) | 0.5965 | Jul 2026 | — |
| 44 | Anthropic | Claude Sonnet 5.5 (Adaptive Reasoning, High Effort, Default Fallback) | 0.594292 | Sep 2026 | $1.64 |
| 45 | Anthropic | Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback) | 0.593759 | Sep 2026 | $13.04 |
| 46 | OpenAI | GPT-6 Astra (Low) | 0.590967 | Sep 2026 | $1.42 |
| 47 | Xiaomi | MiMo-V2.6-Pro | 0.586234 | Sep 2026 | $0.26 |
| 48 | OpenAI | GPT-6.1 Terra (High) | 0.584606 | Oct 2026 | $0.26 |
| 49 | Kimi | Kimi K3 (Max) | 0.58273 | Jul 2026 | — |
| 50 | OpenAI | GPT-6 Sol (Medium) | 0.579722 | Sep 2026 | — |