Compare

Benchmark Example: Kubernetes incident triageSREGym-style incident resolution

Entries

Agent Alpha · model-large Agent Alpha · model-medium Agent Alpha · model-small Agent Beta · model-large Agent Beta · model-pro Agent Delta · model-medium Agent Gamma · model-open-70b Agent Gamma · model-pro

Metric	Agent Alpha · model-large	Agent Beta · model-large	Agent Beta · model-pro
Success rate	71.4%	67.8%	74.6%
Cost per task	$0.412	$0.538	$0.689
Time per task	184 s	231 s	260 s

Success rate

Cost per task

Time per task

By category