AssetOpsBench
🚀
19
Benchmark asset operation performance in the browser
Enterprise Agents and Benchmarks
Enterprise agent ecosystem featuring AssetOpsBench (industrial) and ITBench (SRE, FinOps, CISO), CUGA to accelerate AI Automation
-
-
CUGA Agent
🤖103Configurable Generalist Agent, leader in AppWorld Benchmark
-
ITBench-Lite-Space
🚀7Develop and run interactive code notebooks with JupyterLab
-
VAKRA Leaderboard
🏆18Explore AI agent benchmark and submit results
-
ibm-research/AssetOpsBench
Updated • 1.22k • 29 -
ibm-research/ITBench-Lite
Updated • 988 • 5 -
MCP-Cosmos: World Model-Augmented Agents for Complex Task Execution in MCP Environments
Paper • 2605.09131 • Published • 56 -
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 20 -
ibm-research/ITBench-Trajectories
Updated • 556 • 3 -
From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
Paper • 2603.22386 • Published • 57 -
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Paper • 2502.05352 • Published • 2 -
Survey on Evaluation of LLM-based Agents
Paper • 2503.16416 • Published • 97 -
SPIRAL: Symbolic LLM Planning via Grounded and Reflective Search
Paper • 2512.23167 • Published • 1 -
ibm-research/VAKRA
Viewer • Updated • 1.33k • 2.39k • 44 -
General Agent Evaluation
Paper • 2602.22953 • Published • 12 -
ibm-research/ScarfBench
Updated • 300 • 6 -
ScarfBench
🐠1Java framework migration
-
Results and Retrospective Analysis of the CODS 2025 AssetOpsBench Challenge
Paper • 2605.08518 • Published • 10 -
lyuchao/ITBench-Trajectories
Updated • 369