Scale AI

company

Verified

https://scale.com/

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

drewrein updated a dataset about 21 hours ago

ScaleAI/DistressBench

rodney-scale published a dataset 2 days ago

ScaleAI/MA-Bench

rodney-scale updated a dataset 2 days ago

ScaleAI/MA-Bench

View all activity

Papers

Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures

View all Papers

ScaleAI 's papers 13

Submitted by

Utkarsh Tyagi

Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

ScaleAI

Submitted by

Harsh Raj

Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures

ScaleAI

Submitted by

Utkarsh Tyagi

SteerDuplex: Steerable Duplex Speech Dialogue Models

ScaleAI

Submitted by

varun-scale

Studying Without a Syllabus: Task-Agnostic Environment Preprocessing

ScaleAI

Submitted by

taesiri

HarnessOpt-Bench: Evaluating LLMs at Harness Optimization

ScaleAI

Submitted by

Harsh Raj

Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures

ScaleAI

Submitted by

Anisha Gunjal

SWE-INTERACT: Reimagining SWE Benchmarks as User-Driven Long-Horizon Coding Sessions

ScaleAI

Submitted by

Utkarsh Tyagi

Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVR

ScaleAI

2

Submitted by

Tu Trinh

HiL-Bench (Human-in-Loop Benchmark): Do Agents Know When to Ask for Help?

ScaleAI

Submitted by

taesiri

SciPredict: Can LLMs Predict the Outcomes of Scientific Experiments in Natural Sciences?

ScaleAI

Submitted by

taesiri

Agentic Rubrics as Contextual Verifiers for SWE Agents

ScaleAI

Submitted by

taesiri

ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents

ScaleAI