RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing
Abstract
RubricRM introduces a generative pairwise reward framework that creates input-specific rubrics to evaluate visual outputs, improving alignment for text-to-image generation and image editing.
Reward models play an essential role in aligning visual generative models, yet most existing visual reward models use a single scalar score or rely on fixed criteria that cannot adapt to different instructions. This limits both interpretability and task sensitivity, especially for text-to-image generation and instruction-based image editing, where different inputs require different evaluation dimensions. We propose RubricRM, a pairwise generative reward modeling framework that first produces an input-specific rubric with evaluation dimensions, weights, and scoring criteria, and then applies the rubric to score candidate images. We train dedicated RubricRM models for text-to-image generation and image editing using a two-stage training pipeline: supervised fine-tuning teaches the model the rubric-based scoring paradigm, while GRPO further improves scoring through fine-grained dimension-level rewards. Experiments on multiple generation and editing benchmarks show that RubricRM outperforms existing specialized reward models and remains competitive with strong proprietary MLLM judges despite using smaller backbones. Our models, data, and code are available at https://github.com/zijiankan/RubricRM.
Get this paper in your agent:
hf papers read 2608.26956 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 4
skylenage-ai/SkyJM-Gen-4B
Datasets citing this paper 1
skylenage-ai/RubricRM-Data
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper