GroundAnything: Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed
Abstract
GroundAnything is a 4B-parameter visual grounding model that uses bidirectional diffusion and blockwise denoising to enable fast parallel decoding with precise localization, outperforming autoregressive counterparts across 30 benchmarks.
Autoregressive (AR) grounding models serialize spatial predictions, introducing sequential latency and imposing a causal order on output tokens. We view grounding as visual evidence extraction: objects, locations, and spatial relations are jointly constrained by the image and query, yet their dependencies do not imply an intrinsic left-to-right generation order. This distinction makes bidirectional diffusion a natural fit, allowing spatial hypotheses to emerge in parallel and be jointly refined through iterative denoising. We introduce GroundAnything, a 4B-parameter grounding foundation model that reconciles fast parallel decoding with precise localization through blockwise denoising. Training combines grounding pretraining from public datasets and dedicated data engines, direct AR-to-diffusion conversion with joint AR and diffusion objectives, supervised fine-tuning, and GRPO-based reinforcement post-training. Across 30 grounding benchmarks, our autoregressive variant, GroundAnything-VLM, establishes a new overall state of the art among similarly sized models at 72.42%, remaining competitive with GPT-6 Astra (71.35%). With entropy-guided decoding, GroundAnything also surpasses the prior state of the art at this scale, averaging 61.75% versus 53.32% for the fast MTP-based LocateAnything model. We further explore decoding strategies, showing that an optional self-speculative mode achieves a 4.51times speedup over the AR counterpart with a 0.74 percentage-point drop in COCO F1mIoU. Infrastructure experiments show that progressive inference optimizations translate parallel decoding into practical speedups. These support efficient visual grounding in latency-sensitive real-world systems.
Community
β‘ Why locate objects one token at a time? SOTA grounding with a 4Γ speedup is here!
Meet GroundAnything: an open-source 4B diffusion model that generates grounding predictions in parallel, delivering a 4Γ speedup over the autoregressive baseline running on vLLM. We rethink visual grounding as visual evidence extraction!
More accurate π― and faster β‘ than pioneering models like Grounding DINO, Rex-Omni, and LocateAnything, with near-real-time inference!
π¦ Code & weights are open source
π Project page
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives (2026)
- Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Grounding (2026)
- Jag: Direct Box Prediction for Efficient Visual Grounding (2026)
- Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding (2026)
- TempoGround: State-Aware Streaming Visual Grounding with Vision-Language Models (2026)
- CoEvolve: Construct-to-Edit Visual Grounding with Bidirectional State Refinement (2026)
- Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modeling (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.39600 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 2
GroundingPI/GroundAnything-VLM
Datasets citing this paper 0
No dataset linking this paper