SERO: Semantic Prediction for Single-Step Object Removal

1RPTU Kaiserslautern-Landau, 2German Research Center for Artificial Intelligence (DFKI)
* Equal contribution

Abstract

Object removal and semantic inpainting of missing regions remain inherently ill-posed, as multiple plausible completions may exist for a given scene. Recent diffusion-based methods have demonstrated strong potential for high-quality object removal; however, they still face two key limitations. First, although they can synthesize sharp and high-resolution images, they often struggle to complete removed regions in a semantically consistent and contextually meaningful manner, where the generated content should agree with the surrounding scene layout and object relationships rather than merely appear visually realistic. Second, their iterative denoising process makes them computationally expensive, limiting their practicality for downstream applications. We propose SERO, a semantic prediction framework for single-step object removal. Our model predicts a hidden-region semantic prior in embedding space, which guides a latent bridge-matching generator toward plausible scene completion by providing both where to edit and what structure is likely to exist behind the removed object. This enables visually realistic and contextually coherent completions in one forward pass. Experiments on the RORD and OBER datasets show that SERO achieves competitive or state-of-the-art performance while requiring only a single generation step.

Pipeline

Overview of the proposed pipeline
Overview of the proposed pipeline. (a) Training: the frozen context encoder and predictor produce hidden-region token embeddings from visible background patches, giving us a spatial prior; a trainable decoder adapter maps this to a dense latent prior that is concatenated with the bridge latent and mask before being fed to the Denoising U-Net. (b) Inference: given a text prompt and input image, a segmentation model generates the removal mask, after which the semantic-prior-conditioned SERO model predicts the clean output in a single forward pass.

Results

Results figure 1
Results figure 2

Evaluation

Evaluation

User Study

User Study

Efficiency

Efficiency

BibTeX

@inproceedings{siraj2026sero,
  title = {SERO: Semantic Prediction for Single-Step Object Removal},
  author = {Siraj, Amreen Hasheem and Javanmardi, Alireza and Jaiswal, Pragati and Stricker, Didier and Pagani, Alain},
  booktitle = {The 23rd ACM SIGGRAPH European Conference on Visual Media Production},
  year = {2026}
}