RealityBridge Logo

RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos

Zhenhua Wu1,2*   Yun Pang1*   Mingkun Chang1*
Yuwei Ning1   Liangzhi Wang1   Yi Xiao1   Guanbin Li1,3†
1Sun Yat-sen University   2Shanghai Innovation Institute   3Shenzhen Loop Area Institute
*Equal contribution   Corresponding author
wuzhh56@mail2.sysu.edu.cn  |  pangy9@mail2.sysu.edu.cn  |  mingkun502@gmail.com  |  ningyw@mail2.sysu.edu.cn  |  wanglzh26@mail2.sysu.edu.cn  |  xiaoy2622935705@gmail.com  |  liguanbin@mail.sysu.edu.cn

Abstract

Long-tail hazardous scenarios are essential for safety-oriented autonomous driving, yet they are difficult to collect at scale. Editable 3D Gaussian Splatting (3DGS) simulation offers a scalable alternative through real-scene reconstruction and controllable editing. However, edited 3DGS-rendered videos often exhibit a significant Sim-to-Real gap, manifested as rendering artifacts, degraded foreground assets, illumination mismatch, and temporal flickering. Addressing these coupled defects requires jointly restoring local appearance, harmonizing edited content, and maintaining temporal consistency, whereas existing methods typically address only a subset of these requirements. To fill this gap, we propose RealityBridge, a video restoration and harmonization framework that converts edited 3DGS renderings into realistic driving footage while preserving simulator-defined structure, edits, and dynamics. RealityBridge conditions a video foundation model on complementary modality signals, with a lightweight GateNet adaptively controlling their injection across backbone blocks. We further develop a task-oriented curation pipeline to construct training data, and design a four-stage supervised training strategy followed by reward-guided post-training. Extensive experiments demonstrate that RealityBridge outperforms existing methods in restoration and harmonization while preserving strong temporal consistency.


Method

RealityBridge Framework

RealityBridge takes a rendered 3DGS video together with foreground masks, edge maps, and category masks as multimodal controls, and produces a photorealistic video that faithfully preserves structure while eliminating rendering artifacts.


Qualitative Comparison

We compare RealityBridge (Ours) against baselines across two tasks.

Task 1: Restoration

3DGS Input

Fixer

Cosmos

RealityBridge (Ours)

Harmonizer

Wan2.2

3DGS Input

Fixer

Cosmos

RealityBridge (Ours)

Harmonizer

Wan2.2

3DGS Input

Fixer

Cosmos

RealityBridge (Ours)

Harmonizer

Wan2.2


Task 2: Harmonization

Vehicles

3DGS Input

Fixer

Cosmos

RealityBridge (Ours)

Harmonizer

Wan2.2

3DGS Input

Fixer

Cosmos

RealityBridge (Ours)

Harmonizer

Wan2.2

3DGS Input

Fixer

Cosmos

RealityBridge (Ours)

Harmonizer

Wan2.2

3DGS Input

Fixer

Cosmos

RealityBridge (Ours)

Harmonizer

Wan2.2

Cyclists

3DGS Input

Cosmos

Fixer

RealityBridge (Ours)

Harmonizer

Wan2.2

3DGS Input

Cosmos

Fixer

RealityBridge (Ours)

Harmonizer

Wan2.2

3DGS Input

Cosmos

Fixer

RealityBridge (Ours)

Harmonizer

Wan2.2


BibTeX

@article{wu2026realitybridge,
  author    = {Zhenhua Wu and Yun Pang and Mingkun Chang and
               Yuwei Ning and Liangzhi Wang and Yi Xiao and Guanbin Li},
  title     = {RealityBridge: Bridging Editable 3D Gaussian Splatting
               Driving Simulations and Real-World Videos},
  year      = {2026},
}