--- license: apache-2.0 ---

🌦️ WeatherEdit: Controllable Weather Editing with 4D Gaussian Field

Chenghao Qian1,*, Wenjing Li1,†, Yuhu Guo2, Gustav Markkula1

image

arXiv Project

A Controllable, Scalable and Efficient Framework for Realistic Weather Editing.

--- - 🎨 Flexible control over **weather types** (snow, fog, rain) - 🌑️ Precise **weather severity** adjustment (light, moderate, heavy) - πŸ–ΌοΈ **Global consistency** for multi-view driving scenes (temporal, spatial) --- ## πŸ’‘ The Quickiest Start You can use our provided pretrained model for the easiest start. If you would like to try the whole pipeline, please go to the subfolder for training instructions ### A. General Weather (`General Scene/`) Please first configure the environment with conda: ```bash git clone https://github.com/Jumponthemoon/WeatherEdit.git cd General_Scene conda env create --file environment.yml conda activate gaussian_splatting ``` We provide a complete pipeline to train and render Gaussian scenes with integrated weather effects. #### 1. Train Your Scene Download the Dataset Pt.1 from [Mip-NeRF 360](https://jonbarron.info/mipnerf360/) and put the `garden` under `data` folder, then run: ```bash python train.py -s path/to/data/ ``` After training, the model will be saved under `output` folder #### 2. Render with Weather Effects ```bash python render.py -m path/to/model --weather snow --fps 10 ``` πŸ”₯ **Plug into your GS-based code?** πŸ‘‰ Check it out [here](https://github.com/Jumponthemoon/WeatherEdit/tree/main/General_Scene) --- ### B. Driving Scene Editing (`Driving_Scene/`) Please first clone the repo and configure the environment with conda: ```bash git clone https://github.com/Jumponthemoon/WeatherEdit.git cd Driving_Scene conda create -n weatheredit python=3.9 -y conda activate weatheredit pip install -r requirements.txt pip install git+https://github.com/nerfstudio-project/gsplat.git@v1.3.0 pip install git+https://github.com/facebookresearch/pytorch3d.git pip install git+https://github.com/NVlabs/nvdiffrast cd third_party/smplx/ pip install -e . cd ../.. ``` * Note: if you encounter error `ImportError: cannot import name 'cached_download' from 'huggingface_hub'`, please follow [this](https://github.com/easydiffusion/easydiffusion/issues/1851#issuecomment-2425265522) instruction. #### 1. Download sample dataset & pretrained model ```bash cd particle_construction ``` Download [sample dataset](https://drive.google.com/file/d/18qwNg_VVcwiyliLW1eDq488lRe8mdnuX/view?usp=sharing) and [pretrained model](https://drive.google.com/file/d/1vXz_-tPkwEU61jFrke9Io044An1j4Bv4/view?usp=sharing), then place them in the `data` and the `output` directory separately. #### 2. Render with Weather Effects Run the script to generate rainy weather in pandaset: ```bash export PYTHONPATH=$(pwd) python tools/gen_particle.py --resume_from ./output/pandaset/44/checkpoint_final.pth --weather rainy ``` The rendered video will be saved under `./output/pandaset/44/video_eval` folder > ⭐ **If you like our work or find it useful, please give us a star or cite below. Thanks!** --- ## πŸ“Œ Citation ```bibtex @article{qian2025wedit, title={WeatherEdit: Controllable Weather Editing with 4D Gaussian Field}, author={Chenghao Qian and Wenjing Li and Yuhu Guo and Gustav Markkula}, year={2025}, eprint={2505.20471}, archivePrefix={arXiv}, primaryClass={cs.CV}, url={https://arxiv.org/abs/2505.20471},} ``` --- ## πŸ“¬ Contact For questions, suggestions, or collaborations: - πŸ“§ tscq@leeds.ac.uk --- Thanks for your interest in WeatherEdit! We hope it helps bring new life to your 3D scenes 🌧️🌨️🌫️