We provide benchmark results of spatiotemporal prediction learning (STL) methods on famous weather prediction datasets, WeatherBench. More STL methods will be supported in the future. Issues and PRs are welcome! Visualization of GIF is released.
Currently supported spatiotemporal prediction methods
Currently supported MetaFormer models for SimVP
We provide visualization figures of various weather prediction methods on Weather Bench (single variable). You can plot your own visualization with tested results (e.g., work_dirs/exp_name/saved) by vis_video.py. Note that --vis_dirs denotes visualize all experimental folders under the path, and --vis_channel can select the channel for visualization. For example, run plotting with the script:
python tools/visualizations/vis_video.py -d weather_t2m_5_625 -w work_dirs/exp_name --index 0 --save_dirs fig_w_t2m_5_625_vis
We provide temperature prediction benchmark results on the popular WeatherBench dataset (temperature prediction t2m) using $12\rightarrow 12$ frames prediction setting.
Similar to Moving MNIST Benchmarks, we benchmark popular STL methods training 50 epochs with single GPU on t2m (K) in configs/weather/t2m_5_625 for 5.625 settings ($32\times 64$ resolutions).
| SimVP-ConvMixer | SimVP-ConvNeXt |
|---|
| |
| SimVP-HorNet | SimVP-MLPMixer |
|---|
| |
| SimVP-MogaNet | SimVP-Poolformer |
|---|
| |
| SimVP-Swin | SimVP-Uniformer |
|---|
| |
(back to top)
Similar to Moving MNIST Benchmarks, we benchmark STL methods training 50 epochs with single GPU on r (%). We provide config files in configs/weather/r_5_625 for 5.625 settings ($32\times 64$ resolutions).
| SimVP-ConvMixer | SimVP-ConvNeXt |
|---|
| |
| SimVP-HorNet | SimVP-MLPMixer |
|---|
| |
| SimVP-MogaNet | SimVP-Poolformer |
|---|
| |
| SimVP-Swin | SimVP-Uniformer |
|---|
| |
(back to top)
Similar to Moving MNIST Benchmarks, we benchmark popular STL methods training 50 epochs with single GPU on uv10 (ms-1). We provide config files in configs/weather/uv10_5_625 for 5.625 settings ($32\times 64$ resolutions). Notice that the input data of uv10 has two channels.
| ConvLSTM (in flow) | ConvLSTM (out flow) |
|---|
| |
| E3D-LSTM | E3D-LSTM (out flow) |
|---|
| |
| MAU (in flow) | MAU (out flow) |
|---|
| |
| MIM (in flow) | MIM (out flow) |
|---|
| |
| PhyDNet (in flow) | PhyDNet (out flow) |
|---|
| |
| PredRNN (in flow) | PredRNN (out flow) |
|---|
| |
| PredRNN++ (in flow) | PredRNN++ (out flow) |
|---|
| |
| PredRNN-V2 (in flow) | PredRNN-V2 (out flow) |
|---|
| |
| SimVP-V1 (in flow) | SimVP-V1 (out flow) |
|---|
| |
| SimVP-V2 (in flow) | SimVP-V2 (out flow) |
|---|
| |
| TAU (in flow) | TAU (out flow) |
|---|
| |
| SimVP-ConvMixer (in flow) | SimVP-ConvMixer (out flow) |
|---|
| |
| SimVP-ConvNeXt (in flow) | SimVP-ConvNeXt (out flow) |
|---|
| |
| SimVP-HorNet (in flow) | SimVP-HorNet (out flow) |
|---|
| |
| SimVP-MLPMixer (in flow) | SimVP-MLPMixer (out flow) |
|---|
| |
| SimVP-MogaNet (in flow) | SimVP-MogaNet (out flow) |
|---|
| |
| SimVP-Poolformer (in flow) | SimVP-Poolformer (out flow) |
|---|
| |
| SimVP-Uniformer (in flow) | SimVP-Uniformer (out flow) |
|---|
| |
| SimVP-VAN (in flow) | SimVP-VAN (out flow) |
|---|
| |
| SimVP-ViT (in flow) | SimVP-ViT (out flow) |
|---|
| |
(back to top)
Similar to Moving MNIST Benchmarks, we benchmark popular STL methods training 50 epochs with single GPU on tcc (%). We provide config files in configs/weather/tcc_5_625 for 5.625 settings ($32\times 64$ resolutions).
| SimVP-ConvMixer | SimVP-ConvNeXt |
|---|
| |
| SimVP-HorNet | SimVP-MLPMixer |
|---|
| |
| SimVP-MogaNet | SimVP-Poolformer |
|---|
| |
| SimVP-Swin | SimVP-Uniformer |
|---|
| |
(back to top)
