Multi-StyleGS: Stylized Gaussian Splatting with Multiple Styles

December 15, 2024 ยท View on GitHub

Code

  • stylied GS model
  • ckpts
  • style code

Video Results

Note: GitHub has a 10MB limit on uploaded video sizes, so we have speeded up and compressed the video.

We use gaussian splatting viewer to generate video:

methodscene gifscene video
ourhttps://github.com/user-attachments/assets/83551ce8-301b-42cd-9971-f2613d666916

The video showcasing the scenes in the regular paper

Figure 1

image

Truck
methodscene gifscene video
ourhttps://github.com/user-attachments/assets/c6f36540-98d5-4e6f-a955-421d4493ea4b
Horse
methodscene gifscene video
ourhttps://github.com/user-attachments/assets/3701d9c3-db02-4d7c-a93f-6cc60f5e8cb9

Figure 4

image

Flower
methodscene1 videoscene2 video
arfarf_flower_0
snerfsnerf_flower_0
ref-nprrefnpr_flower_0
our
our(free trajectory)our_flower
Tree
methodscene1 videoscene2 video
arf
snerf
ref-npr
our

Figure 6

image

Truck
methodscene1 giffull video
arfhttps://github.com/user-attachments/assets/ac9ecf7c-f86f-4059-9f2b-dcf0ce7b6e0e
snerfhttps://github.com/user-attachments/assets/7da14a63-221c-4652-85b1-02403b65b2d8
ref-nprhttps://github.com/user-attachments/assets/ffdc04f8-3d7b-4c7b-b13a-a1e51949f298
ourhttps://github.com/user-attachments/assets/7917fe9b-1380-4dcc-96e0-d42812520242
Horse
methodscene1 giffull video
arfhttps://github.com/user-attachments/assets/2682a612-3e05-4f48-ae60-f7c8feede859
snerfhttps://github.com/user-attachments/assets/849e13a0-0098-4e9c-a527-e9de1905594b
ref-nprhttps://github.com/user-attachments/assets/0305d9b7-544e-4105-9fc3-24f2fec8a77f
ourhttps://github.com/user-attachments/assets/e329d08e-3da5-4984-abfd-e48595382d69

Figure 7

image

Truck
methodscene1 giffull video
ref-nprhttps://github.com/user-attachments/assets/d1b415eb-5331-4ed7-80e0-62c7774207d7
ourhttps://github.com/user-attachments/assets/a28aa778-1acf-4d3d-9d7f-08d017a90cd4
Horse
methodscene1 giffull video
ref-nprhttps://github.com/user-attachments/assets/76622985-693a-4aa1-b0c8-46e5d985d5c0
ourhttps://github.com/user-attachments/assets/3701d9c3-db02-4d7c-a93f-6cc60f5e8cb9

Figure 8

image

Flower
methodscene1 gif
ref-npr
our

The video showcasing the scenes in the supplyment detail

Figure 1

image

methodscene gifscene video
ourhttps://github.com/user-attachments/assets/429228cb-961e-448d-a418-68777eb20955
our(only vgg)https://github.com/user-attachments/assets/c585548d-8757-4c44-b54d-e65a67a59c8a

Figure 4

image

style name(our method)scene gif(our method)scene video
Style Composition: bipartite matchinghttps://github.com/user-attachments/assets/5f37f510-b389-40a0-ac7b-c32381155506
Style Composition: manual designationhttps://github.com/user-attachments/assets/141132ae-08ec-4ad5-b19f-0f174317ed08
Style Composition: bipartite matchinghttps://github.com/user-attachments/assets/c6f36540-98d5-4e6f-a955-421d4493ea4b
Style Foregroundhttps://github.com/user-attachments/assets/2550d49b-13fe-49ed-9bf2-05cf137ec8a6
Style Backgroundhttps://github.com/user-attachments/assets/f308bc9e-3407-4380-811f-ebabfe5dc1b0

Figure 9

image

methodscene gifscene video
snerfhttps://github.com/user-attachments/assets/6727327d-efd4-4a64-b4e6-fcd016cac155
arfhttps://github.com/user-attachments/assets/c20e5e88-00dc-4dc7-b0f4-d3909def7f15
ref-nprhttps://github.com/user-attachments/assets/c2fdb6cd-4dec-4be1-9f9b-af50fa087d1d
ourhttps://github.com/user-attachments/assets/8d2ffa74-f1d6-4c52-a3e6-495bae5c47b2

Multi-style for family scene:

methodscene gifscene video
ourhttps://github.com/user-attachments/assets/6893dc5c-0435-4572-895f-1f667defb666

Additional Results

style imagesscene gifscene video
foreground: , background: https://github.com/user-attachments/assets/79c0261e-4546-447d-b219-b96d360eb870
foreground: , background: https://github.com/user-attachments/assets/464ba47f-5852-487a-afca-33b19be63979
foreground: , background: https://github.com/user-attachments/assets/c039c144-8a5d-4df9-91e1-139868b5c25a

Van Gogh

Style Image: style_image

methodscene gifscene video
arfhttps://github.com/user-attachments/assets/c46cc04a-4e6c-4860-a90a-f76c113fe831
ourhttps://github.com/user-attachments/assets/363b38cb-4694-4849-af06-1e247bbccbbe

Picasso

Style Image: style_image

I didn't know what Picasso style was, so I searched randomly online for a picture.

methodscene gifscene video
arfhttps://github.com/user-attachments/assets/6540ed13-b2c2-4101-aca2-a981ee288266
ourhttps://github.com/user-attachments/assets/a5ba02a5-117a-40b0-aff7-ef7c61e908bb

Van Gogh and Picasso

methodscene gifscene video
ourhttps://github.com/user-attachments/assets/fde17c04-c78f-4310-b0c5-9a328b60ccc5

Indoor Scene]

We perform experiments on replica datasets. Due to image compression, GIFs may become blurry, please check the video.

style imagesscene gifscene video
https://github.com/user-attachments/assets/a300305f-7b46-4b74-a575-6f829ad9db9f
https://github.com/user-attachments/assets/b4cc4d2b-4c7d-47d2-8f45-27ff6f12817a