less than 1 minute read

Rendering, Composition, and Animation in SuGaR

1. Rendering a Scene

  • view_sugar_results.ipynb notebook๊ณผ metrics.py ์Šคํฌ๋ฆฝํŠธ๋Š” ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ํ‘œํ˜„๊ณผ Gaussian Splatting rasterizer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์žฅ๋ฉด์„ ๋ Œ๋”๋งํ•˜๋Š” ๋ฐฉ๋ฒ•์˜ ์˜ˆ์‹œ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค. ์ž์„ธํ•œ ๋‚ด์šฉ์€ ๊ณง ์ถ”๊ฐ€๋  ์˜ˆ์ •์ž…๋‹ˆ๋‹ค.

2. Composition and Animation Data from Blender

  • Exporting from Blender: blender directory๋Š” Blender์—์„œ ์ˆ˜์ •ํ•˜๊ฑฐ๋‚˜ ์• ๋‹ˆ๋ฉ”์ด์…˜ํ•œ SuGaR meshes์˜ composition ๋ฐ animation ๋ฐ์ดํ„ฐ๋ฅผ ๋‚ด๋ณด๋‚ด๋Š” ์—ฌ๋Ÿฌ Python ์Šคํฌ๋ฆฝํŠธ๊ฐ€ ํฌํ•จ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.
  • sugar_scene/sugar_compositor.py ์Šคํฌ๋ฆฝํŠธ์—๋Š” ์ด๋Ÿฌํ•œ ์• ๋‹ˆ๋ฉ”์ด์…˜ ๋˜๋Š” composition ๋ฐ์ดํ„ฐ๋ฅผ PyTorch๋กœ ๊ฐ€์ ธ์™€ SuGaR ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ํ‘œํ˜„์— ์ ์šฉํ•  ์ˆ˜ ์žˆ๋Š” Python ํด๋ž˜์Šค๊ฐ€ ํฌํ•จ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.

3. High-Quality Rendering with Hybrid Representation

  • Hybrid representation: ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ํ‘œํ˜„์„ ํ†ตํ•ด Gaussian Splatting rasterizer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๊ณ ํ’ˆ์งˆ์˜ ์žฅ๋ฉด ๋ Œ๋”๋ง์ด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค.
  • ์•„๋ž˜ ์˜ˆ์‹œ๋ฅผ ์ฐธ๊ณ ํ•˜์„ธ์š”. image

4. Future Tutorial

  • ์ด๋Ÿฌํ•œ ์Šคํฌ๋ฆฝํŠธ์™€ ํด๋ž˜์Šค๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๋ฐฉ๋ฒ•์ด ์•ฝ๊ฐ„ ๊นŒ๋‹ค๋กœ์šธ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์‚ฌ์šฉ๋ฒ•์— ๋Œ€ํ•œ ์ž์„ธํ•œ ํŠœํ† ๋ฆฌ์–ผ์ด ๊ณง ์ถ”๊ฐ€๋  ์˜ˆ์ •์ž…๋‹ˆ๋‹ค.

Leave a comment