연구 - 📷 cam2world는 camera pose를 world space에서 보는 것 🤳

[3D CV 연구] 3DGS COLMAP depth unit

less than 1 minute read

COLMAP의 real-world scales를 알 수는 없습니다.

[3D CV 연구] 3DGS scene.cameras_extent

less than 1 minute read

3dgs scene.cameras_extent

[3D CV 연구] How to scale monodepth to COLMAP coordinate

1 minute read

Monodepth를 COLMAP coordinate로 rescaling하는 법을 알아봅시다.

[3D CV 연구] 3DGS How to get the gaussian points for each pixel

less than 1 minute read

각 pixel에 대한 gaussian points를 얻는 방법

[3D CV 연구] NeRF Spherical Harmonics Coarse-to-Fine training

less than 1 minute read

HDR Plenoxel에서는 coarse-to-fine으로 spherical harmonics를 학습시킵니다.

[3D CV 연구] 3DGS Spherical Harmonics oneupSHdegree

3 minute read

3dgs spherical harmonics

[3D CV 연구] 3DGS self.xyz_gradient_accum

5 minute read

self.xyz_gradient_accum 설명

[3D CV 연구] 3DGS camera_angle_x, fovx, fovy

1 minute read

fovx에 해당하는 camera_angle_x만 있으면 image의 height, width로 fovy도 계산이 가능합니다.

[3D CV 연구] 3DGS self.optimizer.param_groups로 파라미터별로 다른 lr 설정

8 minute read

optimizer.param_groups로 파라미터별로 다른 lr 설정이 가능합니다.

[3D CV 연구] 3DGS 3D gaussians initialization

3 minute read

3D Gaussian들의 properties를 initilize하는 법을 정리합니다.

[3D CV 연구] 3DGS build_covariance_from_scaling_rotation

2 minute read

3DGS SH2RGB

[3D CV 연구] 3DGS SuGaR sugar_model.py _covert_vertex_colors_to_texture

less than 1 minute read

3DGS SuGaR sugar_model.py _covert_vertex_colors_to_texture

[3D CV 연구] 3DGS SuGaR surface_mesh_to_bind = o3d_mesh

15 minute read

surface_mesh_to_bind = o3d_mesh & n_points = len(triangles * n_gaussians_per_triangle

[3D CV 연구] 3DGS SH2RGB

12 minute read

3DGS SH2RGB

[3D CV 연구] 3DGS affine approximation of the projective transformation

less than 1 minute read

3DGG affine apprximiation of the projective transformation

[3D CV 연구] 3DGS alpha blending & inaccurate surface edge & Modeling sharp surface edges

1 minute read

3DGS alpha blending & inaccurate surface edge & Modeling sharp surface edges

[3D CV 연구] 3DGS SuGaR sugar_model.py extract_texture_image_and_uv_from_gaussians

19 minute read

3DGS SuGaR sugar_model.py extract_texture_image_and_uv_from_gaussians

[3D CV 연구] 3DGS Gaussian Surfels Poisson Reconstrucion

1 minute read

3DGS Gaussian Surfels Poisson Reconstruction

[3D CV 연구] 3DGS SuGaR Troublshooting Mesh Issues

less than 1 minute read

3DGS SuGaR Troublshooting Mesh Issues & Poisson Surface Reconstruction

[3D CV 연구] 3DGS SuGaR Adapt the scale and the bounding box of the scene

less than 1 minute read

3DGS SuGaR Adapt the scale and the bounding box of the scene

[3D CV 연구] 3DGS Tips for using SuGaR regularization sdf or density

less than 1 minute read

3DGS Tips for using SuGaR regularization sdf or density

[3D CV 연구] 3DGS Tips for using SuGaR your custom data and obtain better reconstructions

2 minute read

3DGS Tips for using SuGaR your custom data and obtain better reconstructions

[3D CV 연구] 3DGS SuGaR benchmark dataset 360_v2 experiments

2 minute read

3DGS SuGaR benchmark dataset 360_v2 experiments

[3D CV 연구] 3DGS SuGaR Rendering, composition and animation

less than 1 minute read

3DGS SuGaR Rendering, composition and animation

[3D CV 연구] 3DGS Tips for using COLMAP

1 minute read

3DGS Tips for using COLMAP

[3D CV 연구] 3DGS SuGaR video capture & custom dataset

less than 1 minute read

3DGS SuGaR video capture & custom dataset

[3D CV 연구] 3DGS SuGaR synthetic datasets

1 minute read

3DGS SuGaR synthetic datasets

[3D CV 연구] 3DGS SuGaR sdf estimation

less than 1 minute read

3DGS SuGaR sdf estimation

[3D CV 연구] 3DGS SuGaR implementations missing point cloud

less than 1 minute read

3DGS SuGaR position_lr_init & spatial_lr_scale

[3D CV 연구] 3DGS SuGaR position_lr_init & spatial_lr_scale

1 minute read

3DGS SuGaR position_lr_init & spatial_lr_scale

[3D CV 연구] 3DGS SuGaR how to improve rendering result of simple object in monochrome background

1 minute read

3DGS SuGaR how to improve rendering result of simple object in monochrome background

[3D CV 연구] 3DGS SuGaR implementation details of coarse mesh extraction and joint refinement

less than 1 minute read

3DGS SuGaR implementation details of coarse mesh extraction and joint refinement

[3D CV 연구] 3DGS SuGaR joint refinement of mesh and gaussians

2 minute read

3DGS SuGaR joint refinement of mesh and gaussians

[3D CV 연구] 3DGS SuGaR nearsest gaussians implementation details

less than 1 minute read

3DGS SuGaR equations

[3D CV 연구] 3DGS SuGaR equations

2 minute read

3DGS SuGaR equations

[3D CV 연구] 3DGS SuGaR entropy loss

1 minute read

3DGS SuGaR entropy loss

[3D CV 연구] 3DGS scene size & scene complexity and spatial learning rate

1 minute read

3DGS scene size & scene complexity and spatial learning rate

[3D CV 연구] 3DGS Loss not going down and renders look bad, scene에 따른 learning rate 조절

less than 1 minute read

3DGS Loss not going down and renders look bad, scene에 따른 learning rate 조절

[3D CV 연구] 3DGS human rendering ideas

less than 1 minute read

3DGS human rendering ideas

[3D CV 연구] 3DGS input & output .ply vertex properties & Meshlab Vert & Spherical Harmonics (SH) & Mesh

4 minute read

3DGS input & output .ply properties & Meshlab Vert & Spherical Harmonics (SH) & Mesh

[3D CV 연구] 3DGS Sorting gaussians with tile ID and depth keys

less than 1 minute read

3DGS tile ID와 depth keys 기반 sorting을 .cu 파일에서 합니다.

[3D CV 연구] 3DGS submodules installation

less than 1 minute read

3DGS submodules 설치방법

[3D CV 연구] 3DGS spatial_lr_scale, scaling_lr, position_lr

1 minute read

3DGS spatial_lr_scale

[3D CV 연구] 3DGS rasterization cuda

less than 1 minute read

3DGS rasterization은 cuda를 사용합니다.

[3D CV 연구] 3DGS random shuffle significantly impact the performance

less than 1 minute read

3DGS random shuffling으로 input images들을 shuffle하지 않으면 performance가 하락합니다.

[3D CV 연구] 3DGS positional gradient in NDC/view space not in world space

less than 1 minute read

3DGS positional gradient는 NDC/view space에서 계산됩니다.

[3D CV 연구] 3DGS How can I get the points’ indices which contribute to the pixels?

less than 1 minute read

3DGS How can I get the points’ indices which contribute to the pixels?

[3D CV 연구] 3DGS의 output .ply

less than 1 minute read

3DGS output .ply파일은 spherical harmonics를 추가 속성으로 포함합니다.

[3D CV 연구] 3DGS gaussian opacity activation is sigmoid

less than 1 minute read

3DGS opacity activation은 sigmoid를 사용합니다.

[3D CV 연구] 3DGS The number of points is decreasing when training large-scale scenes

less than 1 minute read

3DGS The number of points is decreasing when training large-scale scenes

[3D CV 연구] 3DGS jacobian w2c matrix

less than 1 minute read

3DGS jacobian w2c matrix

[3D CV 연구] 3DGS float32

less than 1 minute read

3DGS는 float32를 사용하는데, float16로 바꿔서 실험해봐도 됩니다.

[3D CV 연구] 3DGS densification and pruning

less than 1 minute read

3DGS densify_until_iter

[3D CV 연구] 3DGS coordinate systems

less than 1 minute read

3DGS point cloud coordinate systems

[3D CV 연구] 3DGS batch rendering using gaussian rasterizer

less than 1 minute read

3DGS batch rendering using gaussian rasterizer

[3D CV 연구] 3DGS add_densification_stats accumulates the gradient to every Gaussian in the visible frustum

less than 1 minute read

3DGS add_densification_stats accumulates the gradient to every Gaussian in the visible frustum

[3D CV 연구] 3DGS SIBR viewer rendering video

less than 1 minute read

3DGS 결과 비디오 만드는 방법

[3D CV 연구] 3DGS big gaussians culling in view-space code bug

less than 1 minute read

3DGS original code has a bug for big gaussians culling

[3D CV 연구] 3DGS zfar is ignored, scene extent, lr

less than 1 minute read

3DGS far plane, gaussian pruning, scene extent & learning rate

[3D CV 연구] 3DGS background color masking with RGBA images

2 minute read

3DGS background color removal & RGBA

[CV 연구] Transformer Attention Visually Explained

6 minute read

Transformer의 Attention을 시각적으로 이해해봅시다.

[생성모델 연구] GAN 발전동향

3 minute read

GAN 발전동향 정리

[3D CV 연구] PSNR, SSIM, LPIPS, MSE metrics.py

2 minute read

PSNR, SSIM, LPIPS, MSE metrics.py

[3D CV 연구] Camera Calibration

less than 1 minute read

camera calibration