less than 1 minute read

Reference

SuperPoint: Self-Supervised Interest Point Detection and Description

Deep Homography Estimation์— ๊ด€ํ•œ ๋ชจ๋“  ๊ฒƒ

Deep Image Homography Estimation

[OpenCV][C++] Homography ํ˜ธ๋ชจ๊ทธ๋ž˜ํ”ผ findHomography getPerspectiveTransform Projective Perspective ์ฐจ์ด warp

Homography $\mathcal{H}$ ๋ž€?

ํ˜ธ๋ชจ๊ทธ๋ž˜ํ”ผ (homography)๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ์นด๋ฉ”๋ผ ๋ทฐ์˜ ์˜์ƒ์— ์žˆ๋Š” ๋‘ ํ‰๋ฉด ์‚ฌ์ด์˜ ๋ณ€ํ™˜ ๋˜๋Š” 3์ฐจ์› ๊ณต๊ฐ„์˜ ํ‰๋ฉด๊ณผ ์˜์ƒ์— ํˆฌ์˜๋œ ํ‰๋ฉด ์‚ฌ์ด์˜ ๋ณ€ํ™˜ํ–‰๋ ฌ์ž…๋‹ˆ๋‹ค.

Homography๋Š” ๋‹ค์‹œ ๋งํ•˜๋ฉด ๋‘ ๊ฐœ์˜ 2D ํ‰๋ฉด ์‚ฌ์ด์˜ ๊ด€๊ณ„๋ฅผ ๋‚˜ํƒ€๋‚ด๋Š” ํ–‰๋ ฌ์ž…๋‹ˆ๋‹ค.

Homographic Adaptation ์ด๋ž€?

Homography Estimation๊ณผ Homographic Adaptation์€ ๊ด€๋ จ์€ ์žˆ์ง€๋งŒ ๋‹ค๋ฅธ ๊ฐœ๋…์ž…๋‹ˆ๋‹ค:

Homography Estimation:

  • ๋‘ ์ด๋ฏธ์ง€ ๊ฐ„์˜ ํ‰๋ฉด ๋ณ€ํ™˜ ๊ด€๊ณ„๋ฅผ ๋‚˜ํƒ€๋‚ด๋Š” ํ–‰๋ ฌ(homography matrix)์„ ์ฐพ๋Š” ๊ณผ์ •์ž…๋‹ˆ๋‹ค.
  • ๋™์ผํ•œ ํ‰๋ฉด์ƒ์˜ ์žฅ๋ฉด์„ ๋‹ค๋ฅธ ์‹œ์ ์—์„œ ์ดฌ์˜ํ•œ ๋‘ ์ด๋ฏธ์ง€ ๊ฐ„์˜ ๋งคํ•‘ ํ•จ์ˆ˜๋ฅผ ๊ตฌํ•ฉ๋‹ˆ๋‹ค.
  • ์ฃผ๋กœ ์ด๋ฏธ์ง€ ์ •ํ•ฉ, ํŒŒ๋…ธ๋ผ๋งˆ ์ƒ์„ฑ, ์นด๋ฉ”๋ผ ๋ณด์ • ๋“ฑ์— ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค.

Homographic Adaptation:

  • SuperPoint์—์„œ ์ œ์•ˆ๋œ ๊ธฐ๋ฒ•์œผ๋กœ, ๊ด€์‹ฌ์  ๊ฒ€์ถœ์˜ ๋ฐ˜๋ณต์„ฑ์„ ํ–ฅ์ƒ์‹œํ‚ค๋Š” ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค.
  • ์ž…๋ ฅ ์ด๋ฏธ์ง€์— ์—ฌ๋Ÿฌ ๋ฌด์ž‘์œ„ ํ˜ธ๋ชจ๊ทธ๋ž˜ํ”ผ๋ฅผ ์ ์šฉํ•˜์—ฌ ๋‹ค์–‘ํ•œ ์‹œ์ ๊ณผ ์Šค์ผ€์ผ์—์„œ ๊ด€์‹ฌ์ ์„ ๊ฒ€์ถœํ•ฉ๋‹ˆ๋‹ค.
  • ๊ฒ€์ถœ๋œ ๊ด€์‹ฌ์ ๋“ค์„ ์›๋ณธ ์ด๋ฏธ์ง€๋กœ ์—ญ๋ณ€ํ™˜ํ•˜์—ฌ pseudo ground truth๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.
  • ์ด๋ฅผ ํ†ตํ•ด ๋ชจ๋ธ์˜ ๋„๋ฉ”์ธ ์ ์‘๋ ฅ์„ ๋†’์ด๊ณ , ์‹ค์ œ ํ™˜๊ฒฝ์—์„œ์˜ ์„ฑ๋Šฅ์„ ๊ฐœ์„ ํ•ฉ๋‹ˆ๋‹ค.

Homographic Adaptation์€ Homography Estimation์˜ ๊ฐœ๋…์„ ํ™œ์šฉํ•˜์ง€๋งŒ, ์ฃผ๋กœ ๊ด€์‹ฌ์  ๊ฒ€์ถœ๊ธฐ์˜ ์„ฑ๋Šฅ ํ–ฅ์ƒ๊ณผ ์ž๊ธฐ ์ง€๋„ ํ•™์Šต์— ์ดˆ์ ์„ ๋งž์ถฅ๋‹ˆ๋‹ค.

Leave a comment