Point Cloud Scene Reconstruction with Depth Estimation

Point cloud scene reconstruction with the aid of depth estimation

The so-called weapon,Xheart starts.

当你手上有 GPU 服务器的时候,Always want to use it to get something.

The thing this time is an attempt to generate point clouds with the help of a depth estimation network.

---

• Point cloud scene reconstruction with the aid of depth estimation

  • 2D photos and 3D worlds
  • 深度估计网络
  • 点云应用

2D photos and 3D worlds

对于一个场景来说,We can always take a picture of it.

But filming the act itself,Often makes it missing some information,This information is the depth of the scene.

深度估计网络

本文使用了预训练的 transformers^[1] 网络.

Untitled

点云应用

after getting the depth,Just follow the depth direction,It is enough to restore the color information in the 2D image to the 3D scene,The process is very simple.

代码可见我的 GITHUB^[2]

Example-1

Example-1

Example-2

Example-2

Snipaste_2022-07-30_19-43-49.png

Snipaste_2022-07-30_19-40-05.png

Snipaste_2022-07-30_19-11-11.png

Snipaste_2022-07-30_19-09-31.png

Snipaste_2022-07-30_19-15-50.png

参考资料

[1]

transformers: https://github.com/huggingface/transformers

[2]

GITHUB: https://github.com/listenzcc/2DPic-to-3DScene