Volt argues that a vanilla transformer, with the right recipe and enough data, no longer needs a convolution-specialized backbone for 3D scene understanding. We took that seriou...
3dtransformerconvolution
Imagine asking a robot: “bring me the Snoopy plush from the corner of the room.” For this to work, the robot needs to find the Snoopy in 3D space — a category it has likely neve...
3dsegmentationopen-vocabulary
Predicting 3D rotations from neural networks sounds straightforward—output a rotation matrix and move on. But rotations live on $\mathrm{SO}(3)$, a curved 3-dimensional manifold...
rotation3ddeep-learning
Authors Junha Lee1,2,*, Chunghyun Park1,2,*, Jaesung Choe1, Yu-Chiang Frank Wang1, Jan Kautz1, Minsu Cho2, Chris Choy1 1NVIDIA, 2POSTECH * indicates equal contribution Abstr...
3d-segmentationfoundation-modelsopen-vocabulary
Authors Wei Dong, Christopher Choy, Charles Loop, Or Litany, Yuke Zhu, Anima Anandkumar IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023 Abstract Indo...
monocular-reconstructionsdfsparse-voxel-grid
Authors Yoonwoo Jeong, Seungjoo Shin, Junha Lee, Christopher Choy, Anima Anandkumar, Minsu Cho, Jaesik Park NeurIPS, 2022 Abstract The recent progress in implicit 3D represe...
neural-radiance-fieldsperceptionnerf
Authors Yufei Wang, Zhou Xian, Feng Chen, Tsun-Hsuan Wang, Yian Wang, Katerina Fragkiadaki, Christopher Choy, Zackory Erickson, David Held RSS, 2022 Model overview from the...
roboticsmanipulationdeformable-objects
Authors Shiyi Lan, Zhiding Yu, Christopher Choy, Subhashree Radhakrishnan, Guilin Liu, Yuke Zhu, Larry S. Davis, Anima Anandkumar IEEE International Conference on Computer Vis...
weakly-supervisedinstance-segmentationsemantic-correspondence
Authors Yoonwoo Jeong, Seokjun Ahn, Christopher Choy, Animashree Anandkumar, Minsu Cho, Jaesik Park ICCV, 2021 Abstract In this work, we propose a camera self-calibration al...
neural-radiance-fieldscamera-calibration3d-reconstruction
The Neural Radiance Fields (NeRF) proposed an interesting way to represent a 3D scene using an implicit network for high fidelity volumetric rendering. Compared with traditional...
neural-networksrendering3d
Authors Christopher Choy, Jaesik Park, Vladlen Koltun International Conference on Computer Vision (ICCV), 2019 Speed vs. accuracy Pareto frontier of prior methods and FCGF....
representation-learning3d-featurescomputer-vision
Abstract We present a method for generating colored 3D shapes from natural language. To this end, we first learn joint embeddings of freeform text descriptions and colored 3D s...
3d-reconstructiongenerative-adversarial-networknatural-language-processing
Abstract 3D semantic scene labeling is fundamental to agents operating in the real world. In particular, labeling raw 3D point sets from sensors provides fine-grained semantics...
3d-vision3d-semantic-segmentationneural-networks