Papers and notes that use sparse tensors or sparse convolution as a specific computational tool within larger 3D learning systems.
Explore the broader 3D perception systems thread
Volt argues that a vanilla transformer, with the right recipe and enough data, no longer needs a convolution-specialized backbone for 3D scene understanding. We took that seriou...
3dtransformerconvolution
Imagine asking a robot: “bring me the Snoopy plush from the corner of the room.” For this to work, the robot needs to find the Snoopy in 3D space — a category it has likely neve...
3dsegmentationopen-vocabulary
Authors Junha Lee1,2,*, Chunghyun Park1,2,*, Jaesung Choe1, Yu-Chiang Frank Wang1, Jan Kautz1, Minsu Cho2, Chris Choy1 1NVIDIA, 2POSTECH * indicates equal contribution Abstr...
3d-segmentationfoundation-modelsopen-vocabulary
Sparse voxel convolutions are permutation invariant because convolution depends on coordinates and random access, not contiguous storage.
neural-networkssparse-convolution
Many problems in science and engineering can be formulated in terms of geometric patterns in high-dimensional spaces. We present high-dimensional convolutional networks (ConvNet...
geometric-pattern-recognitionhigh-dimensional-convolutional-networkssparse-convolution
We present Deep Global Registration, a differentiable framework for pairwise registration of real-world 3D scans. Deep global registration is based on three modules: a 6-dimens...
3d-reconstructionglobal-registration3d-features
Abstract The automation of mechanical tasks brought the modern world unprecedented prosperity and comfort. However, the majority of automated tasks have been simple mechanical ...
3d-perceptionneural-networkscomputer-vision
Authors Christopher Choy, Jaesik Park, Vladlen Koltun International Conference on Computer Vision (ICCV), 2019 Speed vs. accuracy Pareto frontier of prior methods and FCGF....
representation-learning3d-featurescomputer-vision
In many robotics and VR/AR applications, 3D-videos are readily-available sources of input (a continuous sequence of depth images, or LIDAR scans). However, those 3D-videos are p...
spatio-temporal-perception4d-convolutional-neural-networksparse-convolution