Deep learning on 3D data is still challenging — partly due to the computational complexity of training on 3D grids. Thus, alternative data structures become more and more interesting. PointNets, for example, operate directly on unordered set of points, i.e. point clouds. Similarly, Point Set Generation Networks are able to directly predict point clouds from images. In this article, I briefly summarize both ideas.