– tags: Graph Signal Processing
MoNets:
– Base of research such as Spline CNNs, Geodesic, Anisotropic CNNs etc. – Contributions: – A generalization of various Graph Learning approaches, unifying spatial and spectral approaches – A new approach using parametric kernels, pseudo-coordinates, integrated with existing models (Anistropic CNN, Geodesic CNN,) – A series of experiments performed on different benchmark manifolds, graphs, and networks – MoNet’s generalization first considers variable x as a point in the manifold or node in a graph depending on the application, task, and input. Variables y is considered the neighboring nodes or points, which is associated with a vector of pseudo-coordinates in d-dimensional space, such that u(x, y) are the pseudo-coordinates of which there is a unique set for each neighbor of x. – Each pseudo-coordinate is put through a weighting function, which replicates the effect of a traditional image convolution kernel whereby each value of the kernel is multiplied by the value that is currently in consideration. In the case of MoNet, the weighting function is a kernel with learnable parameters that operates on the pseudo-coordinates:
– we will have covariance matrix of order ’d’ by ’d’ and mean vector of order 1 by ’d’ for the kernel. – patch operator weighting functions (fancy way of saying kernel) used in different convolutional operations on the manifold. ( the heatmap figure of 3d models) – This kernel is learned only in MoNet, versus hard-coded in GCNNs and ACNNs. The first thing one might notice is how much “smoother” the weights (red curves) are in MoNet, versus the more distinct (GCNN) and more integrated (ACNN) weights of the other approaches. – This flexibility is part of the reason why both allow for the sharing of parameters cross-dataset. This opens up the capacity for ideas like Transfer Learning to be applied to the geometric domain.
– Spectral convolutions are mathematically as well as theoretically similar to their vanilla convolution counterparts whereas spatial convolutions are conceptually as well as markedly similar to vanilla convolutions.