Abstract: We introduce Geometric Shallow Learning (GSL) as an alternative to Geometric Deep Learning (GDL) by demonstrating how Hypersphere Neural Networks (HNNs) leverage geometric inductive biases ...