Geometric Algebra, Quaternions, Matrices, Riemannian Spaces: A Debate Across Two Centuries
This post is a roundtable-style analysis of four mathematical "languages" for describing space and transformation. Its central claim: they are not competitors but different blades forged from the same iron, each optimal in its own domain.
Key points
- Family tree: Riemannian manifolds are the most general stage (arbitrary curvature); Euclidean space is the flat special case. On flat space, GA is the algebraic language (geometric product unifies inner and outer products), matrices are the coordinate representation, and quaternions are the 3D rotation special case. Specifically: quaternions ≅ Cl(3,0)⁺; by Artin–Wedderburn, Clifford algebras are isomorphic to matrix algebras; the metric tensor g_ij is a "pointwise-varying matrix field"; Clifford bundles combine GA with Riemannian manifolds.
- History: Hamilton's quaternions (1843), Grassmann's exterior algebra (1844), Clifford's geometric product (1878), Riemann's manifolds (1854). In the 1880s Gibbs/Heaviside carved vector analysis out of quaternions, and GA was forgotten for ~70 years until Hestenes' *Space-Time Algebra* (1966). Lesson: the most usable, not the most elegant, wins.
- 3D rotation verdict: Quaternions win in engineering (4 numbers, no gimbal lock, SLERP, cheap renormalization, deep ecosystem in Unity/Unreal/ROS/Eigen); GA rotors are theoretically superior (rotation axis = bivector, generalize to any dimension) and algebraically equivalent in 3D. Matrices remain the fast "output format" for batch vertex transforms; Riemannian methods matter only for rotation statistics (pose averaging, medical registration).
- Unification verdict: GA is the algebraic unifier (complex numbers = Cl(0,1), quaternions = Cl(3,0)⁺, Pauli/Dirac matrices as representations, Maxwell's equations as ∇F = J); Riemannian geometry is the geometric unifier (flat/spherical/hyperbolic spaces, gravity, information geometry, manifold optimization). They are complementary wings, fused in the Clifford bundle and the Dirac operator.
- Engineering verdict (ranking: matrices > quaternions > GA ≈ Riemannian):
- ML: matrices 10/10 (attention, GEMM on Tensor Cores); GA 5/10 (Geometric Clifford Algebra Networks, ICML 2023); Riemannian 4/10 (natural gradient, 2–5× speedups at medium scale); quaternions 3/10 (QNNs).
- Robotics: quaternions 9/10 (ROS tf2, IMU fusion, SLAM), matrices 8/10 (homogeneous transforms, Jacobians); GA emerging via gafro (IEEE RAM 2025).
- Graphics/XR: matrices 10/10 (MVP pipeline), quaternions 9/10 (SLERP skeletal animation); GA elegant but niche (CGA intersections); Riemannian 2/10.
- Curved space / constrained optimization / information geometry / relativity → Riemannian geometry (geomstats, Pymanopt)
- Large-scale linear compute / ML training / rendering → matrices (NumPy, PyTorch, cuBLAS)
- 3D rotation interpolation / attitude representation / IMU fusion → quaternions (Eigen, GLM, ROS tf2); upgrade to GA rotors for higher dimensions
- High-dimensional geometry / equivariant ML / physics modeling → geometric algebra (ganja.js, galgebra, gafro)
- Unsure → default to matrices
- Matrices stay the default representation layer; quantum computing (HHL) and AI-discovered algorithms (AlphaTensor, Nature 2022) may reshape parts of numerical linear algebra.
- Quaternions remain entrenched in 3D engineering for the next decade; growth areas are quaternion neural networks and differentiable physics.
- GA is the main contender for growth: if equivariant GNNs go mainstream, GA could enter the standard ML toolbox within 5–10 years.
- Riemannian methods will grow slowly in medium-scale optimization, hyperbolic networks, and medical imaging—forever an expert tool.
- Ultimate convergence: geometric deep learning on curved manifolds via Clifford bundles—"a generational project."
- Hestenes, *Space-Time Algebra* (1966)
- Shoemake, *Animating Rotation with Quaternion Curves*, SIGGRAPH 1985
- Dorst, Fontijne, Mann, *Geometric Algebra for Computer Science* (2007)
- Ruhe et al., *Geometric Clifford Algebra Networks*, ICML 2023 (arXiv:2302.06594)
- Löw et al., *GAFRO: Geometric Algebra for Robotics*, IEEE RAM 2025
- Amari, *Information Geometry and Its Applications* (2016); do Carmo, *Riemannian Geometry* (1992); Strang, *Introduction to Linear Algebra* (2016)
- AlphaTensor, *Discovering faster matrix multiplication algorithms with RL*, Nature 2022
- arXiv:2511.15398 (GA for CG/XR); arXiv:2605.16308 (CGA for LLMs)
- Tooling: geomstats, Pymanopt, ganja.js, galgebra, gafro
Decision tree
Future outlook
Conclusion: There is no single king. Matrices rule engineering, quaternions rule 3D rotation, GA rules algebraic unification, Riemannian geometry rules curvature. "The true master is not the blade, but the hand that knows which blade to draw."