Shape Polymorphic Tracing And Compilation

via “shape-polymorphic-tracing-and-compilation”

Google's numerical computing library — autodiff, JIT, vectorization, NumPy API for ML research.

Unique: JAX's shape polymorphism is integrated into jit — users can specify abstract shapes and jit automatically generates code that works for multiple concrete shapes. This is achieved through a tracer system that uses symbolic shapes during compilation and generates XLA code with runtime shape checks.

vs others: More efficient than recompiling for each shape because code is generated once; more flexible than static shape systems because shapes can vary at runtime