Dynamic Shape Handling And Symbolic Dimension Inference

Cross-platform ML inference accelerator — runs ONNX models on any hardware with optimizations.

Unique: Implements symbolic dimension tracking (onnxruntime/core/graph/graph_utils.h) where tensor dimensions are represented as symbolic expressions (e.g., batch_size * seq_len) rather than fixed integers. Shape inference propagates these expressions through the graph, computing output shapes as functions of input dimensions. At runtime, symbolic variables are bound to actual values, enabling dynamic shape handling.

vs others: More flexible than TensorFlow's static shape model (which requires fixed shapes or explicit dynamic shape handling) and more efficient than PyTorch's dynamic shape handling (which recompiles the graph for each shape) because ORT infers shapes statically and binds them at runtime.

via “dynamic shape inference and handling for variable-length inputs”

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Unique: Implements shape inference logic that propagates dynamic shapes through the graph, enabling inference with variable-length inputs without recompilation. The shape inference engine handles both static and dynamic dimensions, adapting to input variations at runtime.

vs others: Provides more flexible dynamic shape support than TensorFlow's static graph model and better shape inference than ONNX Runtime's limited dynamic shape support.