Multi Quantization Scheme Abstraction With Automatic Selection

via “quantized-codebook-learning-for-discrete-speech-units”

automatic-speech-recognition model by undefined. 11,95,671 downloads.

Unique: Uses product quantization with straight-through estimators to learn discrete speech units without requiring phonetic labels — the quantizer acts as a learned bottleneck that forces the model to discover meaningful acoustic patterns, unlike supervised phoneme-based approaches that require manual annotation

vs others: Discovers more linguistically-relevant discrete units than k-means clustering on MFCC features because the quantizer is jointly optimized with the feature extractor, resulting in units that better preserve phonetic information (phoneme error rate 15% lower on downstream tasks)