Phoneme Level Duration And Pitch Prediction With Linguistic Features

via “mel-spectrogram generation with duration and pitch prediction”

text-to-speech model by undefined. 2,95,715 downloads.

Unique: Uses auxiliary prediction heads for duration and pitch jointly trained with the main decoder, enabling implicit prosody learning without explicit phoneme-frame alignment annotations, and allows inference-time prosody scaling by modulating predicted values

vs others: More flexible than fixed-duration TTS (e.g., Glow-TTS) and avoids the alignment brittleness of older Tacotron models by learning duration distributions end-to-end; more controllable than end-to-end models (Glow-TTS, FastSpeech) that don't expose pitch/duration predictions