Text: Advanced text-to-speech models such as FastSpeech can synthesize speech significantly faster
than previous autoregressive models with comparable quality. The training of FastSpeech model relies on an
autoregressive teacher model for duration prediction and knowledge distillation , which can ease the one-to-many
mapping problem in TTS. However, FastSpeech has several disadvantages: 1) the teacher-student distillation
pipeline is complicated, 2) the duration extracted from the teacher model is not accurate enough, and the target
mel-spectrograms distilled from teacher model suffer from information loss due to data simplification, both of
which limit the voice quality. In this paper, we propose FastSpeech 2, which addresses the issues in FastSpeech
and better solves the one-to-many mapping problem in TTS by 1) directly training the model with ground-truth
target instead of the simplified output from teacher, and 2) introducing more variation information of speech as
conditional inputs. Specifically, we extract duration, pitch and energy from speech waveform and directly take
them as conditional inputs during training and use predicted values during inference. We further design FastSpeech
2s, which is the first attempt to directly generate speech waveform from text in parallel, enjoying the benefit of
full end-to-end training and even faster inference than FastSpeech. Experimental results show that 1) FastSpeech 2
and 2s outperform FastSpeech in voice quality with much simplified training pipeline and reduced training time; 2)
FastSpeech 2 and 2s can match the voice quality of autoregressive models while enjoying much faster inference
speed.
LJ042-0094 (Ground-Truth)
LJ042-0094 (Synthesized)
Text: the soviet authorities denied oswald permission
LJ021-0108 (Ground-Truth)
LJ021-0108 (Synthesized)
Text: from the standpoint of the good of the industries themselves, as well as the general public
interest,
LJ030-0031 (Ground-Truth)
LJ030-0031 (Synthesized)
Text: secret service agents formed a cordon to keep the press and photographers from impeding their
passage and scanned the
crowd for threatening movements.
LJ001-0012 (Ground-Truth)
LJ001-0012 (Synthesized)
Text: especially as no more time is occupied, or cost incurred, in casting, setting, or printing
beautiful letters
LJ011-0202 (Ground-Truth)
LJ011-0202 (Synthesized)
Text: the uncle claimed her. the husband resisted.
LJ006-0114 (Ground-Truth)
LJ006-0114 (Synthesized)
Text: they bought their offices from one another, and were thus considered to have a vested interest
in them.
LJ009-0038 (Ground-Truth)
LJ009-0038 (Synthesized)
Text: in the center of the chapel was the condemned pew, a large dock-like erection painted
black.
LJ006-0161 (Ground-Truth)
LJ006-0161 (Synthesized)
Text: again, a turnkey deposed that his chief did not enter the wards more than once a fortnight.
LJ027-0127 (Ground-Truth)
LJ027-0127 (Synthesized)
Text: while neglecting to maintain his unity of ideal in the case of nearly all the numerous species
of snakes, he should have
added a tiny rudiment in the case of the python
LJ050-0158 (Ground-Truth)
LJ050-0158 (Synthesized)
Text: the department hopes to design a practical system which will fully meet the needs of the
protective research section of
the secret service.
Text: his mother, however, was a little shy of the company for him, and besides she could not always
spare him.
2299_6524_000057_000000 (Ground-Truth)
2299_6524_000057_000000 (Synthesized)
Speaker: 2299
Text: on the arrival at the hut to my chagrin we found it filled with snow.
2388_153731_000003_000000 (Ground-Truth)
2388_153731_000003_000000 (Synthesized)
Speaker: 2388
Text: the story of the first scientific observation of the corona and the prominences is thrillingly
interesting, and in fact dramatic.
3615_14677_000014_000000 (Ground-Truth)
3615_14677_000014_000000 (Synthesized)
Speaker: 3615
Text: beat three eggs with a pinch of salt; add one pint of milk and two thirds of a cup of
flour.
4744_31668_000003_000001 (Ground-Truth)
4744_31668_000003_000001 (Synthesized)
Speaker: 4744
Text: far from morbid naturally, she did her best to deny the thought, and so simple and unartificial
was her type of mind that for weeks together she would wholly lose it.
480_127525_000006_000000 (Ground-Truth)
480_127525_000006_000000 (Synthesized)
Speaker: 480
Text: i tried and found by experiment that the tide kept sweeping us westward until i had laid her
head due east, or just about right angles to the way we ought to go.
5126_27504_000011_000003 (Ground-Truth)
5126_27504_000011_000003 (Synthesized)
Speaker: 5126
Text: it looked as if our luck was dead out, and we began to think our chance of getting across the
border to queensland, and clear out of the colony that way, looked worse every day.
6098_57837_000008_000000 (Ground-Truth)
6098_57837_000008_000000 (Synthesized)
Speaker: 6098
Text: word was sent of their predicament to the nearest fort, and lieutenant pershing was sent with a
small detachment to their rescue.
6544_231862_000065_000001 (Ground-Truth)
6544_231862_000065_000001 (Synthesized)
Speaker: 6544
Text: denzil did look, and uttered a second cry more startling than the first.
968_122545_000053_000000 (Ground-Truth)
968_122545_000053_000000 (Synthesized)
Speaker: 968
Text: the bee fought the window angrily, up and down, up and down, for several minutes; then found the
open glass and whirled
out into the sunshine, joyfully.