Researchers at St. Petersburg State University have integrated an intonational model into a neural network, making the artificial intelligence’s (AI) pronunciation sound more natural and familiar to humans. This development will help improve text-to-speech systems used in voice assistants and humanoid robots. This was reported on the university's website.

Most often, language models reproduce the most common variants of word pronunciation or elements of a phrase. AI is largely unable to produce intonation that conveys semantic and emotional nuances. At the same time, an unfortunate combination of intonation patterns in different parts of a sentence can spoil the overall impression, even when the voice generation is of high quality. Russian linguists have attempted to rectify this shortcoming of neural networks. The modifications they proposed have enabled the neural network to overcome the unnaturalness or monotony of intonation.

The AI training was based on an intonation classification system developed by staff at the Department of Phonetics and Methods for Teaching Foreign Languages at St. Petersburg State University – Associate Professor Nina Volskaya and the Head of Department, Professor Pavel Skrelin. This methodology takes into account the type of sentence: a question, a narrative, a command, a request or an address. Furthermore, the system incorporates a wide range of intonation variants.

"Thanks to the correct structuring of the data and the use of labels for intonation variants, the model was able to convey various nuances in intonation, which allows for a more natural and expressive generated sound. ‘This approach makes the synthesis system more flexible and suitable for various applications, including voice control and educational programs," explained Ulyana Kochetkova, an associate professor at St. Petersburg State University.