Hi, my name is Xinwei. I am a second year Phd student within the TEFLON project. I was very happy and excited about attending the INTERSPEECH 2023 from 20.August to 24.August in Dublin.
It was my first time joining such an international and well-known conference. In this conference I met a lot of senior researchers from all over the world in the fields of speech and signal processing that includes my supervisor Prof. Torbjørn Karl Svendsen. I also met Prof. Mikko Kurimo from the university of Aalto and many of the other members in our project during this conference.
There were so many interesting ideas and techniques being proposed this year. I just wished to clone several of myself in order to be the audience of several parallel presentations, instead of running from one room to another all over the building. I also noticed many inspirational posters that inspired me for my research fields. In addition, I also encountered some of the posters with which I was not familiar with, e.g., speech synthesis and speech enhancement. It was really amazing to talk to those presenters and grasp the main concepts and problems of those fields in half an hour’s time.
I also presented our work with the title “An Analysis of Goodness of Pronunciation for Child Speech”. Thanks to many questions and advice from the audiences, I am now having a clearer picture of my future research work.
Really amazing conference. Can’t wait to meet all of you next year!
Hi, I’m Nhan Phan, a PhD student at Aalto University. I’m part of the Teflon project, and my role is to maintain the Pop2Talk Nordic mobile application. Pop2Talk is a language learning game that allows children to imitate words that were said during the game progress, and get a rating of their pronunciation. Based on the original game version intended for English, the Pop2Talk Nordic version expanded to Nordic languages. As I write this blog post, we have successfully developed four different versions of the game. These include:
- A Finnish version for children who find it challenging to pronounce the phoneme “R”.
- A Swedish version for children with Speech Sound Disorder.
- And two other versions for children who want to learn Norwegian or English.
While much of the project’s foundational work was led by experienced partners in children’s speech-language pathology and in automatic speech recognition technology, I was fortunate to be involved in the project, being responsible for the design and maintenance of both the server and the mobile game.
With our need for illustrations in multiple languages, we turned to the latest AI technology for automatic image generation. I provided our partners with technical instructions on crafting text prompts to ensure the resulting images were both captivating and child-friendly. To my surprise, the images they produced were outstanding, surpassing all my expectations. Check out this cool picture from Magdalena at Karolinska Institutet. Funny thing, the girl is the spitting image of my 2-year-old daughter. I had to ask right away to use it as my daughter’s avatar.
When I showed the game to my daughter, she was super into it—even though she’s just starting to learn Finnish. She got so hooked that I had to yank the phone from her! I really hope other kids get just as excited when they play (and fingers crossed, they’ll want to take a break after a while).
As we move into October, we’re preparing for numerous experiments. These will study how children acquire vocabulary and pronunciation, and evaluate the game’s effectiveness in helping them. Those experiments will be conducted in various schools across Finland, Sweden and Norway. My primary focus at the moment is to ensure the server runs without any serious problems.