A snapshot from the video presentation showing a visualisation the mapping of vowel sounds from words in text to musical notes.
My bachelor thesis that evolved into a publication, presented at the 2nd Nordic SMC conference in 2021 with the title: Sonification of Twitter Hashtags Using Earcons Based on the Sound of Vowels. In the study real-time Twitter hashtags are sonified based on the syllables of the words, creating musical melodies with enhanced vowel sounds. A web-app were developed in JavaScript, which was following certain hashtags, playing their respective melodies when used and displaying the tweets. A user test were conducted were the participants during one weeks time were asked to visit the web-app 5 min a day and later tested if they could recognise the hashtags by only listening to the melodies. The results showed the participants at a significant level could recognise the melodies, but not that the vowel sounds affected their distinguishability.
Here’s a video presentation of the paper:
A video presentation of the paper.