US scientists have created an AI that can recreate streets by their sounds
The University of Texas at Austin has announced the development of an innovative artificial intelligence model capable of generating images of city streets from audio recordings. Audio-visual clips containing sounds and images of streets from different countries were used to train the system.
The training process utilized clips with static images and ambient sounds collected from YouTube videos. They covered both urban and rural streets in North America, Asia, and Europe. Using algorithms, the AI learned to match sounds to certain objects in the images.
As part of the experiment, photos were taken along with 2 generated images of other streets, while playing a sound track corresponding to the first image. The task was to determine which of the 3 images corresponded to the auditioned sound. The result was an 80% accuracy in identifying the correct photos.
According to the authors of the project, this study opens new perspectives for forensics, for studying the impact of the perception of sounds and images on human mental health, as well as for the development of urban design methods in populated areas
Science & Tech
AI / ML
9
0
0
Share
Comments
Recommended
Ignacio Gutiérrez
2 subscribers
9 months ago
Subscribe
YouTube brings auto-dubbing to more channels
YouTube's new auto dubbing feature, which allows creators to automatically translate their videos into multiple languages, is now available to hundreds of thousands of channels in the YouTube Partner Program. This exciting development builds on earlier efforts to break down language barriers on the platform
YouTube automatically detects the language and creates dubbed versions in other languages.
Show more
Science & Tech
3
0
0
Share
Pavel Ryzhikh
80 subscribers
9 months ago
Subscribe
The first full-fledged alternative to Apple Pay has launched in Norway
The first full-fledged alternative to Apple Pay has gone live in Norway - made possible by an EU law on access to NFC on iPhones.
Users in Europe can not only select the Vipps app for payments by default, but also open it with the side button - like Apple Pay