US scientists have created an AI that can recreate streets by their sounds
The University of Texas at Austin has announced the development of an innovative artificial intelligence model capable of generating images of city streets from audio recordings. Audio-visual clips containing sounds and images of streets from different countries were used to train the system.
The training process utilized clips with static images and ambient sounds collected from YouTube videos. They covered both urban and rural streets in North America, Asia, and Europe. Using algorithms, the AI learned to match sounds to certain objects in the images.
As part of the experiment, photos were taken along with 2 generated images of other streets, while playing a sound track corresponding to the first image. The task was to determine which of the 3 images corresponded to the auditioned sound. The result was an 80% accuracy in identifying the correct photos.
According to the authors of the project, this study opens new perspectives for forensics, for studying the impact of the perception of sounds and images on human mental health, as well as for the development of urban design methods in populated areas
Gadgets
AI / ML
9
0
0
Share
Comments
Recommended
Pavel Ryzhikh
80 subscribers
7 months ago
Subscribe
Designers can work together in virtual reality
The Spatial Analogue app for Apple Vision Pro is now available for free on the App Store.
This app provides “the first collaborative platform for 3D immersive experiences on Apple Vision Pro.” Designers can use it to work on projects while in different locations. The virtual reality makes it feel like they are together.
The app is designed for professionals working with 3D models. With Spatial A
Show more
Gadgets
AR / VR
8
0
0
Share
Pavel Ryzhikh
80 subscribers
7 months ago
Subscribe
Switzerland has invented a detachable electrical system for alpine skis
Swiss startup E-Outdoor has announced its new E-Skimo system. It is designed to make ski slopes easier to climb.
The E-Skimo system includes motorized treads mounted on skis. They significantly increase the speed of ascent. Each ski is equipped with a removable 20 Nm gearless stepper motor, a 220 Wh lithium battery and a snowmobile-like rubber tread. The motor units are equipped with 6-axis IMU m