Unveiling the prototype of Facebook AR glasses, with superior audio and acoustic features

Don't expect to see Apple glasses Before 2022 At the very least, but we've now already seen a prototype of a tough competitor as Facebook has unveiled its Facebook AR glasses that could soon see the light. Interestingly, this prototype does not have a display and focuses entirely on the auditory experience, or what is known as spatial audio and augmented sound reality, two areas that Facebook is actively interested in, and the company's latest research shows how it plans to create devices that can control the real world and make virtual things look like Real ones next to you, even if they aren't really there. Find out what Facebook glasses can offer.

Facebook AR glasses technology

The Facebook Reality Labs Research team has revealed a prototype of the glasses. Team members divide their work into two techniques.

First It is called “Cognitive superpowers “, Which improves specific sounds and reduces background noise in the real world. For example, it will give you a clear way to hear someone sitting with you in a noisy place, for example.

Technology can do this by using the glasses' multiple microphones to capture the sounds around you. After that, the movements of the head and eyes will be monitored and recorded to find out and determine the source of the sounds you want to hear and the sounds you want to filter.

While researchers aren't developing a special technology for the hearing impaired, they could help those who prefer not to use hearing aids in social situations.

He said Thomas Lonner, One of the researchers who worked on the world's first digital hearing device: “By putting hard of hearing people on an equal footing with people of normal hearing, we can help them become more socially interactive. This aligns well with Facebook's core mission, in the sense that hearing impairment often distances people from social situations. ”

The FRL Research audio team is also working on developing a technology for what is known as ``Voice attendance", Which will recreate how sounds are transmitted and reverberated in the real world of augmented and virtual reality." And the glasses will make the sound sound very realistic, as if you are actually listening to what is happening around you rather than something that comes from a device.

Facebook explains that the same approach can be taken to accurately simulate real-world sounds in certain things such as virtual reality experiences.

When someone in a room talks to you, one ear will hear it before the other. Volume also varies in each ear. Moreover, the shape of the ear slightly changes the way we all hear sound. All of these signals tell your brain where the sound is coming from. The sound interacts with your environment, bouncing off the walls before it reaches your ear. These are the basic components that, if accurately reproduced, allow virtual sounds to reproduce real sounds.

In 2017, a voice search team helped transmit spatial audio, virtual sounds that mimic trends that come from real life. They have also created high-quality audio simulation technologies that make virtual environments even more believable. These technologies pushed the very latest in spatial audio technology forward and augmented many of today's experiences on Oculus Quest “the first comprehensive game system for virtual reality” and the Rift Platform, including First Steps and Oculus First Contact. The next limit is spatial sound customization and the modeling of how the sound interacts with real environments.

Incidentally, Apple also holds a patent for a method for identifying an audio source, which can also be used in the real or virtual world.

Facebook's audio augmented reality glasses technology is similar to HomePods

Facebook says the same technology could give humans the same ability as HomePods to hear a clear spoken sentence while playing loud music. HomePods use a combination of microphones and speakers to allow Siri to filter background music and focus on hearing your voice. Facebook showed how its modular device could allow us to do the same.

It's definitely interesting things, and the fact that Facebook chose to reveal this work indicates an actual intention to bring this technology out soon. And the whole spectrum of AR and VR glasses and headphones is sure to be a great field over the next few years.