BOSE is working on its own pair of augmented reality glasses

March 13, 2018 by Innovation for Africa - No Comments

Bose has announced at SXSW that it’s working on its own pair of augmented reality glasses, but not in the way that you’d think. Instead of superimposing data over the world visually, like Google Glass or Intel’s Vaunt glasses, Bose’s AR concept unsurprisingly focuses on audio, adding “audible layer of information and experiences” to the real world, according to a report from CNET.

Bose isn’t just working on one pair of glasses, either. The company has bigger ambitions for its audio AR as an entire platform for developers to build off, and to that end, the Bose is releasing a Bose AR SDK and setting up a $50 million fund to invest in companies that will build things with Bose AR.

For now, the company is showing off a pair of glasses with integrated headphones at SXSW (which will be available sometime this summer in limited amounts for developers and manufacturers), but Bose says that its AR platform can “be built into headphones, eyewear, helmets and more.” Bose AR isn’t just about audio, either. The devices will use sensors to track head motions for gesture controls and work with GPS from a paired smartphone to track location.

As for what kind of experiences audio-based augmented reality could offer? Bose has a couple of ideas. The company envisions having a Bose AR device reenact historical events or speeches from landmarks and statues as you visit them or get audio directions to your gate when your GPS detects that you’ve arrived at the airport. The company also aspires to combine visual information with the Bose AR platform, too, so you could hear a translation of a sign you’re looking get, get a weather report when you look out your window, or hear the history of a painting in a museum.

It seems that we’re still far away from devices making their way into consumers’ hands (or rather, on consumers’ heads), but it’s certainly an interesting approach to augmented reality that plays to Bose’s strengths that’s completely different from most of the other AR products out there.

Bose has announced that it is developing a pair of augmented reality glasses, which focuses on audio. Rather than superimposition of data over visually, like Google Glass or Intel’s Vaunt glasses, Bose’s AR technology adds an “audible layer of information and experiences.” The audio specialist company isn’t just working on these glasses, but it also wants to build its audio AR as an entire platform for developers to create experiences. To that end, the company is also releasing a Bose AR SDK.

Most AR glasses aim to enhance what their users see by positioning digitally-rendered visuals in the real world. However, Bose unsurprisingly took a different path. Its AR wearable platform will essentially augment reality with sound, not sight. Bose has developed a prototype pair of glasses that incorporates its AR technology. In each arm of the glasses, there are small acoustics packages embedded, that provide headphone-like features to them.

 

“It places audio in your surroundings, not digital images, so you can focus on the amazing world around you — rather than a tiny display,” John Gordon, VP (consumer electronics division), Bose, said in a statement. “It knows which way you’re facing and can instantly connect that place and time with endless possibilities for travel, learning, music and more. And it can be added to products and apps we already use and love, removing some of the big obstacles that have kept AR on the sidelines,” he added.

The highlight of the Bose AR glasses is that they will understand what a user is looking at and play audio to complement it. For instance, when travelling you can use the Bose AR to simulate historical events at landmarks, play a speech from any historic figures whose statue, for example, you might be standing in front of.

Bose claims that the technology can be useful in several settings. The company says that the technology produces a powerful and clear sound that can be introduced in wearables such as headphones, eyewear, and helmets.

Notably, there are no cameras or lenses in the Bose AR system. Instead, a Bose AR wearable will use sensors to track head motion and the GPS from an iOS or Android device to track location. These sensors will then send the data to a Bose AR-enabled app which will aggregate the information and send relevant and real-time content back to the user’s ears instantly.

Bose says it is planning to invest up to $50 million in startups focused on apps, services, or technologies for the Bose AR platform. It added that the platform is open to approved developers and manufacturers and current collaborations include companies like ASICS Studio, Strava, TripAdvisor, TuneIn, and Yelp.

For now, the glasses won’t be available to consumers, a Bose spokesperson told CNET, just to developers and manufacturers (the Bose AR SDK, and limited quantities of a refined and updated version of the Bose AR glasses, will be available this summer). It’s unclear when they will be available to consumers or how much they’ll cost. Bose also didn’t say whether you’ll be able to get a prescription lens put in them.

Think of it as different type of wearable headphone that’s got some very smart features.

“Unlike other augmented reality products and platforms, Bose AR doesn’t change what you see, but knows what you’re looking at — without an integrated lens or phone camera,” Bose said. “And rather than superimposing visual objects on the real world, Bose AR adds an audible layer of information and experiences, making every day better, easier, more meaningful, and more productive.”

Other companies, like German-startup Bragi, which makes totally wireless in-ear earphones, talk fervently about the computerization of headphones. But Bose has brought the concept to a different form factor, one that can presumably house a larger battery to power the always-on experience.

The secret sauce seems to be the tiny, “wafer-thin” acoustics package developed for the platform. Bose said it represents the future of mobile micro-sound and features “jaw-dropping power and clarity.”

Bose adds the technology can “be built into headphones, eyewear, helmets and more and it allows simple head gestures, voice, or a tap on the wearable to control content.”

“Bose AR represents a new kind of augmented reality, one that’s made for anyone and every day,” said John Gordon, vice president of the Consumer Electronics Division at Bose. “It places audio in your surroundings, not digital images, so you can focus on the amazing world around you — rather than a tiny display. It knows which way you’re facing and can instantly connect that place and time with endless possibilities for travel, learning, music and more. And it can be added to products and apps we already use and love, removing some of the big obstacles that have kept AR on the sidelines.”

Aside from core features like music listening and call making, Bose said the wearable uses sensors to track head motion, and the GPS from an iOS or Android device to track location. “The sensors send the motion and location data to a Bose AR-enabled app that aggregates the information, sending relevant, real-time content back to the user’s ears instantly. And it can be used for multiple applications.”

Here are some examples Bose gave for how it might be used:

For travel, the Bose AR could simulate historic events at landmarks as you view them — “so voices and horses are heard charging in from your left, then passing right in front of you before riding off in the direction of their original route, fading as they go.” You could hear a statue make a famous speech when you approach it. Or get told which way to turn towards your departure gate while checking in at the airport.

Bose AR could translate a sign you’re reading. Or tell you the word or phrase for what you’re looking at in any language. Or explain the story behind the painting you’ve just approached.

With gesture controls, you could choose or change your music with simple head nods indicating yes, no, or next (Bragi headphones already do this).

Bose AR would add useful information based on where you look. Like the forecast when you look up or information about restaurants on the street you look down.