It was only a matter of time before someone added generative AI to an AR headset and startup Brilliant Labs took the plunge with its recently revealed Frame smart glasses.
Looking like a pair of Where's Waldo glasses (or Where's Wally for our UK readers), Frame houses a multi-modal digital assistant called Noa. It consists of multiple AI models from other brands that work together in unison to help users learn about the world around them. These lessons can be done by simply looking at something and then issuing a command. Let's say you want to know more about the nutritional value of a raspberry. Thanks to OpenAI technology, you can command Noa to perform a “visual analysis” of the subject. The reading appears on the outer AR lens. Additionally, it can offer real-time language translation through Whisper AI.
The Frame can also search the internet through its Perplexity AI model. The search results will even provide price tags for potential purchases. In a recent VentureBeat article, Brilliant Labs claims that Noa can provide instant clothing price checks by simply scanning the piece, or search listings for new homes on the market. All you have to do is look at the house in question. You can even generate images on the fly via Stable Diffusion, according to ZDNET.
Evolving assistant
Returning to VentureBeat, their report offers a deeper look at how Noa works.
The digital assistant is always on, constantly capturing information from its surroundings. And it will apparently “take on a unique personality” over time. The publication explains that when activated for the first time, Noa appears as an “egg” on the screen. Owners will have to answer a series of questions, and upon completion, the egg turns into a character avatar whose personality reflects the user. As Frame is used, Noa analyzes the interactions between it and the user, evolving to improve in addressing tasks.
An expanded view of the Frame can be found on the official Brilliant Labs website which provides some interesting information on how the technology works. The on-screen content is projected using a micro-OLED onto a “geometric prism” in the lens. 9To5Google notes that this is reminiscent of how Google Glass worked. On the bridge of the nose is the Frame's camera placed on a PCBA (printed circuit board assembly).
At the end of the stems, you have the batteries inside two large cubes. Brilliant Labs claims the frames can last an entire day, and to charge them you'll need to plug in the Mister Power dongle, which will inadvertently turn the glasses into a high-tech Groucho Marx personification.
Availability
Currently open for pre-order, the Frame will set you back $350 a pair. It will be available in three colors: Smokey Black, Cool Gray and the transparent H20. You can opt for prescription lenses. Doing so will increase the price to $448. There is a chance that Brilliant Labs does not have your exact recipe. Instead, they recommend selecting the option that most closely matches your actual prescription. Shipping is free and the first batch will ship on April 15.
It appears that all AI features are subject to a daily usage limit. Brilliant Labs plans to launch a subscription service that removes the limit. We reached out to the company for clarification and asked several other questions, such as how exactly does the Frame receive information? This story will be updated later.
Until then, check out TechRadar's list of the best VR headsets for 2024.
