What has Apple got planned for Augmented Reality (AR) Glasses? Here are all the rumors, rounded up!

Augmented Reality (AR) or Mixed Reality is different than Virtual Reality (VR). Rather than being immersed in a fully-rendered world, AR/MR layers data on top of the real world. Right now, Apple's efforts are focused on ARKit, its platform for hundreds of millions of iPhone and iPad users. But Apple doesn't see AR as a single product, like Microsoft's HoloLens or Snap's Spectacles. Apple sees AR as a core technology that will be part of many products coming in the future. Just like LCD and OLED are part of many products today. And that might just include Apple Glasses.

October 10, 2017: Cook: The technology does not yet exist for Apple Glasses

Apple has been working on a "glasses"-type augmented reality display for a while, according to rumors. An actual shipping product is still a ways off, though, according to Apple CEO, Tim Cook.

Speaking to The Independant:

"There are rumours and stuff about companies working on those – we obviously don't talk about what we're working on," Cook says. (Patents have shown that Apple is at least looking into such wearables, and reports have suggested that the ARKit introduction on the iPhone is partly a way to help build that interest and ecosystem.)

"But today I can tell you the technology itself doesn't exist to do that in a quality way. The display technology required, as well as putting enough stuff around your face – there's huge challenges with that.

"The field of view, the quality of the display itself, it's not there yet," he says. And as with all of its products, Apple will only ship something if it feels it can do it "in a quality way".

"We don't give a rat's about being first, we want to be the best, and give people a great experience," he says. "But now anything you would se on the market any time soon would not be something any of us would be satisfied with. Nor do I think the vast majority of people would be satisfied."

Cook remains incredibly bullish on AR in general, of course. Apple launched ARKit for developers back in June and ARKit-powered apps launched to hundreds of millions of iPhone and iPad users in September. He believes the impact of AR will be dramatic and likened it to the advent of mobile apps on Apple's App Store.

It'll simply be a while still before the AR experience moves from our hands to our faces.

June 3, 2017: Rumor claims Apple AR glasses postponed, potentially canceled

Google had glass, which was more personal display than AR. Microsoft has HoloLens. Snapchat has spectacles. And Apple? While rumors have suggested Apple was working on glasses of its own, a new supply chain AMA suggests that product might have been pushed back — or even killed entirely.

From Reddit

65% Project Mirrorshades / Iris will be cancelled. It's a very unique design, if it can be done properly it will be like what the iPhone 10 years ago.

Rough bill of materials of Project Mirrorshades - Apple Iris. Note Iris is Siri backwards. Kopin NED Acetate frame Polarisized or prescription lens with Zeiss smart optics Bone conduction modules Microphones (noise cancellation) Light sensor Accelerometer for step tracking and head movement app navigation Magnetometer for navigation Capacitive Pavel Ceramic battery Apple chipset Charging circuit BL5 Induction module

Apple will likely introduce AR through iPhone or iPad, perhaps using Pokémon Go as a demo, long before we see glasses. But, AR is a long game for Apple, so we'll also have to wait and see where the technology takes them. And us.

April 20, 2017: Apple health and safety reports hints at Glasses

At some point having to hold a phone in your hand becomes less convenient than simply putting on a pair of glasses or contacts or otherwise intercepting and altering the photons going into your eyes.

Gizmodo got its hands on an Environmental Health and Safety report in April 2017 that seemingly implies employees have been testing some sort of AR or VR unit.

One report on February 21 that included "medical treatment beyond first aid," involved a prototype unit at Apple's De Anza office in Cupertino. "After BT4 user study, user advised study lead, that she experienced discomfort in her eye and said she was able to see the laser flash at several points during the study. Study lead referred her to optometrist and secured prototype unit for analysis." In another report, an employee working at Apple's Vallco Parkway office in Cupertino reported eye pain on March 2. "Employee reported eye pain after working with new prototype, thought it may be associated with use. He noticed that the security seal on the magenta (outer) case had been broken and had thought the unit may have been tampered with." A source inside Apple speculated that this injury may have something to do with an augmented reality product Apple may be testing, something like glasses with an overhead display.

Apple has the resources to explore any product it wants to, so this is the kind of surprising that isn't. We'll just have to wait and see if it starts moving into production any time soon or simply remains an exploration for a good long while.

March 27, 2017: Apple began building its Glasses team over a year ago

This is how Apple rolls.

The Financial Times, on :

Apple first began to build a team to examine the feasibility of a head-worn device more than a year ago. Now, it is devoting more resources to its augmented-reality efforts, with the aim of taking it from a science project towards a consumer product, according to people familiar with the company's plans. However, any launch is still at least a year away, perhaps much longer. Apple declined to comment.

As its engineers have become more adept at miniaturisation technology with products such as its AirPods wireless headphones and the iPad's Pencil, AR seems to have overtaken Apple's secretive car project as the company's top priority for its next big launch, beyond the iPhone.

Spoiler: Apple's special project group works on multiple projects at once and priorities change depending on how far along a project is and how Apple feels it can make a difference in the market.

November 14, 2016: Apple weighing expansion into digital glasses

Bloomberg:

Apple Inc. is weighing an expansion into digital glasses, a risky but potentially lucrative area of wearable computing, according to people familiar with the matter.

While still in an exploration phase, the device would connect wirelessly to iPhones, show images and other information in the wearer's field of vision, and may use augmented reality, the people said. They asked not to be identified speaking about a secret project.

It'd be a bigger shock at this point if Apple wasn't exploring Glasses.

What would Apple Glasses be?

Apple Glasses would take the current ARKit experience on iPhone and iPad and embedd the necessary technologies needed to move it from your hands to your face. That way, you wouldn't need to hold up a phone or tablet, or switch from standard apps to AR and back. You'd have a dedicated window into AR, ready and available, at all times.

There are a few things Apple would need to make AR glasses jump from sci-fi to IRL:

  • Battery technoloy that lasted long enough to be useful but didn't weigh you down excessively.
  • Apple silicon, similar to what's found in the A-series systems-on-a-chip, to handle tracking, scaling, rendering, and all the other heavy lifting.
  • High-resolution displays, or some form of photon-hijacking technology that would overlay AR at a high enough quality, even at such extremely close range.
  • W-series style wireless communications to interact with everything from your iPhone to your AirPods (if sound technology isn't built in or sufficient for all use cases.)
  • TrueDepth-style camera system to ingest the real world so it can be augmented.

Cramming all that technology into something light and attractive enough to be worn often enough to be useful will be incredibly challenging. But that's Apple's job.

When should you expect AR or mixed reality glasses from Apple?

Apple rarely rushes into new markets and, considering the experience from Apple Watch, patience is more likely than ever.

So, when it comes to Apple mixed reality glasses, we can only expect them when we see them. Or see through them.