Vive to Get an Eye-tracking Add-on with Optional Corrective Lenses

http://ift.tt/2oO4sCm

7invensun, one of the latest companies accepted into HTC’s Vive X accelerator program, is launching an eye-tracking add-on made specially for the Vive headset. The device, which will launch initially as a development kit in China this month, uses a series of IR LEDs and a near-eye camera to track the player’s eyes in real time, enabling a range of potential benefits.

Meeting with 7invensun at HTC’s Vive X accelerator space in San Francisco today, I got to see the aGlass eye-tracking development kit in action. The device, which comes as two compact assemblies which easily insert around the Vive’s lenses, uses a ring of IR LED’s to illuminate each eye while a small camera records the movements and sends the data back to the computer for processing. The devices are smartly powered from the Vive’s extra USB port that’s hidden under the cable retainer at the top of the headset.

Foveated Rendering and More

Eye-tracking can be used for a number of useful purposes in VR, perhaps one of the biggest being foveated rendering, which reduces the resolution around your peripheral vision where it doesn’t need to be as sharp while leaving the center part of your vision at high quality. This can significantly reduce the processing power required to render a high-quality, high-framerate VR scene. Among the VR industry, foveated rendering via eye-tracking is largely considered a necessary technology to one day achieve retinal-resolutions in VR headsets, by reducing the processing power needed to render on such high pixel-density displays.

Foveated rendering is already up and running with the aGlass dev kit, and is presently said to work on any application with no modifications, so long as the computer is equipped with an NVIDIA GPU. Presumably the company will aim to extend the capability to AMD cards as well. My current understanding is that other functions that employ eye-tracking data are GPU-independent, but foveated rendering is a special case because of their rendering technique.

Beyond foveated rendering, eye-tracking can be used to more realistically animate the eyes of your VR avatar, simulate depth-of-field effects, be used for conscious and unconscious input inside of VR apps, and more.

Corrective Lenses

Beyond the eye-tracking, the aGlass add-on also opens the door to corrective lenses for those who normally wear glasses. Today’s high-end VR headsets lack variable focus control, so those with glasses are either stuck trying to fit them inside the headset or not playing with them at all. The aGlass add-on is designed for easy insertion of custom-made lenses that rest over the Vive’s original lenses. The development kit comes with three powers of lenses. And if you don’t need corrective lenses, the device works entirely fine without them.

Hands-on With the aGlass Dev Kit

I got to try the dev kit myself at the Vive X accelerator office in San Francisco today.

The calibration process took several tries and quite a bit of fidgeting with the headset to get right. In my experience this is not entirely unique to aGlass, but speaks to the underlying challenges of designing and eye-tracking system that can handle a wide range of face and eye structures, not to mention those with eye problems (just an FYI, I’m fortunate to have normal 20/20 vision).

Once we did get the system calibrated—which involves looking at a series of dots in the screen and takes only a few seconds, if it works in the first try—I was shown a version of NVIDIA’s VR Funhouse demo that employed foveated rendering. Foveated rendering only works well if the eye-tracking is fast and accurate enough that the user can’t tell that there’s any foveated rendering happening.

I was told the aGlass has 5ms latency, and this was fast enough that—under the right settings—I could barely tell that the foveated rendering was turned on, which is great. The particular method they were using to achieve the foveated rendering was described as “proprietary,” and it did work better than a number of other attempts I’ve seen which often introduce a blurry feeling in the periphery which gives the effect away easily and doesn’t feel quite right.

The particular laptop computer power this demo lacked ‘VR ready’ hardware and when foveated rendering was disabled, I could easily see lots of jitter do to the computer not being able to keep up with the rendering workload. Once foveated rendering was enabled, it allowed the computer to achieve the necessary 90FPS consistently.

The installation seems dead simple though the current dev kit adds a little bulk around the Vive’s lenses which slightly restricts the IPD setting on the lower end. The average IPD is often quoted around ~64mm, but with the aGlass installed I was only able to bring the Vive IPD down to 65mm, though the company says they aim to fix this for the consumer version of the device.

aGlass Release Date

7invensun says the aGlass eye-tracking dev kit add-on for Vive will go on sale in China this month, priced around $220. In the US, the company expects to offer the dev kit for sale in Q3. There’s no word yet on when a consumer version of the device will become available.

The post Vive to Get an Eye-tracking Add-on with Optional Corrective Lenses appeared first on Road to VR.

from Road to VR http://ift.tt/2oO4vhw
via IFTTT