"Gesture interaction" 8. Nimble Sense

As early as 2012, 2013, the field of gesture recognition has taken place in several important industry mergers and acquisitions. such as Intel's takeover of Omek, Google's takeover of Flutter, and Apple's acquisition of prime sense, the Israeli company that previously provided technical support to Microsoft Kinect, for $345 million. Gesture recognition has long been a battleground for the future of major giants. Because the Giants are gradually seeing (gesture recognition) The important changes in the traditional way of operation.

Virtual reality is the next generation of human-computer interaction interface, Oculus has shown the output of the end of the example, and good performance. But in the input, that is how people in the virtual reality to give instructions and operations, is still in the state of crowded, voice control, eye movement, operating lever, gesture recognition and other methods, who dare not say that they are dominant.

The 2014 low Oculus acquisition of NIMBLEVR, marking gesture recognition has now basically won. Compared to other ways, gesture recognition has so many advantages: low learning costs, human beings from the birth of learning by hand interaction; flexibility, practicality, gesture recognition based on the interaction mode has a basic usable products.

Gesture recognition also has its own shortcomings, such as the operation of a long arm will be tired, the hands overlap will have the problem of recognition is not allowed, but in general, the current stage may be the most suitable method, the other may be used as auxiliary input methods, such as eye movement and voice control, in some professional sports field, the operating lever may also become the leading input

Nimble VR is a gesture recognition technology company founded in 2012, the founder of Robert2011 graduated from the computer Department of MIT, specializing in gesture recognition, when the company was acquired with only 4 employees. Nimble VR research motion tracking camera system and algorithms that can monitor and analyze the body skeleton structure. Using their own gaming experience, they developed software that tracks joint angles and joint positions, creating a realistic virtual reality arm. But they could not find a camera that was sensitive enough to pick out the joint data. Including Microsoft's Kinect, are used primarily to detect large targets, rather than subtle hand movements. As a result, the research team designed its own dedicated somatosensory depth sensor, nimble sense.

Nimble Sense

Nimble sense landing Kickstarter, crowdfunding is not over, was Oculus Fancy. The biggest feature of nimble sense is the ability to seamlessly sync the recognizable gestures into VR games or software, allowing the user to feel the presence of both hands in the virtual reality world, and this process does not require any hardware products to be worn on hand.

Nimble sense uses a tof depth camera with a frame rate of 45fps to capture a dense three-dimensional point cloud in the infrared laser emitter space. The real-world three-dimensional point cloud is rendered in the correct position and angle, the point cloud can even be rendered to other players in the virtual field of view, so that in the multi-person, social applications, the different viewpoints can be shared with each other point cloud. If the binocular camera gesture recognition method, can only be dependent on a specific pupil distance specific point of view of the two infrared images, can not be shared with other viewpoints of users.

The nimble sense's Tof camera captures the user's 110-degree range (which is 10 degrees higher than the visible angle of Oculus) and is 10-70cm in depth, meaning that it can be displayed in the virtual reality world as long as you can see both hands. You can interact with all objects in the virtual reality world with precision. Nimble Sense has made a breakthrough in balancing equipment accuracy, cost, and power consumption, bringing an affordable tof depth camera to the user, with a nimble sense of $99 in Kickstarter's crowdfunding.

Nimble sense is very small and can be installed on top of the Oculus VR helmet. It monitors the user's hand movement, and the software then simulates each gesture in mathematical ways. Nimble sense installs in the DK2 to cover two LEDs, which are used for DK2 position tracking, but do not affect the performance of the tracking, which is also the problem when installing leap motion. The recognition rate is higher and more sensitive than leap motion,nimble sense.

Nimble sense uses the PMD sensor chip and works closely with PMD on hardware and software. Unlike Camboard, nimble sense's optical system is specifically optimized for VR systems to achieve wide viewing angles, long distances, and high-precision hand tracking.

Copyright NOTICE: This article for Bo Master original article, without Bo Master permission not reproduced.

"Gesture interaction" 8. Nimble Sense