Virtual reality and augmented reality (spectacles or helmets) status and future-introduction

Augmented Realitytechnology is made up of Virtual Realitytechnology development, the earliest to be used in military, beginning this year, because of the popularity of smartphones, intelligent hardware and the emergence of Google Glass, augmented reality technology is a lot of attention, at present, I am more optimistic about the future of augmented reality technology.
First, the present Virtual Reality (Virtual Reality, referred to as VR)Virtual reality technology uses the computer to create a virtual space, the use of virtual reality glasses can make users completely immersed in a virtual synthesis environment, can not see the real environment, using binocular vision principle, the virtual world in the glasses is 3D three-dimensional. 1, VR helmet: Now more famous is the Oculus company acquired by Facebook, Oculus glasses can display such as unity software built virtual scene, and let users immersed in the virtual world of roller coaster, play games, watch movies and so on. 2, VR glasses: The current solution is a type of head-mounted mobile phone box, put the smart phone into and split screen display, you can produce similar to the VR helmet effect, such as Samsung Gear VR in the future, virtual reality will not only involve the visual, auditory, but also involved in the sense of smell, touch, taste, the construction of a similar to the real
Second, the present Augmented Reality (augmented Reality, referred to as AR)Augmented reality technology can integrate virtual information (objects, pictures, video, sound, etc.) into the real world, enrich the reality and build a more comprehensive and better world. Google Glass began, augmented reality glasses began to appear, but are still primary products, these glasses can provide users with some simple auxiliary information, but complex information is powerless. 1, Monocular glasses: Google Glass, monocular rendering information, navigation, SMS, telephone, video and other functions, because it is one-eyed, unable to render 3D effect, and due to the appearance of the reasons for limited application scenarios. 2, Binocular: Meta Glass, binocular image, use binocular parallax can produce 3D effect that developers want. By detecting and supplementing the actual scene, the wearer gets the information that the real world cannot get quickly, and because the interaction is more natural, these virtual items are more realistic.
Third, the future of augmented reality in the future, we wear glasses or contact lenses will again change our communications equipment, office equipment, entertainment equipment and so on; In the future, we no longer need computers, mobile phones and other entities, just in the eyes of the impact of the projection screen, can create a floating screen and 3D three-dimensional operation interface; in the future, The boundaries of the human eye will be opened again, the boundaries of the hands will be once again broken, thousands of of kilometers away from the friend can immediately appear in front of you face in the conversation, you will also touch the unreal world of anything; in the future, a wave you can completely immerse in another virtual world, a cup of tea, a sea, even another life, Millions of possible lives that the real world cannot reach.

Iv. Introduction to Binocular imaging principles (self-organizing, welcome correction)

Divides the three-dimensional imaging effect into three latitudes: proximity, front and back, and depth.

Distance: The whole scene in the mind of the Near and far effect;

Before and after: the image in front of the screen (out of the screen effect) or after the screen;

Depth: The level of the distance from each object in the scene;

1, near and far adjustment:

The distance between the scene and the left and right eye is determined by two images;

When the stereo image is in front of the screen, the farther away the two images are, the closer the images are.

When the stereoscopic image is behind the screen, the farther away the two images are, the farther the images are.

2, front and rear adjustment:

Left (right) eye to left (right) camera image, then the image is behind the screen;

Left (right) eye to right (left) camera image, then the image is in front of the screen;

3, the depth adjustment:

The distance between the two cameras of the 3D camera is determined;

The distance is large, the depth is large, the distance is small;

Because the human eye distance is about 65mm, the brain has been accustomed to the depth of field effect of this goal distance, I think that to restore the real scene effect, camera spacing 65mm or more reasonable.
V. Existing wearable virtual reality or augmented reality eyewear products and their technical categories

Simple research Report on augmented reality glasses

I. The development history of augmented reality eyewear (argumented Reality Glasses)

The Enhanced World Exposition (Argumentedworld Expo) showcases the development history of augmented reality eyewear for nearly 50 years, starting with the advent of the first generation of the "Damocles Sword" of the University of Utah scientist Ivan in 1968, and the development of augmented reality eyewear has never stopped.

After countless scientific and technological efforts, augmented reality glasses have been updated iterative first-generation helmet-type single-screen display, the second-generation head-hoop swing display, the third generation of glasses-type single crystal display, know today's fourth generation of various 3D-enhanced glasses-type products, has been described as a variety of schools, flowers.

Second, the mainstream augmented reality glasses to achieve technical means 1, transparent display

Epson MOVERIOBT-200 Smart Glasses

Most of the smart eyewear products based on Google Glass are mainly transparent display technology, unlike Google Glass glasses, Epson Moverio BT-200, although also using transparent display technology, but the difference is that it has embedded a transparent display on two lenses , so it can form a 3D stereoscopic visual effect in front of the eyes.

2. Virtual Retina Display (retinal) technology

The retina display is capable of projecting images directly onto the retina of the user through a low-intensity laser or light-emitting diode, with an unobstructed view. This concept was proposed more than 20 years ago, but until recent years technological advances have made various retinal displays feasible. For example, the edge emitting light emitting diode, which is more than the surface emitting diode light output power, but less than the power requirements of the laser, it is applied to the retina display, can provide a higher brightness and lower cost choice. Compared with traditional displays, the retina displays have a higher luminance-to-power ratio and a correspondingly large reduction in energy consumption.

VRD is a bit like the traditional CRT TV imaging principle, the electron gun casts light on the glass screen. In the application of VRD glasses, there is no glass that absorbs and forwards light into the real world, and their VRD images are projected directly onto the retina of the user's eye.

In this way, VRD technology will make ar feel more than a traditional display. Because the traditional display technology, the image is layered in the real world, the huge text or hint information will float on the reality. The images produced by the VRD device will become part of your real vision, and you will be fully integrated into the reality, without just thinking that your vision is covered by certain information. In practical application, many practical problems can be solved. For example, when you remotely control a robot, you want to get the robot's "fullscreen" first-person view, rather than a video-based display in the upper-right corner of your field of view. One-eyed Google glasses, more unlikely to let you have this immersive feeling.

The glasses that are now using VRD technology are mainly the glyph of the Avegant company.

3, semi-transparent LCD projection of the light

Projection module

Like any other spectacle device, it is also a projection type, with an extremely compact projector hidden in the frame and left and right. The image on the semi-transparent LCD is projected onto the sub-optical lens by the LED light source, providing stereoscopic vision. The projector's Tft LCD resolution is 960x540 pixels.

Metaglass Projection Module

Lens

The use of translucent optical lens, so that you can see the reality of the scene, but also superimposed on a layer of video from the projector.

Metaglass camera

4. Tof Camera

It consists of a pair of HD cameras and an infrared detector, which allows for deep probing. The so-called TOF is the abbreviation of time of flight, that is, the duration of the light, and by measuring the transmission delay between pulses, the depth information of the object can be obtained.

This module is responsible for a large number of responsibilities, including gesture recognition, QR code (one of two-dimensional code) tracking, feature tracking, inertial measurement unit, which is the core input components of the glasses.

Finally, some official parameters are given:

Dual 960x540 pixel through Tft LCD display, 23° Vision 720p RGB camera X-ray infrared depth detection camera tri-axis accelerometer, tri-axis gyroscope, tri-axis Compass

5. Monochrome Glass Projection

The core feature of the Glass up is a miniature projector on the right side frame that casts monochrome images on the right mirror surface, allowing you to read information, text, or browse pictures. Although not as real-time as Google glasses to capture or video, but compared to the price and appearance, is enough to be exciting.

Iii. Some ideas--a new interaction 1, glasses a few ideas

1) Basic conditions: not tired eyes, beautiful appearance, interactive nature, development fluency;

2) Scene acquisition: Need to be aware of the external scene, or even the ability to rebuild;

3) display mode: I think the way to achieve the desired result is to be displayed on the screen, but there seems to be better technology in the study, such as the Secret Project of Magic Leap;

4) It needs to be used in a stunning way, followed by independent development and commercial application.

5) Create new ways to display, interact, and create new experiences.

2, the new interactive system vision

1) Basic callable interface: Two-eye display, two camera image, gesture acquisition, gesture depth, tri-axis accelerometer, gyroscope, GPS, network, Bluetooth external connection device interface

2) Basic interaction logic:

L two sets of coordinates: relative to the real world (can be fixed screen, fixed objects and other display effects), relative to the glasses (can follow the head position display);

L Effective Fingertip marking: the current identified between the finger mark out, user-friendly perception and adjustment;

L can touch: relative to the real distance, the object touched by the finger has a certain response (such as the touch object is relatively bright, or the fingertip is relatively bright);

L Rotatable: Space expands from plane to real world, objects can be rotated and scaled arbitrarily

L Regular: The window or object in the field of view by coordinates

3) Some specific interactive functions

L push forward with two fingers and forward all application icons from behind, and all open applications, arranged around the field of view

L double-handed fingers to the sides, enlarge view, picture, etc.

L Arm down, exit the current application

L single finger, drag the smallest movable object, and select text, rotate the object, including list, drag the interface, zoom the touch of the picture, etc.

L two fingers from pinch to open, realize open file function

L Three-finger scrolling page

L single-finger long-touch or two-finger touch to achieve auxiliary tap (right button)

L left two fingers open, with right hand multi-choice

L Select one hand, the other hand is removed from the hand to achieve the copy function

L Screen Lock function: When the user needs to temporarily fix all the content, to prevent the use of misoperation;

L Long distance hint or collect to backstage: when the user leaves fixed screen a certain distance to take effect;

Welcome to Supplement

Thank you

Virtual reality and augmented reality (spectacles or helmets) status and future-introduction