Terms related to Nui

Share the terms mentioned in Mr. Yu Tao, a senior Microsoft Enterprise architect and application development expert, for reference. Some terms are detailed based on your understanding:

 

1. beamformingalgorithm)

An array signal model based on the current array is used to determine the direction of the sound source on the horizontal plane;

 

2. cdrp (color depth register pixel)

Color and depth pixel registration process;

 

3. DMO

DirectX Media object

 

4. Deep data stream)

Data generated by the deep image camera. Deep data streams are also composed of Deep Image frames. In each frame of deep image, the height of each pixel is 13 BITs representing the distance from the infrared camera to the nearest object.

 

5. Kinect sensor)

The sensor connects to the PC using a USB excuse and consists of the following parts:

• Microphone Array microphone array;
• IR emitter infrared transmitter;
• Color Sensor RGB camera;
• IR depth sensor infrared depth image camera;
• Moving touch tilt motor angular control drive motor;

 

6. latency

This refers to the synchronization time when data collected from the Kinect device is transmitted to the application through USB,LatencyThe length of time depends onCPU processing speedAndUSB transmission rate.

 

7. Natural Human-Computer Interaction Interface

The natural user interface provides more natural interaction methods such as voice, gesture, touch, and body feeling. The word "natural" is relative to the graphic user interface (GUI, gui requires users to first learn the operations pre-configured by software developers, while Nui only requires people to interact with machines in the most natural ways of communication (such as language, voice, and text.

 

8. Kinect USB synchronization Interface

Kinect connects to a PC through a USB interface. This interface supports four types of data transmission: synchronization, control, terminal, and batch. The synchronous interface of the Kinect device is used to obtain audio, color image streams, Deep Image streams, and related data streams from the sensor. This interface allows the device to support constant transmission bandwidth.

 

9. YUV stream

A digital video data. The YUV and RGB formats are different. It is a brightness signal plus two chromatic aberration signals to express the image, where Y represents the brightness,UVRepresentativeColor DifferenceIncluding two components (CB and Cr) that constitute the color, used to detect different chromatic aberration signals. (Also available in Houdini$ CB, $ Cr, $ CGAnd other variables with the same functions. They are also used to detect chromatic aberration signals)

Different YUV formats represent different image compression methods. Common formats include YUV 4: 2: 0, YUV 4: 2: 2, YUV 4: 1, YUV 4: 4: 4. The storage modes are packed and plannar ).

 

10. Light Coding

Primesense named its deep measurement technology light coding. as its name implies, it is to compile code for the space to be measured by lighting with a light source.Structured Light TechnologyBut unlike the traditional structured light method, the light source is not a two-dimensional image encoding with periodic changes, but a "body encoding" with three-dimensional depth ", this light source becomesLaser Speckle(Laser Speckle) is a random diffraction spot formed when the laser is shining on a coarse object or penetrating the glass.

These speckle are highly random and will change the pattern with different distances. That is to say, the pattern of any two places in the space is different. As long as such a structured light is attached to the space, the whole space is marked and an object is put into this space. You only need to look at the speckle pattern on the object to know where the object is located. Of course, before that, we need to record the pattern of the whole space, so we need to first calibrate the light source.

 

11. thread security and garbage collection

The static public members of the Microsoft Kinect class are thread-safe. thread security needs to be considered in other multi-threaded scenarios. For complex and multi-threaded applications, you need to consider locking and defensive code to ensure thread security.

In addition, the garbage collector must release resources in time to prevent memory leakage.

 

The above are all the terms to be shared in this article, hoping to help you understand the terms you encounter during development.

 

Terms related to Nui