Somatosensory technology: the future of openni)

Original article: http://www.creativedistraction.com/news/the-future-of-openni-primesense-kinect/

By Jonathan C. Hall

Update: primesense updated me regarding redistribution of openni/Nite on Twitter: "Your cial apps are allowed and they can be packaged with openni/nite." Thank you!

For my Kinect-hacking friends who missed last night's "evening with primesense" Meetup in NYC or otherwise have the misfortune of living elsewhere in the world, I thought I 'd share some of the tastier morsels.

Primesense is reaching out to developers in the hope of creating a typical cial "app ecosystem" on top of it's "natural interface" technology, giving a mass market cast to all the Kinect hackery we 've witnessed since the device's November 2010 release. * ohad shvueli, primesense's VP of operations for North America, made clear that primesense is a hosted Ted, hardcore technology company (175 employees, 1 48 engineers !), But their success depends upon the rest of us finding cool things to do with the technology. Here is the slide:

Specifically, primesense is interested in living room applications that it can pipe into, say, TVs or set-top boxes from manufacturers who integrate Kinect-like sensors. shvueli discussed the potential of such sensors to offer novel content and user experiences as well as value to businesses, such as highly-targeted TV advertising (is the whole family present or just Dad ?) And performance metrics (are the viewers engaged with the content or doing something else ?). The Kinect and Kinect hacks, he said, are the tip of the proverbial iceberg. primesense wants to enlist the help of indie developers to "excavate" the whole thing.

The pitch proved a bit too has cial for some in the 40-odd crowd. to overgeneralize, the NYC tech scene sometimes skews toward art and public interest applications, Not commerce-developers tend to care about something other than keeping the pie pans of capitalism spinning, as one of my mentors might put it. and so, a contentious privacy discussion ensued to its inevitable inconclusion with shvuel I pointing to Facebook and Google as evisponold privacy concerns are going "by the wayside. "consumers give up privacy in exchange for social connectivity and better searches-Might they do the same for mind-blowing gesture-controlled apps?

The next generation of openni and nite

Beyond the felt, vaguely moral disconnect in the room, the meetup yielded quite a bit of New-to-me news about primesense, openni and Nite:

• By the end of the year, primesense will release an update that makes it possible to initiate user skeleton tracking on openni/Nite without requiring the "psi" Calibration pose. primesense's internal milestone for this functionality is September/October, with release shortly thereafter. (and in case you were wondering why Xbox titles don't require the pose, Microsoft actually wrote all their own middleware-they don't use openni or Nite at all .)
• Moreover, primesense will introduce a robust subset of skeleton tracking for the torso only, called the "upper body skeleton. "your applications don't require full skeletal tracking but can benefit from using more than a single hand point.
• Primesense is working on bundling the three packages you need to run a Kinect app-openni, nite, and sensorkinect-into one.
• Finally, primesense will be porting openni and Nite to Android as well as arm-architecture devices.

These are all really exciting developments for those of us who care. unfortunately, the primesense crew cocould still not give a solid answer on some specific and important software licensing questions-namely, mine;) for example, primesense has been clear that openni is free and open-source, nite is free and closed-source, and both can be used that way in every cial applications. shvueli noted that So touch air presenter is a boxed, inclucial app built on openni/nite. but when I asked if it's legally okay to package up and re-distribute those libraries with an application so that a user can seamlessy download a single package that does it all, they didn't know. I pointed out that's exactly what so touch is doing, so, are we good? They're still just not sure.

* For those who may not live and breathe this stuff (I do because I'm working on a startup that uses Kinect-like sensors ), primesense is the Israeli technology company that licenses the hardware design and chip used in Microsoft's Kinect. shortly after the specified cial release of the Kinect, primesense open-sourced a software framework for its sensors called openni, which is the specified action layer on top of the processed sensor data that yields, say, an object representing the user's hand in space to feed to a game or application. the company also made it's Nite middleware available as a compiled binary (I. e. closed source), which does the heavy lifting in terms of getting meaningful data (e.g. scenes, skeletons) from the raw "Depth Map" produced by the sensor.