Clever use of hadoop large data processing functions

Hadoop's big http://www.aliyun.com/zixun/aggregation/14345.html "> Data processing capabilities can be used to mine data, explore relationships between seemingly unrelated information, As well as quick fixes for software engineers using traditional technology to solve the problem of digging, the large data processing function of Hadoop has so many uses software professionals have never been surprised.

Are hospitalized patients suffering from staphylococcus infections? When talking about solving real-world problems with a variety of nosql and Hadoop methods, Hortonworks, senior director of global education, Danielle Tomlinson, talked about an interesting case where , some data on their health habits were collected through the use of radio frequency identification techniques in the badges of health care professionals. "They put a sensor in the sink," Tomlinson said. "They were able to see which doctors did not spend enough time on the hand-washing station, leading to the spread of the disease." ”

Solve large data problems in real time

Of course, the best thing about Hadoop is its ability to handle huge amounts of data in real time. How does a developer at the depths of a data center know how traffic is on the freeway? Some cities, according to Tomlinson, only track GPS positions on millions of of mobile phone users, analyze that data, and build real-time traffic reports based on how the phone is moving in traffic. The collection of large numbers and large data processing are done on the Hadoop platform.

Of course, for most business Java professionals, Big data is still a mystery, but Hortonworks decided to change the phenomenon. For those of you who are learning Hadoop, Hortonworks Sandbox is a smart start because it provides a personal, portable Hadoop environment and a series of interactive Hadoop instructions. All of this is packaged in a virtual environment where you can get it and run it within 15 minutes.

Hortonworks Sandbox is a good start for software architects looking for solutions to big data problems, or for application developers who are reviewing new technologies. But note: Hadoop is addictive. Soon, all the problems look like big data problems, and then you want to use Hadoop to solve every big problem with data processing.

Original link: http://www.searchsoa.com.cn/showcontent_74290.htm