Big data ushered in the open source era Hadoop can find gold?

IDC's Big Data market forecasts, big data will usher in a big era. Analysts said the big data output would reach $16.9 billion trillion by 2015. But it's not clear how new the market is, or whether big data start-ups will actually scratch a gold rush.

Is this open source hype? Repeat in the style of big data?

Probably, yes. Open source has been popular in the tech press for years because it has promised to reduce costs and gain enterprise-class it freedom. Ultimately, there are only a few emerging enterprise investments (MySQL, JBoss), but for most businesses, the real value comes from it vendors and in-house IT organizations, using open source to provide raw materials for their software projects. Open source is increasingly not about sales, but code, which is what it is designed to do.

Now, a lot of VCs are putting a lot of money into big data. Start-ups want to be rich, and some do. But make it clear: data analysis has long been a part of the technology industry.

Now we might call it "big data," but it's at least a far-away industry for the next 20 years, writes one blogger.

Call it a data warehouse, data mining, or business analysis. You can call whatever you like. It's not new, not even a game-changing player, but many industries need to optimize data collection and analysis for a long time, so it makes sense to improve technology.

However, there are two aspects to be noted for the new Big data (which can also be open source): Cost and scale.

These two factors may be more important than others, and the phenomenal growth of Hadoop has even left the "data mining" out of its former status. Hadoop enables the collection and analysis of data to be low-cost, scalable, and commercially available hardware. In the past, financial services companies that ran credit operations had to pay IBM large cheques for professional hardware and software.

It's not going to happen again. Hadoop has a lot of popular data and translates it into a competitive market.

Hadoop does not appear out of thin air. A variety of other things, including upgrading infrastructure, mobile devices and social data, will benefit people who are highly relevant to Hadoop. Importantly, before open source, the real value of Hadoop and large data movement was owned by the enterprise and not paid to different vendors. Yes, this will be a good way for hadoop start-ups, but the bigger winner is the internal Hadoop expertise that has been developed.

In short, big data is big. But it is not new, and the innovation is to reduce the cost of data warehousing by processing large amounts of data. Like open source, most of the value of large data is used by in-house teams to know how to apply their expertise to the data they collect. The good news is that some companies will get rich from the "gold Rush" of big data.

Better news is that most of the companies that are rich will continue to use Hadoop and large data technology.

(Responsible editor: The good of the Legacy)