SQL Server introduces Hadoop large data processing capabilities-products and technologies

Microsoft has released early code that allows customers to access the Java architecture to SQL Server 2008 R2, SQL Server Parallel Data Warehouse, and next-generation Microsoft databases.

Doug cutting, inspired by Google MapReduce to invent Open-source Hadoop, has become, to some extent, an industry standard for processing large amounts of data on clustered servers, including Amazon, Web giants such as Facebook and Twitter also use Hadoop.

The industry believes Hadoop can be used to understand the details of millions of users ' preferences and status updates to change service responses. The goal of Hadoop is to penetrate more powerfully into mainstream it.

The Microsoft Research Department has been working on something very similar to Hadoop since 2006, known as "Dryad". Earlier this year, the program achieved Dryad through integration with SQL Server and Windows Azure cloud. Although Microsoft has not yet updated, it looks as if Dryad will become a powerful competitor on the SQL Server platform that affects large data enthusiasts.

Microsoft has now started to provide the connector for the Hadoop Connector for SQL Server Parallel Data Warehouse and Hadoop Connector for the preview version of SQL Server Community technology.

The connector is two-way, and you can migrate data forward or backward between Hadoop and Microsoft database servers.

Microsoft says the connector allows customers to analyze unstructured data in Hadoop and then return to the SQL Server environment for analysis.

The two connectors use SQL to Hadoop (sqoop) to transfer data efficiently between the Hadoop File System (HDFS) and the Microsoft relational database. The Parallel Data Warehouse uses the PDW Bulk load/extract tool for fast import or export.

SQL Server PDW customers can get this Hadoop connector from Microsoft, and regular SQL Server 2008 R2 clients can get Hadoop Connector for SQL Server code.