Twitter will open-source MySQL/Hadoop transfer Tool

According to foreign media reports, Twitter plans an additional part of the open-source Hadoop-happy architecture, which is used for internal data analysis. As a well-known Crane, this tool is used to convert MySQL to Hadoop. This open-source data analysis platform is built on Google's private infrastructure.

Twitter uses Hadoop for data analysis, and the platform is also used on the site, including the Twitter name search function.

Most of Twitter's table data is stored in MySQL, and only a small part is stored in Cassandra. The Technical Director of Twitter said that what to do is to end MySQL table store in some places.

Therefore, Crane is developed to migrate data from MySQL to HDFS or Hadoop HBase.

Article reposted from: Open Source Chinese Community [http://www.oschina.net]
Title: Twitter transfers open-source MySQL/Hadoop tools
Address: http://www.oschina.net/news/10164/Twitter-to-open-source-MySQL-to-Hadoop-tool