VMware extended Large data attempts to virtualize Hadoop

VMware announces that it will allow vsphere to manage the Hadoop cluster. As a result, thousands of VMware Enterprise customers will be able to use the software they already know to control the Hadoop deployment. Technically, this improves the company's level of running Hadoop nodes in virtualized infrastructures, while bringing the benefits of virtualization to large data platforms.


VMware has recently launched the VMware vsphere Big Data Extensions, which will allow the company's popular infrastructure management software to control the Hadoop clusters established by enterprise customers. The extension still requires a basic Hadoop platform, Hortonworks, MAPR, Cloudera, or VMware partner Pivotal are distributed based on this open-source Apache code. This large data extension allows these assignment tasks to be managed through vsphere. "VMware enables companies to host their own large data as services," said Michael Matchett, senior analyst at Taneja Group. ”


VMware through its Serengeti projects, the goal of the project is to optimize the Hadoop cluster to run on the virtualized infrastructure. Matchett said it was a very important step in the project. Running a Hadoop node on a virtual machine, rather than running on bare metal, brings the same advantages as a virtualized computing server: More efficient use of hardware resources and more flexible management of systems. "You can host Hadoop in a virtual environment because it allows you to mix other workloads and leverage the benefits of the infrastructure across multiple clients," says Matchett. ”


Other companies are also trying to virtualize the Hadoop cluster. Amazon's cloud computing services offer elastic Map Reduce (EMR) products that are essentially a common cloud service similar to Hadoop. VMware is primarily targeted at private cloud and client deployments.


additional support for vsphere may also herald other initiatives by VMware. For example, VMware may extend the platform to allow easy migration of vsphere managed Hadoop workloads by using the company's upcoming public cloud offerings, which are expected to be launched later this year. Other companies, notably Microsoft, will also allow their own management software to control the Hadoop release.


　　VMware's new features are part of a public beta, and customers can use vsphere author this week to sign up for the test, which is expected to be officially launched at the end of the year. In addition to announcing this extension, VMware says the Serengeti project supports the latest open source code for Apache Hadoop, including the new yarn feature, which some in the Hadoop community think could lead to more new applications based on the Hadoop platform.