Apache Cloud Platform

VMware today unveiled the latest open source project--serengeti, which enables companies to quickly deploy, manage, and extend Apache Hadoop in virtual and cloud environments. In addition, VMware works with the Apache Hadoop community to develop extension capabilities that allow major components to "perceive virtualization" to support flexible scaling and further improve the performance of Hadoop in virtualized environments. Chen Zhijian, vice president of cloud applications services at VMware, said: "Gain competitive advantage by supporting companies to take full advantage of oversized data ...

Companies such as IBM®, Google, VMWare and Amazon have started offering cloud computing products and strategies. This article explains how to build a MapReduce framework using Apache Hadoop to build a Hadoop cluster and how to create a sample MapReduce application that runs on Hadoop. Also discusses how to set time/disk-consuming ...

Currently, the Hadoop distribution has an open source version of Apache and a Hortonworks distribution (HDP Hadoop), MapR Hadoop, and so on. All of these distributions are based on Apache Hadoop.

Recently, the Apache Software Foundation (ASF) announced that the Apache Deltacloud has upgraded from the Apache incubator (Apache incubation project) to the top open source project (TLP). Deltacloud, an Open-source API developed by Redhat in September 2009, defines a restful Web service designed to provide a unified approach to interacting with cloud service providers and cloud resources. In addition, Deltacloud also includes some ...

1. As with most other distributed systems, the Apache Mesos, in order to simplify the design, also employs a master/slave structure that, in order to solve the master single point of failure, makes master as lightweight as possible, and the above number It can be reconstructed through various slave, so it is easy to solve the single point of failure by zookeeper. (What is Apache Mesos?) Reference: "Unified resource management and scheduling platform (System) Introduction", this article analysis based on MES ...

"Editor's note" Recently, MAPR has formally integrated the Apache drill into the company's large data-processing platform, and opened up a series of large database-related tools. Today, in the highly competitive field of Hadoop, open source has become a tool for many companies, they have to contribute more code to protect themselves, but also through open source to attack other companies. In this case, Derrick Harris made a brief analysis on Gigaom. Recently, Mapr,apache Drill Project founder, has ...

1. The foreword Scheduler is the core component of Mesos, which is mainly responsible for allocating resources on each slave to each framework, and the common scheduling mechanism is Fifo,fair scheduler,capacity Scheduler,quincy,condor. Mesos in order to support the multi-framework access, the two-layer scheduling mechanism is adopted, first, the resource is allocated to the framework by the allocator in Mesos, then the framework itself ...

This year, big data has become a topic in many companies. While there is no standard definition to explain what "big Data" is, Hadoop has become the de facto standard for dealing with large data. Almost all large software providers, including IBM, Oracle, SAP, and even Microsoft, use Hadoop. However, when you have decided to use Hadoop to handle large data, the first problem is how to start and what product to choose. You have a variety of options to install a version of Hadoop and achieve large data processing ...

1. The introduction of Mesos is mainly composed of four components, respectively, Mesos-master,mesos-save,scheduler and executor, each component is based on protocal buffer actor Model for communication (using Open Source Library libprocess). In other words, each module is a server (in fact, the socket server), listening to messages from other modules, once received a message ...

"Csdn Live Report" December 2014 12-14th, sponsored by the China Computer Society (CCF), CCF large data expert committee contractor, the Chinese Academy of Sciences and CSDN jointly co-organized to promote large data research, application and industrial development as the main theme of the 2014 China Data Technology Conference (big Data Marvell Conference 2014,BDTC 2014) and the second session of the CCF Grand Symposium was opened at Crowne Plaza Hotel, New Yunnan, Beijing. Figuratively Architec ...