China Mobile Cloud computing technology system Research and "big Cloud" product development (2013)

From September 2013 to November, the total output of seven major milestones, including: Big Cloud 2.5 official release, co-organized CCF first big Data contest, NoSQL through acceptance, Jiangxi Comprehensive query storehouse on-line, Fujian Big Data Center launches, the BCH community starts the operation and the public cloud test commercial launches the integration and so on.

Outcome 1: Grand Cloud 2.5 officially released

L Results Description

December 4, 2013, the mobile Internet Conference officially released the 2.5 version of the big cloud products. Bill presided over the release ceremony, the Ministry of Industry and Telecommunications Institute Yu Xiaohui chief engineer to do a guest speech, Guangdong province, southern base general manager Lin, Jiangxi Branch and deputy general manager Huang Ghost Cloud users address, the research institute of Cloud computing system General Manager Sun Shaoling introduced the 2.5 version of the new features.

Sutra 2.5 focuses on the introduction of distributed relational database Bc-rdb and distributed resilient block storage System Bc-ebs two new products, the Bi-paas and Bc-hadoop two products have a major breakthrough in the function, and the release of the Bc-hadoop Open source community, called on the parties to join the community, to develop a suitable version of Hadoop for telecom operators.

• Results-specific outputs

"Big Cloud 2.5 Release Introduction"

L Results Landing and integration of the first-line situation

Sutra 2.5 Released Products Bc-rdb has been commercially available in Jiangxi, Bc-ebs will be used in the southern base of the public service cloud. Bc-hadoop has been applied in Anhui and Fujian, and will support the group's centralized platform in the future.

Outcome 2: Co-CCF first China Big Data Technology Innovation contest

L Results Description

China Mobile Research Institute of Cloud Computing Systems as a co-organizer, excellent completion of the first Chinese large Data technology innovation contest, the contribution of the competition, the cluster environment support, results assessment, technical review and other important work. The five finalists of China Mobile's two-track games were awarded two second prize and three third prize. According to the special topic of the students ' identification and paging black hole in the network management of China Mobile, the bottleneck of two typical large data scenes, the award-winning team results for the current network application provides a direct reference to the outstanding solutions. Competition stage, the Research institute cloud computing system based on large-scale computing laboratories, the adoption of self-developed China Mobile large cloud platform Bc-ec and Bc-hadoop products, for 248 teams, to provide a total of 744 virtual machines and large data processing required bc-hadoop, Hive, HBase, Impala, such as distributed cluster environment, provides a strong and reliable guarantee for the competition, and has been repeatedly thanked by the Main Committee and the participating teams.

• Results-specific outputs

Competition topic "Social circle construction and specific type of user identification" and "Paging black hole Analysis"

The results, source code and technical solutions of the 29 successful teams of "social circle building and specific type of user identification"

"Paging black hole analysis," The results of 7 successful teams, source code, technical solutions, etc.

L Results Landing and integration of the first-line situation

The analysis of the special topic of the students ' user identification and the paging black hole in the network management of China Mobile through the Division Two typical large data scene award-winning team provides technical solutions, procedures, source code can be directly in the provincial companies in the current network deployment applications.

Results 3:nosql resource pool through system acceptance

L Results Description

According to NoSQL equipment specifications, interface specification requirements for software development and self-test.

Through the acceptance test of the construction department in December, the test case pass rate is 100%.

• Results-specific outputs

"NoSQL System test Report"

L Results Landing and integration of the first-line situation

Bc-hugetalbe won the bid for the NoSQL system of a private cloud in South Base, which will provide storage and processing capability for cloud business. Currently through acceptance testing, waiting for further integration with cloud business.

Results 4: Jiangxi Company to "IOE" application pilot

L Results Description

Combined with "big cloud" Bc-rdb products, in Jiangxi Mobile Comprehensive query library system and terminal invoicing system to introduce distributed transaction database products, replace Oracle, reduce system construction maintenance costs, enhance system scalability.

• Results-specific outputs

Bc-rdb New Release version: BC-RDB 2.0.12 Version

L Results Landing and integration of the first-line situation

Comprehensive query library system has been successfully run for 2 months, stable operation, no serious bugs, during this period completed a number of feature upgrades. Phase two is importing data to prepare for pressure measurement.

Terminal invoicing system has completed the deployment, and the application of the function docking, import data, pressure measurement, performance basically meet business requirements, ready to go online.

Achievement 5: Fujian Big Data Center construction starts

L Results Description

In Fujian large data platform deployment bc-hadoop2.0, Fujian companies and the new World of integration of the bc-hadoop2.0 training, the configuration of large data platform to check and tune, to support the large data platform before the online test.

• Results-specific outputs

Training materials

Results Landing and integration of the first-line situation

At present, the large data platform has deployed 24 nodes, 154TB free space for online log processing.

Outcome 6: Sutra BCH Open Source Community launch

L Results Description

Start the big cloud Bchadoop open Source community, aiming at the demand of China Mobile IT system for Hadoop, the development of the open source Community model Bchadoop, United Asia Trust, and Huawei's Hadoop developers form the core members of Bchadoop Open source community, developing the billion-yang, Leicester, Newland , Bupt, Northeastern University, the Chinese Academy of Sciences and other commercial and university as users, collaboration to promote Bchadoop.

• Results-specific outputs

Bchadoop community: Include members, Bchadoop release homepage, bchadoop collaboration space, develop bchadoop baseline version, etc.

L Results Landing and integration of the first-line situation

In a number of provincial companies to open source model to promote the landing of Bchadoop, including Anhui large data platform, Fujian large data platform and Liaoning, Hebei, Jiangsu and so on.

Outcome 7: Public cloud Test commercial start-up integration

L Results Description

The China Mobile public Service cloud platform uses the large elasticity computing system BC-EC and the object storage systems Bc-onest as the basic ability, provides the cloud host and the cloud storage business. In response to the need for a public service cloud to test commercial online at the end of 2013, Bc-ec and Bc-onest project for the current network demand for sustainable development, BC-EC new virtual machine migration, online backup, high availability and IP unified management, such as about 20 new functions, completed the system high availability, performance optimization, Operation Tools, Monitoring alarm and other 16 new features development, and fully support the current network upgrade. Bc-onest upgrades the dependent underlying zk/hadoop/hbase with a ha-enabled version, upgrades Onest's own components, and improves the availability of its Component services. New key process monitoring and alarm requirements, logical rack distribution and other requirements, strengthen the system operation and maintenance capabilities. Add Windows client software to optimize business usage portal requirements and enhance user experience.

• Results-specific outputs

bc-ec2.5 software products and develop and upgrade documentation, Bc-onest software products and develop and upgrade documentation

L Results Landing and integration of the first-line situation

Completed the upgrading of the public service cloud test business and provided continuous three-tier support.