How open source technology and cloud computing spark

Source: Internet
Author: User
Keywords Cloud computing open source data processing cloud computing

Cloud computing has not been overlooked, and recently, according to army and contractor executives working on the distributed general ground System-Army standard Cloud (DSC) in Afghanistan, cloud computing has been used militarily and has changed military intelligence forever.

"From a technical point of view, you can have almost unlimited processing power, unlimited memory, and unlimited storage in response to data processing and management and data fusion," says Shane Miller, head of DCGS's main contractor Booz Allen Hamilton. Almost unimaginable

since the 75 million records generated by Afghanistan's Enduring Freedom of movement (Twist enduring Freedom) and inbound data from 600 feed sources have been kept in the cloud , the cloud computing approach has provided a huge storage capacity for the military. To establish DSC, the army relies on Open-source platforms and software available from commercial and government departments to avoid costly licensing fees and to control development costs within a highly regulated budget.

The DSC infrastructure consists of 228 servers, more than 1800 CPUs, 100 dual 6 core processors (operating at 2.80 GHz) and 128 dual 4 core processors (running at 2.93 GHz). This infrastructure requires 13.92 megabytes of RAM and 1.032TB of hard disk storage.

Miller said the army as a system integrator for the project not only owns the open architecture platform used for the project, but also has a large number of software components.

For DSC, the Army employs five key Open-source technologies, Hadoop, Hadoop Core, Accumulo, Condor, and Solrcloud.

DCGS Project manager Col. "Hadoop is an open source computing system that many cloud technicians have been looking for," says Charles Wells. ”

Hadoop is a project from the Apache Software Foundation, which is typically used to handle large data. The DSC developer deploys the Hadoop Distributed File System (the open source version of the Google File system) to allow for rapid and reliable data analysis of both structured and unstructured, extending to exabyte levels.

Developers deployed the Hadoop core parallelization infrastructure for a comparable open source version of the MapReduce programming model to parallel tasks across a large number of nodes.

Open Source Tool Accumulo provides developers with a powerful, high-performance data storage and retrieval system. Using Accumulo, they can use open source technology to store petabytes of structured data.

Condor is an open source management infrastructure platform. Developers chose Condor because it provides a high throughput computing environment that provides the flexibility they need for cloud computing.

DSC features a search structure similar to the Internet, which enables them to get query answers in seconds, a function that is implemented through Solrcloud, and Solrcloud is a distributed index management feature that enables high-speed search.

Wells says using COTS hardware and open source software platforms to deploy cloud computing environments can provide the military with processing and storage capabilities, while making the army's intelligence cloud an efficient and high-performance system.

"Edit Recommendation"

The era of cloud computing we need a mix of it talent in the future how will you buy cloud computing resources? Microsoft November 1 Promotions Azure cloud computing Ucloud cloud computing Joint monitoring treasure to build three-dimensional cloud monitoring System "responsible editor: Xiao Yun TEL: (010) 68476606"

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.