Recently, a student asked me about the difference between the hadoop Distributed File System and openstack Object Storage Service, and said a few words to him. I personally think that data processing and storage are preferred. There is no absolute quality. It should be used based on specific applications.
I found some online saying: this is the original: http:// OS .51cto.com/art/201202/314254.htm
"Both
With the rapid development of the information age, big data technology and the private cloud environment are both very useful. However, if they are combined, enterprises will obtain huge profits. Although the combination of the two will make the environment more complex, enterprises can still see the significant synergy effect of combining the openstack private cloud with the Apache hadoop environment. How
Recently, someone mentioned a problem in Quora about the differences between the hadoop Distributed File System and openstack object storage.
The original question is as follows:
"Both HDFS (hadoop Distributed File System) and openstack Object Storage seem to share a similar objective: To achieve redundant, fast,
A
The Amazon cloud of OpenStack, which is modeled after Google's cloudOpenStack focuses on virtualization/virtual machines and their associated services, and Hadoop is focused on massive data analysis and processing.
Two
The main purpose of 2OpenStack is to make a complete cloud computing infrastructure. Includes cloud computing (Compute), Network, object storage (objects store), image file Storage (image)
Introduction to OpenStack extension topic in frontLearning Goals:
Learn about the automated deployment of OpenStack
Understand the issues that exist when Hadoop is cloud
Learn about Ceph and the application of Ceph in OpenStack
Learn about OpenStack and
Highly Available
Concept
Level
Chen Ben
How to Achieve
Classification
The ha of OpenStack
virtual machine ha
compare
application level ha,heat ha template
component ha
mysql ha
Three ways-master-slave synchronization, Main and Standby mode
three ways of two
Introduction to OpenStack Architecture analysis written in frontLearning Goals:
Understand the logical relationships of OpenStack components;
Understand the communication and deployment relationships of the various components of OpenStack;
Understand the work flow of OpenStack;
Next I will master:
This tutorial is based on the Ubuntu12.04 edition, and it will help readers build a openstack minimized installation. I am the top of the Wuyue, translation more use of transliteration method, so the individual words and the original discrepancy, please understand. I am not a major in English, I think the most important thing is to understand the technology, and not the four level and grind in the boring English-Chinese translation, so my goal is loya
ceilometer provides monitoring, metering services, Horizon provides user interface, Barbican provides secret key management services.
The fourth tier is mainly consumer services, so-called consumer services, mainly refers to the fourth tier of services need to use the first three layers of services to work.
The fourth floor mainly includes heat, Magnum, Sahara, Solum and Murano, of which heat mainly provide orchestration services, Magnum mainly provide container services, Sahara mainly
first, the basic knowledge of OpenStackOpenStack is a free software and open source project that was developed and initiated by NASA and Rackspace to Apache2.0 licenses (compatible with GPLv3 and DFSG).OpenStack is an open source cloud computing management Platform project, composed of several major components to accomplish specific tasks. OpenStack supports almost all types of cloud environments, and the p
Use
AWS Services
OpenStack Services
The Chinese interpretation of OpenStack words
Dashboard
AWS Console
Horizon
The horizon of the world;
Calculate compute
EC2
Nova
Star
Internet
Vpc
Neutron
Neutron
Object storage
S3
Swift
Swift; agile.
Block storage
Ebs
Openstack official website content: http://docs.openstack.org/grizzly/openstack-object-storage/admin/content/
Because I only focus on the part of openstack Object Storage, I did not write anything related to other modules (or I am relatively lazy). I may add it if necessary in the future.
The translation level is limited. If a netizen finds an error during re
Install times wrong: Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (site) on project Hadoop-hdfs:an Ant B Uildexception has occured:input file/usr/local/hadoop-2.6.0-stable/hadoop-2.6.0-src/hadoop-hdfs-project/ Hadoop-hdfs/target/findbugsxml.xml
Hardware requirements
Installing OpenStack
1 Installing the CentOS 65 system and emptying the Iptables firewall rules
2 The required toolkit for installing the system includes OpenStack-dependent and cloudfoundry-dependent
3 Installing Epel Repo
4 Upgrade Current system
5 Installing OpenStack Repo currently cloudfoundry can
need to run these commands to start working in a new repository.OpenStack provides open source software for building private cloud and public cloud.The OpenStack Foundation facilitates the development, distribution and adoption of OpenStack cloud operating systems.Read more DeveloperWorks articles about OpenStack: "Enable DB2 in
As a core tutorial for OpenStack, we have come to the final summary.
OpenStack currently has dozens of modules, this tutorial discusses the most important core modules: Keystone,nova,glance,cinder and neutron. Please look at the following figure:
This figure is truncated from https://www.openstack.org/software/project-navigator/, which is the official 6 Core Service defined by
Robust management and security model
An open architecture
Hybrid Cloud Compatibility
Scalable, resilient architecture
Comprehensive support and services
If your company needs an enterprise-class OpenStack solution, read on to see what a true enterprise-class private cloud can and should offer. For the next two weeks, I'll write a series of blogs that include multiple sections, "6 big needs for enterprise-class
10. OpenStack Object Storage Service (SWIFT)
configuration: I added two hard drives (SDB,SDC) to the compute node for storage, and the compute node in my build is the storage node, because the computer can't pull more virtual ...
Brief introduction:
There are four main components of Swift: Swift-proxy-server, Swift-account-server, Swift-container-server, Swift-object-server
Swift-proxy-server (Proxy service): Externally provided object service API
functions are implemented, enabling OpenStack to work in the main standby mode (Active-backup this high availability mode).Quantum only requires an instance of Nova-network to run, and therefore cannot work with Multi_host mode.Quantum allows a single tenant to have multiple private dedicated L2 networks, which, by enforcing QoS, should enable Hadoop clusters to work well on the Nova node in the future.For
Well, we've already installed fuel master, and now we're ready to install OpenStack, so you can see the OpenStack main interface when the installation is complete.Continue yesterday, we went into the fuel UI and then "new OpenStack Environment" to create the OpenStack deployment environment.650) this.width=650; "src="
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.