ceph hardware

Someone asked me, how did you manage to do the unified storage? I smiled, loudly told him: Ceph in hand, the world I have. Ceph is a unified distributed storage system designed for outstanding performance, reliability, and scalability. After the adoption of OpenStack as the eldest brother is a very out of hand, by everyone's extensive attention. Of course, this is because it provides a variety of reliabl

Learn about Ceph, an open source distributed storage system that enhances your OpenStack environment Ceph is an open-source, distributed storage System that complies with POSIX (Portable operating system for UNIX) and runs under the GNU general Public License. Originally developed by Sage Weill in 2007, the project was founded on the idea of proposing a cluster without any single point of failure to ensure

[TOC]k8s Mount Ceph RBDk8s Mount Ceph RBD There are two ways, one is the traditional way of PVPVC, which means that the administrator needs to pre-create the relevant PV and PVC, and then the corresponding deployment or replication to mount the PVC use. After k8s 1.4, Kubernetes provides a more convenient way to dynamically create PV, that is, Storageclass. Using Storageclass, you do not have to create a fi

1. Installing the PYTHON,UWSGI,NGINX EnvironmentPIP installation omittedYumgroupinstall "Developmenttools" Yuminstallzlib-develbzip2-develpcre-developenssl-develncurses-develsqlite-develreadline-develtk-develyuminstallpython-dev Elpipinstalluwsgi2. Understand the Restful APIHttp://www.ruanyifeng.com/blog/2014/05/restful_api.html3. Understanding the Flask FrameworkHttp://www.pythondoc.com/flask-restful/first.html4. Call the Python plugin libraryhttp://docs.ceph.org.cn/rbd/librbdpy/5. Write Interf

Thomas is my pseudonym used by the Ceph China Community Translation team, which was first published in the Ceph China community. Now reproduced to my blog, for everyone to circulateCEPH ObjectStore API IntroductionThis article was translated by the Ceph China Community-thomas, Chen School Draft.English Source: The CEPH

Summary of common Hadoop and Ceph commandsIt is very practical to summarize the commonly used Hadoop and Ceph commands.HadoopCheck whether the nm is alive. bin/yarn node list deletes the directory and hadoop dfs-rm-r/directory.Hadoop classpath allows you to view the paths of all classes.Hadoop leave safe mode method: hadoop dfsadmin-safemode leave wordcount program: generate random text bin/hadoop jar hadoo

based on the high-speed configuration of the Ceph storage cluster environment, it is possible to do related object operations:1. Set the OSD pool Min_sizefirst look at the pool with the Rados command such as the following:#rados LspoolsDatametadataRBDThe default OSD number of Min_size is configured to 2, where an OSD example is required to set it to 1ceph OSD Pool get {pool-name} {key}ceph OSD Pool set {Poo

Ceph source code analysis: Network Module Because Ceph has a long history, the network does not use the epoll model that is currently commonly used, but uses a multi-threaded model similar to MySQL. Each connection (socket) has a read thread, read data from the socket continuously. A write thread writes data to the socket. Multi-threaded implementation is simple, but the concurrency performance is not flatt

Application and fault handling of CEPH in KVM virtualizationIn a distributed cluster, the user is provided with object storage, block storage and file storage.Benefits: Unified StorageNo single point of failureData multi-split redundancyScalable storage CapacityAutomatic fault tolerance and fault self-healingThree major role components of ceph and their rolerepresented as 3 daemonsCeph OSDMonitorMdsThere ar

Ceph's data management begins with the Ceph client's write operation, and since Ceph uses multiple replicas and strong consistency policies to ensure data security and integrity, a write request data is written to the primary OSD first and then primary The OSD further copies the data to the secondary and other tertiary OSD and waits for their completion notification before sending the final completion confi

Ceph RADOSGW Object Storage interface, research configuration for a long time, now share the following. The prerequisite for configuring RADOSGW first is that you have successfully configured the Ceph cluster to view the Ceph cluster through Ceph–s, in the health state. Here, the auth configuration of the

Nova ConfigurationDisk_cachemodes = "Network=writeback" (enabled)Change to Disk_cachemodes = "Network=none" (off) Ceph Configuration Open Ceph RBD CacheClientRbd_cache = TrueRbd_cache_writethrough_until_flush = TrueAdmin_socket =/var/run/ceph/guests/$cluster-$type. $id. $pid. $cctid. AsokLog_file =/var/log/qemu/qemu-guest-$pid. logRbd_concurre

In the case of a network, Ubuntu installation software is very convenient, to install Ceph, also on a command to fix, want to install ceph0.72 on ubuntu14.04, because the official source of Ceph Ceph-extra does not contain ubuntu14.04 trusty package, Ceph, which uses 163 of its source, is an unwanted version, so it com

The pool is a logical partition of Ceph's stored data, and it acts as a namespace. Other distributed storage systems, such as MogileFS, Couchbase, and Swift, have the concept of pool, but they are called different. Each pool contains a certain number of objects in the PG,PG are mapped to different OSD, so pool is distributed throughout the cluster. Apart from isolating data, we can also set different optimization strategies for different pool, such as number of replicas, number of data cleansing

Ceph practice summary: the configuration of the RBD block device client in Centos, cephrbd Before proceeding to this chapter, you need to complete the basic cluster building, please refer to the http://blog.csdn.net/eric_sunah/article/details/40862215 Ceph Block devices are also calledRBDOrRADOS. Block Device During the experiment, a virtual machine can be used as the