ceph training

1. Installing the PYTHON,UWSGI,NGINX EnvironmentPIP installation omittedYumgroupinstall "Developmenttools" Yuminstallzlib-develbzip2-develpcre-developenssl-develncurses-develsqlite-develreadline-develtk-develyuminstallpython-dev Elpipinstalluwsgi2. Understand the Restful APIHttp://www.ruanyifeng.com/blog/2014/05/restful_api.html3. Understanding the Flask FrameworkHttp://www.pythondoc.com/flask-restful/first.html4. Call the Python plugin libraryhttp://docs.ceph.org.cn/rbd/librbdpy/5. Write Interf

Thomas is my pseudonym used by the Ceph China Community Translation team, which was first published in the Ceph China community. Now reproduced to my blog, for everyone to circulateCEPH ObjectStore API IntroductionThis article was translated by the Ceph China Community-thomas, Chen School Draft.English Source: The CEPH

Summary of common Hadoop and Ceph commandsIt is very practical to summarize the commonly used Hadoop and Ceph commands.HadoopCheck whether the nm is alive. bin/yarn node list deletes the directory and hadoop dfs-rm-r/directory.Hadoop classpath allows you to view the paths of all classes.Hadoop leave safe mode method: hadoop dfsadmin-safemode leave wordcount program: generate random text bin/hadoop jar hadoo

based on the high-speed configuration of the Ceph storage cluster environment, it is possible to do related object operations:1. Set the OSD pool Min_sizefirst look at the pool with the Rados command such as the following:#rados LspoolsDatametadataRBDThe default OSD number of Min_size is configured to 2, where an OSD example is required to set it to 1ceph OSD Pool get {pool-name} {key}ceph OSD Pool set {Poo

Application and fault handling of CEPH in KVM virtualizationIn a distributed cluster, the user is provided with object storage, block storage and file storage.Benefits: Unified StorageNo single point of failureData multi-split redundancyScalable storage CapacityAutomatic fault tolerance and fault self-healingThree major role components of ceph and their rolerepresented as 3 daemonsCeph OSDMonitorMdsThere ar

Ceph's data management begins with the Ceph client's write operation, and since Ceph uses multiple replicas and strong consistency policies to ensure data security and integrity, a write request data is written to the primary OSD first and then primary The OSD further copies the data to the secondary and other tertiary OSD and waits for their completion notification before sending the final completion confi

[TOC]k8s Mount Ceph RBDk8s Mount Ceph RBD There are two ways, one is the traditional way of PVPVC, which means that the administrator needs to pre-create the relevant PV and PVC, and then the corresponding deployment or replication to mount the PVC use. After k8s 1.4, Kubernetes provides a more convenient way to dynamically create PV, that is, Storageclass. Using Storageclass, you do not have to create a fi

In the case of a network, Ubuntu installation software is very convenient, to install Ceph, also on a command to fix, want to install ceph0.72 on ubuntu14.04, because the official source of Ceph Ceph-extra does not contain ubuntu14.04 trusty package, Ceph, which uses 163 of its source, is an unwanted version, so it com

The pool is a logical partition of Ceph's stored data, and it acts as a namespace. Other distributed storage systems, such as MogileFS, Couchbase, and Swift, have the concept of pool, but they are called different. Each pool contains a certain number of objects in the PG,PG are mapped to different OSD, so pool is distributed throughout the cluster. Apart from isolating data, we can also set different optimization strategies for different pool, such as number of replicas, number of data cleansing

Ceph RADOSGW Object Storage interface, research configuration for a long time, now share the following. The prerequisite for configuring RADOSGW first is that you have successfully configured the Ceph cluster to view the Ceph cluster through Ceph–s, in the health state. Here, the auth configuration of the

Nova ConfigurationDisk_cachemodes = "Network=writeback" (enabled)Change to Disk_cachemodes = "Network=none" (off) Ceph Configuration Open Ceph RBD CacheClientRbd_cache = TrueRbd_cache_writethrough_until_flush = TrueAdmin_socket =/var/run/ceph/guests/$cluster-$type. $id. $pid. $cctid. AsokLog_file =/var/log/qemu/qemu-guest-$pid. logRbd_concurre

First, collocated group status1. CreatingWhen you create a storage pool, it creates a specified number of collocated groups. CEPH displays creating when creating one or more collocated groups, and when created, the OSD in the acting set of its collocated group will be interconnected; Once the interconnect is complete, the Collocated group state should become active+clean, meaning that the Ceph client can wr

Before starting the text, I would like to thank Unitedstack Engineer Zhu Rongze for his great help and careful advice on this blog post. This paper makes a more explicit analysis and elaboration on the calculation method of Ceph reliability (https://www.ustack.com/blog/build-block-storage-service/) for Unitedstack company at the Paris summit. For the interests of this topic friends to discuss, research, the article if there is inappropriate, but also

Ceph practice summary: configuration of the RBD block device client in Centos Before proceeding to this chapter, you need to complete the basic cluster building, please refer to the http://blog.csdn.net/eric_sunah/article/details/40862215 Ceph Block devices are also calledRBDOrRADOS. Block Device During the experiment, a virtual machine can be used as the ceph-c

Ceph practice summary: the configuration of the RBD block device client in Centos, cephrbd Before proceeding to this chapter, you need to complete the basic cluster building, please refer to the http://blog.csdn.net/eric_sunah/article/details/40862215 Ceph Block devices are also calledRBDOrRADOS. Block Device During the experiment, a virtual machine can be used as the