past interval. Last_epoch_started: Last peering after the Osdmap version number epoch. Last_epoch_clean: Last recovery or backfill after the Osdmap version number epoch. (Note: After the peering is finished, the data recovery operation is just beginning, so last_epoch_started and Last_epoch_clean may differ). For example: The current epoch value of the Ceph system is pg1.0, and the acting set and up set are all [0,1,2]
Osd.3 failure resulte
Keyvaluestore is another storage engine that Ceph supports (the first is Filestore), which is in the Emporer version of Add LevelDB support to Ceph cluster backend store Design Sum At MIT, I put forward and implemented the prototype system, and achieved the docking with ObjectStore in the firely version. is now incorporated into Ceph's Master. Keyvaluestore is a lightweight implementation relative to Filest
I recently needed to test the rgw of CEpH in my work, so I learned while testing.
First, the tool uses Intel's open-source tool cosbench, which is also the industry's mainstream object storage testing tool.
1. cosbench installation and startupDownload the latest cosbench packageWget https://github.com/intel-cloud/cosbench/releases/download/v0.4.2.c4/0.4.2.c4.zipExtractUnzip 0.4.2.c4.zip
Install related ToolkitYum install java-1.7.0-openjdk NMAP-ncat
K8s Cluster Install the client on each of the above:Ceph-deploy Install k8s IP addressCreate a k8s action user :Ceph auth Add client.k8s mon ' Allow rwx ' OSD ' Allow rwx 'Ceph auth get client.k8s-o/etc/ceph/ceph.client.k8s.keyring #导出新建用户的钥匙 to place the exported keys under the/etc/ceph/of each k8sCeph Auth List #查看权限
Ceph uses block storage, and the system kernel needs to 3.0 and above the kernel to support some ceph modules. You can specify a type when creating a block (Type1 and type2) , only type2 can protect the snapshot and protect it before cloning. Complete operation process with block device:1 , creating a block device ( in M)RBD Create yjk01--size 1024x768--pool vms--image-format 2RBD info yjk01--pool VMSRBD
Phenomenon:The question of request blocked is often found through the Ceph-w log (if the virtual machine system runs on Ceph, it will find a serious lag)Investigation:1, through the Dstat did not find a significant bottleneck (Dstat-tndr 2)2, through the Iostat also found no obvious bottleneck (IOSTAT-DX 2)3, through the Netstat also did not find the Storage Network network card send queue or receive queue
each object 2M capacity, the total capacity of this value is 100T)[Email protected] ~]# ceph OSD Pool Set-quota data max_objects 50000000Set-quota max_objects = 25000000 for pool dataSet the data pool to a maximum storage space of 100T[[email protected] ~]# ceph OSD Pool Set data target_max_bytes 100000000000000Set pool 0 target_max_bytes to 1000000000000004, data pool full problem resolution, now the
Job Responsibilities:Participate in building cloud storage services, including development, design, and operational work?Requirements for employment:1, Bachelor degree or above, more than 3 years of storage system development, design or operation and maintenance work experience;2, familiar with the Linux system and understanding of the kernel, cloud computing, virtualization have some knowledge;3, have Ceph, Glusterfs and other distributed storage of
Official documents:http://docs.ceph.com/docs/master/cephfs/http://docs.ceph.com/docs/master/cephfs/createfs/(create CEPHFS file system)Ceph official Chinese Documentation:http://docs.ceph.org.cn/Configuration in OpenStack:http://docs.ceph.com/docs/master/rbd/rbd-openstack/Blogs, etc.:http://blog.csdn.net/dapao123456789/article/category/2197933Http://docs.openfans.org/ceph/ceph4e2d658765876863/
In centos6.3, to use CEpH block device, you must install a later version of qemu.Install qemu-1.5.2 after CEpH is installed# Tar-xjvf qemu-1.5.2.tar.bz2# Cd qemu-1.5.2#./Configure -- enable-RBDYou must add the -- enable-RBD option so that qemu can support the RBD protocol.In this step, an error may be reported:Error: user requested feature rados block DeviceConfigure was not able to find itThis is because t
Ceph Cluster Problem Grooming
Created: Linhaifeng, last modified: Yesterday 5:35 afternoon
1: Will the data be sent to the log disk and deleted immediately or delayed?Validation: Tuning Parameters#从日志到数据盘最大同步间隔间隔秒数, Default: 5Filestore Max sync interval = 15Process Analysis: A client object sent to Ceph's PG, note that the log is written to return the results, and then within 15 seconds of the interval,Three OSD node data is synchronized
1 Describe my deployment environment first:2 osd,1 monitor,1 Console Management Server, 1 client, are 24 cores, 64G memory, 1.6T SSD flash card, gigabit network card; The Ceph version currently installed is 0.94.7.2 Current statusI use the DD command to write 5G data, using Iostat to observe%util immediately 100% Ah, while the await indicators are more than 4,000, and at this time the network bandwidth is only used around 10M.650) this.width=650; "Src
Machine Room operation error caused the rack or host power down is the occasional thing, then how in this case, let the Ceph service with the OS startup and fast start? Here is a simple method:Execute the following command on the OSD host:sudo ln-s/usr/lib/systemd/system/[email protected]/etc/systemd/system/multi-user.target.wants/[email protected]sudo systemctl enable [email protected]sudo systemctl is-enabled [email protected]Execute the following c
Because the kubelet itself does not support RBD commands, a kube system plugin is required:Download Plugin Quay.io/external_storage/rbd-provisioner:Https://quay.io/repository/external_storage/rbd-provisioner?tag=latesttab=tagsDownload Docker pull quay.io/external_storage/rbd-provisioner:latest on node of k8s clusterInstall only the plugin itself will error: need to install kube roles and permissions The following are:Https://github.com/kubernetes-incubator/external-storageHttps://github.com/kube
Using the Ceph OSD Tree command to view the Ceph cluster, you will find weight and reweight two values
Weight weight and disk capacity, general 1T, value is 1.000, 500G is 0.5
It is related to the capacity of the disk and does not change due to reduced disk available space
It can be set with the following command
Ceph OSD Crush Reweight
The reweight is a v
[Ceph_deploy] [ERROR] Runtimeerror:failed to execute Command:ceph-disk-activate–mark-init sysvinit–mount/dev/sdb1To be honest, the question is two.I put the OSD in a separate partition SDB executes the commands that are:Ceph-deploy OSD Prepare NETWORK:/DEV/SDB1Ceph-deploy OSD Activate NETWORK:/DEV/SDB1The above is wrong.The right thing isCeph-deploy Osd–zap-disk Create Network:sdbCeph-deploy OSD Prepare NETWORK:/DEV/SDB1:/DEV/SDB2Ceph-deploy OSD Activate NETWORK:/DEV/SDB1:/DEV/SDB2The problem is
Have you modified/sys/block/sdk/queue/read_ahead_kb read_ahead?Modified to 8192, the default value is 128;is the SATA disk OSD changed to 8192? How much of a performance boost?In addition, this value should be modified at any time, right? Can it be dynamically adjusted after deployment?What effect will it have on the OSD?can improve read performanceCan be modified in real timeWhat does this parameter mean?Pre-read bytes?This parameter is useful for sequential reads, meaning how much content to r
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.