of the replication delay;
Other ways to improve IOPS performance, based on the results, I made a simple sort of:
1, the replacement of SSD, or PCIe SSD, such as IO equipment, its IOPS ability to upgrade the ordinary 15K SAS disk number to a hundredfold, million times, or even hundreds of thousands of times times the meter;
2, increase the physical memory, the corresponding increase InnoDB Buffer pool si
keeps up with master in time. Each table must explicitly specify a primary key, if you do not specify a primary key, will result in row mode, each modification should be full table scan, especially the large table is very terrible, the delay will be more serious, and even lead to the entire slave library is suspended, can refer to the case: the lack of MySQL primary key lead to the reserve hang; The application side to do more things, so that the MySQL side less work, especially with IO-relate
to be released.Parallel Replication for MariaDB refer to: Replication and Binary Log Server System variables#slave_parallel_threads–mariadb Knowledge Base(2) Each table to explicitly specify the primary key, if not specify the primary key, it will result in the row mode, each modification to the full table scan, especially the large table is very scary, the delay will be more serious, and even cause the entire slave library is suspended, can refer to the case: the lack of MySQL primary key caus
For more articles, please refer to: Analysis of cloud computing, the first draft is complete !!!
This document is datedLatest cloud computing InformationHope you will like it!
Due to SSD read/write latency and iops (I/O perSecond) These two aspects have about three orders of magnitude advantage over traditional mechanical hard drives, which has led some people to doubt the prospect of mechanical hard drives, I think SSD will be the first choice in t
ORACLE MySQL. In my scenario, MariaDB is used as a server Load balancer instance, and it is almost always able to keep up with the master in time. A primary key must be explicitly specified for each table. If no primary key is specified, a full table scan is required for each modification in row mode, especially for large tables, latency is more serious, and even the entire slave database is suspended. For more information, see the case: hang of the slave database due to the lack of the mysql p
database due to the lack of the mysql primary key;
The application end does more things to make MySQL end do less things, especially IO-related activities. for example, the front-end uses the memory CACHE or local write queue to merge multiple reads and writes for one time, even some write requests are eliminated;
Appropriate database/table sharding policies are implemented to reduce the copy pressure on a single database/table, so as to avoid the replication delay of the entire instance due
single database/table;Based on the advantages and disadvantages of other methods to improve IOPS performance, I made a simple sorting:Switching to an SSD, or PCIe SSD or other I/O devices, the IOPS capability is improved by hundreds, ten thousand times, or even several 100,000 times of ordinary 15 K SAS disks;Increase the physical memory, increase the InnoDB Buffer Pool size, and put more hot data in the m
, especially the large table is very terrible, the delay will be more serious, and even lead to the entire slave library is suspended, can refer to the case: the lack of MySQL primary key lead to the reserve hang;The application side to do more things, so that the MySQL side less work, especially with IO-related activities, such as: the front-end through memory cache or local write queue, etc., merge multiple read and write for once, or even eliminate some write requests;The appropriate sub-libr
IOPS performance , depending on the effect, I made a simple sort: More than SSD, or PCIe SSD and other IO devices, the increase in IOPS capacity is the average 15K SAS disk number hundred times, multiples, or even hundreds of thousands of times times the meter; Increase the physical memory, correspondingly increase the size of the InnoDB Buffer pool, so that more hot data in memory, reduce the frequency of
quickly reduce the amount of data, conversely high compression ratio of the same reason. Unfortunately, this important information is often unclear in the actual process.However, recently seen a counter-dedup, compressed in front, the post. Why? What about it?Tegile All-FlashThe company was founded about 2010 years ago, the first to do hybrid array (2012,t3100-t3400), until 2014 just launched all-Flash (t3600,t3800), products and capabilities in just
faults. That is to say, it performs a lot of IO operations.
Linux performance monitoring 2: Too small MPs queue
Any I/O operation takes a certain amount of time, and the time is determined for the hard disk, it contains the disk rotation delay RD (rotation delay) and the head search time DS (disk seek ). RD is determined by the disk speed (RPM. RD is half the time required for a disk to rotate for one week. For example, RPM is 10000.
RPS = RPM/60 = 166
1/166 = 0.0006 = 6 ms disk rotation takes
Significance and Calculation Method of Mysql database QPS and TPS
The terms QPS and TPS are often mentioned in the monitoring of database performance. Next we will briefly share the meanings and calculation methods of QPS and TPS in the MySQL database.
1 TPS: the transaction volume per second. You can obtain the TPS value requested by the client application in the following way:
Questions = show global status like 'questions ';Uptime = show global status like 'uptime ';QPS = Questions/Uptime
. The two parameters can be achieved by consulting the O M team and the vendor. The call process is as follows:
SQL> set serveroutput on;
SQL> DECLARE
2 lat INTEGER;
3 iops INTEGER;
4 mbps INTEGER;
5 BEGIN
6 -- DBMS_RESOURCE_MANAGER.CALIBRATE_IO (
,
, Iops, mbps, lat );
7 DBMS_RESOURCE_MANAGER.CALIBRATE_IO (2, 10, iops, mbps, lat );
help assess the I/O capability of the database's storage system, and gauge maximum IOPS and Mbytes/s.
Capability I/o feature is based on a database internal function (dbms_resource_manager.calibrateio (). This function is integrated within the oracle database and can better meet the test I/o problems, the report information will be output at the end. So what should I pay attention to when executing this package? 1. permission. You must have sysdba pe
# Docker--version Docker version 1.10.3, build f476348/1.10.3 as an example of 1.10.3, with the following Cgroup-related option:--blkio-weight BlockIO (relativeweight), between10and1000-- blkio-weight-device=[]blockioweight (relative deviceweight)--cpu-shares CPUshares (relativeweight)--cpu-period LimitCPUCFS (Completelyfairscheduler) period--cpu-quota LimitCPUCFS (Completelyfairscheduler) quota--cpuset-cpus cpusinwhichtoallow execution (0-3,0,1)--cpuset-mems MEMsinwhichtoallow execution (0-3
Block Storage SystemDistributed storage has excellent performance, can carry a lot of failures, it is easy to scale, so we use ceph to build a high-performance, high-reliability block storage system, and use it to support the public cloud and managed Cloud cloud host, the Cloud Drive service.Because of the use of Distributed block storage system, the process of copying images is avoided, so the creation time of cloud hosts can be reduced to less than 10 seconds, and the cloud hosts can be quickl
In March of this year, we introduced SSD-based Elastic Block-level storage for Amazon EC2 instances. After a few months of release, this new method of choice, known as general-purpose storage (SSD), has accounted for 90% of the newly created EBS volumes, we learned from customers' feedback that they like this consistent performance very much (pre-configured storage is 3 iops per GB) and increased to 3000 iops
# Docker--version Docker version 1.10.3, build f476348/1.10.3 as an example of 1.10.3, with the following Cgroup-related option:--blkio-weight BlockIO (relativeweight), between10and1000-- blkio-weight-device=[]blockioweight (relative deviceweight)--cpu-shares CPUshares (relativeweight)--cpu-period LimitCPUCFS (Completelyfairscheduler) period--cpu-quota LimitCPUCFS (Completelyfairscheduler) quota--cpuset-cpus cpusinwhichtoallow execution (0-3,0,1)--cpuset-mems MEMsinwhichtoallow execution (0-3
Use storage space to increase the IOPS of the virtual machine disk
Readers familiar with Windows Azure Virtual machine know that after we have created the Azure VM, we log on through RDP and see that the Azure VM contains 2 disks:
1 c disk is the operating system of the letter, is a persistent disk.
2 d disk is temporary Storage, is a non-persistent disk. d disk can only be used for temporary files, and any files saved in D disk will be deleted aft
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.