MySQL order by rand () Efficiency

Original address: http://www.phpchina.com /? Action-viewnews-itemid-33727

 

This topic explains in detail MySQL Order By Rand () Efficiency The optimization solution and the optimization process are provided. It is a rare article about MySQL order by rand () efficiency.

Recently, due to the need to study the random extraction Implementation of MySQLMethod. For example, to randomly extract a record from the tablename table, the general syntax is: Select * From tablename order by rand () limit 1.

 

However, I checked the MySQL official manual. The prompt for rand () indicates that rand () cannot be used in the order by clause ()FunctionThis will cause the data column to be scanned multiple times. However, in MySQL 3.23, order by rand () can still be used for random operations.

However, the test results show that the efficiency is very low. It takes more than 8 seconds to query 5 data records in a database with more than 0.15 million entries. According to the official manual, Rand () is executed multiple times in the order by clause, which is naturally inefficient and inefficient.

You cannot use a column with RAND () values in an order by clause, because order by wowould evaluate the column multiple times.

Search for Google. Basically, data is randomly obtained by querying max (ID) * rand () on the Internet.

Select *
From 'table' as T1 join (select round (RAND () * (select max (ID) from 'table') as ID) as T2
Where t1.id> = t2.id
Order by t1.id ASC limit 5;

However, five consecutive records are generated. The solution is to query only one item at a time and query five times. Even so, it is worthwhile because it takes less than 0.15 million seconds to query 0.01 tables.

 

The following statement uses join, Which is used on the MySQL forum.

Select *
From 'table'
Where ID> = (select floor (max (ID) * rand () from 'table ')
Order by ID limit 1;

I tested it. It took 0.5 seconds and the speed was good, but there was still a big gap with the above statements. I always feel that something is abnormal.

 

So I changed the statement.

Select * From 'table'
Where ID> = (select floor (RAND () * (select max (ID) from 'table ')))
Order by ID limit 1;

The query efficiency is improved, and the query time is only 0.01 seconds.

 

Finally, complete the statement and add the min (ID) judgment. At the beginning of the test, because I did not add the min (ID) Judgment, half of the time is always the first few rows in the table.
The complete query statement is:

Select * From 'table'
Where ID> = (select floor (RAND () * (select max (ID) from 'table')-(select Min (ID) from 'table ')) + (select Min (ID) from 'table ')))
Order by ID limit 1;
Select *
From 'table' as T1 join (select round (RAND () * (select max (ID) from 'table')-(select Min (ID) from 'table ')) + (select Min (ID) from 'table') as ID) as T2
Where t1.id> = t2.id
Order by t1.id limit 1;

Finally, these two statements are queried 10 times in PHP respectively,
The former takes 0.147433 seconds.
The latter takes 0.015130 seconds.
It seems that using the join syntax is much more efficient than using functions directly in the WHERE clause.

 

References:
MySQL order by index optimization: http://www.phpq.net/mysql/mysql-order-by.html
MySQL order by syntax: http://www.phpq.net/mysql/mysql-order-by-syntax.html
MySQL order by rand () Efficiency: http://www.phpq.net/mysql/mysql-order-by-rand.html
MySQL order by usage: http://www.phpq.net/mysql/mysql-order-by-use.html

 

Original address: http://www.phpchina.com /? Action-viewnews-itemid-33727