[Post] how to delete duplicate records in SQL query

Source: Internet
Author: User

SQL statement to query duplicate records and delete Repeated Records

Search for records with all repeated titles:
Select * From t_info A where (select count (*) from t_info where title = A. Title)> 1) Order by title DESC
I. Search for duplicates Recording
1. Search for all Repeated Records
Select * from table where repeated field in (select repeated field from Table group by repeated field having count (*)> 1)
2. Filter duplicate records (only one record is displayed)
Select * From hzt where ID in (select max (ID) from hzt group by title)
Note: The maximum ID record is displayed here.
II. Delete duplicate records
1. Delete all duplicate records (use with caution)
Delete table where repeated field in (select repeated field from Table group by repeated field having count (*)> 1)
2. Keep one record (this should be the token _^ required by most people)
Delete hzt where id not in (select max (ID) from hzt group by title)
Note: The maximum ID record is retained here.
1. Search for redundant duplicate records in the Table. duplicate records are determined based on a single field (peopleid ).
Select * from people
Where peopleid in (select peopleid from people group by peopleid having count (peopleid)> 1)

2. Delete unnecessary duplicate records in the Table. Repeat records are determined based on a single field (eagleid), leaving only the records with the smallest rowid
Delete from people
Where peopleid in (select peopleid from people group by peopleid having count (peopleid)> 1)
And rowid not in (select Min (rowid) from people group by peopleid having count (peopleid)> 1)

3. Search for redundant duplicate records in the table (multiple fields)
Select * From vitae
Where (A. peopleid, A. seq) in (select peopleid, seq from vitae group by peopleid, seq having count (*)> 1)

4. Delete redundant record (multiple fields) in the table, leaving only the records with the smallest rowid
Delete from vitae
Where (A. peopleid, A. seq) in (select peopleid, seq from vitae group by peopleid, seq having count (*)> 1)
And rowid not in (select Min (rowid) from vitae group by peopleid, seq having count (*)> 1)

5. Search for redundant duplicate records (multiple fields) in the table, excluding records with the smallest rowid
Select * From vitae
Where (A. peopleid, A. seq) in (select peopleid, seq from vitae group by peopleid, seq having count (*)> 1)
And rowid not in (select Min (rowid) from vitae group by peopleid, seq having count (*)> 1)
Supplement:
There are more than two duplicate records. One is a completely repeated record, that is, record with all fields already exists. The other is record with duplicate key fields, such as duplicate name fields, other fields are not necessarily repeated or can be ignored.
1. For the first type of repetition, it is easier to solve.
Select distinct * From tablename
You can get the result set without repeated records.

If the table needs to delete duplicate records (one record is retained), you can delete the record as follows:
Select distinct * into # TMP from tablename
Drop table tablename
Select * into tablename from # TMP
Drop table # TMP

the reason for this repetition is that the table design is not weekly. You can add a unique index column.
2. Repeat problems generally require that the first record in the repeat record be retained. The procedure is as follows
assume that the duplicate field is name, address, obtain the unique result set of the two fields.
Select Identity (INT,) as autoid, * into # TMP from tablename
select Min (autoid) as autoid into # tmp2 from # TMP group by name, autoid
select * from # TMP where autoid in (select autoid from # tmp2)

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.