The three commonly used syntax for repeating data analysis distinct, group by, and partition by

Data deduplication is one of the most common operations in data analysis due to the frequent duplication of data, while distinct,group by and partition by can achieve deduplication, and in practice it is necessary to select the appropriate syntax according to different scene requirements.

Distinct: only need to remove duplicate data, keep no duplicate data

GROUP BY: You can see what data is duplicated as needed

Partition by: The most powerful, can be ordered to duplicate data, combined with the outer nested statements, can be used to filter unwanted data on-demand.

The three commonly used syntax for repeating data analysis distinct, group by, and partition by