Python Data Large performance analysis

Premise: If you have a hundreds of m file that needs to be parsed, a function needs to run many times (thousands of times), you need to consider performance issues

Performance Analysis module: CProfile

How to use: Cprofile.run ("func ()"), where Func () is a function for profiling

Test results: The results show how long each function was written, and when the built-in function was run

Analyze functions that run more times and take a lot of time to optimize, such as: regular expression matching is time consuming, you can combine multiple regularization into one

Python Data Large performance analysis