In a hurry, 100 points. I beg for help. how can data collection be executed in real time?

In a hurry, 100 points. I beg for help. how can data collection be executed in real time? I used php to write more than 20 programs that capture web pages and call interfaces. The problem is that the program cannot be executed. if it is executed together, it will crash, if you know how Tao is doing it, you can also share it. I hope to give some advice to the younger brother on program optimization and mysql database optimization. it is very urgent.

Reply to discussion (solution)

You can contact CISCO

Set_time_limit (0 );

Or

Thread

Or

Jump to execute one by one

Or

And so on ..

Upgrade the MYSQL database or process temporary files.

You can execute scheduled tasks. Also, if PHP. INI is to be configured, the latency is long.