Linux_shell_ Split File _ multi-process script

"Demand Scenario": A 10000w row of file processing, multi-process processing such as the start of 100 processes simultaneously processing.

"Method": Split file (split), make shell script execution background process

"Demo":

Assuming that the handler is test.php, you need to receive parameters to process the data file path plus the incoming parameter eg:part_01 1 "the second parameter is used to assist internal invocation of different interface processing"

"Method":

Demo.data 1000w Line

Split split-l 10000 Demo.data Part_

Execution Results 100 files

Processing scripts, test.php

Make Shell

#/bin/SHdir='mulu/part_*'I=0 for file inch`ls$dir` Do Let"i++" Let"j=i%2"nohup PHP test.php $file$j > $file. Res & Done

"Batch Kill"

Todo

Linux_shell_ Split File _ multi-process script