Spring batch processing and programming model

1. Batch processing:

Similar to the batch commit in SQL

2. Scene:

Business timed batch operations, but what about the batch programming model?

3. Open Source Framework

Spring Batch

4. Programming Model:

Reader-processor-writer

Joblauncher-job-jobexecution-Jobparametersvalidator

Jobexecution result = Launcher.run (Job, New Jobparameters ()); Runjob mechanism

5. Strategy

A. Batch commit, configure transaction commit-interval= "1000"

B. Failure policy Skip-policy Skip-limit skippable-exception-classes (we usually just log in the project, then manually process or retry)

C. Retry policy retry-limit retry-policy

D. Monitoring strategy Listeners

E. Workflow:

F.map-reduce:spliter/parallel, Flow (There are also map-reduce ideas here, both in BPM and in the ESB), which are incorporated into the thread pool

6. Integration with the ESB

Support for cluster deployment, but personally feel that the built-in flow is a bit awkward, because this design to the database built-in table structure, preferably using BPM to replace the better

Looking at these concepts, take a look at the picture and see

System integration can be done with mq,rdbms,flatfile,socket access.

Spring batch processing and programming model