Book Brief: Spring Batch processing framework

Big Data era batch processing weapon, the first domestic original Analysis Spring batch framework.

Content Introduction:

The Spring batch processing framework provides a comprehensive and systematic introduction to the batch framework, spring batch, which provides readers with detailed practical examples of the basic development capabilities of the spring batch framework for big data batching, and a specific anatomy of the framework design and source code. , while helping readers master the basic functions and advanced features of the spring batch framework, the design principles of the spring batch framework are thoroughly analyzed, helping readers to master the Spring batch framework.

The Spring batch processing framework is divided into three parts: introductory, Basic, and advanced. The introductory article introduces the basic features and new features of batch processing, Spring batch, and the Quick Start Hello World, which leads readers to get started, and thus into the worlds of data batching. The basic article focuses on the core concepts of data batching, typical job configuration, job-step configuration, and the classic three-step strategy in the Spring batch framework: Data reading, processing, and data writing, and a detailed description of how to file CVS, JSON-formatted files, XML files, The data in the database and the JMS message queue is read, processed, and written, and the operations of the database are described in detail using JDBC, Hibernate, stored procedures, JPA, Ibatis, and so on. The advanced article provides the ability of high performance, high reliability and parallel processing, showing readers how to realize the control of job flow, including sequential flow, conditional flow, parallel flow, how to implement robust job, including Skip, retry and restart, how to implement the extended job and parallel job, including multi-threaded job, parallel job, Remote jobs and partitioning jobs for distributed, high-performance, and highly scalable data batch jobs.

? catalogue

1th chapter of the introductory article

The 1th chapter Introduction to Spring Batch
1. 1 What is batch processing
1. 2 Spring Batch
1. 2. 1 Typical scenarios
1. 2. 2 Spring Batch Architecture
1. 3 Spring Batch Benefits
1. 3. 1 Rich out-of-the-box components
1. 3. 2 Processing for Chunk
1. 3. 3 Transaction management Capabilities
1. 3. 4 Meta Data management
1. 3. 5 easy-to-monitor batch processing applications
1. 3. 6 rich Process Definition
1. 3. 7 Robust Batch processing applications
1. 3. 8 Easy-to-scale batch applications
1. 3. 9 Reuse Enterprise Existing IT assets
1. 4 Spring Batch 2. 0 new Features
1. 4. 1 Support Java5
1. 4. 2 support for non-sequential step
1. 4. 3 for chunk processing
1. 4. 4 meta-data access
1. 4. 5 Extensibility
1. 4. 6 Configurable
1. 5 Spring Batch 2. 2 new features
1. 5. 1 Spring Data integration
1. 5. 2 Support for Java configuration
1. 5. 3 Spring Retry
1. 5. 4 Job Parameters
1. 6 Development environment Construction

The 2nd chapter of Spring Batch's Hello World
2. 1 Scenario Description
2. 2 Project Preparation
2. 2. 1 Project Structure
2. 2. 2 Preparing the statement file
2. 2. 3 Defining Domain Objects
2. 3 Defining the job infrastructure
2. 4 Defining the reconciliation job
2. 4. 1 Configuring Itemreader
2. 4. 2 Configuring Itemprocessor
2. 4. 3 Configuring Itemwriter
2. 5 Job execution
2. 5. 1 Java Calls
2. 5. 2 junit Unit Test
2. 6 Concept Preview


2nd Basic article

The 3rd Chapter Spring Batch Basic concept
3. 1 namespaces
3. 2 Job
3. 2. 1 Job Instance
3. 2. 2 Job Parameters
3. 2. 3 Job Execution
3. 3 Step
3. 3. 1 Step execution
3. 4 Execution Context
3. 5 Job Repository
3. 5. 1 Job Repository Schema
3. 5. 2 Configuring the Memory Job
Repository
3. 5. 3 Configuring the DB Job Repository
3. 5. 4 Database Schema
3. 6 Job Launcher
3. 7 Itemreader
3. 8 Itemprocessor
3. 9 Itemwriter

4th. Configuring Job Jobs
4. 1 Basic Configuration
4. 1. 1 Restart Job
4. 1. 2 job Blocker
4. 1. 3 Job Parameters Check
4. 1. 4 Job abstraction and inheritance
4. 2 Advanced Features
4. 2. 1 Step Scope
4. 2. 2 attribute late Binding
4. 3 Running the job
4. 3. 1 Scheduling jobs
4. 3. 2 Command line execution
4. 3. 3 Integration with Scheduled tasks
4. 3. 4 Integration with Web applications
4. 3. 5 Stop Job

The 5th chapter is to configure the operation step
5. 1 Configuring step
5. 1. 1 Step abstraction and inheritance
5. 1. 2 Step Execution Interceptor
5. 2 Configuring Tasklet
5. 2. 1 Restart Step
5. 2. 2 Business
5. 2. 3 transaction rollback
5. 2. 4 Multi-threaded step
5. 2. 5 Custom Tasklet
5. 3 Configuring Chunk
5. 3. 1 Commit Interval
5. 3. 2 exception skipped
5. 3. 3 Step Retry
5. 3. 4 Chunk Completion Strategy
5. 3. 5 Read, Process transactions
5. 4 Interceptors
5. 4. 1 Chunklistener
5. 4. 2 Itemreadlistener
5. 4. 3 Itemprocesslistener
5. 4. 4 Itemwritelistener
5. 4. 5 SkipListener
5. 4. 6 Retrylistener

The 6th chapter reads the Data itemreader
6. 1 Itemreader
6. 1. 1 Itemreader
6. 1. 2 Itemstream
6. 1. 3 System Read Components
6. 2 Flat Format Files
6. 2. 1 Flat file format
6. 2. 2 Flatfileitemreader
6. 2. 3 Recordseparatorpolicy
6. 2. 4 Linemapper
6. 2. 5 Defaultlinemapper
6. 2. 6 Linecallbackhandler
6. 2. 7 Read delimiter file
6. 2. 8 Reading fixed length files
6. 2. 9 Read JSON file
6. 2. 10 read records across multiple lines of files
6. 2. 11 Read mixed record file
6. 3 XML Format files
6. 3. 1 XML parsing
6. 3. 2 Spring OXM
6. 3. 3 Staxeventitemreader
6. 4 Read multiple Files
6. 5 Read Database
6. 5. 1 Jdbccursoritemreader
6. 5. 2 Hibernatecursoritem
Reader
6. 5. 3 Storedprocedureitem
Reader
6. 5. 4 Jdbcpagingitemreader
6. 5. 5 Hibernatepagingitem
Reader
6. 5. 6 Jpapagingitemreader
6. 5. 7 Ibatispagingitemreader
6. 6 Read JMS queue
6. 6. 1 Jmsitemreader
6. 7 Service Reuse
6. 8 Custom Itemreader
6. 8. 1 Do not restart Itemreader
6. 8. 2 can restart Itemreader
6. 9 Interceptors
6. 9. 1 Interceptor Interface
6. 9. 2 Interceptor exception
6. 9. 3 Execution order
6. 9. 4 Annotation
6. 9. 5 attribute Merge

The 7th Chapter writes the data itemwriter
7. 1 itemwrite
7. 1. 1 Itemwriter
7. 1. 2 Itemstream
7. 1. 3 System Write components
7. 2 Flat Format Files
7. 2. 1 Flatfileitemwriter
7. 2. 2 Lineaggregator
7. 2. 3 Fieldextractor
7. 2. 4 Back adjustment operation
7. 3 XML Format files
7. 3. 1 Staxeventitemwriter
7. 3. 2 Back adjustment operation
7. 4 Write multiple files
7. 4. 1 Multiresourceitemwriter
7. 4. 2 extension Multiresourceitem
Writer
7. 5 Write Database
7. 5. 1 Jdbcbatchitemwriter
7. 5. 2 Hibernateitemwriter
7. 5. 3 Ibatisbatchitemwriter
7. 5. 4 Jpaitemwriter
7. 6 Write JMS queue
7. 6. 1 Jmsitemwriter
7. 7 Composition Write
7. 8 Item Routing Writer
7. 9 Sending mail
7. 9. 1 Simplemailmessageitem
Writer
7. 10 Service Reuse
7. 10. 1 Itemwriteradapter
7. 10. 2 propertyextracting
Delegatingitemwriter
7. 11 Custom Itemwrite
7. 11. 1 Do not restart Itemwriter
7. 11. 2 can restart Itemwriter
7. 12 Interceptors
7. 12. 1 Interceptor Interface
7. 12. 2 Interceptor exception
7. 12. 3 Execution order
7. 12. 4 Annotation
7. 12. 5 attribute Merge

The 8th chapter deals with Data itemprocessor
8. 1 itemprocessor
8. 1. 1 itemprocessor
8. 1. 2 System processing components
8. 2 Data Conversion
8. 2. 1 Partial data conversion
8. 2. 2 Data type conversions
8. 3 Data filtering
8. 3. 1 Data filter
8. 3. 2 Data filtering statistics
8. 4 Data validation
8. 4. 1 Validator
8. 4. 2 Validatingitemprocessor
8. 5 Combination Processor
8. 6 Service Reuse
8. 6. 1 Itemprocessoradapter
8. 7 Interceptors
8. 7. 1 Interceptor Interface
8. 7. 2 Interceptor exception
8. 7. 3 Execution order
8. 7. 4 Annotation
8. 7. 5 attribute Merge


3rd High-level article

9th. Job Flow Step Flow
9. 1 Order Flow
9. 2 Conditional flow
9. 2. 1 Next
9. 2. 2 Exitstatus VS
Batchstatus
9. 2. 3 decision Conditions
9. 3 Parallel flow
9. 4 external Flow definition
9. 4. 1 Flow
9. 4. 2 Flowstep
9. 4. 3 JobStep
9. 5 Step data sharing
9. 6 Terminating job
9. 6. 1 End
9. 6. 2 stop
9. 6. 3 fail

10th Chapter Robust Job
10. 1 Skipping Skip
10. 1. 1 Configuring Skip
10. 1. 2 Skip Policy Skippolicy
10. 1. 3 Skip Interceptors
10. 2 Retry retry
10. 2. 1 Configuring retry
10. 2. 2 Retry Policy Retrypolicy
10. 2. 3 Retry Interceptor
10. 2. 4 Retry Template
10. 3 Restart Restart
10. 3. 1 Restart Job
10. 3. 2 Boot Count limit
10. 3. 3 Restarting a completed task

The 11th chapter expands job, parallel processing
11. 1 scalability
11. 2 Multi-threaded step
11. 2. 1 Configuring multi-threaded Step
11. 2. 2 Thread Safety
11. 2. 3 Thread-Safe step
11. 2. 4 threads that can be restarted
Safety Step
11. 3 Parallel step
11. 4 Remote Step
11. 4. 1 Remote Step Frame
11. 4. 2 based on SI for remote step
11. 5 Divisional Step
11. 5. 1 Key interfaces
11. 5. 2 Basic Configuration
11. 5. 3 File partitions
11. 5. 4 Database Partitioning
11. 5. 5 Remote Partition Step

Book Brief: Spring Batch processing framework