About widgets paging through databases

Requirements: Data extraction for third-party databases with incremental data every 2 hours.

Requirements: T-1 Day Data is processed uniformly every 12:05.

So the use of 1 weeks to develop a small tool, mainly docking third-party Oracle,pg,mysql database data.

Adoption Technology:

1. Multi-threading, thread pool

2.JDBC, Connection Pool

3. Database Paging

Encounter problems

1.Javaswing page design is very difficult

Solution: Adopt the mature Eclipse plugin Windowbuilder

2. During the paging process, new data insertions can affect data loss or duplicate extraction

Solution: ORDER BY or temp table

3. Reconnection mechanism After database connection is disconnected

Solution: The Timer tool retries three times, and the manual batch tool retries continuously until the connection is acquired.

About widgets paging through databases