1. General data import and export Operation module review
In my winfrom development framework, there is a common import module, which silently handles the specification of Excel data into different object tables, has been used to quickly complete the work of data import. Very early in the essay "WinForm Development framework of the general data import and export operation" inside a very comprehensive introduction of its related functions, in the Code generation tool Database2sharp inside, generated Winfrom interface code has also put its calling code into the, so it is very good to use , very happy.
In the ongoing project practice, found that the use of SQLite clients as a stand-alone version of the operation is also more and more, so a large number of data import, is often encountered, we know that SQL Server Bulk INSERT data will be very fast, even if you do not use the transaction, a number of inserts, the mass will be relatively fast , this may benefit from the transaction optimization effect of SQL Server itself. However, as a stand-alone version of the database, SQLite each operation is a separate transaction, the insertion of a data efficiency may not be obvious, if the operation of 1000, 10,000, the slow data is obvious, even unbearable. I once in the "Use transaction operations SQLite data bulk insertion, improve data batch write speed, source code explanation" Inside mentions the batch inserts the common dictionary module The dictionary data, uses the transaction to insert the data before and after the volume, that speed but the difference is very big.
Based on the above factors, the decision of the General Data import module for transactional optimization, in order to adapt to my frequent use of SQLite database to import data in large quantities, improve the customer's good experience. This article mainly based on the improvement of transactional operations, the implementation of SQLite data based on batch fast import operations.