There are two ways to traverse all files under a folder: 1) Use multiple Flat file Connection to use "|" For all of the files we want. Piece together as a connector connection string;2) with the Foreach Loop container, specify the file name pattern and folder;
The former needs to do some work to find those folders, perhaps a script task or a Foreach Loop container to find those files, and if there is more trouble with subfolders, the latter sub-folder search SSIS has provided an option, It is convenient to choose the enumerator we want, but the difference is that the latter is iterative for each file of each file, which means that if data flow in the Foreach loop is to be executed (the number of files), the former is executed only once. I do not know whether there will be performance problems, in the case of a large number of files, but still inclined to the latter, even if the assumption that the number of files processed to thousands, with multiple Flat file connection one-time processing is very resource-intensive, If the server has other tasks or the application is likely to be compromised when running, it is likely that the memory will be eaten up, which is not as good as a slow run, in case the business scenario is not urgent.
Multiple File connection I don't see where I can use it.
Connection Manager->> multiple Flat file Connection & multiple file Connection