Connection Manager->> multiple Flat file Connection & multiple file Connection

Source: Internet
Author: User

There are two ways to traverse all files under a folder: 1) Use multiple Flat file Connection to use "|" For all of the files we want. Piece together as a connector connection string;2) with the Foreach Loop container, specify the file name pattern and folder;

The former needs to do some work to find those folders, perhaps a script task or a Foreach Loop container to find those files, and if there is more trouble with subfolders, the latter sub-folder search SSIS has provided an option, It is convenient to choose the enumerator we want, but the difference is that the latter is iterative for each file of each file, which means that if data flow in the Foreach loop is to be executed (the number of files), the former is executed only once. I do not know whether there will be performance problems, in the case of a large number of files, but still inclined to the latter, even if the assumption that the number of files processed to thousands, with multiple Flat file connection one-time processing is very resource-intensive, If the server has other tasks or the application is likely to be compromised when running, it is likely that the memory will be eaten up, which is not as good as a slow run, in case the business scenario is not urgent.

Multiple File connection I don't see where I can use it.

Connection Manager->> multiple Flat file Connection & multiple file Connection

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.