How long does DataFactory take to insert 1 million data

Source: Internet
Author: User

There is a system that needs to test a large amount of data. It is really convenient to use the DataFactory tool to generate data for the first time. After configuring the link of the database table, you can generate data and time relationships, I have not studied whether the data format requirements comply with the standards. It is estimated that there should be relevant settings. This is a good introduction for other studies. There was a small problem when connecting tables. DataFactory still had requirements for table name recognition. The system table I tested was "T _***. **. ** "format, recognized as" **. ** ", so you need to modify the table name first, insert the data, and then change the table name back. I wonder if there are other better methods?

Enter the number of data inserts. Enter 100 for the first time. Check the result. The result shows that 00: 00: 03 S is run, and 00: 02: 38 S is run for 10000 data, if you want to insert 1 million data, it should take at least 200 minutes. The following is the results message:

Executing script '000000 '.
Loading table 'tb _ 100 '.
The script '000000' has completed successfully. elapsed time: 00:00:03
Executing script '000000 '.
Loading table 'tb _ 100 '.
The script '000000' has completed successfully. elapsed time: 00:02:38
Executing script '000000 '.
Loading table 'tb _ 100 '.

I just used DataFactory. I still need to study it.

 

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.