Continuous integration and continuous deployment in DW/BI

Source: Internet
Author: User

Deployment method

In Redshift

1, Deploy Process:drop and Refresh the view, Drop table, Create an empty table using the DDL
2, Build data:insert the data to table from the view

In Netezza, when do deployment:

1, Deploy Process:drop all the existing tables, Refresh the view and create the a empty table for that view
2, Build data:create the table with data (CTAS from view), replace the empty table with the new table

When building data, the scripts would first create an a table with a incoming suffix, then does some data validation, if all P assed, then replace the empty target table with the incoming table.

Jenkins slaves is an EC2 Linux server.
In the slave, it calls shell script to run of the SQL (Refresh views and tables)
It also run shells which connect to the DMA server to run the DMA jobs
Using pipeline to get Jenkins jobs connected

Continuous integration and continuous deployment in DW/BI

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.