Indirect construction of Kettle scheduling platform using Jenkins Automatic deployment Tool

Source: Internet
Author: User
Tags blank page


about the Jenkins the introduction I will not say, own Baidu, because this tool call script just his function of the iceberg, other features I also can not understand, because not that field.
Let me explain why we need a scheduling platform, and finish learning Jenkins can solve any problems after that. Then start by explaining the installation deployment, and then talk about how to invoke the Kettle Job (and handle job dependencies)

1. Why do we need to dispatch the platform?

2.Answer: Most people mayKettlethe schedule is still stuck in thewinof Scheduled Tasks,Linuxof theCron, but jobs are becoming more and more dependent on each other, such as:AHomework,bjob, after execution, to executeCoperations), these simple through the planning task is not complete, perhaps some people say, can put these three jobs inKettlein a job that represents its dependencies, then doing so will put the modular job into a bloated job, highly coupled between the work, a large job may also existKettlememory consumption is too large for problems with memory overflow, so it is difficult to manage.
2. What problems can be solved after you finish learning Jenkins?
Answer: Centrally Manage jobs/scheduling of conversions, as well as log saving for each schedule, handling job scheduling dependency issuessuch as(because at present I am also small white, also just contact this thing, I just want to share what I know to everyone, so will speak relatively simple, but personally thinkJenkinsThere are many things that can be done, such as distributed scheduling systems.

3. How do I install the deployment?

A: First tell me about my test environment:Win7-64bit, theBrowser (browser has compatibility issues, start withIE, found the installation of a consistent blank page, and then changed the Google kernel is no problem),jre1.80, well-configuredJavapath, downloadjenkins.war-2.72version, placed under a path,G:\jenkins\jenkins.war, runcmd,inputJava-jar G:\jenkins\jenkins.war, and then wait for the startup (Bring your ownJettyStart), see... up and runingstart successfully, note8080don't be possessed, after the successful starthttp://localhost:8080(Modify the port number on the officer net check).

If you use the Tomcat, you can put the jenkins.war file directly under Tomcat 's webapps directory.

The page will let you enter a password, the password in the prompt message to start with the instructions in what path under what file, only need to copy out , paste in (there are also hints on the page in what file)

Then jump to a plugin installation page and choose the first recommended method

Then it will be installed automatically (again server-side deployment, if the server side is not networked, you can skip this step directly)

I installed my own time, there are two plug-ins did not install successfully, has been stuck, and then I closed the cmd interface, re-open, after the completion of the user set

Go to Main page after completion

Then the deployment is done.

4. Here is the most important point of attention, how to dispatch Kettle job, conversion?

Answer: 1. Click on the new page

2. Create a job, click OK

3. Configure the contents of the job, and the mode of triggering (we mainly:1 timing trigger 2. dependent on other job triggers), start with a timed trigger and configure the interface as follows: The format of the schedule is similar to Linux of the Cron format, but somewhat different, see the question mark next to the description, basically the same.

According to see the put, build step here can choose to execute Shell\bat

Enter the code to invoke the job, and everyone should be familiar with it.

We can also perform multiple kettle jobs in this job2 , we just need to click Add Build step, then these two Kettle Serial execution from top to bottom (personal test)

then after we set up the dependency problem here, follow the settings as above we do a test3 Jenkins Job ( but don't need to configure scheduled scheduling, because test3 I want to trigger the schedule after the other job is done ), We want Jenkins's job2 to execute and then execute the test3 job of Jenkins, then increase the build operation, specify which Jenkins job to invoke, enter the job name in the input box below, Here you will be prompted to show which Jenkins jobs you currently have. ("Build" is the word in the field of software automation deployment, and we understand that "dispatch execution" means just fine)

Click Save. Back to the main page , Job2 will follow the configuration, andthe execution of Test3 will also be triggered after job2 execution is complete .

Then we have done a simple job dependency processing.

Other simple interface Instructions:

On the home page you can see the addition of all the jobs and his status

In the upper right corner we can open the page automatically refresh, in fact, is the role of F5.

There are two icons in front of each job, identifying certain meanings, meaning the following:

Here the plus can also add tabs, in fact, is the job classification management display role, what job is displayed under what tab.

Both buttons are executed immediately meaning, click on the job name, you can enter to modify its configuration.

Well, Jenkins combined with the kettle of the dispatch explained I finished, I hope that we can dig a lot of Jenkins function.

Using the Jenkins Automatic deployment tool to indirectly build a scheduling platform for Kettle

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.