Home > Internet > Online Trends

Calculation method of job execution time for homogeneous Hadoop environment

Source: Internet
Author: User
Keywords Hadoop mapreduce job execution time
Tags analyzing environment error hadoop help operation scheduling show
Developer on Alibaba Coud: Build your first app with APIs, SDKs, and tutorials on the Alibaba Cloud. Read more ＞

Calculation method of job execution time for homogeneous Hadoop environment

Zhang Macro Hai Linpeng Jia Zongpu Shen Chao Wentao

Execution time is one of the important reference factors of job scheduling. By analyzing the execution characteristics of Hadoop MapReduce environment, this paper proposes a method to estimate the execution time of the work by using Map task and reduce task execution time as input. Under certain assumptions, this method obtains the execution time of map task and reduce task with the help of job pre execution. The experimental results show that the error rate of operation time is less than 7.


Calculation method of job execution time for homogeneous Hadoop environment

This article is an English version of an article which is originally in the Chinese language on aliyun.com and is provided for information purposes only. This website makes no representation or warranty of any kind, either expressed or implied, as to the accuracy, completeness ownership or reliability of the article or any translations thereof. If you have any concerns or complaints relating to the article, please send an email, providing a detailed description of the concern or complaint, to info-contact@alibabacloud.com. A staff member will contact you within 5 working days. Once verified, infringing content will be removed immediately.

Related Keywords:
execution time php time calculation cpu idle time calculation execution of for loop in c php time code execution python execution time mysql query execution time
Related Article
Getting Started with CDN
Front-end Must Learn: CDN Acceleration Principle
Elements of CDN Network
Understand the Principle of CDN Acceleration in One Article
Cloud Security Issues Derived from the Development of Cloud C...
8 New Types of Attacks Facing the Cloud Environment

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

Hot Article
Hot Tags
computing conference access forum computer class data get http html applications
Popular Keywords
node js build network management system tutorial network configure network ipv6 need to connect to internet no machine download network with new users network dns name of 7 days

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

Get Started for Free

  • Sales Support

    1 on 1 presale consultation

    Chat Contact Sales

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

    Open a Ticket

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.

    Learn More