Home > Cloud Computing > Cloud Informations

About map and reduce maximum concurrency number settings

Source: Internet
Author: User
Keywords concurrency Value name can reboot
Developer on Alibaba Coud: Build your first app with APIs, SDKs, and tutorials on the Alibaba Cloud. Read more ＞
About map and reduce the maximum number of concurrent Settings blog Category: Test hadoop&http://www.aliyun.com/zixun/aggregation/37954.html ">nbsp;

I. Environmental

1. Hadoop 0.20.2

2, operating system Linux

Ii. Setting up

1, because Hadoop cluster all machines can not be completely configured, so the different node machines concurrent maximum map and reduce number of the best not the same.

2, modify the Mapreduce-sit.xml file on the corresponding node machine, add the following parameters:

<property> <name>mapred.tasktracker.map.tasks.maximum</name> <value>2</value> <description>the Maximum number of map tasks that'll be run simultaneously by a task tracker. </description></property><property> <name>mapred.tasktracker.reduce.tasks.maximum</ name> <value>2</value> <description>the Maximum number of reduce tasks that'll be run Simultaneously by a task tracker. </description></property>

This field value can be different on each node machine.

3, view the http://192.168.3.131:50030/machines.jsp?type=active to check the number.

Iii. Summary

1, after configuration, do not need to restart the cluster of all the machines, just restart your modified node machine can be.

2, if the Web page can not see the change, then execute any job, the value will highlight the change.

3, combined with the fair scheduler to use, can maximize performance.

From: http://blog.csdn.net/dajuezhao/article/details/5809788

This article is an English version of an article which is originally in the Chinese language on aliyun.com and is provided for information purposes only. This website makes no representation or warranty of any kind, either expressed or implied, as to the accuracy, completeness ownership or reliability of the article or any translations thereof. If you have any concerns or complaints relating to the article, please send an email, providing a detailed description of the concern or complaint, to info-contact@alibabacloud.com. A staff member will contact you within 5 working days. Once verified, infringing content will be removed immediately.

Related Keywords:
json map reduce php map reduce map reduce mongodb ruby map reduce concurrency and multithreading in c maximum number in a list python unix maximum number of files in a directory
Related Article
What Is Cached Data
How Do I Choose a Cloud Hosting Provider for A Startup?
How Do I Choose a Cloud Hosting Service?
3 Models of Cloud Computing Services IaaS, PaaS, SaaS
Best Cloud Computing Provider Trends for 2020

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

Hot Article
Hot Tags
computing conference access forum computer class data get http html applications
Popular Keywords
direct digital landing development documentation data user director of marketing deploy it ddos how to description of products and services ddos information data website domain to dns

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

Get Started for Free

  • Sales Support

    1 on 1 presale consultation

    Chat Contact Sales

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

    Open a Ticket

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.

    Learn More