Hadoop Benchmark Test and example

#pi值示例hadoop Jar/app/cdh23502/share/hadoop/mapreduce2/hadoop-mapreduce-examples-2.3.0-cdh5.0.2. Jar PI -  $#生成数据 The first parameter is the number of rows the second parameter is the location of the Hadoop jar/app/cdh23502/share/hadoop/mapreduce2/hadoop-mapreduce-examples-2.3.0-cdh5.0.2. Jar Teragen1000000/teradata# Specifies the number of maps used, default is 2 Hadoop jar/app/cdh23502/share/hadoop/mapreduce2/hadoop-mapreduce-examples-2.3.0-cdh5.0.2. Jar Teragen-dmapred.map.tasks=Ten 1000000/terasort# Testing the functionality of sequencing Hadoop jar/app/cdh23502/share/hadoop/mapreduce2/hadoop-mapreduce-examples-2.3.0-cdh5.0.2. Jar Terasort/teradata/terasortout# Test HDFs Write file baseline test Hadoop jar/app/cdh23502/share/hadoop/mapreduce2/hadoop-mapreduce-client-jobclient-2.3.0-cdh5.0.2-tests.jar Testdfsio-Write-nrfilesTen-filesize -

This version of hadoop-2.3cdh5.0.2 is now used

In the execution of the task, found that there are a lot of nodemanager inside Container is successfully completed, but in front still will produce similar container was appmaster killed, exit with non zero code 143

This kind of log, let me very puzzled, in the Web UI page also can see this, but the whole task after running on the Web page will not be seen.

Later on the Internet search, found that this is yarn a bug.

about how to patch, patch with patches, patch needs to be installed.

Then recompile the module and replace the associated jar package.

Hadoop Benchmark Test and example