Hadoop Performance Testing Tool

Su-HDFS

Pi estimator testing:
Time hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar PI 10 100

Teragen/terasort/teravalidate testing:
1. Time hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teragen 10485760000/user/hduser/input #10,485,760,000 = 1000 GB = 1 Tb

2. Time hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar terasort/user/hduser/input/user/hduser/Output

3. Time hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teravalidate/user/hduser/output/user/hduser/validate

Testdfsio testing:
Usage:
Hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar testdfsio-read |-write |-clean [-nrfiles N] [-filesize MB]

1. Time hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar testdfsio-Write-nrfiles 10-filesize 1

2. Time hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar testdfsio-read-nrfiles 10-filesize 1

3. Time hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar testdfsio-clean


Testdfsio, nn1_, mr1 _
Hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.2.0-tests.jar


Teragen/terasort/teravalidate, PI Estimator
Hadoop JAR/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar

This article is from the ilovecat blog, be sure to keep this source http://hj192837.blog.51cto.com/655995/1568673

Hadoop Performance Testing Tool