Hadoop---wordcount command

Source: Internet
Author: User
Tags shuffle hadoop fs

[Email protected] file]$ Hadoop jar ~/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.2.jar Wordcount/inputfile output
16/04/11 22:31:02 INFO Client. Rmproxy:connecting to ResourceManager at master/192.168.222.122:18040
16/04/11 22:31:03 INFO input. Fileinputformat:total input paths to Process:2
16/04/11 22:31:03 INFO MapReduce. Jobsubmitter:number of Splits:2
16/04/11 22:31:03 INFO MapReduce. Jobsubmitter:submitting Tokens for job:job_1460438506725_0002
16/04/11 22:31:03 INFO Impl. yarnclientimpl:submitted Application application_1460438506725_0002
16/04/11 22:31:04 INFO MapReduce. Job:the URL to track the job:http://master:18088/proxy/application_1460438506725_0002/
16/04/11 22:31:04 INFO MapReduce. Job:running job:job_1460438506725_0002
16/04/11 22:31:13 INFO MapReduce. Job:job job_1460438506725_0002 running in Uber Mode:false
16/04/11 22:31:13 INFO MapReduce. Job:map 0% Reduce 0%
16/04/11 22:31:26 INFO MapReduce. Job:map 100% Reduce 0%
16/04/11 22:31:34 INFO MapReduce. Job:map 100% Reduce 100%
16/04/11 22:31:34 INFO MapReduce. Job:job Job_1460438506725_0002 completed successfully
16/04/11 22:31:34 INFO MapReduce. job:counters:49
File System Counters
File:number of bytes read=67
File:number of bytes written=290851
File:number of Read operations=0
File:number of Large Read operations=0
File:number of Write Operations=0
Hdfs:number of bytes read=237
Hdfs:number of bytes Written=25
Hdfs:number of Read operations=9
Hdfs:number of Large Read operations=0
Hdfs:number of Write operations=2
Job Counters
Launched Map tasks=2
launched reduce Tasks=1
Data-local Map tasks=2
Total time spent by all maps in occupied slots (ms) =21525
Total time spent by all reduces in occupied slots (ms) =6185
Total time spent by all map tasks (ms) =21525
Total time spent by all reduce tasks (ms) =6185
Total Vcore-seconds taken by all map tasks=21525
Total Vcore-seconds taken by all reduce tasks=6185
Total Megabyte-seconds taken by all map tasks=22041600
Total Megabyte-seconds taken by all reduce tasks=6333440
Map-reduce Framework
Map input records=2
Map Output records=6
Map Output bytes=61
Map output materialized bytes=73
Input Split bytes=200
Combine input Records=6
Combine Output records=5
Reduce input groups=3
Reduce Shuffle bytes=73
Reduce input Records=5
Reduce Output records=3
Spilled records=10
Shuffled Maps =2
Failed shuffles=0
Merged Map outputs=2
GC time Elapsed (ms) =267
CPU Time Spent (ms) =2860
Physical memory (bytes) snapshot=515694592
Virtual memory (bytes) snapshot=2516971520
Total committed heap usage (bytes) =257171456
Shuffle Errors
Bad_id=0
Connection=0
Io_error=0
Wrong_length=0
Wrong_map=0
Wrong_reduce=0
File Input Format Counters
Bytes read=37
File Output Format Counters
Bytes written=25
[[email protected] file]$ Hadoop fs-ls output
Found 2 Items
-rw-r--r--1 zznu supergroup 0 2016-04-11 22:31 output/_success
-rw-r--r--1 zznu supergroup 2016-04-11 22:31 output/part-r-00000
[Email protected] file]$

Hadoop---wordcount command

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.