Highlights of hadoop pseudo-distributed configuration problems

Question 1: cocould only be replicated to 0 nodes, instead of 1

2013-06-24 11:39:32, 383 error Org. apache. hadoop. security. usergroupinformation: priviledgedactionexception as: zqgame cause: Java. io. ioexception: File/data/zqhadoop/data/mapred/system/jobtracker.info cocould only be replicated to 0 nodes, instead of 12013-06-24 11:39:32, 384 info Org. apache. hadoop. IPC. server: IPC server handler 1 on 9000, call addblock (/data/zqhadoop/data/mapred/system/jobtracker.info, dfsclient_nonmapreduce _-344066732_1, null) from 192.168.216.133: 59866: Error: java. io. ioexception: File/data/zqhadoop/data/mapred/system/jobtracker.info cocould only be replicated to 0 nodes, instead of 1java. io. ioexception: File/data/zqhadoop/data/mapred/system/jobtracker.info Cocould only be replicated to 0 nodes, instead of 1 At Org. apache. hadoop. HDFS. server. namenode. fsnamesystem. getadditionalblock (fsnamesystem. java: 1920) at Org. apache. hadoop. HDFS. server. namenode. namenode. addblock (namenode. java: 783) at Sun. reflect. nativemethodaccessorimpl. invoke0 (native method) at Sun. reflect. nativemethodaccessorimpl. invoke (nativemethodaccessorimpl. java: 57) at Sun. reflect. delegatingmethodaccessorimpl. invoke (delegatingmethodaccessorimpl. java: 43) at java. lang. reflect. method. invoke (method. java: 601) at Org. apache. hadoop. IPC. RPC $ server. call (RPC. java: 587) at Org. apache. hadoop. IPC. server $ handler $ 1.run( server. java: 1432) at Org. apache. hadoop. IPC. server $ handler $ 1.run( server. java: 1428) at java. security. accesscontroller. doprivileged (native method) at javax. security. auth. subject. DOAs (subject. java: 415) at Org. apache. hadoop. security. usergroupinformation. DOAs (usergroupinformation. java: 1190) at Org. apache. hadoop. IPC. server $ handler. run (server. java: 1426)

Here, hadoop finds available nodes, but the results cannot be found.

Problem at/etc/hosts and $ hadoop_home/CONF/mapred-site.xml and core-site.xml.

Solution:

1. Modify $ hadoop_home/CONF/mapred-site.xml and core-site.xml to change host to IP Address

Core-site.xml

 
Zqgame @ master :~ /Hadoop-1.2.0/bin $ more ../CONF/core-site.xml <? XML version = "1.0"?> <? XML-stylesheet type = "text/XSL" href = "configuration. XSL"?> <! -- Put site-specific property overrides in this file. --> <configuration> <property> <Name> FS. default. name </Name> <value> HDFS: // 192.168.216.20.: 9000 </value> </property> <Name> hadoop. TMP. dir </Name> <value>/data/zqhadoop/Data </value> </property> </configuration>
 

Mapred-site.xml

Zqgame @ master :~ /Hadoop-1.2.0/bin $ more ../CONF/mapred-site.xml <? XML version = "1.0"?> <? XML-stylesheet type = "text/XSL" href = "configuration. XSL"?> <! -- Put site-specific property overrides in this file. --> <configuration> <property> <Name> mapred. job. tracker </Name> <value> 192.168.216.20.: 9001 </value> </property> </configuration>
 

2. Modify/etc/hosts configuration and add local IP binding

 
Zqgame @ master :~ /Hadoop-1.2.0/bin $ more/etc/hosts127.0.0.1 localhost127.0.1.1 master192.168.216.20.localhost. localdomain localhost
 

3. Disable the Firewall

Please note the transfer: http://blog.csdn.net/weijonathan/article/details/9162619