Hadoop YARN ERROR 1/1 local-dirs is bad *, 1/1 log-dirs is bad *

Source: Internet
Author: User

Turn http://blog.csdn.net/u012303571/article/details/46913471

  View NodeManager Log send the following information  2015-07-16 15:28:58,643 WARN Org.apache.hadoop.yarn.server.nodemanager.directorycollection:directory/opt/beh/data/yarn/nmlocal error, used Space above threshold of 90.0%, removing from List of valid directories2015-07-16 15:28:58,645 WARN org.apache.hadoop.yarn . Server.nodemanager.directorycollection:directory/opt/beh/logs/yarn/nmlogs error, used space above threshold of 90% , removing from List of valid directories2015-07-16 15:28:58,645 INFO Org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService:Disk (s) failed:1/1 local-dirs is bad:/opt/beh/ data/yarn/nmlocal; 1/1 Log-dirs is bad:/opt/beh/logs/yarn/nmlogs2015-07-16 15:28:58,645 ERROR Org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService:Most of the disks failed. 1/1 Local-dirs is bad:/opt/beh/data/yarn/nmlocal; 1/1 Log-dirs is bad:/opt/beh/logs/yarn/nmlogs2015-07-16 15:28:58,648 INFO Org.apache.hadoop.yarn.event.AsyncDispatcher:Registering class Org.apache.hadoOp.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for Class Org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.logaggregationservice2015-07-16 15:28:58,648 INFO Org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:per Directory File limit = 81922015-07-16 15:28:58,658 INFO org.apache.hadoop.yarn.event.AsyncDispatcher:Registering class Org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for Class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice$ Localizertracker2015-07-16 15:28:58,711 WARN Org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices:The auxilurary Service named ' Mapreduce_ Shuffle ' in the configuration are for Class class Org.apache.hadoop.mapred.ShuffleHandler which have a name of ' Httpshuffle ' . Because these is not the same tools trying to send servicedata and read ServiceMeta Data May has issues unless the refer to the name in the config.  solution   remove some of the useless data to reduce the disk capacity to 90%2015-07-16 15:29:06,808 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl:Notifying Containermanager to unblock new container-requests2015-07-16 15:38:58,817 INFO Org.apache.hadoop.yarn.server.nodemanager.directorycollection:directory/opt/beh/data/yarn/nmlocal passed disk Check, adding to List of valid directories.2015-07-16 15:38:58,821 INFO Org.apache.hadoop.yarn.server.nodemanager.directorycollection:directory/opt/beh/logs/yarn/nmlogs passed disk Check, adding to List of valid directories.2015-07-16 15:38:58,821 INFO Org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService:Disk (s) turned GOOD:1/1 local-dirs is good:/opt/ beh/data/yarn/nmlocal; 1/1 Log-dirs is good:/opt/beh/logs/yarn/nmlogs

Hadoop YARN ERROR 1/1 local-dirs is bad *, 1/1 log-dirs is bad *

Related Article

E-Commerce Solutions

Leverage the same tools powering the Alibaba Ecosystem

Learn more >

Apsara Conference 2019

The Rise of Data Intelligence, September 25th - 27th, Hangzhou, China

Learn more >

Alibaba Cloud Free Trial

Learn and experience the power of Alibaba Cloud with a free trial worth $300-1200 USD

Learn more >

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.