INFO ApplicationMaster:54 - Final app status: FAILED, exitCode: 13, (reason: Uncaught exception: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested virtual cores < 0, or requested virtual cores > max configured, requestedVirtualCores=6, maxVirtualCores=4
The reason is that the task requests 6 vcores, but the maximum value is 4 vcores. Therefore, an error is returned because the application for 6 vcores is unavailable.
We reported this problem after hadoop-2.6.0 upgraded hadoop-2.8.4
Yarn-site.xml
<! -- 2.8.4 Max default 4 --> <property> <Name> yarn. schedres. Maximum-allocation-vcores </Name> <value> 4 </value> </property> <! -- 2.6.0 Max default 32 --> <property> <Name> yarn. schedres. Maximum-allocation-vcores </Name> <value> 32 </value> </property>
Change the 2.8.4 yarn-site.xml to 32 and restart yarn.
Yarn reports the error requested virtual cores <0, or requested virtual cores> MAX configured, requestedvirtualcores = 6, maxvirtualcores = 4