Prompt for problems:
Exception in thread "main" java.io.IOException:Error opening job jar:/home/deploy/recsys/workspace/ouyangyewei/ Recommender-dm-1.0-snapshot-lib at org.apache.hadoop.util.RunJar.main (runjar.java:90) caused by: Java.util.zip.ZipException:error in opening zip file @ java.util.zip.ZipFile.open (Native Method) at Java.util.zip.zipfile.<init> (zipfile.java:127) at java.util.jar.jarfile.<init> (JarFile.java:135 ) at java.util.jar.jarfile.<init> (jarfile.java:72) at Org.apache.hadoop.util.RunJar.main ( runjar.java:88)-bash-3.2$ Hadoop fs-ls/home/deploy/recsys/workspace/ouyangyeweiwarning: $HADOOP _home is deprecated.
Dispatch command:
Hadoop jar Recommender-dm_fat.jar Com.yhd.ml.statistics.category.GenCategoryUserProfileJob--userprofiletable Full_ User_profile--categoryid 957370--categoryfile/user/hive/warehouse/category/part-m-00000--output/home/deploy/ Recsys/workspace/ouyangyewei/output
There are two general reasons for this error:1. First check if the jar package is available under the corresponding path2. The path to the jar package is written correctly3. There is a problem with the jar package
The reason is: there is no such jar in the corresponding folder, I found the jar package with the Hadoop fs-ls folder path command, but I did not see the jar package with the LL command,
differences between the "ll" command and the "Hadoop fs-ls path" command:
1. ll command: View all files locally on the server
2. hadoop fs-ls Path command: View all HDFs files
The Hadoop dispatch command dispatches the server-local jar package
"Error opening job jar" errors when Hadoop scheduler occurs