Hive cannot be accessed when spark2.0.0 is started ... /lib/spark-assembly-*.jar: There is no workaround for that file or directory

After the recent upgrade of the entire schema to spark 2.0.0, the problem was that every time a hive--service Metastore started, a small bug was always reported.

Unable to access/home/ndscbigdata/soft/spark-2.0.0/lib/spark-assembly-*.jar: There is no file or directory.

And what is going on in this line, there is no information on the Internet.

Have no way, had to step-by-step analysis, finally found the crux of the problem.

The main reason is this: in the hive.sh file, the discovery of such a command, originally initially when spark exists, the spark in the relevant jar package loading. And since spark upgraded to 2.0.0, the original Lib's entire large jar package has been replaced by a small jar package that has been dispersed, so there is definitely no way to find this spark-assembly jar package. This is where the problem lies.

# Add Spark assembly jar to the Classpath
if [[-N ' $SPARK _home]]
Then
Sparkassemblypath= ' ls ${spark_home}/lib/spark-assembly-*.jar '
Classpath= "${classpath}:${sparkassemblypath}"

Replace this Spark-assembly-*.jar ' with Jars/*.jar, and there will be no such problem.

This also confirms how each software upgrade process involves automatic transport or backward compatibility issues.