Record a spark connection problem with MySQL

An error occurred while using spark to connect to MySQL:

08:51:32.495 [main] error-error loading factory org.apache.calcite.jdbc.calcitejdbc41factoryjava.lang.noclassdeffounderror:org/apache/calcite/linq4j/ Queryprovider at Java.lang.ClassLoader.defineClass1 (Native Method) ~[?:1.8.0_144] at JAVA.LANG.CLASSLOADER.D Efineclass (classloader.java:763) ~[?:1.8.0_144] at Java.security.SecureClassLoader.defineClass ( secureclassloader.java:142) ~[?:1.8.0_144] at Java.net.URLClassLoader.defineClass (urlclassloader.java:467) ~[?:1.8 .0_144] at java.net.urlclassloader.access$100 (urlclassloader.java:73) ~[?:1.8.0_144] at Java.net.URLClassLoa Der$1.run (urlclassloader.java:368) ~[?:1.8.0_144] at Java.net.urlclassloader$1.run (urlclassloader.java:362) ~[?:1. 8.0_144] at java.security.AccessController.doPrivileged (Native Method) ~[?:1.8.0_144] at Java.net.URLClassLo Ader.findclass (urlclassloader.java:361) ~[?:1.8.0_144] at Java.lang.ClassLoader.loadClass (classloader.java:424) ~[    ?: 1.8.0_144]    At Sun.misc.launcher$appclassloader.loadclass (launcher.java:335) ~[?:1.8.0_144 "at Java.lang.ClassLoader.loadCl        (classloader.java:357) ~[?:1.8.0_144] at Java.lang.ClassLoader.defineClass1 (Native Method) ~[?:1.8.0_144] At Java.lang.ClassLoader.defineClass (classloader.java:763) ~[?:1.8.0_144 "at Java.security.SecureClassLoader.defin EClass (secureclassloader.java:142) ~[?:1.8.0_144] at Java.net.URLClassLoader.defineClass (urlclassloader.java:467) ~[?:1.8.0_144] at java.net.urlclassloader.access$100 (urlclassloader.java:73) ~[?:1.8.0_144] at Java.net.URLC Lassloader$1.run (urlclassloader.java:368) ~[?:1.8.0_144] at Java.net.urlclassloader$1.run (URLClassLoader.java:362 ) ~[?:1.8.0_144] at java.security.AccessController.doPrivileged (Native Method) ~[?:1.8.0_144] at Java.net.UR Lclassloader.findclass (urlclassloader.java:361) ~[?:1.8.0_144] at Java.lang.ClassLoader.loadClass (        classloader.java:424) ~[?:1.8.0_144]At Sun.misc.launcher$appclassloader.loadclass (launcher.java:335) ~[?:1.8.0_144 "at Java.lang.ClassLoader.loadClass  (classloader.java:357) ~[?:1.8.0_144] at Java.lang.ClassLoader.defineClass1 (Native Method) ~[?:1.8.0_144] at Java.lang.ClassLoader.defineClass (classloader.java:763) ~[?:1.8.0_144] at Java.security.SecureClassLoader.defineC Lass (secureclassloader.java:142) ~[?:1.8.0_144] at Java.net.URLClassLoader.defineClass (urlclassloader.java:467) ~[ ?: 1.8.0_144] at java.net.urlclassloader.access$100 (urlclassloader.java:73) ~[?:1.8.0_144] at Java.net.URLCla Ssloader$1.run (urlclassloader.java:368) ~[?:1.8.0_144] at Java.net.urlclassloader$1.run (URLClassLoader.java:362) ~ [?: 1.8.0_144] at java.security.AccessController.doPrivileged (Native Method) ~[?:1.8.0_144] at Java.net.URLCl Assloader.findclass (urlclassloader.java:361) ~[?:1.8.0_144] at Java.lang.ClassLoader.loadClass (Classloader.java : 424) ~[?:1.8.0_144] at sUn.misc.launcher$appclassloader.loadclass (launcher.java:335) ~[?:1.8.0_144] at Java.lang.ClassLoader.loadClass ( classloader.java:357) ~[?:1.8.0_144] at JAVA.LANG.CLASS.FORNAME0 (Native Method) ~[?:1.8.0_144] at Java.lang. Class.forName (class.java:264) ~[?:1.8.0_144] at Org.apache.calcite.avatica.UnregisteredDriver.instantiateFactory ( unregistereddriver.java:115) [calcite-avatica-1.2.0-incubating.jar:1.2.0-incubating] at Org.apache.calcite.avatica.UnregisteredDriver.createFactory (unregistereddriver.java:74) [ Calcite-avatica-1.2.0-incubating.jar:1.2.0-incubating] at Org.apache.calcite.avatica.unregistereddriver.<init > (unregistereddriver.java:55) [calcite-avatica-1.2.0-incubating.jar:1.2.0-incubating] at Org.apache.calcite.jdbc.driver.<init> (driver.java:53) [calcite-core-1.2.0-incubating.jar:1.2.0-incubating ] at org.apache.calcite.jdbc.driver.<clinit> (driver.java:49) [calcite-core-1.2.0-incubating.jar:1.2.0- Incubating]       At JAVA.LANG.CLASS.FORNAME0 (Native Method) [?: 1.8.0_144] at Java.lang.Class.forName (class.java:348) [?: 1.8.0 _144] at java.sql.DriverManager.isDriverAllowed (drivermanager.java:556) [?: 1.8.0_144] at Java.sql.DriverMana Ger.isdriverallowed (drivermanager.java:548) [?: 1.8.0_144] at Java.sql.DriverManager.getDrivers (Drivermanager.java : 446) [?: 1.8.0_144] at org.apache.spark.sql.execution.datasources.jdbc.jdbcutils$ $anonfun $createconnectionfactory $1.apply (jdbcutils.scala:52) [spark-sql_2.11-2.1.0.jar:2.1.0] at org.apache.spark.sql.execution.datasources.jdbc.jdbcutils$ $anonfun $createconnectionfactory$1.apply ( JDBCUTILS.SCALA:50) [spark-sql_2.11-2.1.0.jar:2.1.0] at org.apache.spark.sql.execution.datasources.jdbc.jdbcrdd$. Resolvetable (jdbcrdd.scala:58) [spark-sql_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.sql.execution.datasources.jdbc.jdbcrelation.<init> (jdbcrelation.scala:113) [Spark-sql_ 2.11-2.1.0.jar:2.1.0] at Org.apache. Spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation (JDBCRELATIONPROVIDER.SCALA:45) [ Spark-sql_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.sql.execution.datasources.DataSource.resolveRelation ( datasource.scala:330) [spark-sql_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.sql.DataFrameReader.load ( dataframereader.scala:152) [spark-sql_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.sql.DataFrameReader.load ( DATAFRAMEREADER.SCALA:125) [spark-sql_2.11-2.1.0.jar:2.1.0] at $line. $read $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $        $IW $ $IW $ $iw .<init> (<console>:45) [Scala-library-2.11.8.jar:?] At $line. $read $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $iw .<init> (<console>:50) [        Scala-library-2.11.8.jar:?] At $line. $read $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $iw .<init> (<console>:52) [        Scala-library-2.11.8.jar:?] At $line. $read $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $iw .<init> (<console>:54) [scala-library-2.11.8.jar:?]        At $line. $read $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $iw .<init> (<console>:56) [Scala-library-2.11.8.jar:?]        At $line. $read $ $IW $ $IW $ $IW $ $IW $ $IW $ $IW $ $iw .<init> (<console>:58) [Scala-library-2.11.8.jar:?]        At $line. $read $ $IW $ $IW $ $IW $ $IW $ $IW $ $iw .<init> (<console>:60) [Scala-library-2.11.8.jar:?]        At $line. $read $ $IW $ $IW $ $IW $ $IW $ $iw .<init> (<console>:62) [Scala-library-2.11.8.jar:?]        At $line. $read $ $IW $ $IW $ $IW $ $iw .<init> (<console>:64) [Scala-library-2.11.8.jar:?]        At $line. $read $ $IW $ $IW $ $iw .<init> (<console>:66) [Scala-library-2.11.8.jar:?]        At $line. $read $ $IW $ $iw .<init> (<console>:68) [Scala-library-2.11.8.jar:?]        At $line $read $ $iw .<init> (<console>:70) [Scala-library-2.11.8.jar:?]        At $line $read .<init> (<console>:72) [Scala-library-2.11.8.jar:?] At $line $read $.<init> (<console>:76) [scala-library-2.11.8.jar:?]        At $line $read $.<clinit> (<console>) [Scala-library-2.11.8.jar:?]        At $line. $eval $. $print $lzycompute (<console>:7) [Scala-library-2.11.8.jar:?]        At $line. $eval $. $print (<console>:6) [Scala-library-2.11.8.jar:?]        At $line $eval. $print (<console>) [Scala-library-2.11.8.jar:?] At Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) ~[?:1.8.0_144 "at Sun.reflect.NativeMethodAccessorIm Pl.invoke (nativemethodaccessorimpl.java:62) ~[?:1.8.0_144] at Sun.reflect.DelegatingMethodAccessorImpl.invoke ( delegatingmethodaccessorimpl.java:43) ~[?:1.8.0_144] at Java.lang.reflect.Method.invoke (method.java:498) ~[?:1.8.0        _144] at Scala.tools.nsc.interpreter.imain$readevalprint.call (imain.scala:786) [Scala-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.imain$request.loadandrun (imain.scala:1047) [Scala-compiler-2.11.8.jar:?] At Scala.tools.nsc.interpreter.imain$wrappedrequest$ $anonfun $loadandrunreq$1.apply (imain.scala:638) [Scala-compiler-2.11.8.jar:?] At scala.tools.nsc.interpreter.imain$wrappedrequest$ $anonfun $loadandrunreq$1.apply (imain.scala:637) [        Scala-compiler-2.11.8.jar:?] At Scala.reflect.internal.util.scalaclassloader$class.ascontext (scalaclassloader.scala:31) [        Scala-reflect-2.11.8.jar:?] At Scala.reflect.internal.util.AbstractFileClassLoader.asContext (abstractfileclassloader.scala:19) [        Scala-reflect-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.imain$wrappedrequest.loadandrunreq (imain.scala:637) [Scala-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.IMain.interpret (imain.scala:569) [Scala-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.IMain.interpret (imain.scala:565) [Scala-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.ILoop.interpretStartingWith (iloop.scala:807) [Scala-compiler-2.11.8.jar:?] At Scala.tools.nsc.interpreter.ILoop.interpretStartingWith (iloop.scala:825) [SCALa-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.ILoop.interpretStartingWith (iloop.scala:825) [Scala-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.ILoop.command (iloop.scala:681) [Scala-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.ILoop.processLine (iloop.scala:395) [Scala-compiler-2.11.8.jar:?]        At Scala.tools.nsc.interpreter.ILoop.loop (iloop.scala:415) [Scala-compiler-2.11.8.jar:?] At scala.tools.nsc.interpreter.iloop$ $anonfun $process$1.apply$mcz$sp (iloop.scala:923) [Scala-compiler-2.11.8.jar        :?]        At scala.tools.nsc.interpreter.iloop$ $anonfun $process$1.apply (iloop.scala:909) [Scala-compiler-2.11.8.jar:?]        At scala.tools.nsc.interpreter.iloop$ $anonfun $process$1.apply (iloop.scala:909) [Scala-compiler-2.11.8.jar:?] At Scala.reflect.internal.util.scalaclassloader$.savingcontextloader (scalaclassloader.scala:97) [        Scala-reflect-2.11.8.jar:?] At Scala.tools.nsc.interpreter.ILoop.process (iloop.scala:909) [scala-Compiler-2.11.8.jar:?] At Org.apache.spark.repl.main$.domain (main.scala:68) [spark-repl_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.repl.Ma In$.main (main.scala:51) [spark-repl_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.repl.Main.main (Main.scala) [Spark-re Pl_2.11-2.1.0.jar:2.1.0] at Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) ~[?:1.8.0_144] at Su N.reflect.nativemethodaccessorimpl.invoke (nativemethodaccessorimpl.java:62) ~[?:1.8.0_144] at Sun.reflect.DelegatingMethodAccessorImpl.invoke (delegatingmethodaccessorimpl.java:43) ~[?:1.8.0_144] at Java.lang . reflect. Method.invoke (method.java:498) ~[?:1.8.0_144] at org.apache.spark.deploy.sparksubmit$.org$apache$spark$deploy$ sparksubmit$ $runMain (sparksubmit.scala:738) [spark-core_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.deploy.sparksubmit$.dorunmain$1 (sparksubmit.scala:187) [spark-core_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.deploy.sparksubmit$.submit (Sparksubmit. scala:212) [spark-core_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.deploy.sparksubmit$.main (SparkSubmit.scala:126) [spark-core_2.11-2.1.0.jar:2.1.0] at Org.apache.spark.deploy.SparkSubmit.main (Sparksubmit.scala) [spark-core_2.11 -2.1.0.jar:2.1.0]caused By:java.lang.ClassNotFoundException:org.apache.calcite.linq4j.QueryProvider at Java.net.u Rlclassloader.findclass (urlclassloader.java:381) ~[?:1.8.0_144] at Java.lang.ClassLoader.loadClass ( classloader.java:424) ~[?:1.8.0_144] at Sun.misc.launcher$appclassloader.loadclass (Launcher.java:335) ~[?:1.8.0_14 4] at Java.lang.ClassLoader.loadClass (classloader.java:357) ~[?:1.8.0_144] ... Morejava.lang.RuntimeException:Error Loading Factory org.apache.calcite.jdbc.CalciteJdbc41Factory at Org.apache.calcite.avatica.UnregisteredDriver.handle (unregistereddriver.java:132) at Org.apache.calcite.avatica.UnregisteredDriver.instantiateFactory (unregistereddriver.java:126) at Org.apache.calcite.avatica. Unregistereddriver.createfactory (unregistereddriver.java:74) at Org.apache.calcite.avatica.UnregisteredDriver. <init> (unregistereddriver.java:55) at org.apache.calcite.jdbc.driver.<init> (driver.java:53) at Org.apache.calcite.jdbc.driver.<clinit> (driver.java:49) at JAVA.LANG.CLASS.FORNAME0 (Native Method) at Java.lang.Class.forName (class.java:348) at java.sql.DriverManager.isDriverAllowed (drivermanager.java:556) at Java.sql.DriverManager.isDriverAllowed (drivermanager.java:548) at Java.sql.DriverManager.getDrivers ( drivermanager.java:446) at org.apache.spark.sql.execution.datasources.jdbc.jdbcutils$ $anonfun $ Createconnectionfactory$1.apply (jdbcutils.scala:52) at Org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils $ $anonfun $createconnectionfactory$1.apply (jdbcutils.scala:50) at Org.apache.spark.sql.execution.datasources.jdbc.jdbcrdd$.resolvetable (jdbcrdd.scala:58) at Org.apache.spark.sql.execution.datasources.jdbc.jdbcrelation.<init> (jdbcrelation.scala:113) at Org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation ( jdbcrelationprovider.scala:45) at Org.apache.spark.sql.execution.datasources.DataSource.resolveRelation ( datasource.scala:330) at Org.apache.spark.sql.DataFrameReader.load (dataframereader.scala:152) at Org.apache.spark.sql.DataFrameReader.load (dataframereader.scala:125) ... Elidedcaused By:java.lang.noclassdeffounderror:org/apache/calcite/linq4j/queryprovider at Java.lang.ClassLoader.defineClass1 (Native Method) at Java.lang.ClassLoader.defineClass (classloader.java:763) at Java.security.SecureClassLoader.defineClass (secureclassloader.java:142) at Java.net.URLClassLoader.defineClass ( urlclassloader.java:467) at java.net.urlclassloader.access$100 (urlclassloader.java:73) at java.net.URLClassLoader$ 1.run (urlclassloader.java:368) at Java.net.urlclassloader$1.run (urlclassloader.java:362) at Java.security.AccessController.doPrivileged (Native Method) at Java.net.URLClassLoader.findClasS (urlclassloader.java:361) at Java.lang.ClassLoader.loadClass (classloader.java:424) at sun.misc.launcher$ Appclassloader.loadclass (launcher.java:335) at Java.lang.ClassLoader.loadClass (classloader.java:357) at Java.lang.ClassLoader.defineClass1 (Native Method) at Java.lang.ClassLoader.defineClass (classloader.java:763) at Java.security.SecureClassLoader.defineClass (secureclassloader.java:142) at Java.net.URLClassLoader.defineClass ( urlclassloader.java:467) at java.net.urlclassloader.access$100 (urlclassloader.java:73) at java.net.URLClassLoader$ 1.run (urlclassloader.java:368) at Java.net.urlclassloader$1.run (urlclassloader.java:362) at Java.security.AccessController.doPrivileged (Native Method) at Java.net.URLClassLoader.findClass ( urlclassloader.java:361) at Java.lang.ClassLoader.loadClass (classloader.java:424) at sun.misc.launcher$ Appclassloader.loadclass (launcher.java:335) at Java.lang.ClassLoader.loadClass (classloader.java:357) at Java.lang.ClassLoader.defineClass1 (Native MEthod) at Java.lang.ClassLoader.defineClass (classloader.java:763) at Java.security.SecureClassLoader.defineClass ( secureclassloader.java:142) at Java.net.URLClassLoader.defineClass (urlclassloader.java:467) at JAVA.NET.URLCLASSLOADER.ACCESS$100 (urlclassloader.java:73) at Java.net.urlclassloader$1.run (URLClassLoader.java : 368) at Java.net.urlclassloader$1.run (urlclassloader.java:362) at java.security.AccessController.doPrivileged ( Native Method) at Java.net.URLClassLoader.findClass (urlclassloader.java:361) at Java.lang.ClassLoader.loadClass ( classloader.java:424) at Sun.misc.launcher$appclassloader.loadclass (launcher.java:335) at Java.lang.ClassLoader.loadClass (classloader.java:357) at JAVA.LANG.CLASS.FORNAME0 (Native Method) at Java.lang.Class.forName (class.java:264) at Org.apache.calcite.avatica.UnregisteredDriver.instantiateFactory ( unregistereddriver.java:115) ... morecaused By:java.lang.ClassNotFoundException:org.apache.calcite.linq4j.QueryProvider at Java.net.URLClasSloader.findclass (urlclassloader.java:381) at Java.lang.ClassLoader.loadClass (classloader.java:424) at Sun.misc.launcher$appclassloader.loadclass (launcher.java:335) at Java.lang.ClassLoader.loadClass ( classloader.java:357) ...　　 More

Connection MySQL code is no problem, but actually will report this mistake, feel very strange, and go to search on the internet also can't find relevant information, is only I encountered this mistake?

At first I thought it was a problem with the MySQL connection jar package, but it was downloaded to the local Java connection and could be connected to MySQL.

At this time notice error classnotfoundexception, general this error is either packet conflict, or packet missing, packet conflict is more disgusting, so first check to see if it is the problem of packet missing, type two shift in idea, In the search box, search for the vegetarian org.apache.calcite.jdbc.CalciteJdbc41Factory. Found this thing, and then to rely on the package to see the relevant jar package, found calcite related to the three jar package, and in the Spark jar package path calcite related jar package only two, OK, download missing jar package on Mven, problem resolution.

Record a spark connection problem with MySQL