Now the latest version is 1.2.0
I use the MAVEN compilation, the official website has ready-made compile commands
Http://spark.apache.org/docs/latest/building-spark.html
My Hadoop is 2.2.0, so the command is:
Export maven_opts="-xmx2g-xx:maxpermsize=512m-xx:reservedcodecachesize=512m" -pyarn-phadoop-2.2 -dhadoop.version=2.2. 0 -dskiptests Clean Package
An error was encountered during compilation
The online statement is:
Find the Mllib\src\main\scala\org\apache\spark\mllib\optimization\gradient.scala file and bring // our loss Two lines of function removal
But not reliable, in fact, as long as the breeze_2.10-0.10.jar himself to download copy to the corresponding directory on the line
The compiled jar package is under the./assembly/target/scala-2.10/Directory
To build a deployment package
./make-distribution.sh--tgz
A binary package was generated under the root directory
spark1.2.0 compiling