Lazy-linalg:spark third-party dependent packaging

• Brief introduction
• The SBT-based approach
• Idea-based approach

Brief introduction

This mission is to pack the third package Lazy-linalg
The package, which contains the SBT script

The SBT-based approach

Download the source code after decompression, in the command line mode (CMD) to enter the source address
E:\Workdir\ScalaWorkdir\lazy-linalg-master
Then execute the command: SBT

This method is simple, but the compilation process requires networking to download a large number of dependent jar packages
has not been successful due to the impact of networking

Idea-based approach

According to the source of the package structure (), the code in my application directly add the package structure. And then compile the package

Idea Project directory structure schematic

PS Compile time note depends on the version, because Lazy-linalg depends on the release of Spark 1.5, and the first compilation setting depends on: Spark-assembly-1.3.0-hadoop2.4.0.jar. So the compilation does not pass
The compilation dependency is later set to: Spark-assembly-1.5.2-hadoop2.6.0.jar is compiled successfully.

PS: Since there is currently no 1.5 version of Spark, it has not been run after the test

Lazy-linalg:spark third-party dependent packaging