Spark-shell execute script and pass in parameters

How to use:

./spark-script. sh your_file.scala first_arg second_arg third_arg

Script :

scala_file=$1Shift 1arguments=[email protected] #set+o POSIX # To enable process substitution if not running on bash spark-shell--master Yarn--deploy-Mode Client--Queue Default--driver-memory 2G--executor-Memory 4G--num-executorsTen         -I < (Echo 'val args = "'$arguments'". Split (" \\s+ ")';Cat$scala _file)

Linux shell redirection:

Command < filename > filename2

command commands use the filename file as the standard input, with the filename2 file as the standard output

Reference documents:

Http://stackoverflow.com/questions/29928999/passing-command-line-arguments-to-spark-shell

Spark-shell execute script and pass in parameters