Spark cluster deployment and applications

I. Overview of the Environment:

192.168.1.2 Master

192.168.1.3 worker

192.168.1.4 worker

Second, Scala environment settings

[[Email protected] ~]# tar zxvf scala-2.10.4.tgz-c/home/hadoop/[[email protected] ~]# Cd/home/hadoop/[[email protected] hadoop]# ln-s scala-2.10.4 scala[[email protected] ~]# chown-r hadoop.hadoop/home/hadoop/# scalaexport Scala_home=/hom E/hadoop/scalaexport path= $PATH: $HADOOP _dev_home/sbin: $HADOOP _dev_home/bin: $SCALA _home/bin[[email protected] hadoop]# SOURCE/HOME/HADOOP/.BASHRC [[email protected] hadoop]# su-hadoop[[email protected] ~]$ scalawelcome to Scala V Ersion 2.10.4 (Java HotSpot (TM) 64-bit Server VM, Java 1.7.0_25). Type in expressions to has them evaluated. Type:help for more information.scala> # Slave1,slave2 perform the same action

Third, spark installation

Spark cluster deployment and applications