[Spark Asia Pacific Research Institute Series] the path to spark practice-Chapter 1 building a spark cluster (step 5) (4)

7. perform the same hadoop 2.2.0 operations on sparkworker1 and sparkworker2 as sparkmaster. We recommend that you use the SCP command to copy the hadoop content installed and configured on sparkmaster to sparkworker1 and sparkworker2;

8. Start and verify the hadoop distributed Cluster

Step 1: format the HDFS File System:

Step 2: Start HDFS in sbin and execute the following command:

The startup process is as follows:

At this point, we found that namenode and secondarynamenode are started on sparkmaster;

Datanode is enabled on sparkworker1 and sparkworker2:

Access http: // sparkmaster: 50070 to log on to Web Control and view the HDFS cluster status:

 

[Spark Asia Pacific Research Institute Series] the path to spark practice-Chapter 1 building a spark cluster (step 5) (4)