Installation and use of Zeppelin

Think immediately can go home, the mood is can't restrain the excitement, alas, or continue to work hard, in fact, do not want to go home so soon, feel back to mean that will come back soon, people really is magic

Today we're going to use Zeppelin, and this is how we can visualize the data we're looking for in a graphical way, okay, let's start our mission today.

1. First we want to download Zeppelin compressed package, when we unzip (this host has been installed on the Java environment)

2. Modify the configuration environment

Enter conf/

Modify Zeppelin-env.sh.template to Zeppelin-env.sh

Modify Zeppelin-site.xml.template to Zeppelin-site.xml

　　

And then we'll modify conf/zeppelin-env.sh new

Export spark_master_ip=192.168.109.136

Export spark_local_ip=192.168.109.136

3. Start Zeppelin

Enter Zeppelin: Go to the bin directory to execute./zeppelin-daemon.sh start

Then the browser accesses the 192.168.109.136:8080 into the interface

　　

Start successful at this point

4.zeppelin Simple and practical

1.text

　　　　

2.html

　　　　

3.table

　　　　

　　　　

5. The data can be analyzed

The most analysis I do is based on the school information, I have the information in the school, the information in each line is ","

To separate the people inside of this, and at this time we analyze this nation

　　　　

Since our Zeppelin is started in Linux, we have to put the original data into the Linux, Zeppelin read the directory is the directory of Linux

　　　　

　　　　

Then we can view the contents of the database, and through this data we find that by reading the data

, in a grouped way, and then in the query data how many, so that the data can be displayed

A.

Val Text = Sc.textfile ("/tmp/xjdx.txt") Case classPerson (College:string,time:integer) Val rdd1= Text.map (line ={val fields= Line.split (",")    if(Fields.length >=Ten) {val mz= Fields (Ten) person (MZ,1)    }Else{person ("1",1)    }})

B.

RDD1.TODF (). Registertemptable ("rdd1")

C.

Select college,count (1 from RDD1 Group by college

This is only for the storage media is the form of the file, for the database of that there is a problem, I will continue to introduce in later chapters, please look forward to

Installation and use of Zeppelin