spark hbase scala example

dataset = spark. Read. Format ("libsvm"). Load ("Data/mllib/sample_libsvm_data.txt ")// Split the data into training and Test Sets (30% held out for testing)Val array (tranningdata, testdata) = dataset. randomsplit (Array (0.7, 0.3), seed = 1234l)// Train a naviebayes ModelVal model = new naivebayes (). Fit (tranningdata)// Select example rows to display.Val predictions = model. Transform (testdata)Predict

The program simply reads the data from the file and calculates it.Package com.bill.www/** * Created by Bill on 2016/2/3. * Purpose: Simple data calculation using Scala * source file: Interface record number of 20, including timestamp and floating-point data * execution: Scala Readfile.scala "E:\\spark\\data\\i_22_221000000073_l_ 20151016\\i_22_221000000073_l_2015

One of the simplest examples of Spark's own is mentioned earlier, as well as the section on Sparkcontext, which describes the transformation in the rest of the content.Object SPARKPI { def main (args:array[string]) { val conf = new sparkconf (). Setappname ("Spark Pi") val spark = New Sparkcontext (conf) val slices = if (args.length > 0) args (0). ToInt Else 2 val n = math.min (100000L * Slice

Spark Streaming Application Simple example Package Com.orc.stream Import org.apache.spark.{ sparkconf, Sparkcontext} import org.apache.spark.streaming.{ Seconds, StreamingContext} /** * Created by Dengni on 2016/9/15. Today also are mid-Autumn Festival * Scala 2.10.4 ; 2.11.X not Works * Use method: * Start this program in this window * 192.1