spark scala example

Package Com.leegh.parameterization/*** @author Guohui Li*/Object Type_contraints {def main (args:array[string]): Unit = {def Rocky[t] (i:t) (implicit ev:t println ("Life is too short,you need spark!")}Rocky ("Spark")}}Report:This blog description:1. Organize your ideas and improve yourself.2. Be educated in Liaoliang teacher, what to gain, so recommend.3. Blog focus on practice, superfluous words are not mu

Package Com.leegh.parameterization/*** @author Guohui Li*/Class Pair[t def bigger = if (First.compareto (second) > 0) First Else second}Class Pair_lower_bound[t] (Val first:t, Val second:t) {def Replacefirst[r;: T] (newfirst:r) = new Pair_lower_bound[r] (Newfirst, second)}Object Type_variables_bounds {def main (args:array[string]): Unit = {Val pair = new pair ("Spark", "Hadoop")println (Pair.bigger)}}Report:This blog description:1. Organize your ideas

Package Com.leegh.parameterization/*** @author Guohui Li*/Class Pair_ordering[t:ordering] (Val first:t, Val second:t) {def bigger (implicit ordered:ordering[t]) = {if (Ordered.compare (first, second) > 0) First Else second}}Object Context_bounds {def main (args:array[string]): Unit = {Val pair = new pair_ordering ("Spark", "Hadoop")println (Pair.bigger)Val pairint = new Pair_ordering (3, 5)println (Pairint.bigger)}}Report:This blog description:1. Orga

Package Com.leegh.parameterization/*** @author Guohui Li*/Because breathe returns This,scala the return type is inferred as animal, and because animal has no eat methodClass Animal {def breathe = this}Class Cat extends Animal {def eat = this}Class Animal {def Breathe:this.type = this}Class Cat extends Animal {def eat:this.type = this}Object Singleton_types {def main (args:array[string]): Unit = {Val cat = new CatCat.breathe.eat}}Report:This blog descr

public number is Dt_spark, every day will have big data actual combat video release, please continue to study.Liaoliang DT Big Data dream factory Scala all videos, PPT and code in Baidu Cloud disk link:http://pan.baidu.com/share/home?uk=4013289088#category/type=0 Qq-pf-to=pcqq.groupLiaoliang "Scala Beginner's introductory classic video course" http://edu.51cto.com/lesson/id-66538.htmlLiaoliang "

Package Com.leegh.actorImport Scala.actors.Actor/*** @author Guohui Li*/Object First_actor extends Actor {Def Act () {for (I println ("Step:" + i)println (Thread.CurrentThread (). GetName)Thread.Sleep (2000)}}}Object Second_actor extends Actor {Def Act () {for (I println ("Step further:" + i)println (Thread.CurrentThread (). GetName)Thread.Sleep (2000)}}}Object Hello_actor {def main (args:array[string]): Unit = {First_actor.start ()Second_actor.start ()}}Report:This blog description:1. Organize

Package Com.leegh.parameterization/*** @author Guohui Li*/Class PersonClass Student extends PersonClass C[+t] (Val args:t)Trait Friend[-t] {def makefriend (Somebody:t)}Object Variance {def makefriendwithyou (S:student, f:friend[student]) {f.makefriend (s)}def main (args:array[string]): Unit = {Val Value:c[person] = new C[student] (new Student)}}Report:This blog description:1. Organize your ideas and improve yourself.2. Be educated in Liaoliang teacher, what to gain, so recommend.3. Blog focus on

5. Apply method and Singleton object in Scala to create a new class: As an additional point, the methods placed in object objects are static methods, as follows: Next look at the use of the Apply method: The above code always when we use "val a = Applytest ()" will cause the call of the Apply method and return the value of the method call, that is, the instantiated object of the applytest. C The lass can also be used by the Apply method, as shown

useful for learning APIs, we recommend that you run these examples in one of these two languages, even if you are a Java developer. In each language, these APIs are similar.The simplest way to demonstrate the power of the spark shell is to use them for simple data analysis. Let's start with an example from the Quick Start Guide in the official documentation.The first step is to open a shell. In order to op

The collection mainly has list, set, Tuple, map, etc., we follow the hands-on practical way to learn. We create a list instance in the Eclipse IDE: Now let's look at the code implementation: In the source code, it is stated that the internal is the method of apply to complete the instantiation; In the same way we can instantiate set: You can also see the implementation of the set instantiation object at this point: Next we'll look at the set in the command-line terminal, first of all set:

The MAVEN components are as follows: org.apache.spark spark-streaming-kafka-0-10_2.11 2.3.0The official website code is as follows:Pasting/** Licensed to the Apache software Foundation (ASF) under one or more* Contributor license agreements. See the NOTICE file distributed with* This work for additional information regarding copyright ownership.* The ASF licenses this file to under the Apache License, Version 2.0* (the "License"); You are no

14.0.2. To enable the idea to support Scala development, you need to install the Scala plugin,After the plug-in installation is complete, IntelliJ idea will require a reboot.2.2. Create a MAVEN projectClick Create New Project to select the JDK installation directory in the Project SDK (it is recommended that the JDK version in the development environment be consistent with the JDK version on the

(transformation) and the Action (action). The main difference between the two types of functions is that transformation accepts the RDD and returns the RDD, while the action accepts the RDD to return the non-rdd.The transformation operation is deferred, meaning that a conversion operation that generates another RDD from an RDD is not performed immediately, and the operation is actually triggered when there is an action action.The action operator triggers sp