spark scala tutorial

Learn Spark 2.0 (new features, real projects, pure Scala language development, CDH5.7)Share the network disk download--https://pan.baidu.com/s/1c2f9zo0 password: pzx9Spark entered the 2.0 era, introducing many excellent features, improved performance, and more user-friendly APIs. In the "unified programming" is very impressive, the implementation of offline computing and Flow computing API unification, the

Scala Beginner's intermediate-Advanced Classic (66th: Scala concurrent programming experience and its application in Spark source code) content introduction and video link2015-07-24DT Big Data Dream FactoryFrom tomorrow onwards, be a diligent person.Watch videos, videos, share videosDT Big Data Dream Factory-scala--Adv

Directory installation JDK installation Scala IDE for Eclipse configuration spark configuration Hadoop create Maven engineering Scala code entry 7 Item 8 Item 9 Installing the JDK Requires installation of jdk1.8 or later.Back to Catalog installing Scala IDE for Eclipse

Package Com.leegh.parameterization/*** @author Guohui Li*/Import Scala.reflect.ClassTagClass Trible[f, S, T] (Val first:f, Val second:s, Val third:t)Object Hello_type_parameterization {def main (args:array[string]): Unit = {val triple = new Triple ("Spark", 3, 3.1415)Val bigdata = new triple[string, String, Char] ("Spark", "Hadoop", ' R ')def Getdata[t] (list:list[t]) = List (LIST.LENGTH/2)println (GetData

Package Com.leegh.implicits/*** @author Guohui Li*/Object Context_implicits {Implicit val default:string = "Java"}Object Param {def print (content:string) (implicit language:string) {println (language + ":" + content)}}Object Context_parameters {def main (args:array[string]): Unit = {Param.print ("Spark") ("Scala")Import Context_implicits._Param.print ("Hadoop")}}Report:This blog description:1. Organize you

Package Com.leegh.parameterization/*** @author Guohui Li*/Object Type_contraints {def main (args:array[string]): Unit = {def Rocky[t] (i:t) (implicit ev:t println ("Life is too short,you need spark!")}Rocky ("Spark")}}Report:This blog description:1. Organize your ideas and improve yourself.2. Be educated in Liaoliang teacher, what to gain, so recommend.3. Blog focus on practice, superfluous words are not mu

Package Com.leegh.parameterization/*** @author Guohui Li*/Class Pair[t def bigger = if (First.compareto (second) > 0) First Else second}Class Pair_lower_bound[t] (Val first:t, Val second:t) {def Replacefirst[r;: T] (newfirst:r) = new Pair_lower_bound[r] (Newfirst, second)}Object Type_variables_bounds {def main (args:array[string]): Unit = {Val pair = new pair ("Spark", "Hadoop")println (Pair.bigger)}}Report:This blog description:1. Organize your ideas

Package Com.leegh.parameterization/*** @author Guohui Li*/Class Pair_ordering[t:ordering] (Val first:t, Val second:t) {def bigger (implicit ordered:ordering[t]) = {if (Ordered.compare (first, second) > 0) First Else second}}Object Context_bounds {def main (args:array[string]): Unit = {Val pair = new pair_ordering ("Spark", "Hadoop")println (Pair.bigger)Val pairint = new Pair_ordering (3, 5)println (Pairint.bigger)}}Report:This blog description:1. Orga

Package Com.leegh.parameterization/*** @author Guohui Li*/Because breathe returns This,scala the return type is inferred as animal, and because animal has no eat methodClass Animal {def breathe = this}Class Cat extends Animal {def eat = this}Class Animal {def Breathe:this.type = this}Class Cat extends Animal {def eat:this.type = this}Object Singleton_types {def main (args:array[string]): Unit = {Val cat = new CatCat.breathe.eat}}Report:This blog descr

public number is Dt_spark, every day will have big data actual combat video release, please continue to study.Liaoliang DT Big Data dream factory Scala all videos, PPT and code in Baidu Cloud disk link:http://pan.baidu.com/share/home?uk=4013289088#category/type=0 Qq-pf-to=pcqq.groupLiaoliang "Scala Beginner's introductory classic video course" http://edu.51cto.com/lesson/id-66538.htmlLiaoliang "

Package Com.leegh.actorImport Scala.actors.Actor/*** @author Guohui Li*/Object First_actor extends Actor {Def Act () {for (I println ("Step:" + i)println (Thread.CurrentThread (). GetName)Thread.Sleep (2000)}}}Object Second_actor extends Actor {Def Act () {for (I println ("Step further:" + i)println (Thread.CurrentThread (). GetName)Thread.Sleep (2000)}}}Object Hello_actor {def main (args:array[string]): Unit = {First_actor.start ()Second_actor.start ()}}Report:This blog description:1. Organize

Package Com.leegh.parameterization/*** @author Guohui Li*/Class PersonClass Student extends PersonClass C[+t] (Val args:t)Trait Friend[-t] {def makefriend (Somebody:t)}Object Variance {def makefriendwithyou (S:student, f:friend[student]) {f.makefriend (s)}def main (args:array[string]): Unit = {Val Value:c[person] = new C[student] (new Student)}}Report:This blog description:1. Organize your ideas and improve yourself.2. Be educated in Liaoliang teacher, what to gain, so recommend.3. Blog focus on

implicit object, then import the function of this type, and then the man can also be used under the function of implicit object in the implicit conversion. Implicit parameters, which can be used to transmit the parameters for an implied number of variables.First write a function:def talk (name:string) (implicit content:string) = println (name + ":" + content), the 2nd is an implicit reference, and then the talk-side If there are no implicit parameters, the editor will report it! At this poi