This evening, I listened to Liaoliang, the 17th lesson of the IMF Legend Action Transformations, which was written in Scala Cogroup:
def main (args:array[string]): Unit ={val sc= Sparkcontext ("Transformations") Cogrouptrans (SC) sc.stop ()}def Cogrouptrans (sc:sparkcontext): Unit={val Stunames=Array (Tuple2 (1, "Spark"), Tuple2 (2, "TECC"), Tuple2 (3, "Hadoop")) Val stuscores=Array (Tuple2 (1,100), Tuple2 (1,99), Tuple2 (2,95), Tuple2 (3,65)) Val names=sc.parallelize (Stunames) Val scores=sc.parallelize (stuscores) Val Stunameandscore=Names.cogroup (scores) Stunameandscore.collect (). foreach (println)}
Follow-up courses can be referred to Sina Weibo Liaoliang _dt Big Data Dream Factory: Http://weibo.com/ilovepains
Liaoliang China Spark First person, public number Dt_spark
Forward please specify the source.
Spark IMF legendary Action 17th lesson Transformations Combat Summary