[Spark] [Python]sortbykey Example

[Spark] [Python]sortbykey Example:

[Email protected] ~]$ HDFs dfs-cat test02.txt
00002 sku010
00001 sku933
00001 sku022
00003 sku888
00004 sku411
00001 sku912
00001 sku331
[Email protected] ~]$

Mydata001=sc.textfile ("Test02.txt")
Mydata002=mydata001.map (Lambda line:line.split ("))

Mydata002.take (3)
OUT[4]: [[u ' 00002 ', U ' sku010 '], [u ' 00001 ', U ' sku933 '], [u ' 00001 ', U ' sku022 ']

Mydata003=mydata002.sortbykey ()

In [9]: Mydata003.take (5)

OUT[9]:
[[u ' 00001 ', U ' sku933 '],
[u ' 00001 ', U ' sku022 '],
[u ' 00001 ', U ' sku912 '],
[u ' 00001 ', U ' sku331 '],
[u ' 00002 ', U ' sku010 ']

In [10]:

API Reference:
Https://spark.apache.org/docs/latest/api/python/pyspark.html#pyspark.RDD

[Spark] [Python]sortbykey Example