[Spark] [Hive] [Python] [SQL] A small example of Spark reading a hive table

[Spark] [Hive] [Python] [SQL] A small example of Spark reading a hive table
$ cat Customers.txt
1Alius
2Bsbca
3Carlsmx

$ hive

Hive>
> CREATE TABLE IF not EXISTS customers (
> cust_id String,
> Name string,
> Country String
>)
> ROW FORMAT delimited fields TERMINATED by ' \ t ';

hive> Load Data local inpath '/home/training/customers.txt ' into table customers;

Hive>exit

$pyspark

SqlContext =hivecontext (SC)
Filterdf=sqlcontext.sql ("" "SELECT * from Customers WHERE name is like" A% "" "")

Filterdf.limit (3). Show ()

+-------+----+-------+
|cust_id|name|country|
+-------+----+-------+
| 001| ani| us|
+-------+----+-------+

[Spark] [Hive] [Python] [SQL] A small example of Spark reading a hive table