thrift for python部署

安裝這個是為了更方便的使用python操作hive。

擷取thrift，

在linux命令下：

wget http://labs.renren.com/apache-mirror/thrift/0.8.0/thrift-0.8.0.tar.gz

tar -xvf thrift-0.8.0.tar.gz

cd thrift-0.8.0

./configure

make

sudo make install

 

然後再安裝thrift of python 模組，很簡單。用之前的easy_install這個命令自動安裝。

[root@master ~]# easy_install thrift
Searching for thrift
Best match: thrift 0.8.0
Processing thrift-0.8.0-py2.7-linux-x86_64.egg
thrift 0.8.0 is already the active version in easy-install.pth

Using /usr/local/lib/python2.7/site-packages/thrift-0.8.0-py2.7-linux-x86_64.egg
Processing dependencies for thrift
Finished processing dependencies for thrift

 

如果是root使用者就直接用easy_install thrift，如果是其他使用者的話需要sudo easy_install thrift。

另外關於python串連到hive的操作，在官方網站上和其他的部落格裡都有相關的介紹操作也很簡單，這裡就不具體舉例操作了。

#!/usr/bin/env python
import sys
sys.path.append('/usr/local/hive/lib/py')
from hive_service import ThriftHive
from hive_service.ttypes import HiveServerException
from thrift import Thrift
from thrift.transport import TSocket
from thrift.transport import TTransport
from thrift.protocol import TBinaryProtocol

def hiveExe(sql):

try:
transport = TSocket.TSocket('127.0.0.1', 10000)
transport = TTransport.TBufferedTransport(transport)
protocol = TBinaryProtocol.TBinaryProtocol(transport)
client = ThriftHive.Client(protocol)
transport.open()

client.execute(sql)

print "The return value is : "
print client.fetchAll()
print "............"
transport.close()
except Thrift.TException, tx:
print '%s' % (tx.message)

if __name__ == '__main__':
hiveExe("select * from paylog limit 10")