Python-redis-pipe file

Redis Import data is a headache, involving tens of millions of, import or very time-consuming, through the generation of pipe files more quickly.

The python3.6.1 version runs in a Linux environment

    With open ("Data1", "W") as F: for        D in data:            k = d["key"]            v = d[' value ')            f.write (' *3\r\n$3\r\nset\r\n$%d\ r\n%s\r\n$%d\r\n%s\r\n '% (len (bytes (k, ' Utf-8 ')), K, Len (bytes (v, ' utf-8 ')), V))

　　

python2.7

    For line in Lines:line=line.strip (' \ n ')        jsonline = json.loads (line)        province = jsonline["province"]if province = = Henan:            key = jsonline["Company_Name"]            k = key.encode (' utf-8 ')    v = line            print ' *3\r\n$3\r\nset\r\n$% d\r\n%s\r\n$%d\r\n%s\r\n '% (Len (k), K, Len (v), V),

　　

127.0.0.1:6379> Select 10ok127.0.0.1:6379[10]> dbsize (integer) 2907521

　　

Python-redis-pipe file