Python3處理檔案中每個詞的方法

Python3處理檔案中每個詞的方法

 　　本文執行個體講述了Python3處理檔案中每個詞的方法。分享給大家供大家參考。具體實現方法如下：

　　?

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45

''''' Created on Dec 21, 2012 處理檔案中的每個詞 @author: liury_lab ''' import codecs the_file = codecs.open('d:/text.txt', 'rU', 'UTF-8') for line in the_file: for word in line.split(): print(word, end = "|") the_file.close() # 若詞的定義有變，可使用Regex # 如詞被定義為數字字母，連字號或單引號構成的序列 import re the_file = codecs.open('d:/text.txt', 'rU', 'UTF-8') print() print('************************************************************************') re_word = re.compile('[\w\'-]+') for line in the_file: for word in re_word.finditer(line): print(word.group(0), end = "|") the_file.close() # 封裝成迭代器 def words_of_file(file_path, line_to_words = str.split): the_file = codecs.open('d:/text.txt', 'rU', 'UTF-8') for line in the_file: for word in line_to_words(line): yield word the_file.close() print() print('************************************************************************') for word in words_of_file('d:/text.txt'): print(word, end = '|') def words_by_re(file_path, repattern = '[\w\'-]+'): the_file = codecs.open('d:/text.txt', 'rU', 'UTF-8') re_word = re.compile('[\w\'-]+')   def line_to_words(line): for mo in re_word.finditer(line): yield mo.group(0) # 原書為return，發現結果不對，改為yield return words_of_file(file_path, line_to_words) print() print('************************************************************************') for word in words_by_re('d:/text.txt'): print(word, end = '|')

　　希望本文所述對大家的Python程式設計有所協助。