solr4.7 Chinese word breaker (ik-analyzer) configuration

SOLR itself on the Chinese word processing is not too good, so the Chinese application often need to add a Chinese word breaker to Chinese word processing, Ik-analyzer is one of the good Chinese word breaker.

First, version information

SOLR version: 4.7.0

Requires Ik-analyzer version: IK Analyzer 2012ff_hf1

Ik-analyzer:http://code.google.com/p/ik-analyzer/downloads/list

Second, the configuration steps

Download the compressed Extract folder after extracting the following directory structure:

We copy the Ikanalyzer2012ff_u1.jar to the Solr\web-inf\lib under the SOLR service.

We copy the IKAnalyzer.cfg.xml and Stopword.dic to the Conf of the core that needs to use the word breaker, and a directory for the core Schema.xml file.

To modify the schema.xml of the core, add the following configuration between the <types></types> configuration items:

[HTML]View Plaincopy

1. <FieldType name="Text_ik" class= "SOLR. TextField ">
2. <analyzer class="Org.wltea.analyzer.lucene.IKAnalyzer"/>
3. </FieldType>

We've got a Text_ik field type, and the word breaker used by this type is Ik-analyzer.

We can use Text_ik when we configure the field type in the schema.xml of this core.

[HTML]View Plaincopy

1. <field name="name" type="Text_ik" indexed="true" stored="true" Multi valued="false" />

Third, Chinese word segmentation test

[HTML]View Plaincopy

2. IKT
6. Text
8. Raw_bytes
10. Start
12. End
14. Type
16. Position
20. People's Republic of China
22. [E4 b8 ad e5 8d 8e e4 ba ba e6 b0 e5 b1 e5 8c e5 9b BD]
24. 0
26. 7
28. Cn_word
30. 1
34. Chinese people
36. [E4 b8 ad e5 8d 8e e4 ba ba e6 b0 91]
38. 0
40. 4
42. Cn_word
44. 2
48. Chinese
50. [E4 b8 ad e5 8d 8e]
52. 0
54. 2
56. Cn_word
58. 3
62. Chinese
64. [E5 8d 8e e4 ba Ba]
66. 1
68. 3
70. Cn_word
72. 4
76. People's Republic
78. [E4 ba ba e6 b0 e5-B1 e5 8c e5 9b BD]
80. 2
82. 7
84. Cn_word
86. 5
90. People
92. [E4 ba ba e6 b0 91]
94. 2
96. 4
98. Cn_word
100. 6
104. Republic
106. [E5 b1 e5 8c e5 9b BD]
108. 4
110. 7
112. Cn_word
114. 7
118. Republican
120. [E5 b1 e5 8c]
122. 4
124. 6
126. Cn_word
128. 8
132. Country
134. [E5 9b BD]
136. 6
138. 7
140. Cn_char
142. 9

solr4.7 Chinese word breaker (ik-analyzer) configuration