A simple example of "Lucene" three highlighted modules-highlighter

Lucene provides two implementations for highlighting, namely highlighter and Fastvectorhighlighter

The three examples here are all using highlighter;

Example code:

2. Package Com.tan.code;
6. Import Java.io.File;
8. Import java.io.IOException;
10. Import Java.io.StringReader;
14. Import Org.apache.lucene.analysis.TokenStream;
16. Import Org.apache.lucene.analysis.core.SimpleAnalyzer;
18. Import org.apache.lucene.document.Document;
20. Import Org.apache.lucene.index.DirectoryReader;
22. Import Org.apache.lucene.index.IndexReader;
24. Import Org.apache.lucene.index.Term;
26. Import org.apache.lucene.queryparser.classic.ParseException;
28. Import Org.apache.lucene.queryparser.classic.QueryParser;
30. Import Org.apache.lucene.search.IndexSearcher;
32. Import Org.apache.lucene.search.Query;
34. Import Org.apache.lucene.search.ScoreDoc;
36. Import Org.apache.lucene.search.TermQuery;
38. Import Org.apache.lucene.search.TopDocs;
40. Import Org.apache.lucene.search.highlight.Highlighter;
42. Import org.apache.lucene.search.highlight.InvalidTokenOffsetsException;
44. Import Org.apache.lucene.search.highlight.QueryScorer;
46. Import Org.apache.lucene.search.highlight.SimpleHTMLFormatter;
48. Import Org.apache.lucene.search.highlight.SimpleSpanFragmenter;
50. Import org.apache.lucene.search.highlight.TokenSources;
52. Import Org.apache.lucene.store.Directory;
54. Import Org.apache.lucene.store.SimpleFSDirectory;
56. Import org.apache.lucene.util.Version;
58. Import Org.wltea.analyzer.lucene.IKAnalyzer;
62. Public class Highlightertest {
66. //Highlight the text (the following is purely fictitious)
68. private String Text = "China has lots of people,most of them is very poor. is very big.  China become strong now,but The poor people are also poor than other controry ";
72. //Original Highlight
74. public void highlighter () throws IOException, invalidtokenoffsetsexception {
78. Termquery termquery = new Termquery ("field", "China");
80. Tokenstream Tokenstream = new Simpleanalyzer (version.lucene_43)
82. . Tokenstream ("field", new StringReader (text));
86. Queryscorer queryscorer = new Queryscorer (termquery);
88. Highlighter highlighter = new highlighter (queryscorer);
90. Highlighter.settextfragmenter (new Simplespanfragmenter (Queryscorer));
92. System.out.println (Highlighter.getbestfragment (Tokenstream, text));
94. }
98. //Use CSS to highlight the handle
100. public void Highlighter_css (String searchtext) throws ParseException,
102. IOException, Invalidtokenoffsetsexception {
106. //Create enquiry
108. Queryparser Queryparser = new Queryparser (version.lucene_43, "field",
110. new Simpleanalyzer (version.lucene_43));
112. Query query = queryparser.parse (SearchText);
116. //Custom callout highlighting text label
118. Simplehtmlformatter htmlformatter = new Simplehtmlformatter (
120. "<span style=\" backgroud:red\ ">", "</span>");
122. //token of the cell
124. Tokenstream Tokenstream = new Simpleanalyzer (version.lucene_43)
126. . Tokenstream ("field", new StringReader (text));
130. //Creative Queryscoer
132. Queryscorer queryscorer = new Queryscorer (Query, "field");
136. Highlighter highlighter = new Highlighter (Htmlformatter, queryscorer);
138. Highlighter.settextfragmenter (new Simplespanfragmenter (Queryscorer));
142. System.out.println (Highlighter.getbestfragments (tokenstream, Text, 4,
144. "..."));  
146. }
150. //Highlight search results
152. public void Highlighter_sr (String field, String searchtext)
154. throws IOException, ParseException, invalidtokenoffsetsexception {
158. //This example is for easy direct use of the index established by the previous experiment
160. Directory directory = new Simplefsdirectory (new File ("E://myindex"));
162. Indexreader reader = directoryreader.open (directory); //Read directory
164. Indexsearcher search = new Indexsearcher (reader); Initializing the query component
166. Queryparser parser = new Queryparser (version.lucene_43, field,
168. New Ikanalyzer (true));
172. Query query = parser.parse (SearchText);
176. Topdocs td = Search.search (query, 10000); Gets a docid that matches the elements on the
178. scoredoc[] sd = Td.scoredocs; //Load all documnet documents
182. System.out.println ("This hit data:" + sd.length);
184. Queryscorer scorer = New Queryscorer (query, "content");
188. Highlighter highlighter = new highlighter (scorer);
190. Highlighter.settextfragmenter (New Simplespanfragmenter (scorer));
194. For (Scoredoc scoredoc:sd) {
196. Document document = Search.doc (Scoredoc.doc);
198. String content = document.get ("content");
200. Tokenstream Tokenstream = Tokensources.getanytokenstream (
202. Search.getindexreader (), Scoredoc.doc, "content", document,
204. New Ikanalyzer (true));
206. System.out.println (highlighter
208. . getbestfragment (Tokenstream, content));
210. }
212. }
214. }

Test code:

2. @Test
4. Public Void Test () throws IOException, Invalidtokenoffsetsexception,
6. parseexception {
8. //Fail ("not yet implemented");
10. Highlightertest highlightertest = new Highlightertest ();
12. Highlightertest.highlighter ();
14. Highlightertest.highlighter_css ("China");
16. Highlightertest.highlighter_css ("poor");
18. HIGHLIGHTERTEST.HIGHLIGHTER_SR ("content", "moon Light Before Bed");
20. }

Test results:

2. <b>china</b> has lots of people,most of them is very poor. <b>china</b> is very big.   <b>china</b> become strong now,but The poor people is also poor than other controry
3. <Spanstyle="Backgroud:red">china</span> has  lots of people,most of them are very poor. <span style= "backgroud:red" >china</ span> is very big. <span style= "Backgroud: Red ">china</span>  become strong now,but the poor people is also poor than  other controry  
4. China has lots of people,most of them is very<span style= "backgroud:red" span class= "tag" >>poor</span>. China is very big. China become strong now,but the <span  style= "backgroud:red" >poor< span class= "tag" ></span> people is also < span class= "tag" ><span style= "backgroud:red" >poor</ span> than other controry  
6. Hit data: 1
8. <b> Bed </b><b> Pre </B><B> Bright Moon light </B, suspect is ground frost

A simple example of "Lucene" three highlighted modules-highlighter