Strategy for highlighting in Lucene or SOLR

One: Functional background

Recently to do a highlight of the search needs, has been done before, so there is no difficulty, but the original use is Lucene, now to be replaced SOLR, In the lucene4.x, scattered in the previous article also analyzed how to achieve highlighting in the search, there are three ways, the specific content, please refer to the previous 2 articles:
First: How to achieve highlighting in Lucene4.3
http://qindongliang.iteye.com/blog/1953409
Second: How to highlight the service side in Solr4.3
http://qindongliang.iteye.com/blog/2034270



Second: the project inquiry

Overall speaking, there are 2 main ways to achieve, the first is the front desk to display data using JS highlighting, the second is the service side highlighted back to the front desk

The process of the back-end highlighting:



Front-end highlighting process:




Three: Pros and cons analysis

Back-end highlighting:
Performance: In the case of large concurrency, there may be some impact on the performance of the server.
Reliability: High, in the browser disable JS script case, still can display normally
Front-end highlighting:
Performance: rendered by client, slightly higher relative performance
Reliability: Low, in the browser disable JS script case, highlighting failure

Four: Precautions

foreground highlighting, you need to put the sentence after the phrase, back to the foreground JS, easy to replace, about the sentence participle, you can use Lucene can also use SOLR, the way is as follows:
In Lucene:

Java code

2. /***
4.      * 
6. * @param Analyzer word breaker
8. * @param text sub-phrase
10. * @throws Exception
12.      */
14. Public Static void Analyzer (Analyzer analyzer,string text)throws exception{
16. Tokenstream ts = analyzer.tokenstream ("name", text);
18. Chartermattribute Term=ts.addattribute (chartermattribute. Class);
20. Ts.reset ();
22. while (Ts.incrementtoken ()) {
24. System.out.println (Term.tostring ());
26. }
28. Ts.end ();
30. Ts.close ();
32. }

/*** *  * @param analyzer Word breaker * @param text sub  -phrase * @throws Exception */public static void Analyzer (Analyzer analyze R,string text) throws exception{        tokenstream ts = analyzer.tokenstream ("name", text);        Chartermattribute Term=ts.addattribute (chartermattribute.class);        Ts.reset ();        while (Ts.incrementtoken ()) {            System.out.println (term.tostring ());        }        Ts.end ();        Ts.close ();}

In Solr, Mode 1:

Java code

2. /***
4. * Word segmentation based on field type and print word segmentation results
6. * @param text
8.  */
10. Public Static void showanalysistype (String text)throws exception{
14. String fieldtype="ik"; //Division of speech Type
16. //Invoke service
18. Fieldanalysisrequest request = new fieldanalysisrequest ("/analysis/field");
20. //set type
22. Request.addfieldtype (FieldType);
24. //Set sentences to be participle
26. Request.setfieldvalue (text);
28. //sc=private static httpsolrclient sc=new httpsolrclient ("Http://localhost:8983/solr/one");
30. //Get Results
32. Fieldanalysisresponse Response =request.process (SC);
34. //Get the corresponding analysis
36. Analysis as = Response.getfieldtypeanalysis (FieldType);
38. list<string> results = new arraylist<string> ();
40. //Use the Guava library to convert the Iteratro object to a list object
42. List<analysisphase> list=lists.newarraylist (As.getindexphases (). iterator ());
44. //Take one of the Fitler's participle results, because a fieldtype is most likely configured with multiple filter, each step through
46. The result of//filter is different, so here, you want to specify a filter to get the word segmentation result ,
48. //So the list.size-1 here to write, notice the value here, is not fixed
50. for (TokenInfo Token:list.get (List.size ()-1). Gettokens ()) {
52. //Get Word segmentation data Results
54. Results.add (Token.gettext ());
56. }
60. }

/*** * Word segmentation based on field type and print word result * @param text */public static void Showanalysistype (String text) throws Exception{string fieldtype= " IK ";//Division of Speech//Call service Fieldanalysisrequest request = new Fieldanalysisrequest ("/analysis/field ");// Set type Request.addfieldtype (FieldType);//Set the sentence to be participle request.setfieldvalue (text);//sc=private Static Httpsolrclient sc=    New Httpsolrclient ("Http://localhost:8983/solr/one");//Get Results Fieldanalysisresponse response =request.process (SC);    The corresponding analysis as = Response.getfieldtypeanalysis (FieldType) is obtained.    list<string> results = new arraylist<string> (); Using the Guava library, convert the Iteratro object to a List object list<analysisphase> list=lists.newarraylist (as.getindexphases (). Iterator (        )); Take the result of a fitler, because a fieldtype is very likely to configure a plurality of filter, each step through the//filter results are different, so here, to specify a filter to get the result of the word segmentation, and because of the related//So the scattered fairy here Write list.size-1, note that the value here is not a fixed for (TokenInfo Token:list.get (List.size ()-1). Gettokens ()) {//Get word breaker result Results.add (t     Oken.gettext ()); }     }

In Solr, Mode 2:

Java code

2. /***
4. * According to the field Word and print the word result
6. * @param text
8.      */
10. Public Static void showanalysis (String text)throws exception{
12. //Here is the field name
14. String fieldname="Cpyname";
16. //fixed wording
18. Fieldanalysisrequest request = new fieldanalysisrequest ("/analysis/field");
20. //Add field
22. Request.addfieldname (FieldName);
24. //Set sentences that require participle
26. Request.setfieldvalue (text);
28. //Request the SOLR service to get results
30. Fieldanalysisresponse Response =request.process (SC);
32. //package result, return, business processing that may be used for subsequent calls
34. list<string> results = new arraylist<string> ();
36. //Get results based on field name
38. Analysis As=response.getfieldnameanalysis (fieldName);
40. //Using Guava Toolkit, turn iterator to list
42. List<analysisphase> list=lists.newarraylist (As.getindexphases (). iterator ());
44. //Print word breaker results
46. for (TokenInfo Token:list.get (List.size ()-1). Gettokens ()) {
48. System.out.println (Token.gettext ());
50. }
54. }

/*** * According to the field and print the word result * @param text * * public static void Showanalysis (string text) throws exception{//Here is the field name String fieldname= "Cpyname";//fixed notation Fieldanalysisrequest request = new Fieldanalysisrequest ("/analysis/field"); Add Field request.addfieldname (FieldName); Set the sentence request.setfieldvalue (text) that requires participle;     Request the SOLR service to get Results fieldanalysisresponse response =request.process (SC);     Encapsulates the result, returned, and possibly for its subsequent invocation of business processing list<string> results = new arraylist<string> ();     Get results based on field name Analysis As=response.getfieldnameanalysis (fieldName);     Using the Guava Toolkit, go iterator to List list<analysisphase> list=lists.newarraylist (as.getindexphases (). iterator ());     Print the word segmentation result for (TokenInfo Token:list.get (List.size ()-1). Gettokens ()) {System.out.println (Token.gettext ()); }     }

Finally welcome everybody sweep the code to follow the public number: I am the Siege division (WOSHIGCS), we study together, the progress and the exchange! (Woshigcs)
The content of this public number is about the search and big data technology and the Internet and other aspects of the sharing of content, but also a warm technical interaction of small homes, what problems can be a message at any time, welcome to visit us!

Copyright NOTICE: This article for Bo Master original article, without Bo Master permission not reproduced.

Strategy for highlighting in Lucene or SOLR