See what actually gets indexed in fast

Source: Internet
Author: User

From: B /thomsven/archive/2011/01/26/seeing-what-actual-gets-indexed.aspx

When fast search for Sharepoint indexes documents, it uses an internal format known as fixml (fast internal XML ). this represents the exact data which get indexed. being able to inspect this can be useful for troubleshooting such

    • Lemmatised forms of nouns and adjectives
    • Refiner values
    • Tokenization of terms
    • Etc.

Fixml is stored in gzip 'ed files under % fastsearch/data/data_fixml. un-gzip 'ing them is fairly straightforward using command line tools that come with fast, but knowing which file to extract is far less trivial. I will show you how you can do this easily. the prerequisites for this approach is:

    1. Sharepoint Access rights to do "Edit page" on the fast search center's result page.
    2. File Access to the data_fixml folder (on the fast server (s) Doing indexing)

OK, so let's get started. First, run a query in a fast search center, so you get a results page, and click "Edit page ":

Then, go down to the "core search results" Web part and choose "edit web part ":

Scrolling up to the top right-hand corner, you open the "Display Properties" of the Web part like this:

Uncheck the "use localization Visualization" to enable editing of the "fetched properties" setting. copy out the text and edit it in an editor to add the last two items (<column name = "internalid"/> <column name = "contentid"/> ), shown in bold here:


<Column name = "workid"/>
<Column name = "rank"/>
<Column name = "title"/>
<Column name = "author"/>
<Column name = "size"/>
<Column name = "path"/>
<Column name = "Description"/>
<Column name = "write"/>
<Column name = "sitename"/>
<Column name = "collapsingstatus"/>
<Column name = "hithighlightedsummary"/>
<Column name = "hithighlightedproperties"/>
<Column name = "contentclass"/>
<Column name = "isdocument"/>
<Column name = "picturethumbnailurl"/>
<Column name = "url"/>
<Column name = "serverredirectedurl"/>
<Column name = "fileextension"/>
<Column name = "spsiteurl"/>
<Column name = "docvector"/>
<Column name = "fcocount"/>
<Column name = "fcoid"/>
<Column name = "pictureheight"/>
<Column name = "picturewidth"/>
<Column name = "internalid"/>
<Column name = "contentid"/>


Note:When pasting the above XML snippet, it will have to all be on one line!

Next, click on the "XSL Editor" and replace the default XSLT with the contents of the attached ZIP file.

You are all set, and can click "OK" at the bottom of the Web Part editor, and then "Save & close" in the ribbon on the top of the page. your screen shoshould now look like this:

If you click on the "show all" Link, it will toggle showing all columns returned from fast. as we just added "internalid" and "contentid", this will appear at the end of the list


Next, we need a powershell script which is available in the technet script repository, get-fastfixml. download this code and install it somewhere on your fast indexing server. then, run it with internalid and contentid for the relevant document as input


As you can see, it has written the full fixml to c: \ fastsearch \ var \ fixml. XML. we can open this file in an editor, and see for example how "deep dive" has been lemmatized to "Deep deeper Deepest" and "Dive diva divas ":


So, we can try searching for "deeper diva", and see that it returns the expected results, and even highlights "deep dive "!

Reading the fixml contents can be challenging at first. Here is a quick overview of the most important tag name conventions:


Composite field, for searching processing SS Fields

Bconf <level>
Bconf7 src = "title"
Represents each field, with level, inside bcat

Separately searchable Field

Sortable Field

Refinable Field

Static result field-show "as is"

Dynamic result field-matched to query terms

I must admit that two of my colleagues did all the hard work here:

    • Aaron Grant did the "show all" toggle XSL
    • Brent groom did the get-fastfixml

Thank you very much, guys!

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.