Lucene Similarity Scoring Formula

來源:互聯網
上載者:User


score(q,d) = coord(q,d)·queryNorm(q)·∑(tf(t in d)·idf(t)^2·t.getBoost()·norm(t,d)) (∑: t in q)

d:document
t:term
q:query

coor(q, d):
  public float coord(int overlap, int maxOverlap)
Implemented as overlap / maxOverlap.
overlap - the number of query terms matched in the document
maxOverlap - the total number of terms in the query


queryNorm(q):
  public float queryNorm(float sumOfSquaredWeights)
Implemented as 1/sqrt(sumOfSquaredWeights).
sumOfSquaredWeights - the sum of the squares of query term weights
sumOfSquaredWeights = q.getBoost()^2·∑(idf(t)·t.getBoost())^2   (∑:t in q)

idf(t):
  public float idf(long docFreq, long numDocs)
Implemented as log(numDocs/(docFreq+1)) + 1.
docFreq - the number of documents which contain the term
numDocs - the total number of documents in the collection(all the indices)

tf(t ind d):
  public float tf(float freq)
Implemented as sqrt(freq).
freq - the frequency of a term within a document

boost(t.field in d):
  public void setBoost(float b)
Sets the boost for this query clause to b.
  public float getBoost()
The boost is 1.0 by default.

norm(t, d):
norm(t,d) = lengthNorm·∏f.boost()  (∏:field f in d named as t)
  If the document has multiple fields with the same name, all their boosts are multiplied together.
lengthNorm = 1.0 / Math.sqrt(numTerms)
lengthNorm-computed when the document is added to the index in accordance with the number of tokens of this field in the document, so that shorter fields contribute more to the score. LengthNorm is computed by the Similarity class in effect at indexing.
Shorter fields (fewer tokens) get a bigger boost from this factor.
numTerms is the number of terms within a field, 
numTerms is FieldInvertState.getLength() if setDiscountOverlaps(boolean) is false, else it's FieldInvertState.getLength() - FieldInvertState.getNumOverlap().
FieldInvertState.getLength(): Get total number of terms in this field.


聯繫我們

該頁面正文內容均來源於網絡整理,並不代表阿里雲官方的觀點,該頁面所提到的產品和服務也與阿里云無關,如果該頁面內容對您造成了困擾,歡迎寫郵件給我們,收到郵件我們將在5個工作日內處理。

如果您發現本社區中有涉嫌抄襲的內容,歡迎發送郵件至: info-contact@alibabacloud.com 進行舉報並提供相關證據,工作人員會在 5 個工作天內聯絡您,一經查實,本站將立刻刪除涉嫌侵權內容。

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.