[
https://issues.apache.org/jira/browse/SOLR-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363557#comment-15363557
]
Joel Bernstein commented on SOLR-9193:
--------------------------------------
Pushed out what I think are the last set of changes for this ticket. The link
above includes all the changes.
The manual testing looked very good. Tested scoreNodes with 250 node id's and
it takes less then 10 millisecond to complete.
I'll probably give this one last review then push out the commits to the
apache/lucene-solr.
> Add scoreNodes Streaming Expression
> -----------------------------------
>
> Key: SOLR-9193
> URL: https://issues.apache.org/jira/browse/SOLR-9193
> Project: Solr
> Issue Type: New Feature
> Reporter: Joel Bernstein
> Assignee: Joel Bernstein
> Fix For: 6.2
>
> Attachments: SOLR-9193.patch
>
>
> The scoreNodes Streaming Expression is another *GraphExpression*. It will
> decorate a gatherNodes expression and us a tf-idf scoring algorithm to score
> the nodes.
> The gatherNodes expression only gathers nodes and aggregations. This is
> similar in nature to tf in search ranking, where the number of times a node
> appears in the traversal represents the tf. But this skews recommendations
> towards nodes that appear frequently in the index.
> Using the idf for each node we can score each node as a function of tf and
> idf. This will provide a boost to nodes that appear less frequently in the
> index.
> The scoreNodes expression will gather the idf's from the shards for each node
> emitted by the underlying gatherNodes expression. It will then assign the
> score to each node.
> The computed score will be added to each node in the *nodeScore* field. The
> docFreq of the node across the entire collection will be added to each node
> in the *docFreq* field. Other streaming expressions can then perform a
> ranking based on the nodeScore or compute their own score using the nodeFreq.
> proposed syntax:
> {code}
> top(n="10",
> sort="nodeScore desc",
> scoreNodes(gatherNodes(...)))
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
