[
https://issues.apache.org/jira/browse/SOLR-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341929#comment-16341929
]
Joel Bernstein edited comment on SOLR-8362 at 1/27/18 3:25 AM:
---------------------------------------------------------------
I wanted to comment on re-indexing text fields with streaming expressions.
There is a straight forward approach that does not require doc values described
here:
[http://joelsolr.blogspot.com/2016/10/solr-63-batch-jobs-parallel-etl-and.html]
I'm not convinced that putting text fields into docValues is the way to go. The
*significantTerms*, *features* and *train* streaming expressions can do some
really nice things with text fields in the inverted index. In the next release,
the new *termVectors* expression allows you to create on-the-fly tf-idf *term
vectors* which can be used all for all kinds of text analytics.
was (Author: joel.bernstein):
I wanted to comment on re-indexing text fields with streaming expressions.
There is a straight forward approach that does not require doc values described
here:
[http://joelsolr.blogspot.com/2016/10/solr-63-batch-jobs-parallel-etl-and.html]
I'm not convinced that putting text fields into docValues is the way to go. The
*significantTerms*, *features* and *train* streaming expressions can do some
really nice things with text fields in the inverted index. In the next release,
the new *termVectors* expression allows you to create on-the-fly tf-idf *term
vectors* which can be used all for all kinds of text analytics.
> Add docValues support for TextField
> -----------------------------------
>
> Key: SOLR-8362
> URL: https://issues.apache.org/jira/browse/SOLR-8362
> Project: Solr
> Issue Type: Improvement
> Reporter: Hoss Man
> Priority: Major
>
> At the last lucene/solr revolution, Toke asked a question about why TextField
> doesn't support docValues. The short answer is because no one ever added it,
> but the longer answer was because we would have to think through carefully
> the _intent_ of supporting docValues for a "tokenized" field like TextField,
> and how to support various conflicting usecases where they could be handy.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
