Mikhail, you are completely right!
And your observation was not superficial or obvious !
Actually DocValues are an un-inverted index, but I was ignoring they can be
used to search !
In my observation I was not taking in consideration docValues ( as it was
not in the user schema), so actually mine was superficial!
Just taking a look, just verified that it's not possible to get the terms
from docValues from the terms component or from the schema browser ( I
guess both of them uses the term dictionary when indexed) .
Just curious to know how docValues are used to search !
Are they loaded as array of values ? ( document ordinal as index and
binary value as value ? )
In the case the search will be linear per Document number.
Which is quite inefficient but at least works!
Cheers
2015-07-22 19:44 GMT+01:00 Mikhail Khludnev <mkhlud...@griddynamics.com>:
>
>
> On Wed, Jul 22, 2015 at 7:08 PM, Alessandro Benedetti <
> benedetti.ale...@gmail.com> wrote:
>
>>
>> Mikhail :
>>
>> "On Wed, Jul 22, 2015 at 5:17 PM, Alessandro Benedetti <
>> benedetti.ale...@gmail.com> wrote:
>>
>> > I find so hard to believe you can search without the inverted index :)
>> >
>>
>> it's madness, but in fact it can."
>>
>> I was talking about strictly the fact that you need the field to be
>> indexed
>> if you want to search in it, no way to do that without indexing.
>> I was talking about Solr, and not talking about copy fields ext ( that
>> will
>> be indexed) .
>> If you don't index in solr, you can't search :)
>>
>
> Alessandro,
> I just wanted to emphasize, that it searches by docValues=true field, even
> it's attributed indexed=false. Speaking generally, docVals are also a
> index, I just find it curious. Sorry, If my note is superfluous and/or
> obvious.
>
>
>>
>> Cheers
>>
>> 2015-07-22 16:04 GMT+01:00 santhosh kumar <santhosh...@gmail.com>:
>>
>> > yes .. that line was commented out... and I have restarted the server ..
>> > after updating the schema.xml .. and document was deleted and added
>> back ..
>> >
>> > On 22 July 2015 at 20:31, Mikhail Khludnev <mkhlud...@griddynamics.com>
>> > wrote:
>> >
>> > > did you removed
>> > > <copyField source="cat" dest="text"/>
>> > > from schema.xml ?
>> > > did you restarted Solr or reloaded core, after that?
>> > > did you reindex that document, after all?
>> > >
>> > > On Wed, Jul 22, 2015 at 5:55 PM, santhosh kumar <
>> santhosh...@gmail.com>
>> > > wrote:
>> > >
>> > > > but field 'cat' is not the 'copyFiled' not in the 'dynamicField'. :)
>> > > >
>> > > > On 22 July 2015 at 20:04, Mikhail Khludnev <
>> mkhlud...@griddynamics.com
>> > >
>> > > > wrote:
>> > > >
>> > > > > it matches by text field
>> > > > >
>> > > > > On Wed, Jul 22, 2015 at 5:28 PM, santhosh kumar <
>> > santhosh...@gmail.com
>> > > >
>> > > > > wrote:
>> > > > >
>> > > > > > Here is the query in debug mode ...
>> > > > > >
>> > > > > > {
>> > > > > > "responseHeader": {
>> > > > > > "status": 0,
>> > > > > > "QTime": 3,
>> > > > > > "params": {
>> > > > > > "debugQuery": "true",
>> > > > > > "indent": "true",
>> > > > > > "q": "software",
>> > > > > > "_": "1437575140328",
>> > > > > > "wt": "json"
>> > > > > > }
>> > > > > > },
>> > > > > > "response": {
>> > > > > > "numFound": 1,
>> > > > > > "start": 0,
>> > > > > > "docs": [
>> > > > > > {
>> > > > > > "id": "SOLR1000",
>> > > > > > "name": "Solr, the Enterprise Search Server",
>> > > > > > "manu": "Apache Foundation",
>> > > > > > "cat": [
>> > > > > > "software"
>> > > > > > ],
>> > > > > > "features": [
>> > > > > > "Advanced Full-Text Search Capabilities using Lucene",
>> > > > > > "Optimized for High Volume Web Traffic",
>> > > > > > "Standards Based Open Interfaces - XML and HTTP",
>> > > > > > "Comprehensive HTML Administration Interfaces",
>> > > > > > "Scalability - Efficient Replication to other Solr
>> Search
>> > > > > > Servers",
>> > > > > > "Flexible and Adaptable with XML configuration and
>> > Schema",
>> > > > > > "Good unicode support: héllo (hello with an accent
>> over
>> > the
>> > > > e)"
>> > > > > > ],
>> > > > > > "price": 0,
>> > > > > > "price_c": "0.0,USD",
>> > > > > > "popularity": 10,
>> > > > > > "inStock": true,
>> > > > > > "incubationdate_dt": "2006-01-17T00:00:00Z",
>> > > > > > "_version_": 1507402709866643500
>> > > > > > }
>> > > > > > ]
>> > > > > > },
>> > > > > > "debug": {
>> > > > > > "rawquerystring": "software",
>> > > > > > "querystring": "software",
>> > > > > > "parsedquery": "text:software",
>> > > > > > "parsedquery_toString": "text:software",
>> > > > > > "explain": {
>> > > > > > "SOLR1000": "\n0.28159538 = (MATCH) weight(text:software
>> in
>> > 0)
>> > > > > > [DefaultSimilarity], result of:\n 0.28159538 = fieldWeight in
>> 0,
>> > > > > > product of:\n 1.0 = tf(freq=1.0), with freq of:\n 1.0 =
>> > > > > > termFreq=1.0\n 2.252763 = idf(docFreq=1, maxDocs=7)\n
>> 0.125 =
>> > > > > > fieldNorm(doc=0)\n"
>> > > > > > },
>> > > > > > "QParser": "LuceneQParser",
>> > > > > > "timing": {
>> > > > > > "time": 3,
>> > > > > > "prepare": {
>> > > > > > "time": 1,
>> > > > > > "query": {
>> > > > > > "time": 1
>> > > > > > },
>> > > > > > "facet": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "mlt": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "highlight": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "stats": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "expand": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "debug": {
>> > > > > > "time": 0
>> > > > > > }
>> > > > > > },
>> > > > > > "process": {
>> > > > > > "time": 2,
>> > > > > > "query": {
>> > > > > > "time": 1
>> > > > > > },
>> > > > > > "facet": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "mlt": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "highlight": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "stats": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "expand": {
>> > > > > > "time": 0
>> > > > > > },
>> > > > > > "debug": {
>> > > > > > "time": 1
>> > > > > > }
>> > > > > > }
>> > > > > > }
>> > > > > > }
>> > > > > > }
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > On 22 July 2015 at 19:47, Alessandro Benedetti <
>> > > > > benedetti.ale...@gmail.com
>> > > > > > >
>> > > > > > wrote:
>> > > > > >
>> > > > > > > I find so hard to believe you can search without the inverted
>> > index
>> > > > :)
>> > > > > > >
>> > > > > > > Are you sure you didn't have in your index some documents with
>> > that
>> > > > > field
>> > > > > > > indexed, before you did the change and put it as not indexed ?
>> > > > > > >
>> > > > > > > Changes in the schema don't apply to already indexed
>> documents (
>> > if
>> > > > you
>> > > > > > > don't go with a re-index) .
>> > > > > > >
>> > > > > > > Can you run your query in debug mode and show us if any
>> strange
>> > > query
>> > > > > > > parsing is happening ( not much likely to happen, but let's
>> > > check) ?
>> > > > > > >
>> > > > > > > Cheers
>> > > > > > >
>> > > > > > > 2015-07-22 15:10 GMT+01:00 Mikhail Khludnev <
>> > > > > mkhlud...@griddynamics.com
>> > > > > > >:
>> > > > > > >
>> > > > > > > > What do you see at Session browser for this field?
>> > > > > > > >
>> > > > > > > > On Wed, Jul 22, 2015 at 4:49 PM, santhosh kumar <
>> > > > > santhosh...@gmail.com
>> > > > > > >
>> > > > > > > > wrote:
>> > > > > > > >
>> > > > > > > > > Hi,
>> > > > > > > > >
>> > > > > > > > > I have started practicing Solr recently and my
>> understanding
>> > on
>> > > > the
>> > > > > > > field
>> > > > > > > > > type properties "index=false", is that field is not
>> > searchable.
>> > > > > > > > >
>> > > > > > > > > But when I execute the below query I got the results.
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://localhost:8494/solr/myfirstcore/select?q=cat%3Asoftware&wt=json&indent=true
>> > > > > > > > >
>> > > > > > > > > configured in schema.xml :
>> > > > > > > > > ---------------------------------------
>> > > > > > > > >
>> > > > > > > > > <field name="cat" type="string" indexed="false"
>> stored="true"
>> > > > > > > > > multiValued="false"/>
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > I have uploaded the below document:
>> > > > > > > > > ----------------------------------------------------
>> > > > > > > > >
>> > > > > > > > > <add>
>> > > > > > > > > <doc>
>> > > > > > > > > <field name="id">SOLR1000</field>
>> > > > > > > > > <field name="name">Solr, the Enterprise Search
>> > Server</field>
>> > > > > > > > > <field name="manu">Apache Foundation</field>
>> > > > > > > > > <field name="cat">software</field>
>> > > > > > > > > <field name="features">Advanced Full-Text Search
>> > Capabilities
>> > > > > using
>> > > > > > > > > Lucene</field>
>> > > > > > > > > <field name="features">Optimized for High Volume Web
>> > > > > > Traffic</field>
>> > > > > > > > > <field name="features">Standards Based Open Interfaces -
>> > XML
>> > > > and
>> > > > > > > > > HTTP</field>
>> > > > > > > > > <field name="features">Comprehensive HTML Administration
>> > > > > > > > > Interfaces</field>
>> > > > > > > > > <field name="features">Scalability - Efficient
>> Replication
>> > to
>> > > > > other
>> > > > > > > > Solr
>> > > > > > > > > Search Servers</field>
>> > > > > > > > > <field name="features">Flexible and Adaptable with XML
>> > > > > > configuration
>> > > > > > > > and
>> > > > > > > > > Schema</field>
>> > > > > > > > > <field name="features">Good unicode support: héllo
>> > > (hello
>> > > > > with
>> > > > > > > an
>> > > > > > > > > accent over the e)</field>
>> > > > > > > > > <field name="price">0.0</field>
>> > > > > > > > > <field name="popularity">10</field>
>> > > > > > > > > <field name="inStock">true</field>
>> > > > > > > > > <field
>> > > > name="incubationdate_dt">2006-01-17T00:00:00.000Z</field>
>> > > > > > > > > </doc>
>> > > > > > > > > </add>
>> > > > > > > > >
>> > > > > > > > > Regards,
>> > > > > > > > > santhosh
>> > > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > --
>> > > > > > > > Sincerely yours
>> > > > > > > > Mikhail Khludnev
>> > > > > > > > Principal Engineer,
>> > > > > > > > Grid Dynamics
>> > > > > > > >
>> > > > > > > > <http://www.griddynamics.com>
>> > > > > > > > <mkhlud...@griddynamics.com>
>> > > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > --
>> > > > > > > --------------------------
>> > > > > > >
>> > > > > > > Benedetti Alessandro
>> > > > > > > Visiting card - http://about.me/alessandro_benedetti
>> > > > > > > Blog - http://alexbenedetti.blogspot.co.uk
>> > > > > > >
>> > > > > > > "Tyger, tyger burning bright
>> > > > > > > In the forests of the night,
>> > > > > > > What immortal hand or eye
>> > > > > > > Could frame thy fearful symmetry?"
>> > > > > > >
>> > > > > > > William Blake - Songs of Experience -1794 England
>> > > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > > --
>> > > > > Sincerely yours
>> > > > > Mikhail Khludnev
>> > > > > Principal Engineer,
>> > > > > Grid Dynamics
>> > > > >
>> > > > > <http://www.griddynamics.com>
>> > > > > <mkhlud...@griddynamics.com>
>> > > > >
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Sincerely yours
>> > > Mikhail Khludnev
>> > > Principal Engineer,
>> > > Grid Dynamics
>> > >
>> > > <http://www.griddynamics.com>
>> > > <mkhlud...@griddynamics.com>
>> > >
>> >
>>
>>
>>
>> --
>> --------------------------
>>
>> Benedetti Alessandro
>> Visiting card - http://about.me/alessandro_benedetti
>> Blog - http://alexbenedetti.blogspot.co.uk
>>
>> "Tyger, tyger burning bright
>> In the forests of the night,
>> What immortal hand or eye
>> Could frame thy fearful symmetry?"
>>
>> William Blake - Songs of Experience -1794 England
>>
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
> Principal Engineer,
> Grid Dynamics
>
> <http://www.griddynamics.com>
> <mkhlud...@griddynamics.com>
>
--
--------------------------
Benedetti Alessandro
Visiting card - http://about.me/alessandro_benedetti
Blog - http://alexbenedetti.blogspot.co.uk
"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"
William Blake - Songs of Experience -1794 England
