I've made a snippet. Code https://github.com/kiselev-dv/es-test/blob/master/ESPagingTest/src/main/java/test/ESTest.java
Test results https://github.com/kiselev-dv/es-test/blob/master/test.log First test 1 shard (test.log line 27) - everything ok Second test 5 shards (test.log line 86) - error Search and paging generation https://github.com/kiselev-dv/es-test/blob/master/ESPagingTest/src/main/java/test/ESTest.java#L73 One more strange thing, search wasn't find anything until I have add small delay https://github.com/kiselev-dv/es-test/blob/master/ESPagingTest/src/main/java/test/ESTest.java#L89 2014-06-06 20:53 GMT+02:00 David Pilato <da...@pilato.fr>: > Any chance you could share your code. In particular, i'd like to see how > you run the query. > > If you could reproduce it with a test case that would be awesome. > > -- > David ;-) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 6 juin 2014 à 20:26, Дмитрий Киселев <dmitry.v.kise...@gmail.com> a > écrit : > > I asked for 5 docs. > > With 1 shard - I got 5 docs. > With 5 shards - I got 25 docs. > With 5 shards, using curl instead of embedded java client - I got 5 docs. > > > 2014-06-06 20:20 GMT+02:00 David Pilato <da...@pilato.fr>: > >> So? What's wrong here? >> >> You asked for 5 docs and you get 5. >> >> I'm missing something I guess. >> >> >> -- >> David ;-) >> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs >> >> Le 6 juin 2014 à 20:02, Дмитрий Киселев <dmitry.v.kise...@gmail.com> a >> écrit : >> >> Sorry, there littlebit different dataset. >> Here is answer with same data and 1 shard >> { >> "took" : 63, >> "timed_out" : false, >> "_shards" : { >> "total" : 1, >> "successful" : 1, >> "failed" : 0 >> }, >> "hits" : { >> "total" : 3879, >> "max_score" : 1.0, >> "hits" : [ { >> "_index" : "gazetteer", >> "_type" : "location", >> "_id" : "adrpnt-0004074128-w145925740-regular", >> "_score" : 1.0 >> }, { >> "_index" : "gazetteer", >> "_type" : "location", >> "_id" : "adrpnt-0007815983-w175372179-regular", >> "_score" : 1.0 >> }, { >> "_index" : "gazetteer", >> "_type" : "location", >> "_id" : "adrpnt-0013765594-w145949343-regular", >> "_score" : 1.0 >> }, { >> "_index" : "gazetteer", >> "_type" : "location", >> "_id" : "adrpnt-0015203925-w147150792-regular", >> "_score" : 1.0 >> }, { >> "_index" : "gazetteer", >> "_type" : "location", >> "_id" : "adrpnt-0016087997-w162848733-regular", >> "_score" : 1.0 >> } ] >> } >> } >> >> >> 2014-06-06 19:54 GMT+02:00 David Pilato <da...@pilato.fr>: >> >>> The total hit number is really inconsistent: >>> >>> With one shard you get: 656523 >>> With 5 shards you get: 3879 >>> >>> I think you are doing something wrong but I can't tell more without >>> looking at the full source code. >>> Could you share how you actually execute the query? >>> >>> Are you sure your Java client is connected to the right instance/cluster? >>> >>> >>> -- >>> *David Pilato* | *Technical Advocate* | *Elasticsearch.com >>> <http://Elasticsearch.com>* >>> @dadoonet <https://twitter.com/dadoonet> | @elasticsearchfr >>> <https://twitter.com/elasticsearchfr> >>> >>> >>> Le 6 juin 2014 à 19:49:47, Дмитрий Киселев (dmitry.v.kise...@gmail.com) >>> a écrit: >>> >>> This is with 5 shards. >>> { >>> "took" : 81, >>> "timed_out" : false, >>> "_shards" : { >>> "total" : 5, >>> "successful" : 5, >>> "failed" : 0 >>> }, >>> "hits" : { >>> "total" : 3879, >>> "max_score" : 1.0, >>> "hits" : [ { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0016087997-w162848733-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0088827105-n2270743905-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0097856729-n2270743903-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0145983393-w154644839-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0209772668-n1884206099-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0015203925-w147150792-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0017569140-n2495059507-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0071389729-w147150672-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0130455978-w145925771-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0139624280-w147150701-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0079711118-w194531715-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0096243499-w194531714-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0162691059-w164700540-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0202220208-w164698447-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0287053820-n2270743890-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0013765594-w145949343-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0026389358-w147150656-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0093401200-w162848869-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0203517601-n2270743895-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0217217459-n2270743898-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0004074128-w145925740-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0007815983-w175372179-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0039697750-w164700428-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0053473990-w271448695-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0129549665-w162848862-regular", >>> "_score" : 1.0 >>> } ] >>> } >>> } >>> >>> And this is with one shard >>> { >>> "took" : 123, >>> "timed_out" : false, >>> "_shards" : { >>> "total" : 1, >>> "successful" : 1, >>> "failed" : 0 >>> }, >>> "hits" : { >>> "total" : 656523, >>> "max_score" : 1.0, >>> "hits" : [ { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0675290941-w116699544-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0675314442-n1557245109-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0675335611-w210502362-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0675352866-w245359553-regular", >>> "_score" : 1.0 >>> }, { >>> "_index" : "gazetteer", >>> "_type" : "location", >>> "_id" : "adrpnt-0675354643-w235622232-regular", >>> "_score" : 1.0 >>> } ] >>> } >>> } >>> >>> >>> 2014-06-06 19:40 GMT+02:00 David Pilato <da...@pilato.fr>: >>> >>>> Can you print also the full response object (toString()) as well? >>>> >>>> -- >>>> *David Pilato* | *Technical Advocate* | *Elasticsearch.com >>>> <http://Elasticsearch.com>* >>>> @dadoonet <https://twitter.com/dadoonet> | @elasticsearchfr >>>> <https://twitter.com/elasticsearchfr> >>>> >>>> >>>> Le 6 juin 2014 à 19:24:00, Дмитрий Киселев (dmitry.v.kise...@gmail.com) >>>> a écrit: >>>> >>>> Yep. >>>> >>>> System.out.println(searchQ.toString()); >>>> >>>> { >>>> "from" : 0, >>>> "size" : 5, >>>> "query" : { >>>> "match_all" : { } >>>> }, >>>> "explain" : false, >>>> "fields" : [ ] >>>> } >>>> >>>> Also, I think it's might be connected with sharding. >>>> I've tried to change number_of_shards to 1 and paging starts act as I >>>> expect. >>>> >>>> Set number_of_shards to 5 and get 25 hits. >>>> Set number_of_shards to 4 and get 20 hits. >>>> >>>> It's seems like from and size applied to every shard separately in my >>>> case. >>>> >>>> -- >>>> Thank you for your time. Best regards. >>>> Dmitry. >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "elasticsearch" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to elasticsearch+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elasticsearch/CAA9QNxOjT5wGmris_4uZ8_33uF6d51hzZ3Z%3DUvBKGbRV-YuR2Q%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/elasticsearch/CAA9QNxOjT5wGmris_4uZ8_33uF6d51hzZ3Z%3DUvBKGbRV-YuR2Q%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>>> -- >>>> You received this message because you are subscribed to a topic in the >>>> Google Groups "elasticsearch" group. >>>> To unsubscribe from this topic, visit >>>> https://groups.google.com/d/topic/elasticsearch/p8RWVdqLcoI/unsubscribe >>>> . >>>> To unsubscribe from this group and all its topics, send an email to >>>> elasticsearch+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elasticsearch/etPan.5391fd20.12200854.12ee%40MacBook-Air-de-David.local >>>> <https://groups.google.com/d/msgid/elasticsearch/etPan.5391fd20.12200854.12ee%40MacBook-Air-de-David.local?utm_medium=email&utm_source=footer>. >>>> >>>> >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> >>> >>> -- >>> Thank you for your time. Best regards. >>> Dmitry. >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/CAA9QNxMC59nEgggzTA5eR83ibdCQiV5URr4CkynDH%2B2%2BKY4z7w%40mail.gmail.com >>> <https://groups.google.com/d/msgid/elasticsearch/CAA9QNxMC59nEgggzTA5eR83ibdCQiV5URr4CkynDH%2B2%2BKY4z7w%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >>> -- >>> You received this message because you are subscribed to a topic in the >>> Google Groups "elasticsearch" group. >>> To unsubscribe from this topic, visit >>> https://groups.google.com/d/topic/elasticsearch/p8RWVdqLcoI/unsubscribe. >>> To unsubscribe from this group and all its topics, send an email to >>> elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/etPan.5392006e.4e6afb66.12ee%40MacBook-Air-de-David.local >>> <https://groups.google.com/d/msgid/elasticsearch/etPan.5392006e.4e6afb66.12ee%40MacBook-Air-de-David.local?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> >> >> -- >> Thank you for your time. Best regards. >> Dmitry. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAA9QNxM7zdsbSqz6B%3DkB1m0JzDJDXSQUa_UG3qQEH5CH1A0gDg%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAA9QNxM7zdsbSqz6B%3DkB1m0JzDJDXSQUa_UG3qQEH5CH1A0gDg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "elasticsearch" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/elasticsearch/p8RWVdqLcoI/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/DB3A3263-2C87-42CA-981D-3DF747144A95%40pilato.fr >> <https://groups.google.com/d/msgid/elasticsearch/DB3A3263-2C87-42CA-981D-3DF747144A95%40pilato.fr?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Thank you for your time. Best regards. > Dmitry. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAA9QNxP_GEgJH5m5aOF85VpyDx1aLKL2gzfUVice0A%2BxDQn7KA%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAA9QNxP_GEgJH5m5aOF85VpyDx1aLKL2gzfUVice0A%2BxDQn7KA%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/elasticsearch/p8RWVdqLcoI/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/885EB070-FAAE-408E-BC1D-2BDF7A6DEECF%40pilato.fr > <https://groups.google.com/d/msgid/elasticsearch/885EB070-FAAE-408E-BC1D-2BDF7A6DEECF%40pilato.fr?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- Thank you for your time. Best regards. Dmitry. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAA9QNxPBU2dH1aci6TFLQXRLo0DdcLX%3DtzOW_uXtKeS3U5UUZw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
