[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-06-16 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16052059#comment-16052059 ] Mark Miller commented on SOLR-9824: --- Yeah, it's meant to go to 6.x. It was baking on 7. Tomas has likely

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-06-14 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049124#comment-16049124 ] David Smiley commented on SOLR-9824: +1 I will. > Documents indexed in bulk are replicated using too

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-06-12 Thread Yago Riveiro (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046593#comment-16046593 ] Yago Riveiro commented on SOLR-9824: Will this backported to 6.x branch? > Documents indexed in bulk

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-06-08 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042894#comment-16042894 ] David Smiley commented on SOLR-9824: I guess this can be marked as Resolved for 7.0? It's been

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-06-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042889#comment-16042889 ] Mark Miller commented on SOLR-9824: --- Thanks! Hadn't been paying attention closely here for a bit. I'll

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-05-22 Thread JIRA
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020597#comment-16020597 ] Tomás Fernández Löbbe commented on SOLR-9824: - I just committed the changes of my patch

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-05-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013047#comment-16013047 ] Tomás Fernández Löbbe commented on SOLR-9824: - I've seen tests hang too, mostly in

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-04-19 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974697#comment-15974697 ] Mark Miller commented on SOLR-9824: --- Once I get back to some beasting test runs on master. There were

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-04-18 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974025#comment-15974025 ] David Smiley commented on SOLR-9824: How about this gets committed for Solr 6.6? > Documents indexed

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2017-02-22 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879075#comment-15879075 ] ASF subversion and git services commented on SOLR-9824: --- Commit

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-28 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783578#comment-15783578 ] Mark Miller commented on SOLR-9824: --- I'm getting pretty comfortable. I spent all the time on SOLR-2646

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-28 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783139#comment-15783139 ] David Smiley commented on SOLR-9824: Ok. If you feel sufficiently comfortable with this patch to

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-28 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782818#comment-15782818 ] Mark Miller commented on SOLR-9824: --- bq. put that into an else branch. I'll do that. bq. there's a

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-12 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743318#comment-15743318 ] David Smiley commented on SOLR-9824: I reviewed your patch. * Nice catch to remove that synchronized on

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-10 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738757#comment-15738757 ] Mark Miller commented on SOLR-9824: --- Also, while I didn't want to change interrupt behavior, the current

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-10 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738751#comment-15738751 ] Mark Miller commented on SOLR-9824: --- So we do have to extract those threads. Future won't end up working

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-09 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735278#comment-15735278 ] David Smiley commented on SOLR-9824: Ok I get we want a flag to articulate that we want long-running

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734499#comment-15734499 ] Mark Miller commented on SOLR-9824: --- bq. It may be safer to ensure that interrupt() only affects the

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734466#comment-15734466 ] Mark Miller commented on SOLR-9824: --- I'd rather not break the current client behavior. As it is now, you

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734440#comment-15734440 ] David Smiley commented on SOLR-9824: I like the idea of removing lastDoc; it's hard to work with. I'm

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733911#comment-15733911 ] Mark Miller commented on SOLR-9824: --- So what I do is use a max int poll time and take advantage of that

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733653#comment-15733653 ] Mark Miller commented on SOLR-9824: --- No that marker trick type thing can't work. Bummer. > Documents

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733236#comment-15733236 ] Mark Miller commented on SOLR-9824: --- Another possible optimization that could make clients always work is

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733062#comment-15733062 ] Mark Miller commented on SOLR-9824: --- {code} if (pollQueueTime > 0 && threadCount == 1

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732967#comment-15732967 ] Mark Miller commented on SOLR-9824: --- bq. This sounds really clever if we can verify that most clients do

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732899#comment-15732899 ] David Smiley commented on SOLR-9824: bq. streaming and chunked encoding would have no size and wait

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732865#comment-15732865 ] Mark Miller commented on SOLR-9824: --- Another idea is to look at the request size and use the wait when

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732817#comment-15732817 ] Mark Miller commented on SOLR-9824: --- At least for the solrj clients - harder to do the same with raw

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732805#comment-15732805 ] Mark Miller commented on SOLR-9824: --- The lastDocInBatch trick may not be the right solution - it's not

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-07 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728786#comment-15728786 ] David Smiley commented on SOLR-9824: Fair points Mark. I think the root fix of the problem I

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-06 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727933#comment-15727933 ] Mark Miller commented on SOLR-9824: --- Hanging around for 250 ms after an update is pretty ugly. I'd like

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-06 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727897#comment-15727897 ] Mark Miller commented on SOLR-9824: --- Nice find. > Documents indexed in bulk are replicated using too

[jira] [Commented] (SOLR-9824) Documents indexed in bulk are replicated using too many HTTP requests

2016-12-02 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717028#comment-15717028 ] David Smiley commented on SOLR-9824: Work-around: Thanks to some additional conditions of when the