[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082194#comment-15082194 ] Joel Bernstein commented on SOLR-7535: -- If we don't want to repeat the *collection* in

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082176#comment-15082176 ] Joel Bernstein commented on SOLR-7535: -- I think the CommitStream would be very useful.

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread Jason Gerlowski (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082154#comment-15082154 ] Jason Gerlowski commented on SOLR-7535: --- Happy to help. Joel did the real work in ge

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082109#comment-15082109 ] Dennis Gove commented on SOLR-7535: --- +1 on that. I'm real excited about this! > Add Upda

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082102#comment-15082102 ] Joel Bernstein commented on SOLR-7535: -- Nice work on this ticket [~gerlowskija]! > A

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082093#comment-15082093 ] ASF subversion and git services commented on SOLR-7535: --- Commit 17229

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081892#comment-15081892 ] Joel Bernstein commented on SOLR-7535: -- Just thinking about how useful it will be to u

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-04 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081855#comment-15081855 ] Joel Bernstein commented on SOLR-7535: -- The UpdateStream worked well during manual tes

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-03 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080600#comment-15080600 ] Joel Bernstein commented on SOLR-7535: -- Ok, if the smaller scale manual testing looks

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-03 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080592#comment-15080592 ] Dennis Gove commented on SOLR-7535: --- It seems like a reasonable approach to limit the rea

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-03 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080578#comment-15080578 ] Joel Bernstein commented on SOLR-7535: -- Locally I won't be able to simulate a large cl

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-03 Thread Jason Gerlowski (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080548#comment-15080548 ] Jason Gerlowski commented on SOLR-7535: --- Haha, I take it that the manual testing didn

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-03 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080537#comment-15080537 ] Joel Bernstein commented on SOLR-7535: -- After some more thought, I'm thinking of addin

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-03 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15080516#comment-15080516 ] Joel Bernstein commented on SOLR-7535: -- The main thing I'll be looking for in the manu

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-02 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076733#comment-15076733 ] Joel Bernstein commented on SOLR-7535: -- It looks like we still need to handle the mult

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076437#comment-15076437 ] Joel Bernstein commented on SOLR-7535: -- I think it would be an improvement to set the

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076436#comment-15076436 ] Joel Bernstein commented on SOLR-7535: -- An exception will be thrown if there is more t

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Jason Gerlowski (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076434#comment-15076434 ] Jason Gerlowski commented on SOLR-7535: --- bq. The partitionKeys will get added to the

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076427#comment-15076427 ] Joel Bernstein commented on SOLR-7535: -- We could also add a GlueStream to tie together

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076420#comment-15076420 ] Joel Bernstein commented on SOLR-7535: -- A couple of possible streams: PartitionStream

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076418#comment-15076418 ] Dennis Gove commented on SOLR-7535: --- Clever. I like it. > Add UpdateStream to Streaming

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076415#comment-15076415 ] Joel Bernstein commented on SOLR-7535: -- Yes, currently partitioning is only done as pa

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076403#comment-15076403 ] Dennis Gove commented on SOLR-7535: --- +1 on fault tolerance as well. 1) I think the expec

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076396#comment-15076396 ] Joel Bernstein commented on SOLR-7535: -- for #1, you've got the right plan. for #2: T

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2016-01-01 Thread Jason Gerlowski (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076381#comment-15076381 ] Jason Gerlowski commented on SOLR-7535: --- +1 for adding fault tolerance, but for doing

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-31 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075917#comment-15075917 ] Joel Bernstein commented on SOLR-7535: -- [~caomanhdat], Adding fault tolerance is going

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-31 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075916#comment-15075916 ] Joel Bernstein commented on SOLR-7535: -- Ah, just realized we forgot about multi-valued

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-30 Thread Cao Manh Dat (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075670#comment-15075670 ] Cao Manh Dat commented on SOLR-7535: Great feature. I just wonder about fault tolerance

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073952#comment-15073952 ] Dennis Gove commented on SOLR-7535: --- I agree. It needs to be fleshed out some more. > Ad

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073926#comment-15073926 ] Joel Bernstein commented on SOLR-7535: -- The problem is the ParallelStream takes a Tupl

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073920#comment-15073920 ] Dennis Gove commented on SOLR-7535: --- I had an interesting thought related to the call to

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073912#comment-15073912 ] Joel Bernstein commented on SOLR-7535: -- Yes, you've described what I was thinking cor

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073907#comment-15073907 ] Dennis Gove commented on SOLR-7535: --- In the Streaming API, read() is called until an EOF

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Jason Gerlowski (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073895#comment-15073895 ] Jason Gerlowski commented on SOLR-7535: --- Thanks for the feedback Joel. (1) and (2) I

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Jason Gerlowski (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073871#comment-15073871 ] Jason Gerlowski commented on SOLR-7535: --- Thanks for taking the time to help me out De

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-29 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073867#comment-15073867 ] Joel Bernstein commented on SOLR-7535: -- [~gerlowskija], the patch looks good. Two co

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-28 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073435#comment-15073435 ] Dennis Gove commented on SOLR-7535: --- I haven't looked at the patch yet but to answer your

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-22 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069064#comment-15069064 ] Joel Bernstein commented on SOLR-7535: -- A Dennis mentioned the SelectStream will handl

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-22 Thread Joel Bernstein (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069059#comment-15069059 ] Joel Bernstein commented on SOLR-7535: -- I would start with the simplest case of key/va

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-22 Thread Dennis Gove (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069053#comment-15069053 ] Dennis Gove commented on SOLR-7535: --- For the original mapping take a look at SolrStream,

[jira] [Commented] (SOLR-7535) Add UpdateStream to Streaming API and Streaming Expression

2015-12-22 Thread Jason Gerlowski (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069034#comment-15069034 ] Jason Gerlowski commented on SOLR-7535: --- I'm in the process of hacking together a fir