Re: Cross-node joins

Updated SOLR-7090 with a not fully-working patch. On Wed, Sep 30, 2015 at 5:45 PM, Scott Blum wrote: > Alright, I'll put something on SOLR-7090 in a bit. > > Meanwhile, I'm trying to get a basic test running, and running into a > stupid problem... I am trying to write a cloud and non-cloud code

Re: Cross-node joins

Alright, I'll put something on SOLR-7090 in a bit. Meanwhile, I'm trying to get a basic test running, and running into a stupid problem... I am trying to write a cloud and non-cloud code path for the facet query. What I want to do is create a solrj HttpSolrClient either way, but I can't figure o

Re: Cross-node joins

I think LUCENE-3759 is not a good place, since this is a Solr specific implementation. Please feel free to use SOLR-7090. Based on my idea of your implementation, it wasn't clear to me whether or not the intention of the patch is the same as what SOLR-7090 (at a high level), as per the description

Re: Cross-node joins

Hi Ishan, I definitely should write a test. It's supposed to be a drop-in replacement for the existing Join query. I wasn't sure if I should hijack SOLR-7090, or maybe LUCENE-3759, or just open a new JIRA. Please advise! Or I'm happy to continue discussing high level on this thread. Best, Sco

Re: Cross-node joins

Hi Scott, I've replied to your comment on SOLR-7090. I just had a look at the your fulljoin implementation, but I wasn't sure if I follow this properly. Maybe a unit test would help? Also, do you plan to open a JIRA (or, maybe, use SOLR-7090 JIRA itself, so as to keep all related efforts together

Re: Cross-node joins

So I went down the route of creating a new QParser named "fulljoin", and I have it essentially working. https://github.com/fullstorydev/lucene-solr/commits/scottb/fulljoin Basically, I copied JoinQParserPlugin, ripped out the local index "from" processing, and replaced it with a SolrCloud facet q

Re: Cross-node joins

I posted back on SOLR-7090 . I'm probably misunderstanding it, but what's there seemed pretty rough to me. On Tue, Sep 29, 2015 at 7:32 PM, Scott Blum wrote: > On Fri, Sep 25, 2015 at 6:49 PM, Erick Erickson > wrote: > >> yeah, the streaming stuf

Re: Cross-node joins

On Fri, Sep 25, 2015 at 6:49 PM, Erick Erickson wrote: > yeah, the streaming stuff is pretty bleeding-edge but pretty cool. > I looked at this for a bit, but I wasn't clear on the performance implications of streaming. We use pagination heavily in our solr interactions, and the doc seems to sug

Re: Cross-node joins

yeah, the streaming stuff is pretty bleeding-edge but pretty cool. Your understanding is accurate, the pathological case is the reason it's not been implemented in core Solr. I suppose you could do exactly what you outlined, just with two queries. for SOLR-4095, why would this affect sharding for

Re: Cross-node joins

Yep, we looked at that, but unfortunately the frequency of group updates and number of users would it infeasible to reindex all group members any time a group changes. On Fri, Sep 25, 2015 at 3:36 PM, Alexandre Rafalovitch wrote: > How often do the group characteristics change? Because you might

Re: Cross-node joins

How often do the group characteristics change? Because you might be better off flattening this at the index time. As in. Users->characteristics, rather than Users->Groups->characteristics. And update the users when the group characteristics change. And if characteristics are non-stored but only ind

Re: Cross-node joins

Hi Erick, Thanks for the thoughtful reply! The context is essentially that I have Groups and Users, and a User can belong to multiple groups. So if I need to do a query like "Find all Users who are members of a Group, for which the Group has certain characteristics", then I need to do something

Re: Cross-node joins

I had some performance issues, so I decided to update core Lucene code. Now I have 3 problems: *) performance issues *) hard to debug code *) annoyed Solr developers whose use cases I did not consider Not that I am reading random JIRAs or anything. Seriously though, for those trying to step

Re: Cross-node joins

Well, let's start by backing up a bit. what is the problem you're trying to solve that needs cross-node joins? Trying to be sure this isn't an XY problem. There is some work in this area, See: https://issues.apache.org/jira/browse/SOLR-7090 (not committed) and https://issues.apache.org/jira/browse