Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-20 Thread Jacques Nadeau
FYI, this is also in master now. -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 20, 2016 at 4:14 AM, Boris Chmiel < boris.chm...@yahoo.com.invalid> wrote: > Great ! Thanks Jacques; I expect to try your patch soon > > Le Samedi 16 janvier 2016 2h36, "rohitkulkarn...@gmail.com" < > r

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-20 Thread Boris Chmiel
Great ! Thanks Jacques; I expect to try your patch soon Le Samedi 16 janvier 2016 2h36, "rohitkulkarn...@gmail.com" a écrit : Oh this is brilliant. I will take a look at this and give it a try. Let me take a moment and thank you all for this ambitious project you've undertaken. Thanks

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-15 Thread rohitkulkarni68
Oh this is brilliant. I will take a look at this and give it a try. Let me take a moment and thank you all for this ambitious project you've undertaken. Thanks a lot! :) Regards, Rohit Sent from my iPhone > On 16-Jan-2016, at 4:11 AM, Jacques Nadeau wrote: > > I have a fix and we should merg

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-15 Thread Jacques Nadeau
I have a fix and we should merge it shortly into master. You can see the progress here: https://issues.apache.org/jira/browse/DRILL-4277 Note that given the simplicity of the patch, if you are adventurous, you could most likely apply this patch on top of the 1.4 version of Drill if you didn't wan

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-14 Thread Jacques Nadeau
Good catch. Reproduced now. Looking into it. -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Jan 14, 2016 at 3:19 PM, Jason Altekruse wrote: > Jacques, not sure if you caught this, in the stacktrace it mentions > broadcast sender. Did the plan for your test query include a broadcast > join

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-14 Thread Jason Altekruse
Jacques, not sure if you caught this, in the stacktrace it mentions broadcast sender. Did the plan for your test query include a broadcast join? * (com.fasterxml.jackson.databind.JsonMappingException) Already had POJO for id (java.lang.Integer) [com.fasterxml.jackson.annotation.ObjectIdGenerator$

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-14 Thread Jacques Nadeau
Hey Rohit, I'm having trouble reproducing this in my environment (pointing at derby + hdfs instead of redshift/postgres). Can you turn on debug logging and then run this query? You can enable the debug logging we are interested in by adding the following item to logback.xml: This

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-13 Thread rohitkulkarni68
Thanks a bunch Jacques! Sent from my iPhone > On 14-Jan-2016, at 12:48 AM, Jacques Nadeau wrote: > > I think it is most likely probably trivial but unfortunately haven't had > the time to look at it yet. It looks like, for some reason, we're having a > failure when serializing the query to pass

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-13 Thread Jacques Nadeau
I think it is most likely probably trivial but unfortunately haven't had the time to look at it yet. It looks like, for some reason, we're having a failure when serializing the query to pass around between nodes. Let me try to take a look today. -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-13 Thread Rohit Kulkarni
Is this trivial, or big? Thanks, Rohit On Thu, Jan 7, 2016 at 11:29 PM, Boris Chmiel < boris.chm...@yahoo.com.invalid> wrote: > Hi everyone,I do also have this error trying to join MSSQL data source > with dfs parquet files. Here the stack : > org.apache.drill.common.exceptions.UserRemoteExcepti

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-06 Thread Jacques Nadeau
Can you turn on verbose errors and post the full stack trace of the error? You can enable verbose errors per the instructions here: https://drill.apache.org/docs/troubleshooting/#enable-verbose-errors -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 6, 2016 at 6:10 AM, wrote: > Any tho

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-06 Thread rohitkulkarni68
Any thoughts on this? I tried so many variants of this query but same error! Thanks, Rohit > On 06-Jan-2016, at 12:26 AM, Rohit Kulkarni wrote: > > Thanks a bunch for replying! I quickly ran this - the TAGS_US data in HDFS is > in parquet format. > > select distinct typeof(cvalue) > > from

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-05 Thread Rohit Kulkarni
Thanks a bunch for replying! I quickly ran this - the TAGS_US data in HDFS is in parquet format. select distinct typeof(cvalue) from hdfs.drill.TAGS_US; +--+ | EXPR$0 | +--+ | VARCHAR | +--+ Same with the table in Redshift. I changed my query to specifically c

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-04 Thread Jacques Nadeau
I don't think it is a type variation change. Can you provide the EXPLAIN output of your query? This looks like it is an execution plan serialization bug. -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Jan 4, 2016 at 8:12 AM, Andries Engelbrecht < aengelbre...@maprtech.com> wrote: > Perhaps

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-04 Thread Andries Engelbrecht
Perhaps check the data type of all the fields being used for the join. Select cvalue, TYPEOF(cvalue) from hdfs.. limit 10 and similar for tag_value on redshift. You can then do a predicate to find records where the data type may be different. where typeof() not like '' I believe there wa

"Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

2016-01-03 Thread Rohit Kulkarni
Hello all, I am sure if not all of you, but some of you must have seen this error some time - *Error: SYSTEM ERROR: IllegalStateException: Already had POJO for id (java.lang.Integer) [com.fasterxml.jackson.annotation.ObjectIdGenerator$IdKey@3372bbe8]* ​I am trying to do a join between Redshift (