The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Stefán Baxter
Hi, Here is small trick I think you will like :). - With this minimal dataset as /tmp/test.json: {"dimensions":{"adults":"A"}} - Running this: select lower(p.dimensions.budgetLevel) as `field1`, lower(p.dimensions.adults) as `field2` from dfs.tmp.`/test.json` as p; - To no sur

Re: The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Stefán Baxter
Well, After some more testing it appears that this has nothing to do with trim. (any non existing nested-value will be pushed aside) select p.dimensions.budgetLevel as `field1`, lower(p.dimensions.adults) as `field2` from dfs.tmp.`/test/0_0_0.parquet` as p; also returns: +-+-+ |

Re: The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Stefán Baxter
Hi, all kidding aside then this renders Drill+Parquet unusable for us at the moment. If there is a quick fix then please let me know. :) Regards, -Stefan On Tue, Jul 21, 2015 at 5:37 PM, Stefán Baxter wrote: > Well, > > After some more testing it appears that this has nothing to do with trim

Re: The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Jacques Nadeau
Whoa, something strange is going on. Expected select * from dfs.tmp.test2; +-+ | dimensions| +-+ | {"adults":"A"} | +-+ select p.dimensions as b from dfs.tmp.test2 p; +-+ |b| +-+ | {"adults":"A"

Re: The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Stefán Baxter
done :) On Tue, Jul 21, 2015 at 6:16 PM, Jacques Nadeau wrote: > Whoa, something strange is going on. > > Expected > select * from dfs.tmp.test2; > +-+ > | dimensions| > +-+ > | {"adults":"A"} | > +-+ > > select p.dimensions as b from dfs.tm

Re: The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Stefán Baxter
Hi, I would be super thankful if someone could fix this for us as it's impeding our devaluation and testing (Assuming a fix is fairly doable). I would be more than happy to take a look at it myself but I'm nowhere near having the required understanding of your inner workings. (I have built the pro

Re: The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Jinfeng Ni
I'm taking a look at the JIRA you filed :DRILL-3533. If I could not find a fix soon, I'll ask someone in our team to take a further look. On Tue, Jul 21, 2015 at 2:50 PM, Stefán Baxter wrote: > Hi, > > I would be super thankful if someone could fix this for us as it's impeding > our devaluatio

Re: The mysterious life of mr. Trim (aka. the value displacement trick)

2015-07-21 Thread Stefán Baxter
Thank you! :) On Tue, Jul 21, 2015 at 10:26 PM, Jinfeng Ni wrote: > I'm taking a look at the JIRA you filed :DRILL-3533. If I could not find a > fix soon, I'll ask someone in our team to take a further look. > > > On Tue, Jul 21, 2015 at 2:50 PM, Stefán Baxter > wrote: > > > Hi, > > > > I woul