Is this a case where kvgen could be potentially leveraged? On Wed, Oct 7, 2015 at 9:55 AM, Tomer Shiran <tshi...@dremio.com> wrote:
> I think it would be much better to leverage something like > CONVERT_FROM(col, 'MyKeyValueFormat') where the entire key/value cell is > parsed into Drill's internal structure just like we do with JSON. That > exposes all those key/value pairs such that you can leverage them in other > SQL operators. > > On Wed, Oct 7, 2015 at 7:32 AM, Tugdual Grall <tugd...@gmail.com> wrote: > > > You can create a custom function to do that: > > - https://drill.apache.org/docs/develop-custom-functions/ > > > > this will end with something like: > > select * > > from *.csv > > where GET_VALUE(col[x] , 'var1' ) = 'value' > > > > (I will publish, in the next few day, a similar function parsing URL in > > values in this repo : > https://github.com/mapr-demos/simple-drill-functions > > ) > > > > t > > > > On Wed, Oct 7, 2015 at 4:22 PM, <michael.engl...@nomura.com> wrote: > > > > > Hi, > > > > > > If I have a separated file (PSV/TSV etc) with a number of columns, each > > > with a single value aside from the last column which contains a bunch > of > > > key value pairs in a string e.g. var1=test var2=test var3=test. Is it > > > possible to query based on individual key/value items in the last > > column? I > > > am looking to querying nested data without using LIKE wildcards in > where > > > statements (I am not sure this is possible with separated text data). > > > > > > Does anyone have any advice on whether this is possible? > > > > > > Thanks, > > > Mike > > > > > > > > > This e-mail (including any attachments) is private and confidential, > may > > > contain proprietary or privileged information and is intended for the > > named > > > recipient(s) only. Unintended recipients are strictly prohibited from > > > taking action on the basis of information in this e-mail and must > contact > > > the sender immediately, delete this e-mail (and all attachments) and > > > destroy any hard copies. Nomura will not accept responsibility or > > liability > > > for the accuracy or completeness of, or the presence of any virus or > > > disabling code in, this e-mail. If verification is sought please > request > > a > > > hard copy. Any reference to the terms of executed transactions should > be > > > treated as preliminary only and subject to formal written confirmation > by > > > Nomura. Nomura reserves the right to retain, monitor and intercept > e-mail > > > communications through its networks (subject to and in accordance with > > > applicable laws). No confidentiality or privilege is waived or lost by > > > Nomura by any mistransmission of this e-mail. Any reference to "Nomura" > > is > > > a reference to any entity in the Nomura Holdings, Inc. group. Please > read > > > our Electronic Communications Legal Notice which forms part of this > > e-mail: > > > http://www.Nomura.com/email_disclaimer.htm > > > > > > > > > > > > -- > Tomer Shiran > CEO and Co-Founder, Dremio > -- *Jim Scott* Director, Enterprise Strategy & Architecture +1 (347) 746-9281 @kingmesal <https://twitter.com/kingmesal> <http://www.mapr.com/> [image: MapR Technologies] <http://www.mapr.com> Now Available - Free Hadoop On-Demand Training <http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
