Split Function in Drill

Hi, Like Hive, Is there any split function available to split the string with special character? Thanks, Parkavi ::DISCLAIMER:: The contents of

Null values in lists

Hi, How to use null values in list?? Even I changed `store.json.all_text_mode` = true also it is shouting same error. Query: select convert_from('{abc:[1,2],bvc:[3,4,null,3]}','json') from tab; Error: UNSUPPORTED_OPERATION ERROR: Null values are not supported in lists by default. Please set

Re: Split Function in Drill

Hello, I do not think this function exist today in Drill. ( https://drill.apache.org/docs/string-manipulation/ ) Maybe you ca create your own Function to achieve this: - https://drill.apache.org/docs/develop-custom-functions-introduction/ -

Re: Memory usage

Hi Andries, thanks for your support Bumping the heap or disabling hash_join alone does not cause the query to completed Drill embedded for Windows behave in a strange way (at least on my machine):  - When I run Drill alone the query falls OOM, with more than 5GB free memory on the task

Parquet Partitions

After reading about Parquet Partition Pruning in Drill 1.1, I was wondering if there is still partitioning based on hive like partitions. I.e. I have a process that is making a hive table with Parquet files. It's using Partitions (Directories). Do I need Drill to read that data using the Hive

Re: Parquet Partitions

John Both would work i.e query partitioned directories directly using file system storage plug in or via Hive table. On Wed, Aug 5, 2015 at 8:58 AM, John Omernik j...@omernik.com wrote: After reading about Parquet Partition Pruning in Drill 1.1, I was wondering if there is still partitioning

Re: Parquet Partitions

Would Drill know to partition prune based on directories if it didn't have the hive metastore to define the partitions at the directory level? On Wed, Aug 5, 2015 at 11:01 AM, Neeraja Rentachintala nrentachint...@maprtech.com wrote: John Both would work i.e query partitioned directories

Re: Parquet Partitions

Yes. You can use the dfs plugin in this case. Regards Ramana On Wed, Aug 5, 2015 at 1:02 PM, John Omernik j...@omernik.com wrote: Would Drill know to partition prune based on directories if it didn't have the hive metastore to define the partitions at the directory level? On Wed, Aug 5,

Re: Parquet Partitions

So , what I am getting at is say a table was created in Hive with PArquet files CREATE table hive_parq(field1 STRING, field2 STRING) Partitioned by part1 STRING, part2 STRING STORED as Parquet. That creates a directory named hive_part, then there will be directories in under that part1=val1,

Re: Parquet Partitions

John, Drill has no idea about the names of your partitions since that information is part of the hive metastore. You can get partition pruning if you modify your query like below select * from dfs.hive_parq where dir0=val1; (dir0 is equivalent to part1, and dir1 would be equivalent to part2) -

Re: Null values in lists

Hi Parkavi, This might be a bug in the convert_from function (please log a bug). Try writing the same json to a file and it should work with all_text_mode set to true. Parth On Wed, Aug 5, 2015 at 12:35 AM, Parkavi Nandagopal parkavi...@hcl.com wrote: Hi, How to use null values in