Re: Drill and Parquet - Best practices - part 1

2015-11-01 Thread Stefán Baxter
So we are off to a flying start :) On Thu, Oct 29, 2015 at 9:50 PM, Stefán Baxter wrote: > Hi, > > We are using Avro, JSON and Parquet for collection various types of data > for analytical processing. > > I have not used Parquet before we starting to play around with

Re: Drill and Parquet - Best practices - part 1

2015-11-01 Thread John Omernik
I've read through your post and had similar thoughts on trying to get together information around Parquet files . I feel like it would be really helpful for to have a section of the Drill User Docs dedicated to user stories on Parquet files. I know stories sound odd to put into documentation,

Re: JDBC connection stuck in an infinite loop

2015-11-01 Thread Jacques Nadeau
Can you try again with the following command line options when you start your client? -Ddrill.exec.zk.retry.count=1 It looks like we have an artificially high attempt count of 7200 as our default (with a 5 second timeout for each). For reference, the settings are here:

Re: JDBC connection stuck in an infinite loop

2015-11-01 Thread William Witt
It does appear to be confined to zookeeper based connections. I’ve expanded to a 3 node drill cluster, so connecting to a single drillbit seems innefficient. Will > On Oct 31, 2015, at 12:42 PM, Jacques Nadeau wrote: > > I think this is a bug. Do you see the same

Re: Overriding delimiter at runtime

2015-11-01 Thread Steven Phillips
The "table with options" feature is currently in the works, and it will address this use case. Currently, the only way to do this is to create two different workspaces, each with a different default format. On Sun, Nov 1, 2015 at 1:45 PM, William Witt wrote: > Is there

Re: Overriding delimiter at runtime

2015-11-01 Thread Ted Dunning
On Sun, Nov 1, 2015 at 7:26 PM, Jacques Nadeau wrote: > In the meantime, you'll have to create two different > workspaces. Each workspace can set its own defaultInputFormat. > Note also that multiple workspaces can refer to the same file locations. (I have seen a few folks