Re: Query hangs on planning

to the number of cores on the setup where the query went through successfully. And details of memory from the two scenarios. Thanks, Khurram On Wed, Aug 31, 2016 at 4:50 PM, Oscar Morante <spacep...@gmail.com> wrote: For the record, I think this was just bad memory configuration after all. I re

Re: Query hangs on planning

:1.7.0_111] Thanks, Khurram On Tue, Aug 9, 2016 at 7:46 PM, Oscar Morante <spacep...@gmail.com> wrote: Yeah, when I uncomment only the `upload_date` lines (a dir0 alias), explain succeeds within ~30s. Enabling any of the other lines triggers the failure. This is a log with the `upload_date`

Re: Drill CPU Usage

;VM Periodic Task Thread" os_prio=0 tid=0x7f4c4c10f800 nid=0x1dbea waiting on condition JNI global references: 314 -Original Message- From: Avi Haleva [mailto:avi.hal...@aternity.com] Sent: Thursday, August 11, 2016 14:10 To: user@drill.apache.org Subject: RE: Drill CPU Usage B

Re: Dockerized Drill with Bridged Network

You can try this image if you want to do a quick test: https://hub.docker.com/r/miradatv/apache-drill/ It has a few patches though. On Tue, Aug 09, 2016 at 05:36:56PM +0300, Oscar Morante wrote: Hi Suhas, I've been running a Drill cluster on Kubernetes just by patching this: https

Re: Dockerized Drill with Bridged Network

Hi Suhas, I've been running a Drill cluster on Kubernetes just by patching this: https://github.com/miradatv/drill/commit/ef139a4d8645936a0ecbc8318546fad99ee9609b I think it should also work on Mesos. Cheers, On Mon, Aug 08, 2016 at 12:55:32PM -0700, Suhas Gaddam wrote: Hi, I am trying

Query hangs on planning

Hi there, I've been stuck with this for a while and I'm not sure if I'm running into a bug or I'm just doing something very wrong. I have this stripped-down version of my query: https://gist.github.com/spacepluk/9ab1e1a0cfec6f0efb298f023f4c805b The data is just a single file with one record

Re: Partition prunning using CURRENT_DATE?

be nice, but this worked pretty well for me too. (I also wonder if you could just change the raw view def file and update the date) John On Thu, Jul 21, 2016 at 2:26 AM, Oscar Morante <spacep...@gmail.com> wrote: Hi John, I've been following your trail of emails :) Thanks for shari

Re: Partition prunning using CURRENT_DATE?

being done for users? I know my issue was I wanted a view that showed only the current date, and I struggled to come up with a good solution to that. John On Wed, Jul 20, 2016 at 6:06 AM, Oscar Morante <spacep...@gmail.com> wrote: I'm trying to trigger partition prunning like this: sele

Partition prunning using CURRENT_DATE?

I'm trying to trigger partition prunning like this: select * from dfs.`json/by-date` where dir0 = cast(current_date as varchar); But apparently, it only works when passing a literal. Am I missing something? Thanks, -- Oscar Morante "Self-education is, I firmly believe, the

Re: S3 query takes a long time to start

there should be a clean fix to this but haven't had the cycles to suggest something. You up for looking at the code and trying to suggest something? thanks! -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Mar 10, 2016 at 8:06 AM, Oscar Morante <spacep...@gmail.com> wrote: I've been ch

Re: S3 query takes a long time to start

s.html On Thu, Mar 10, 2016 at 12:27:42PM +0200, Oscar Morante wrote: I'm querying 20G of gzipped JSONs split in ~5600 small files with sizes ranging from 1M to 30Mb. Drill is running in aws in 4 m4.xlarge nodes and it's taking around 50 minutes before the query starts executing. Any idea w

S3 query takes a long time to start

this? Thanks, -- Oscar Morante "Self-education is, I firmly believe, the only kind of education there is." -- Isaac Asimov. signature.asc Description: Digital signature

Time intervals overflowing?

that the second expression turns into a negative interval. Is that the expected behavior? Cheers, -- Oscar Morante "Self-education is, I firmly believe, the only kind of education there is." -- Isaac Asimov. signature.asc D

Re: Need some help debugging slow S3 download speed

://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/NativeLibraries.html On Sun, Feb 21, 2016 at 11:53 AM, Oscar Morante <spacep...@gmail.com> wrote: I'm still fighting with this, so far I've tried: - Adding the native hadoop libraries. - `s3n://` and `s3a://`. - SSL

Re: Need some help debugging slow S3 download speed

. Is there anything else that I can try to improve the situation? At the begining I thought that S3 was the bottleneck but everything is pointing to kind of lock in Drill. Or maybe I'm just being unrealistic and asking too much :? Cheers, On Fri, Feb 19, 2016 at 02:27:56PM +0200, Oscar Morante

Need some help debugging slow S3 download speed

. Thanks! -- Oscar Morante "Self-education is, I firmly believe, the only kind of education there is." -- Isaac Asimov. signature.asc Description: Digital signature

Re: 'DATE - DATE' not supported?

to relax the type constraints (a component of Drill-4372). Hopefully, you could run your original query in the near future. On Tue, Feb 9, 2016 at 6:47 AM, Oscar Morante <spacep...@gmail.com> wrote: Hi there, I'm new to both the list and Drill. I'm doing some tests using Tableau and

'DATE - DATE' not supported?

of query should be supported. Is this a regression? Am I doing something wrong? Thanks, -- Oscar Morante "Self-education is, I firmly believe, the only kind of education there is." -- Isaac Asimov. signature.asc Descriptio

Source for drill's calcite?

different from the version Drill is using, and `1.4.0-incubation` it doesn't work either. I've tried to look for the source but I can't seem to find `1.4.0-drill-r10` anywhere. Any ideas? PS: Here's the patch so far -> https://gist.github.com/spacepluk/40df5a90ddee2efe1f4a -- Oscar Morante &q

Re: Source for drill's calcite?

alcite/commits/1.4.0-drill-r9 On Tue, Feb 9, 2016 at 7:46 AM, Oscar Morante <spacep...@gmail.com> wrote: > I'm trying to add support for week and weekdays to `date_trunc` and > `date_part`. It seems to be working fine right now except that I need to > patch calcite's TimeUnit so th