Re: Feature/Question

2021-06-01 Thread Ted Dunning
e node - but not the other way around. > > I was running the queries from drill-localhost instance from one of the > nodes. Is there something else I should try to achieve the above behavior ? > > From: ted.dunn...@gmail.com At: 05/30/21 18:51:03 UTC-4:00 > To: Akshay Bhasin (BLOO

Re: Feature/Question

2021-06-01 Thread Akshay Bhasin (BLOOMBERG/ 731 LEX)
from drill-localhost instance from one of the nodes. Is there something else I should try to achieve the above behavior ? From: ted.dunn...@gmail.com At: 05/30/21 18:51:03 UTC-4:00To: Akshay Bhasin (BLOOMBERG/ 731 LEX ) Cc: dev@drill.apache.org Subject: Re: Feature/Question Here are some more an

Re: Feature/Question

2021-05-30 Thread Ted Dunning
Here are some more answers: On Thu, May 27, 2021 at 10:09 AM Akshay Bhasin (BLOOMBERG/ 731 LEX) < abhasi...@bloomberg.net> wrote: > Hi Ted, > > Yes sure - below are the 2 reasons for it - > > 1) If I run 5 drill machines in a cluster, all connected to a single end > point at s3, I'll have to use

Re: Feature/Question

2021-05-27 Thread Charles Givre
to s3 bucket. I think you can only put/upload files there, you cannot write > to it. > > Best, > Akshay > > From: ted.dunn...@gmail.com At: 05/27/21 12:57:07 UTC-4:00To: Akshay Bhasin > (BLOOMBERG/ 731 LEX ) > Cc: dev@drill.apache.org > Subject: Re: Feature/Questio

Re: Feature/Question

2021-05-27 Thread Akshay Bhasin (BLOOMBERG/ 731 LEX)
7;m not sure drill can write to s3 bucket. I think you can only put/upload files there, you cannot write to it. Best, Akshay From: ted.dunn...@gmail.com At: 05/27/21 12:57:07 UTC-4:00To: Akshay Bhasin (BLOOMBERG/ 731 LEX ) Cc: dev@drill.apache.org Subject: Re: Feature/Question Akshay,

Re: Feature/Question

2021-05-27 Thread Ted Dunning
es to parquet & parquet.crc. > > My end goal here is to have a drill cluster reading data from s3 & a > separate process to convert data to parquet & parquet.crc files & upload it > to s3. > > Best, > Akshay > > From: ted.dunn...@gmail.com At: 04/27/21

Re: Feature/Question

2021-05-27 Thread Akshay Bhasin (BLOOMBERG/ 731 LEX)
ess to convert data to parquet & parquet.crc files & upload it to s3. Best, Akshay From: ted.dunn...@gmail.com At: 04/27/21 17:37:43 UTC-4:00To: Akshay Bhasin (BLOOMBERG/ 731 LEX ) Cc: dev@drill.apache.org Subject: Re: Feature/Question Akshay, That's great news! On Tue, Apr 27, 2021 a

Re: Feature/Question

2021-04-27 Thread Ted Dunning
7;XXX/YYY/filename', > 'XXX/ZZZ/filename' and able to query like > SELECT * FROM XXX. > > Thanks ! > > Best, > Akshay > > From: ted.dunn...@gmail.com At: 04/21/21 17:21:42 > To: Akshay Bhasin (BLOOMBERG/ 731 LEX ) , > dev@drill.apache.org > Subject: Re:

Re: Feature/Question

2021-04-27 Thread Akshay Bhasin (BLOOMBERG/ 731 LEX)
17:21:42To: Akshay Bhasin (BLOOMBERG/ 731 LEX ) , dev@drill.apache.org Subject: Re: Feature/Question Akshay, Yes. It is possible to do what you want from a few different angles. As you have noted, S3 doesn't have directories. Not really. On the other hand, people simulate this using namin

Re: Feature/Question

2021-04-21 Thread Ted Dunning
Akshay, Yes. It is possible to do what you want from a few different angles. As you have noted, S3 doesn't have directories. Not really. On the other hand, people simulate this using naming schemes and S3 has some support for this. One of the simplest ways to deal with this is to create a view t

Feature/Question

2021-04-21 Thread Akshay Bhasin (BLOOMBERG/ 731 LEX)
Hi Drill Community, I'm Akshay and I'm using Drill for a project I'm working on. There is this particular use case I want to implement - I want to know if its possible. 1) Currently, we have a partition of file system and we create a view on top of it. For example, we have below directory str