My query is generic What I am asking is that does drill fire query on target data store and only fetch result or does it fetch data and then fire query ?
Regards Chetan -----Original Message----- From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, February 20, 2017 8:14 PM To: user@drill.apache.org Subject: RE: Query on performance using Drill and Amazon s3. Hi chetan, Projjwal has the issue. Me too asked the same question On Feb 20, 2017 7:56 PM, "Chetan Kothari" <HYPERLINK "mailto:chetan.koth...@oracle.com"chetan.koth...@oracle.com> wrote: > Hi Nitin > > > > Where does the query execute? > > Does Drill execute query on AWS and fetch results to be displayed? > > > > Regards > > Chetan > > > > -----Original Message----- > From: Nitin Pawar [mailto:nitinpawar...@gmail.com] > Sent: Monday, February 20, 2017 6:19 PM > To: HYPERLINK "mailto:user@drill.apache.org"user@drill.apache.org > Subject: Re: Query on performance using Drill and Amazon s3. > > > > how are you doing select * .. using drill UI or sqlline? > > where are you running it from ? > > is the drill hosted in aws or on your local machine? > > > > I think majority of the time is spent on displaying the result set > instead of querying the file if the drill server is on aws. > > If the drill server is local then it might be your network which might > take a lot of time based on s3 bucket location and where your drill > server is > > > > On Mon, Feb 20, 2017 at 5:37 PM, PROJJWAL SAHA <HYPERLINK "mailto: > HYPERLINK > "mailto:proj.s...@gmail.com%22proj.s...@gmail.com"proj.s...@gmail.com"proj.s...@gmail.com> > wrote: > > > > > Hello all, > > > > > > I am using 1GB data in the form of .tsv file, stored in Amazon S3 > > > using Drill 1.8. I am using default configurations of Drill using S3 > > > storage plugin coming out of the box. The drill bits are configured > > on > > > a 5 node cluster with 32GB RAM and 4VCPU. > > > > > > I see that select * from xxx; query takes 23 mins to fetch 1,040,000 > rows. > > > > > > Is this the expected behaviour ? > > > I am looking for any quick tuning that can improve the performance > > or > > > any other suggestions. > > > > > > Attaching is the JSON profile for this query. > > > > > > Regards, > > > Projjwal > > > > > > > > > > > -- > > Nitin Pawar > > >
