Drill- Query execution plan

[Sudip Mukherjee]

Hi,
Need some help understanding the below steps of a query execution. The below 
query is broken down in to these steps.
If you could just explain me in short or point to a documentation link would be 
great for me as I am trying to dig into drill code and logics.

SELECT SUM(1) AS `COL` FROM mydb.testtable HAVING COUNT(1)>0 [query is sent 
from tableau]




Sudip[cid:image001.png@01D0EED8.6C54AE60]



***Legal Disclaimer***
"This communication may contain confidential and privileged material for the
sole use of the intended recipient. Any unauthorized review, use or distribution
by others is strictly prohibited. If you have received the message by mistake,
please advise the sender by reply email and delete the message. Thank you."
**

Re: Drill- Query execution plan

[Abdel Hakim Deneche]

Hi Sudip,

Did you include an image in your email ? unfortunately, Drill's mailing
list doesn't allow any attachments, so we are not able to see the image

On Sun, Sep 13, 2015 at 10:51 PM, Sudip Mukherjee 
wrote:

> Hi,
>
> Need some help understanding the below steps of a query execution. The
> below query is broken down in to these steps.
>
> If you could just explain me in short or point to a documentation link
> would be great for me as I am trying to dig into drill code and logics.
>
>
>
> *SELECT SUM(1) AS `COL` FROM mydb.testtable HAVING COUNT(1)>0 [query is
> sent from tableau]*
>
>
>
>
>
>
>
>
>
> Sudip
>
>
> ***Legal Disclaimer***
> "This communication may contain confidential and privileged material for the
> sole use of the intended recipient. Any unauthorized review, use or 
> distribution
> by others is strictly prohibited. If you have received the message by mistake,
> please advise the sender by reply email and delete the message. Thank you."
> **
>
>


-- 

Abdelhakim Deneche

Software Engineer

  


Now Available - Free Hadoop On-Demand Training

RE: Drill- Query execution plan

[Sudip Mukherjee]

Hi Abdel,

Sorry for that. The code flow that I am trying to understand is below 

Like in my query::
SELECT SUM(1) AS `COL` FROM mydb.testtable HAVING COUNT(1)>0

Is the Projection broken down to 1) Final record output , 2) Projection on 
Aggregation  something like that. Please correct me if I am wrong.



00-00Screen : rowType = RecordType(INTEGER COL): rowcount = 1.0, cumulative 
cost = {62.1 rows, 607.1 cpu, 0.0 io, 0.0 network, 0.0 memory}, id = 217
00-01  Project(COL=[$0]) : rowType = RecordType(INTEGER COL): rowcount = 
1.0, cumulative cost = {62.0 rows, 607.0 cpu, 0.0 io, 0.0 network, 0.0 memory}, 
id = 216
00-02SelectionVectorRemover : rowType = RecordType(INTEGER COL, BIGINT 
$f1): rowcount = 1.0, cumulative cost = {62.0 rows, 607.0 cpu, 0.0 io, 0.0 
network, 0.0 memory}, id = 215
00-03  Filter(condition=[>($1, 0)]) : rowType = RecordType(INTEGER COL, 
BIGINT $f1): rowcount = 1.0, cumulative cost = {61.0 rows, 606.0 cpu, 0.0 io, 
0.0 network, 0.0 memory}, id = 214
00-04StreamAgg(group=[{}], COL=[SUM($0)], agg#1=[COUNT()]) : 
rowType = RecordType(INTEGER COL, BIGINT $f1): rowcount = 1.0, cumulative cost 
= {60.0 rows, 600.0 cpu, 0.0 io, 0.0 network, 0.0 memory}, id = 213
00-05  Project($f0=[1]) : rowType = RecordType(INTEGER $f0): 
rowcount = 20.0, cumulative cost = {40.0 rows, 120.0 cpu, 0.0 io, 0.0 network, 
0.0 memory}, id = 212
00-06Scan(groupscan=[GroupScan [ScanSpec=ScanSpec [tableName= 
testtable, filter=null], columns=[`*`]]]) : rowType = 
RecordType(VARCHAR(2147483647) Company, VARCHAR(2147483647) Name): rowcount = 
20.0, cumulative cost = {20.0 rows, 40.0 cpu, 0.0 io, 0.0 network, 0.0 memory}, 
id = 211

Thanks,
Sudip

-Original Message-
From: Abdel Hakim Deneche [mailto:adene...@maprtech.com] 
Sent: 14 September 2015 PM 08:12
To: dev@drill.apache.org
Subject: Re: Drill- Query execution plan

Hi Sudip,

Did you include an image in your email ? unfortunately, Drill's mailing list 
doesn't allow any attachments, so we are not able to see the image

On Sun, Sep 13, 2015 at 10:51 PM, Sudip Mukherjee 
wrote:

> Hi,
>
> Need some help understanding the below steps of a query execution. The 
> below query is broken down in to these steps.
>
> If you could just explain me in short or point to a documentation link 
> would be great for me as I am trying to dig into drill code and logics.
>
>
>
> *SELECT SUM(1) AS `COL` FROM mydb.testtable HAVING COUNT(1)>0 [query 
> is sent from tableau]*
>
>
>
>
>
>
>
>
>
> Sudip
>
>
> ***Legal Disclaimer***
> "This communication may contain confidential and privileged material 
> for the sole use of the intended recipient. Any unauthorized review, 
> use or distribution by others is strictly prohibited. If you have 
> received the message by mistake, please advise the sender by reply email and 
> delete the message. Thank you."
> **
>
>


-- 

Abdelhakim Deneche

Software Engineer

  <http://www.mapr.com/>


Now Available - Free Hadoop On-Demand Training 
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>



***Legal Disclaimer***
"This communication may contain confidential and privileged material for the
sole use of the intended recipient. Any unauthorized review, use or distribution
by others is strictly prohibited. If you have received the message by mistake,
please advise the sender by reply email and delete the message. Thank you."
**

[I] Apache Drill Query Execution PLAN Doesn't use mongo db index (drill)

[via GitHub]

dwevedivaibhav opened a new issue, #2826:
URL: https://github.com/apache/drill/issues/2826

   Hi Team,
   
   I am trying to execute the millions of record query from mongo db storage 
with timestamp filter, it getting slow even though i created the index of 
timestamp in mongo collection, but its taking so long time to execute and some 
time time its failing also due to huge record. 
   
   Please find the sample query which i am executing from apache drill
   
   select  * FROM `mongo`.`sampletable`
   WHERE `SentTime` >= TO_TIMESTAMP('2023-08-10 00:00:00', '-MM-dd 
HH:mm:ss')
 AND `SentTime` < TO_TIMESTAMP('2023-08-17 00:00:00', '-MM-dd HH:mm:ss')
   LIMIT 10


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Re: [I] Apache Drill Query Execution PLAN Doesn't use mongo db index (drill)

[via GitHub]

jnturton commented on issue #2826:
URL: https://github.com/apache/drill/issues/2826#issuecomment-1692997614

   I wonder if your constant timestamp expressions are being folded by the 
planner. Do you get the same performance from the next query?
   
   ```sql
   SELECT * FROM mongo.sampletable
   WHERE SentTime >= TIMESTAMP '2023-08-10 00:00:00'
   AND SentTime < TIMESTAMP '2023-08-17 00:00:00'
   LIMIT 10
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Re: [I] Apache Drill Query Execution PLAN Doesn't use mongo db index (drill)

[via GitHub]

dwevedivaibhav commented on issue #2826:
URL: https://github.com/apache/drill/issues/2826#issuecomment-2074469124

   Yes Same problem @jnturton 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Re: [I] Apache Drill Query Execution PLAN Doesn't use mongo db index (drill)

[via GitHub]

jnturton closed issue #2826: Apache Drill Query Execution PLAN Doesn't use 
mongo db index
URL: https://github.com/apache/drill/issues/2826


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Re: [I] Apache Drill Query Execution PLAN Doesn't use mongo db index (drill)

[via GitHub]

jnturton commented on issue #2826:
URL: https://github.com/apache/drill/issues/2826#issuecomment-2076442625

   Duplicate of #2906.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org