[ 
https://issues.apache.org/jira/browse/LENS-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339963#comment-14339963
 ] 

Nitin Gupta commented on LENS-356:
----------------------------------

For this case, I would want the design to be kept simple and homogeneous. We 
can use the thread pool threads to perform all estimates. I don't believe the 
cost savings here are significant. As others have said, we may be limited in 
future design where a decision can be made based on K operations instead of all 
N. 
Do we have an estimate of the stack space requirements for each thread? We can 
increase the number of thread pool threads in order to achieve the same number 
of parallel operations. 

> Run estimate for each driver in parallel 
> -----------------------------------------
>
>                 Key: LENS-356
>                 URL: https://issues.apache.org/jira/browse/LENS-356
>             Project: Apache Lens
>          Issue Type: Sub-task
>          Components: server
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 2.1
>
>
> We are estimating the cost of query on each driver sequentially. Since each 
> estimate is independent those can be parallelized.
> For each driver rewrite the query, call driver.estimate - need to parallelize 
> this for all drivers. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to