[ 
https://issues.apache.org/jira/browse/HIVE-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084168#comment-17084168
 ] 

Ashutosh Chauhan commented on HIVE-23210:
-----------------------------------------

[~rajesh.balamohan] Do you have proposed solution for it as well? Are you 
suggesting to run single task jobs at higher priority compared to rest of tasks 
in daemon. That doesn't sound fair as it may starve multi-task jobs if you have 
steady stream of these single task jobs.

> Fix shortestjobcomparator when jobs submitted have 1 task their vertices
> ------------------------------------------------------------------------
>
>                 Key: HIVE-23210
>                 URL: https://issues.apache.org/jira/browse/HIVE-23210
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Priority: Major
>         Attachments: TestShortestJobFirstComparator.java
>
>
> In latency sensitive queries, lots of jobs can have vertices with 1 task. 
> Currently shortestjobcomparator does not work correctly and returns tasks in 
> random order.
> [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/comparator/ShortestJobFirstComparator.java#L51]
> This causes delay in the job runtime. I will attach a simple test case 
> shortly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to