Mostafa Mokhtar created IMPALA-6404:
---------------------------------------

             Summary: Evenly distribute local and remote scan ranges across 
Impalad(s) when 100% locality is not achievable
                 Key: IMPALA-6404
                 URL: https://issues.apache.org/jira/browse/IMPALA-6404
             Project: IMPALA
          Issue Type: Improvement
          Components: Distributed Exec
            Reporter: Mostafa Mokhtar
            Assignee: Lars Volker


Current scheduler tries to assign as many local reads as possible, this works 
well if 100% locality is achievable, but in cases where some nodes have 
locality while others don't an even scan ranges are assigned to the backends 
which results in execution skew.

Ideally the scheduler should create an even distribution of local and remote 
scan ranges to avoid skew.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to