Jonathan Eagles created TEZ-3334:
------------------------------------

             Summary: Tez Custom Shuffle Handler
                 Key: TEZ-3334
                 URL: https://issues.apache.org/jira/browse/TEZ-3334
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Jonathan Eagles


For conditions where auto-parallelism is reduced (e.g. TEZ-3222), a custom 
shuffle handler could help reduce the number of fetches and could more 
efficiently fetch data. In particular if a reducer is fetching 100 pieces 
serially from the same mapper it could do this in one fetch call. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to