[
https://issues.apache.org/jira/browse/TEZ-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vasanth kumar RJ updated TEZ-1836:
----------------------------------
Attachment: TEZ-1836.2.patch
[~sseth], Implemented review comments.
But spillPer is used in DefaultSorter and PipelinedSorter constructor for
pre-check, so I moved to ExternalSorter.
> Provide better error messages when tez.runtime.io.sort.mb is wrongly
> configured
> -------------------------------------------------------------------------------
>
> Key: TEZ-1836
> URL: https://issues.apache.org/jira/browse/TEZ-1836
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Assignee: Vasanth kumar RJ
> Attachments: TEZ-1836.1.patch, TEZ-1836.2.patch
>
>
> For tez.runtime.io.sort.mb=3000, following error message is thrown
> >>>
> info=[Error: Failure while running task:java.lang.RuntimeException:
> java.io.IOException: Invalid "tez.runtime.io.sort.mb": 3000
> >>>
> This should mention the range of valid configuration for
> "tez.runtime.io.sort.mb" (1 to 2047)
> For tez.runtime.io.sort.mb=0, following error message is thrown
> >>>>
> info=[Error: Failure while running task:java.lang.IllegalArgumentException:
> io.sort.mb should be larger than 0
> at
> com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
> at
> org.apache.tez.runtime.library.common.sort.impl.ExternalSorter.getInitialMemoryRequirement(ExternalSorter.java:289)
> >>>>
> This should mention "tez.runtime.io.sort.mb" and not "io.sort.mb".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)