Re: [PR] TEZ-4547: Add Tez AM JobID to the JobConf [tez]

2024-05-14 Thread via GitHub
abstractdog commented on code in PR #339: URL: https://github.com/apache/tez/pull/339#discussion_r1599582588 ## tez-dag/src/main/java/org/apache/tez/dag/app/dag/impl/OutputCommitterContextImpl.java: ## @@ -34,14 +34,16 @@ public class OutputCommitterContextImpl implements

Re: [PR] TEZ-4547: Add Tez AM JobID to the JobConf [tez]

2024-05-14 Thread via GitHub
abstractdog commented on code in PR #339: URL: https://github.com/apache/tez/pull/339#discussion_r1599573887 ## tez-mapreduce/src/main/java/org/apache/tez/mapreduce/hadoop/MRJobConfig.java: ## @@ -131,6 +131,11 @@ public interface MRJobConfig { public static final String

[jira] [Updated] (TEZ-4547) Add Tez AM JobID to the JobConf

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4547: -- Fix Version/s: 0.10.4 > Add Tez AM JobID to the JobConf > --- > >

[jira] [Assigned] (TEZ-4547) Add Tez AM JobID to the JobConf

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor reassigned TEZ-4547: - Assignee: Venkatasubrahmanian Narayanan > Add Tez AM JobID to the JobConf >

[jira] [Commented] (TEZ-4019) Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of LocalDirAllocator

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846209#comment-17846209 ] László Bodor commented on TEZ-4019: --- merged to master, thanks [~jeagles] for the patch! > Modify Tez

[jira] [Assigned] (TEZ-4019) Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of LocalDirAllocator

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor reassigned TEZ-4019: - Assignee: Jonathan Turner Eagles (was: Kuhu Shukla) > Modify Tez shuffle handler to use

[jira] [Updated] (TEZ-4019) Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of LocalDirAllocator

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4019: -- Fix Version/s: 0.10.4 > Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of >

[jira] [Resolved] (TEZ-4019) Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of LocalDirAllocator

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor resolved TEZ-4019. --- Resolution: Fixed > Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of >

Re: [PR] [TEZ-4019] Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of LocalDirAllocator [tez]

2024-05-14 Thread via GitHub
abstractdog merged PR #355: URL: https://github.com/apache/tez/pull/355 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (TEZ-4542) Tez application may fail due to int overflow when record size is large and sort memory is low.

2024-05-14 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846208#comment-17846208 ] Chenyu Zheng commented on TEZ-4542: --- Thanks [~abstractdog] and [~rbalamohan] for the review!

[jira] [Updated] (TEZ-4542) Tez application may fail due to int overflow when record size is large and sort memory is low.

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4542: -- Fix Version/s: 0.10.4 > Tez application may fail due to int overflow when record size is large and >

[jira] [Resolved] (TEZ-4542) Tez application may fail due to int overflow when record size is large and sort memory is low.

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor resolved TEZ-4542. --- Resolution: Fixed > Tez application may fail due to int overflow when record size is large and > sort

[jira] [Commented] (TEZ-4542) Tez application may fail due to int overflow when record size is large and sort memory is low.

2024-05-14 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846206#comment-17846206 ] László Bodor commented on TEZ-4542: --- merged to master, thanks [~zhengchenyu] for the patch and

Re: [PR] TEZ-4542: Tez application may fail due to int overflow when record size is large and sort memory is low. [tez]

2024-05-14 Thread via GitHub
abstractdog merged PR #336: URL: https://github.com/apache/tez/pull/336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] TEZ-4542: Tez application may fail due to int overflow when record size is large and sort memory is low. [tez]

2024-05-14 Thread via GitHub
rbalamohan commented on PR #336: URL: https://github.com/apache/tez/pull/336#issuecomment-2109427570 LGTM. +1. BTW, pipelinesorter is the brainchild of @t3rmin4t0r . :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub