[jira] [Updated] (TEZ-4506) Report the node of a task attempt failure better

2023-09-01 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4506: -- Fix Version/s: 0.10.3 > Report the node of a task attempt failure bet

[jira] [Commented] (TEZ-4506) Report the node of a task attempt failure better

2023-09-01 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761244#comment-17761244 ] László Bodor commented on TEZ-4506: --- discussed offline, a failing node ip/hostname itself

[jira] [Assigned] (TEZ-4506) Report the node of a task attempt failure better

2023-08-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned TEZ-4506: - Assignee: Ayush Saxena > Report the node of a task attempt failure bet

[jira] [Created] (TEZ-4512) One-to-One edge Parallelism

2023-08-28 Thread katty he (Jira)
katty he created TEZ-4512: - Summary: One-to-One edge Parallelism Key: TEZ-4512 URL: https://issues.apache.org/jira/browse/TEZ-4512 Project: Apache Tez Issue Type: Improvement Affects Versions

[jira] [Commented] (TEZ-4506) Report the node of a task attempt failure better

2023-08-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758749#comment-17758749 ] Ayush Saxena commented on TEZ-4506: --- Will this not be a problem, we leaked server NM IP details

[jira] [Resolved] (TEZ-2119) Counter for launched containers

2023-08-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor resolved TEZ-2119. --- Resolution: Fixed > Counter for launched contain

[jira] [Updated] (TEZ-2119) Counter for launched containers

2023-08-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-2119: -- Fix Version/s: 0.10.3 > Counter for launched contain

[jira] [Commented] (TEZ-2119) Counter for launched containers

2023-08-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758726#comment-17758726 ] László Bodor commented on TEZ-2119: --- merged to master, thanks a lot for reviewing [~jeagles

[jira] [Commented] (TEZ-2119) Counter for launched containers

2023-08-24 Thread Jonathan Turner Eagles (Jira)
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758649#comment-17758649 ] Jonathan Turner Eagles commented on TEZ-2119: - I think this looks good. Adding review to github

[jira] [Commented] (TEZ-2119) Counter for launched containers

2023-08-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758514#comment-17758514 ] László Bodor commented on TEZ-2119: --- please review > Counter for launched contain

[jira] [Resolved] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container

2023-08-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor resolved TEZ-1037. --- Fix Version/s: 0.10.3 Resolution: Fixed > Replace multiple members in TaskAttemptI

[jira] [Commented] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container

2023-08-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758398#comment-17758398 ] László Bodor commented on TEZ-1037: --- merged to master, thanks [~ayushtkn] for the patch! > Repl

[jira] [Updated] (TEZ-4510) Performance counters

2023-08-23 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4510: -- Description: We need to improve on counters that can help to decide what went wrong in case

[jira] [Updated] (TEZ-4511) Counter for input read errors

2023-08-23 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4511: -- Description: We need to see how many times AM was notified about input read errors, otherwise

[jira] [Created] (TEZ-4511) Counter for input read errors

2023-08-23 Thread Jira
László Bodor created TEZ-4511: - Summary: Counter for input read errors Key: TEZ-4511 URL: https://issues.apache.org/jira/browse/TEZ-4511 Project: Apache Tez Issue Type: Sub-task

[jira] [Updated] (TEZ-4466) Measure exact stream read time while fetching

2023-08-23 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4466: -- Parent: TEZ-4510 Issue Type: Sub-task (was: Improvement) > Measure exact stream read time wh

[jira] [Updated] (TEZ-4505) Create counters about time intervals spent in certain states in StateMachineTez

2023-08-23 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4505: -- Parent: TEZ-4510 Issue Type: Sub-task (was: Improvement) > Create counters about time interv

[jira] [Created] (TEZ-4510) Performance counters

2023-08-23 Thread Jira
László Bodor created TEZ-4510: - Summary: Performance counters Key: TEZ-4510 URL: https://issues.apache.org/jira/browse/TEZ-4510 Project: Apache Tez Issue Type: Improvement Reporter

[jira] [Updated] (TEZ-2119) Counter for launched containers

2023-08-23 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-2119: -- Parent: TEZ-4510 Issue Type: Sub-task (was: Improvement) > Counter for launched contain

[jira] [Commented] (TEZ-4509) Error starting DAGAppMaster,Tez 0.10.2 with Hadoop 3.3.0

2023-08-15 Thread xiongyinke (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754836#comment-17754836 ] xiongyinke commented on TEZ-4509: - I think the following error message is crucial

[jira] [Created] (TEZ-4509) Error starting DAGAppMaster,Tez 0.10.2 with Hadoop 3.3.0

2023-08-15 Thread xiongyinke (Jira)
xiongyinke created TEZ-4509: --- Summary: Error starting DAGAppMaster,Tez 0.10.2 with Hadoop 3.3.0 Key: TEZ-4509 URL: https://issues.apache.org/jira/browse/TEZ-4509 Project: Apache Tez Issue Type

[jira] [Commented] (TEZ-1092) Read failure diagnostics should be available to the user

2023-08-08 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751972#comment-17751972 ] László Bodor commented on TEZ-1092: --- I think this is already resolved in TEZ-4336 for ShuffleScheduler

[jira] [Commented] (TEZ-4508) Allow the FAIR_PARALLELISM mode to accept multiple source vertices

2023-08-07 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751675#comment-17751675 ] László Bodor commented on TEZ-4508: --- assigned this ticket to you [~okumin], thanks for the contribution

[jira] [Assigned] (TEZ-4508) Allow the FAIR_PARALLELISM mode to accept multiple source vertices

2023-08-07 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor reassigned TEZ-4508: - Assignee: okumin > Allow the FAIR_PARALLELISM mode to accept multiple source verti

[jira] [Created] (TEZ-4508) Allow the FAIR_PARALLELISM mode to accept multiple source vertices

2023-08-07 Thread okumin (Jira)
okumin created TEZ-4508: --- Summary: Allow the FAIR_PARALLELISM mode to accept multiple source vertices Key: TEZ-4508 URL: https://issues.apache.org/jira/browse/TEZ-4508 Project: Apache Tez Issue Type

[jira] [Comment Edited] (TEZ-4507) Task failure due to memory issues in 0.10+

2023-08-02 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750146#comment-17750146 ] László Bodor edited comment on TEZ-4507 at 8/2/23 6:56 AM: --- thanks for reporting

[jira] [Commented] (TEZ-4507) Task failure due to memory issues in 0.10+

2023-08-02 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750146#comment-17750146 ] László Bodor commented on TEZ-4507: --- thanks for reporting this [~ankur_raj_134] this malloc/free message

[jira] [Updated] (TEZ-4507) Task failure due to memory issues in 0.10+

2023-08-01 Thread Ankur Raj (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Raj updated TEZ-4507: --- Description: This issue is seen on clusters which have tez-0.10.2 branch. on running insert overwrite queries

[jira] [Updated] (TEZ-4507) Task failure due to memory issues in 0.10+

2023-07-31 Thread Ankur Raj (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Raj updated TEZ-4507: --- Description: This issue is seen on AWS EMR-6.9.0 and above clusters which have tez-0.10.2 branch. on running

[jira] [Created] (TEZ-4507) Task failure due to memory issues in 0.10+

2023-07-31 Thread Ankur Raj (Jira)
Ankur Raj created TEZ-4507: -- Summary: Task failure due to memory issues in 0.10+ Key: TEZ-4507 URL: https://issues.apache.org/jira/browse/TEZ-4507 Project: Apache Tez Issue Type: Bug Affects

[jira] [Commented] (TEZ-4505) Create counters about time intervals spent in certain states in StateMachineTez

2023-07-29 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748801#comment-17748801 ] László Bodor commented on TEZ-4505: --- with initial implementation I got something like this, testing

[jira] [Updated] (TEZ-4506) Report the node of a task attempt failure better

2023-07-28 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4506: -- Description: There was an OOM in a hive application, and in the console, I can see things like

[jira] [Updated] (TEZ-4506) Report the node of a task attempt failure better

2023-07-28 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4506: -- Description: There was an OOM in a hive application, and in the console, I can see things like

[jira] [Updated] (TEZ-4506) Report the node of a task attempt failure better

2023-07-28 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4506: -- Description: There was an OOM in a hive application, and in the console, I can see things like

[jira] [Updated] (TEZ-4506) Report the node of a task attempt failure better

2023-07-28 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4506: -- Description: There was an OOM in a hive application, and in the console, I can see things like

[jira] [Created] (TEZ-4506) Report the node of a task attempt failure better

2023-07-28 Thread Jira
László Bodor created TEZ-4506: - Summary: Report the node of a task attempt failure better Key: TEZ-4506 URL: https://issues.apache.org/jira/browse/TEZ-4506 Project: Apache Tez Issue Type

[jira] [Assigned] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container

2023-07-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned TEZ-1037: - Assignee: Ayush Saxena > Replace multiple members in TaskAttemptImpl for container related st

[jira] [Commented] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container

2023-07-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748250#comment-17748250 ] Ayush Saxena commented on TEZ-1037: --- Taking over have put up a PR with the said changes!!! > Repl

[jira] [Updated] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container

2023-07-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated TEZ-1037: -- Summary: Replace multiple members in TaskAttemptImpl for container related stuff with a single reference

[jira] [Updated] (TEZ-4505) Create counters about time intervals spent in certain states in StateMachineTez

2023-07-27 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4505: -- Summary: Create counters about time intervals spent in certain states in StateMachineTez (was: Create

[jira] [Updated] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container, possible the AMContainer

2023-07-27 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-1037: -- Description: https://github.com/apache/tez/blob/5beab4ced9d07bc813a8d79ded111b72af5a2f02/tez-dag/src

[jira] [Commented] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container, possible the AMContainer

2023-07-27 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747862#comment-17747862 ] László Bodor commented on TEZ-1037: --- unassign this to get it back to the open ticket pool cc: [~ayushtkn

[jira] [Assigned] (TEZ-1037) Replace multiple members in TaskAttemptImpl for container related stuff with a single reference to the container, possible the AMContainer

2023-07-27 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor reassigned TEZ-1037: - Assignee: (was: Rekha Joshi) > Replace multiple members in TaskAttemptImpl for contai

[jira] [Assigned] (TEZ-4505) Create counter(s) that can reflect how much time a task attempt was waiting on getting a container

2023-07-27 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor reassigned TEZ-4505: - Assignee: László Bodor > Create counter(s) that can reflect how much time a task atte

[jira] [Commented] (TEZ-4345) Collect jstack on-demand with a request to AM

2023-07-26 Thread okumin (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747497#comment-17747497 ] okumin commented on TEZ-4345: - [~abstractdog] Sorry for my multi posts. As the following comment, we also add

[jira] [Resolved] (TEZ-4504) Upgrade Guava to 32.0.1 due to CVE-2023-2976

2023-07-26 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor resolved TEZ-4504. --- Resolution: Fixed > Upgrade Guava to 32.0.1 due to CVE-2023-2

[jira] [Commented] (TEZ-4504) Upgrade Guava to 32.0.1 due to CVE-2023-2976

2023-07-26 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747375#comment-17747375 ] László Bodor commented on TEZ-4504: --- merged to master, thanks [~ayushtkn] for the patch! > Upgrade Gu

[jira] [Updated] (TEZ-4504) Upgrade Guava to 32.0.1 due to CVE-2023-2976

2023-07-26 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4504: -- Fix Version/s: 0.10.3 > Upgrade Guava to 32.0.1 due to CVE-2023-2

[jira] [Updated] (TEZ-4505) Create counter(s) that can reflect how much time a task attempt was waiting on getting a container

2023-07-25 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4505: -- Description: I haven't thought about this in detail, but I'm wondering if can create a counter that can

[jira] [Updated] (TEZ-4505) Create counter(s) that can reflect how much time a task attempt was waiting on getting a container

2023-07-25 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4505: -- Description: I haven't thought about this in detail, but I'm wondering if can create a counter that can

[jira] [Created] (TEZ-4505) Create counter(s) that can reflect how much time a task attempt was waiting on getting a container

2023-07-25 Thread Jira
László Bodor created TEZ-4505: - Summary: Create counter(s) that can reflect how much time a task attempt was waiting on getting a container Key: TEZ-4505 URL: https://issues.apache.org/jira/browse/TEZ-4505

[jira] [Assigned] (TEZ-4504) Upgrade Guava to 32.0.1 due to CVE-2023-2976

2023-07-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned TEZ-4504: - Assignee: Ayush Saxena > Upgrade Guava to 32.0.1 due to CVE-2023-2

[jira] [Created] (TEZ-4504) Upgrade Guava to 32.0.1 due to CVE-2023-2976

2023-07-25 Thread Jira
László Bodor created TEZ-4504: - Summary: Upgrade Guava to 32.0.1 due to CVE-2023-2976 Key: TEZ-4504 URL: https://issues.apache.org/jira/browse/TEZ-4504 Project: Apache Tez Issue Type

[jira] [Commented] (TEZ-2119) Counter for launched containers

2023-07-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746322#comment-17746322 ] László Bodor commented on TEZ-2119: --- did you have the chance [~rohini]? cc: [~jeagles] this patch takes

[jira] [Assigned] (TEZ-4503) Warn about large conf properties in payload

2023-07-20 Thread Stamatis Zampetakis (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stamatis Zampetakis reassigned TEZ-4503: Assignee: Stamatis Zampetakis > Warn about large conf properties in payl

[jira] [Updated] (TEZ-4503) Warn about large conf properties in payload

2023-07-20 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4503: -- Description: context in comments at HIVE-27511 motivation is to warn in logs about huge properties

[jira] [Commented] (TEZ-4503) Warn about large conf properties in payload

2023-07-20 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17745076#comment-17745076 ] László Bodor commented on TEZ-4503: --- [~zabetak], [~ayushtkn]: any of you interested in contributing

[jira] [Created] (TEZ-4503) Warn about large conf properties in payload

2023-07-20 Thread Jira
László Bodor created TEZ-4503: - Summary: Warn about large conf properties in payload Key: TEZ-4503 URL: https://issues.apache.org/jira/browse/TEZ-4503 Project: Apache Tez Issue Type: Improvement

[jira] [Comment Edited] (TEZ-4344) Collect jstack periodically from all containers

2023-07-18 Thread okumin (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744187#comment-17744187 ] okumin edited comment on TEZ-4344 at 7/18/23 11:47 AM: --- [~ayushtkn] [~abstractdog] Hi

[jira] [Commented] (TEZ-4344) Collect jstack periodically from all containers

2023-07-18 Thread okumin (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744187#comment-17744187 ] okumin commented on TEZ-4344: - [~ayushtkn][~abstractdog] Hi, can we have a chance to make it more pluggable

[jira] [Assigned] (TEZ-4502) Migrate to ProtobufRpcEngine2

2023-07-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned TEZ-4502: - Assignee: Ayush Saxena > Migrate to ProtobufRpcEngi

[jira] [Updated] (TEZ-4344) Collect jstack periodically from all containers

2023-07-18 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4344: -- Fix Version/s: 0.10.3 > Collect jstack periodically from all contain

[jira] [Commented] (TEZ-4344) Collect jstack periodically from all containers

2023-07-18 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744072#comment-17744072 ] László Bodor commented on TEZ-4344: --- merged to master, thanks [~ayushtkn] for implementing this feature

[jira] [Resolved] (TEZ-4344) Collect jstack periodically from all containers

2023-07-18 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor resolved TEZ-4344. --- Resolution: Fixed > Collect jstack periodically from all contain

[jira] [Created] (TEZ-4502) Migrate to ProtobufRpcEngine2

2023-07-17 Thread Ashok Kumar (Jira)
Ashok Kumar created TEZ-4502: Summary: Migrate to ProtobufRpcEngine2 Key: TEZ-4502 URL: https://issues.apache.org/jira/browse/TEZ-4502 Project: Apache Tez Issue Type: Task Reporter

[jira] [Commented] (TEZ-4451) ThreadLevel IO Stats Support for TEZ

2023-07-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743248#comment-17743248 ] Steve Loughran commented on TEZ-4451: - you can log filesystem stats in filesystem close for abfs

[jira] [Commented] (TEZ-4451) ThreadLevel IO Stats Support for TEZ

2023-07-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743033#comment-17743033 ] Ayush Saxena commented on TEZ-4451: --- We are on 3.3.6 now in Tez, I think this should be doable now

[jira] (TEZ-2119) Counter for launched containers

2023-07-07 Thread Rohini Palaniswamy (Jira)
[ https://issues.apache.org/jira/browse/TEZ-2119 ] Rohini Palaniswamy deleted comment on TEZ-2119: - was (Author: rohini): Will take a look next week. [~jeagles], can you also take a look ? > Counter for launched contain

[jira] [Commented] (TEZ-2119) Counter for launched containers

2023-07-07 Thread Rohini Palaniswamy (Jira)
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741085#comment-17741085 ] Rohini Palaniswamy commented on TEZ-2119: - Will take a look next week. [~jeagles], can you also

[jira] [Commented] (TEZ-2119) Counter for launched containers

2023-07-07 Thread Rohini Palaniswamy (Jira)
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741084#comment-17741084 ] Rohini Palaniswamy commented on TEZ-2119: - Will take a look next week. [~jeagles], can you also

[jira] [Assigned] (TEZ-4344) Collect jstack periodically from all containers

2023-07-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned TEZ-4344: - Assignee: Ayush Saxena > Collect jstack periodically from all contain

[jira] [Commented] (TEZ-2119) Counter for launched containers

2023-07-06 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740457#comment-17740457 ] László Bodor commented on TEZ-2119: --- github PR is ready for review, please take a look [~rohini

[jira] [Updated] (TEZ-4501) Fix TestLocalMode timeouts - handle drained in case of InterruptedException

2023-07-04 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4501: -- Summary: Fix TestLocalMode timeouts - handle drained in case of InterruptedException (was: Fix

[jira] [Updated] (TEZ-4501) Fix TestLocalMode timeouts

2023-07-04 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4501: -- Description: The relevant part from AsyncDispatcher is: {code} synchronized (waitForDrained

[jira] [Updated] (TEZ-4501) Fix TestLocalMode timeouts

2023-07-04 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4501: -- Description: The relevant part from AsyncDispatcher is: {code} synchronized (waitForDrained

[jira] [Updated] (TEZ-4501) Fix TestLocalMode timeouts

2023-07-04 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4501: -- Description: The relevant part from AsyncDispatcher is: {code} synchronized (waitForDrained

[jira] [Updated] (TEZ-4501) Fix TestLocalMode timeouts

2023-07-04 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4501: -- Description: The relevant part from AsyncDispatcher is: {code} synchronized (waitForDrained

[jira] [Updated] (TEZ-4501) Fix TestLocalMode timeouts

2023-07-04 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4501: -- Description: The relevant part from AsyncDispatcher is: {code} synchronized (waitForDrained

[jira] [Assigned] (TEZ-4501) Fix TestLocalMode timeouts

2023-07-04 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor reassigned TEZ-4501: - Assignee: László Bodor > Fix TestLocalMode timeo

[jira] [Created] (TEZ-4501) Fix TestLocalMode timeouts

2023-07-04 Thread Jira
László Bodor created TEZ-4501: - Summary: Fix TestLocalMode timeouts Key: TEZ-4501 URL: https://issues.apache.org/jira/browse/TEZ-4501 Project: Apache Tez Issue Type: Bug Reporter

[jira] [Resolved] (TEZ-4478) Refactor dependency versions into properties in pom

2023-07-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved TEZ-4478. --- Resolution: Fixed > Refactor dependency versions into properties in

[jira] [Commented] (TEZ-4344) Collect jstack periodically from all containers

2023-07-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739464#comment-17739464 ] Ayush Saxena commented on TEZ-4344: --- Have created a PR with ThreadDump logic for TezChild. Have added

[jira] [Resolved] (TEZ-4465) Implement getPreviousState in StateMachineTez after YARN-11395

2023-07-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved TEZ-4465. --- Resolution: Done > Implement getPreviousState in StateMachineTez after YARN-11

[jira] [Commented] (TEZ-4465) Implement getPreviousState in StateMachineTez after YARN-11395

2023-07-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739363#comment-17739363 ] Ayush Saxena commented on TEZ-4465: --- Done as part of TEZ-4493, Resolving!!! > Implement getPreviousSt

[jira] [Resolved] (TEZ-4493) Upgrade to hadoop 3.3.6

2023-06-29 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor resolved TEZ-4493. --- Resolution: Fixed > Upgrade to hadoop 3.3.6 > --- > >

[jira] [Commented] (TEZ-4493) Upgrade to hadoop 3.3.6

2023-06-29 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738759#comment-17738759 ] László Bodor commented on TEZ-4493: --- merged to master, thanks [~ayushtkn] for the patch! > Upgr

[jira] [Updated] (TEZ-4493) Upgrade to hadoop 3.3.6

2023-06-29 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4493: -- Fix Version/s: 0.10.3 > Upgrade to hadoop 3.3.6 > --- > >

[jira] [Commented] (TEZ-4061) InputAttemptIdentifier and CompositeInputAttemptIdentifier cannot be compared for equality

2023-06-27 Thread Sungwoo Park (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737530#comment-17737530 ] Sungwoo Park commented on TEZ-4061: --- Let me create a pull request later. > InputAttemptIdentif

[jira] [Updated] (TEZ-4124) GuavaShim: introduce an interoperability layer for different guava versions

2023-06-26 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated TEZ-4124: - Fix Version/s: (was: 0.9.3) > GuavaShim: introduce an interoperability layer for different gu

[jira] [Updated] (TEZ-4344) Collect jstack periodically from all containers

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4344: -- Description: 1. set a property of interval of seconds (default: 0 ==> off) 2. attach jstack files to

[jira] [Updated] (TEZ-4344) Collect jstack periodically from all containers

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4344: -- Description: 1. set a property of interval of seconds (default: 0 ==> off) 2. attach jstack files to

[jira] [Updated] (TEZ-4344) Collect jstack periodically from all containers

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4344: -- Description: 1. set a property of interval of seconds (default: 0 ==> off) 2. attach jstack files to

[jira] [Updated] (TEZ-4498) Refactor/merge ordered and unordered shuffle

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4498: -- Description: This problem is present for a long time ago, we maintain 2 completely different groups

[jira] [Updated] (TEZ-4500) Create base classes for Shuffle* and Fetcher* classes

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4500: -- Description: In the long term, in order to get ShuffleManager+ShuffleScheduler and Fetcher

[jira] [Updated] (TEZ-4500) Create base classes for Shuffle* and Fetcher* classes

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4500: -- Description: In the long term, in order to get ShuffleManager+ShuffleScheduler and Fetcher

[jira] [Created] (TEZ-4500) Create base classes for Shuffle* and Fetcher* classes

2023-06-24 Thread Jira
László Bodor created TEZ-4500: - Summary: Create base classes for Shuffle* and Fetcher* classes Key: TEZ-4500 URL: https://issues.apache.org/jira/browse/TEZ-4500 Project: Apache Tez Issue Type

[jira] [Updated] (TEZ-4498) Refactor/merge ordered and unordered shuffle

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4498: -- Description: This problem is present for a long time ago, we maintain 2 completely different groups

[jira] [Updated] (TEZ-4499) Move shuffle counters to a common class

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4499: -- Description: Both ShuffleManager and ShuffleScheduler has fields like: {code

[jira] [Updated] (TEZ-4499) Move shuffle counters to a common class

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4499: -- Summary: Move shuffle counters to a common class (was: Refactor shuffle counters to a common class

[jira] [Updated] (TEZ-4499) Refactor shuffle counters to a common class

2023-06-24 Thread Jira
[ https://issues.apache.org/jira/browse/TEZ-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated TEZ-4499: -- Description: Both ShuffleManager and ShuffleScheduler has fields like: {code

<    1   2   3   4   5   6   7   8   9   10   >