[jira] [Updated] (TEZ-3880) do not count rejected tasks as killed in vertex progress

[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3880: -- Attachment: TEZ-3880.02.patch Fixed the test... this requires adding a field to progress but it's

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316923#comment-16316923 ] Sergey Shelukhin commented on TEZ-3880: --- [~sseth] perfect timing ;) Fixed the test. Th

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319389#comment-16319389 ] Sergey Shelukhin commented on TEZ-3880: --- [~hagleitn] can you take a look at the update

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321209#comment-16321209 ] Sergey Shelukhin commented on TEZ-3880: --- [~hagleitn] can you please commit it? I'm not

[jira] [Assigned] (TEZ-3892) getClient API for TezClient

[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned TEZ-3892: - Assignee: Eric Wohlstadter > getClient API for TezClient > --- > >

[jira] [Commented] (TEZ-3892) getClient API for TezClient

[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387144#comment-16387144 ] Sergey Shelukhin commented on TEZ-3892: --- Can you post on RB? thnx > getClient API for

[jira] [Commented] (TEZ-3892) getClient API for TezClient

[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388447#comment-16388447 ] Sergey Shelukhin commented on TEZ-3892: --- +1, but I'm also not a Tez committer. cc [~ha

[jira] [Created] (TEZ-3900) upgrade to a recent guava version

Sergey Shelukhin created TEZ-3900: - Summary: upgrade to a recent guava version Key: TEZ-3900 URL: https://issues.apache.org/jira/browse/TEZ-3900 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-3900) upgrade to a recent guava version

[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3900: -- Attachment: TEZ-3900.patch > upgrade to a recent guava version > -

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388901#comment-16388901 ] Sergey Shelukhin commented on TEZ-3900: --- [~ewohlstadter] [~hagleitn] can you take a lo

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390121#comment-16390121 ] Sergey Shelukhin commented on TEZ-3900: --- Hmm... the problem we actually have is that H

[jira] [Created] (TEZ-3904) an API to update tokens for Tez AM and the DAG

Sergey Shelukhin created TEZ-3904: - Summary: an API to update tokens for Tez AM and the DAG Key: TEZ-3904 URL: https://issues.apache.org/jira/browse/TEZ-3904 Project: Apache Tez Issue Type: B

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391955#comment-16391955 ] Sergey Shelukhin commented on TEZ-3900: --- Where can one view the best practices? :) We

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393675#comment-16393675 ] Sergey Shelukhin commented on TEZ-3900: --- Nm, we actually just broke our own shading so

[jira] [Created] (TEZ-3906) general purpose plugin interface

Sergey Shelukhin created TEZ-3906: - Summary: general purpose plugin interface Key: TEZ-3906 URL: https://issues.apache.org/jira/browse/TEZ-3906 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3906) general purpose plugin interface

[ https://issues.apache.org/jira/browse/TEZ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405697#comment-16405697 ] Sergey Shelukhin commented on TEZ-3906: --- cc [~hagleitn] [~ewohlstadter] this will be n

[jira] [Commented] (TEZ-3904) an API to update tokens for Tez AM and the DAG

[ https://issues.apache.org/jira/browse/TEZ-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484426#comment-16484426 ] Sergey Shelukhin commented on TEZ-3904: --- Not that I know of. However, MR is deprecated

[jira] [Created] (TEZ-3943) TezClient leaks DAGClient for prewarm

Sergey Shelukhin created TEZ-3943: - Summary: TezClient leaks DAGClient for prewarm Key: TEZ-3943 URL: https://issues.apache.org/jira/browse/TEZ-3943 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Description: This may in turn leak some security related threads. > TezClient leaks DAGClient for

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Attachment: TEZ-3943.patch > TezClient leaks DAGClient for prewarm > -

[jira] [Commented] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489808#comment-16489808 ] Sergey Shelukhin commented on TEZ-3943: --- [~ewohlstadter] can you take a look? > TezC

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Attachment: TEZ-3943.01.patch > TezClient leaks DAGClient for prewarm > --

[jira] [Commented] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491243#comment-16491243 ] Sergey Shelukhin commented on TEZ-3943: --- Fixed some client test. The other ones pass

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Attachment: TEZ-3943.02.patch > TezClient leaks DAGClient for prewarm > --

[jira] [Commented] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491395#comment-16491395 ] Sergey Shelukhin commented on TEZ-3943: --- Looks like testshiffle is pretty unstable. h

[jira] [Commented] (TEZ-2132) Support fault tolerance & speculation in pipelined data transfer for ordered output

[ https://issues.apache.org/jira/browse/TEZ-2132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491425#comment-16491425 ] Sergey Shelukhin commented on TEZ-2132: --- hmm... > Support fault tolerance & speculati

[jira] [Commented] (TEZ-2218) Turn on speculation by default

[ https://issues.apache.org/jira/browse/TEZ-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491428#comment-16491428 ] Sergey Shelukhin commented on TEZ-2218: --- Hmm... > Turn on speculation by default > --

[jira] [Created] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm

Sergey Shelukhin created TEZ-3951: - Summary: TezClient wait too long for the DAGClient for prewarm Key: TEZ-3951 URL: https://issues.apache.org/jira/browse/TEZ-3951 Project: Apache Tez Issue

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: TEZ-3951.patch > TezClient wait too long for the DAGClient for prewarm; tries to shut

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Summary: TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: (was: TEZ-3951.patch) > TezClient wait too long for the DAGClient for prewarm; tr

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: TEZ-3951.patch > TezClient wait too long for the DAGClient for prewarm; tries to shut

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502587#comment-16502587 ] Sergey Shelukhin commented on TEZ-3951: --- [~ewohlstadter] can you take a look? > Te

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502606#comment-16502606 ] Sergey Shelukhin commented on TEZ-3951: --- Pewarm itself is a pretty obscure feature, a

[jira] [Commented] (TEZ-2218) Turn on speculation by default

[ https://issues.apache.org/jira/browse/TEZ-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503803#comment-16503803 ] Sergey Shelukhin commented on TEZ-2218: --- Thanks for the info... as far as I know Hive

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505072#comment-16505072 ] Sergey Shelukhin commented on TEZ-3951: --- [~ewohlstadter] [~ashutoshc] ping? > TezCli

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505223#comment-16505223 ] Sergey Shelukhin commented on TEZ-3951: --- Added a small test case to test the timeout.

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: TEZ-3951.01.patch > TezClient wait too long for the DAGClient for prewarm; tries to s

[jira] [Commented] (TEZ-3904) an API to update tokens for Tez AM and the DAG

[ https://issues.apache.org/jira/browse/TEZ-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506317#comment-16506317 ] Sergey Shelukhin commented on TEZ-3904: --- Yeah that's the idea, although in the case o

[jira] [Moved] (TEZ-3953) make interface change from TEZ-3951 non-breaking

[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin moved HIVE-19858 to TEZ-3953: -- Key: TEZ-3953 (was: HIVE-19858) Project: Apache Tez (was: Hive)

[jira] [Updated] (TEZ-3953) make interface change from TEZ-3951 non-breaking

[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3953: -- Attachment: TEZ-3953.patch > make interface change from TEZ-3951 non-breaking > -

[jira] [Commented] (TEZ-3953) Restore ABI-compat for DAGClient for TEZ-3951

[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16534116#comment-16534116 ] Sergey Shelukhin commented on TEZ-3953: --- [~jlowe] yes, can you push it there? Thanks

[jira] [Commented] (TEZ-3980) ShuffleRunner: the wake loop needs to check for shutdown

[ https://issues.apache.org/jira/browse/TEZ-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589304#comment-16589304 ] Sergey Shelukhin commented on TEZ-3980: --- +1 non-binding > ShuffleRunner: the wake lo

[jira] [Updated] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3957: -- Attachment: TEZ-3957.patch > Report TASK_DURATION_MILLIS as a Counter for completed tasks > -

[jira] [Assigned] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned TEZ-3957: - Assignee: Sergey Shelukhin (was: Eric Wohlstadter) > Report TASK_DURATION_MILLIS as a Cou

[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16665699#comment-16665699 ] Sergey Shelukhin commented on TEZ-3957: --- I'm going to fix some but not all checkstyle

[jira] [Updated] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3957: -- Attachment: TEZ-3957.01.patch > Report TASK_DURATION_MILLIS as a Counter for completed tasks > --

[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667578#comment-16667578 ] Sergey Shelukhin commented on TEZ-3957: --- CPU milliseconds is CPU time, this reports w

[jira] [Updated] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3957: -- Attachment: TEZ-3957.02.patch > Report TASK_DURATION_MILLIS as a Counter for completed tasks > --

[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677567#comment-16677567 ] Sergey Shelukhin commented on TEZ-3957: --- Updated > Report TASK_DURATION_MILLIS as a

[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677629#comment-16677629 ] Sergey Shelukhin commented on TEZ-3957: --- Hmm.. all the tests failed to fork wm and do

<    1   2