[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677629#comment-16677629 ] Sergey Shelukhin commented on TEZ-3957: --- Hmm.. all the tests failed to fork wm and don't appear to

[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677567#comment-16677567 ] Sergey Shelukhin commented on TEZ-3957: --- Updated > Report TASK_DURATION_MILLIS as a Counter for

[jira] [Updated] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3957: -- Attachment: TEZ-3957.02.patch > Report TASK_DURATION_MILLIS as a Counter for completed tasks >

[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-10-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667578#comment-16667578 ] Sergey Shelukhin commented on TEZ-3957: --- CPU milliseconds is CPU time, this reports wall clock time.

[jira] [Updated] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-10-26 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3957: -- Attachment: TEZ-3957.01.patch > Report TASK_DURATION_MILLIS as a Counter for completed tasks >

[jira] [Commented] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-10-26 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665699#comment-16665699 ] Sergey Shelukhin commented on TEZ-3957: --- I'm going to fix some but not all checkstyle warnings...

[jira] [Updated] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-10-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3957: -- Attachment: TEZ-3957.patch > Report TASK_DURATION_MILLIS as a Counter for completed tasks >

[jira] [Assigned] (TEZ-3957) Report TASK_DURATION_MILLIS as a Counter for completed tasks

2018-10-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned TEZ-3957: - Assignee: Sergey Shelukhin (was: Eric Wohlstadter) > Report TASK_DURATION_MILLIS as a

[jira] [Commented] (TEZ-3980) ShuffleRunner: the wake loop needs to check for shutdown

2018-08-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589304#comment-16589304 ] Sergey Shelukhin commented on TEZ-3980: --- +1 non-binding > ShuffleRunner: the wake loop needs to

[jira] [Commented] (TEZ-3953) Restore ABI-compat for DAGClient for TEZ-3951

2018-07-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534116#comment-16534116 ] Sergey Shelukhin commented on TEZ-3953: --- [~jlowe] yes, can you push it there? Thanks > Restore

[jira] [Updated] (TEZ-3953) make interface change from TEZ-3951 non-breaking

2018-06-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3953: -- Attachment: TEZ-3953.patch > make interface change from TEZ-3951 non-breaking >

[jira] [Moved] (TEZ-3953) make interface change from TEZ-3951 non-breaking

2018-06-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin moved HIVE-19858 to TEZ-3953: -- Key: TEZ-3953 (was: HIVE-19858) Project: Apache Tez (was:

[jira] [Commented] (TEZ-3904) an API to update tokens for Tez AM and the DAG

2018-06-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506317#comment-16506317 ] Sergey Shelukhin commented on TEZ-3904: --- Yeah that's the idea, although in the case of Tez the actual

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: TEZ-3951.01.patch > TezClient wait too long for the DAGClient for prewarm; tries to

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505223#comment-16505223 ] Sergey Shelukhin commented on TEZ-3951: --- Added a small test case to test the timeout. > TezClient

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505072#comment-16505072 ] Sergey Shelukhin commented on TEZ-3951: --- [~ewohlstadter] [~ashutoshc] ping? > TezClient wait too

[jira] [Commented] (TEZ-2218) Turn on speculation by default

2018-06-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503803#comment-16503803 ] Sergey Shelukhin commented on TEZ-2218: --- Thanks for the info... as far as I know Hive doesn't turn on

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502606#comment-16502606 ] Sergey Shelukhin commented on TEZ-3951: --- Pewarm itself is a pretty obscure feature, and the time to

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502587#comment-16502587 ] Sergey Shelukhin commented on TEZ-3951: --- [~ewohlstadter] can you take a look? > TezClient wait too

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: TEZ-3951.patch > TezClient wait too long for the DAGClient for prewarm; tries to

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: (was: TEZ-3951.patch) > TezClient wait too long for the DAGClient for prewarm;

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Attachment: TEZ-3951.patch > TezClient wait too long for the DAGClient for prewarm; tries to

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3951: -- Summary: TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[jira] [Created] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm

2018-06-05 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3951: - Summary: TezClient wait too long for the DAGClient for prewarm Key: TEZ-3951 URL: https://issues.apache.org/jira/browse/TEZ-3951 Project: Apache Tez Issue

[jira] [Commented] (TEZ-2218) Turn on speculation by default

2018-05-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491428#comment-16491428 ] Sergey Shelukhin commented on TEZ-2218: --- Hmm... > Turn on speculation by default >

[jira] [Commented] (TEZ-2132) Support fault tolerance & speculation in pipelined data transfer for ordered output

2018-05-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491425#comment-16491425 ] Sergey Shelukhin commented on TEZ-2132: --- hmm... > Support fault tolerance & speculation in pipelined

[jira] [Commented] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491395#comment-16491395 ] Sergey Shelukhin commented on TEZ-3943: --- Looks like testshiffle is pretty unstable.

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Attachment: TEZ-3943.02.patch > TezClient leaks DAGClient for prewarm >

[jira] [Commented] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491243#comment-16491243 ] Sergey Shelukhin commented on TEZ-3943: --- Fixed some client test. The other ones pass for me. >

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-25 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Attachment: TEZ-3943.01.patch > TezClient leaks DAGClient for prewarm >

[jira] [Commented] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489808#comment-16489808 ] Sergey Shelukhin commented on TEZ-3943: --- [~ewohlstadter] can you take a look? > TezClient leaks

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Attachment: TEZ-3943.patch > TezClient leaks DAGClient for prewarm >

[jira] [Updated] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-24 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3943: -- Description: This may in turn leak some security related threads. > TezClient leaks DAGClient for

[jira] [Created] (TEZ-3943) TezClient leaks DAGClient for prewarm

2018-05-24 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3943: - Summary: TezClient leaks DAGClient for prewarm Key: TEZ-3943 URL: https://issues.apache.org/jira/browse/TEZ-3943 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3904) an API to update tokens for Tez AM and the DAG

2018-05-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484426#comment-16484426 ] Sergey Shelukhin commented on TEZ-3904: --- Not that I know of. However, MR is deprecated in Hive, so we

[jira] [Commented] (TEZ-3906) general purpose plugin interface

2018-03-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405697#comment-16405697 ] Sergey Shelukhin commented on TEZ-3906: --- cc [~hagleitn] [~ewohlstadter] this will be needed to expand

[jira] [Created] (TEZ-3906) general purpose plugin interface

2018-03-19 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3906: - Summary: general purpose plugin interface Key: TEZ-3906 URL: https://issues.apache.org/jira/browse/TEZ-3906 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

2018-03-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393675#comment-16393675 ] Sergey Shelukhin commented on TEZ-3900: --- Nm, we actually just broke our own shading so tez jar came

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

2018-03-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391955#comment-16391955 ] Sergey Shelukhin commented on TEZ-3900: --- Where can one view the best practices? :) We were deploying

[jira] [Created] (TEZ-3904) an API to update tokens for Tez AM and the DAG

2018-03-08 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3904: - Summary: an API to update tokens for Tez AM and the DAG Key: TEZ-3904 URL: https://issues.apache.org/jira/browse/TEZ-3904 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

2018-03-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390121#comment-16390121 ] Sergey Shelukhin commented on TEZ-3900: --- Hmm... the problem we actually have is that Hive has recently

[jira] [Commented] (TEZ-3900) upgrade to a recent guava version

2018-03-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388901#comment-16388901 ] Sergey Shelukhin commented on TEZ-3900: --- [~ewohlstadter] [~hagleitn] can you take a look? > upgrade

[jira] [Updated] (TEZ-3900) upgrade to a recent guava version

2018-03-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3900: -- Attachment: TEZ-3900.patch > upgrade to a recent guava version >

[jira] [Created] (TEZ-3900) upgrade to a recent guava version

2018-03-06 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3900: - Summary: upgrade to a recent guava version Key: TEZ-3900 URL: https://issues.apache.org/jira/browse/TEZ-3900 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3892) getClient API for TezClient

2018-03-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388447#comment-16388447 ] Sergey Shelukhin commented on TEZ-3892: --- +1, but I'm also not a Tez committer. cc [~hagleitn] can you

[jira] [Commented] (TEZ-3892) getClient API for TezClient

2018-03-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387144#comment-16387144 ] Sergey Shelukhin commented on TEZ-3892: --- Can you post on RB? thnx > getClient API for TezClient >

[jira] [Assigned] (TEZ-3892) getClient API for TezClient

2018-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned TEZ-3892: - Assignee: Eric Wohlstadter > getClient API for TezClient > --- > >

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321209#comment-16321209 ] Sergey Shelukhin commented on TEZ-3880: --- [~hagleitn] can you please commit it? I'm not a Tez committer

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319389#comment-16319389 ] Sergey Shelukhin commented on TEZ-3880: --- [~hagleitn] can you take a look at the updated patch? thanks

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316923#comment-16316923 ] Sergey Shelukhin commented on TEZ-3880: --- [~sseth] perfect timing ;) Fixed the test. The follow up jira

[jira] [Updated] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3880: -- Attachment: TEZ-3880.02.patch Fixed the test... this requires adding a field to progress but it's

[jira] [Updated] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3880: -- Attachment: TEZ-3880.01.patch > do not count rejected tasks as killed in vertex progress >

[jira] [Updated] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3880: -- Attachment: (was: TEZ-3880.01.patch) > do not count rejected tasks as killed in vertex

[jira] [Updated] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3880: -- Attachment: TEZ-3880.01.patch Removed the TODOs, and added a test > do not count rejected tasks

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314066#comment-16314066 ] Sergey Shelukhin commented on TEZ-3880: --- I don't see it used anywhere in the codebase, so I'm assuming

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-04 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312260#comment-16312260 ] Sergey Shelukhin commented on TEZ-3880: --- When AM tries to schedule on LLAP and there's no capacity, it

[jira] [Updated] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-04 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3880: -- Attachment: TEZ-3880.patch [~ewohlstadter] [~sseth] can you take a look? thnx > do not count

[jira] [Created] (TEZ-3881) expose kill reason, as opposed to just a single kill count, in vertex progress

2018-01-04 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3881: - Summary: expose kill reason, as opposed to just a single kill count, in vertex progress Key: TEZ-3881 URL: https://issues.apache.org/jira/browse/TEZ-3881 Project:

[jira] [Updated] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-04 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3880: -- Summary: do not count rejected tasks as killed in vertex progress (was: do not show rejected

[jira] [Moved] (TEZ-3880) do not show rejected tasks as killed in query UI

2018-01-04 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin moved HIVE-18074 to TEZ-3880: -- Key: TEZ-3880 (was: HIVE-18074) Project: Apache Tez (was: Hive)

[jira] [Commented] (TEZ-3879) potential abort propagation issue (race?)

2017-12-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297650#comment-16297650 ] Sergey Shelukhin commented on TEZ-3879: --- The whole log is very large... do you have smth in particular

[jira] [Updated] (TEZ-3879) potential abort propagation issue (race?)

2017-12-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3879: -- Description: I'm looking at a Hive LLAP query where AM aborts some tasks for whatever reason (AM

[jira] [Commented] (TEZ-3879) potential abort propagation issue (race?)

2017-12-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297577#comment-16297577 ] Sergey Shelukhin commented on TEZ-3879: --- [~sseth] [~ewohlstadter] can you take a look? > potential

[jira] [Updated] (TEZ-3879) potential abort propagation issue (race?)

2017-12-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3879: -- Description: I'm looking at a Hive LLAP query where AM aborts some tasks for whatever reason (AM

[jira] [Created] (TEZ-3879) potential abort propagation issue (race?)

2017-12-19 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3879: - Summary: potential abort propagation issue (race?) Key: TEZ-3879 URL: https://issues.apache.org/jira/browse/TEZ-3879 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-3866) add ability to pass information between plugins

2017-11-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3866: -- Description: Distinct from TEZ-3815, since even with a hack that makes plugins aware of each

[jira] [Updated] (TEZ-3866) add ability to pass information between plugins

2017-11-15 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3866: -- Description: Distinct from TEZ-3815, since even with a hack that makes plugins aware of each

[jira] [Commented] (TEZ-3866) add ability to pass information between plugins

2017-11-15 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254677#comment-16254677 ] Sergey Shelukhin commented on TEZ-3866: --- cc [~hagleitn] [~aplusplus] this is needed for Hive workload

[jira] [Created] (TEZ-3866) add ability to pass information between plugins

2017-11-15 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3866: - Summary: add ability to pass information between plugins Key: TEZ-3866 URL: https://issues.apache.org/jira/browse/TEZ-3866 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-3846) Tez AM may not clean up properly on an internal error

2017-09-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186309#comment-16186309 ] Sergey Shelukhin commented on TEZ-3846: --- Tez version was 0.9.0 (the one Hive is using on master).

[jira] [Updated] (TEZ-3846) Tez AM may not clean up properly on an internal error

2017-09-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3846: -- Summary: Tez AM may not clean up properly on an internal error (was: Tez session may not clean

[jira] [Commented] (TEZ-3846) Tez session may not clean up on internal error

2017-09-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185046#comment-16185046 ] Sergey Shelukhin commented on TEZ-3846: --- cc [~aplusplus] [~sseth] > Tez session may not clean up on

[jira] [Updated] (TEZ-3846) Tez AM may not clean up properly on an internal error

2017-09-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3846: -- Description: Normally, in Hive we blindly reopen the session on any submit error; however I

[jira] [Commented] (TEZ-3385) DAGClient API should be accessible outside of DAG submission

2017-08-31 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149692#comment-16149692 ] Sergey Shelukhin commented on TEZ-3385: --- Is this only for DAGClient, or for TezClient only? Hive might

[jira] [Updated] (TEZ-3823) expose AM location and application ID from TezClient

2017-08-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3823: -- Attachment: TEZ-3823.patch [~sseth] can you take a look? Small patch > expose AM location and

[jira] [Updated] (TEZ-3823) expose AM location and application ID from TezClient

2017-08-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3823: -- Summary: expose AM location and application ID from TezClient (was: expose AM location from

[jira] [Created] (TEZ-3815) allow plugins to be aware of each other

2017-08-09 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3815: - Summary: allow plugins to be aware of each other Key: TEZ-3815 URL: https://issues.apache.org/jira/browse/TEZ-3815 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3815) allow plugins to be aware of each other

2017-08-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120487#comment-16120487 ] Sergey Shelukhin commented on TEZ-3815: --- cc [~sseth] > allow plugins to be aware of each other >

[jira] [Commented] (TEZ-3812) race condition in ssl shuffle

2017-08-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113350#comment-16113350 ] Sergey Shelukhin commented on TEZ-3812: --- cc [~sseth] [~visakh_nair] > race condition in ssl shuffle >

[jira] [Updated] (TEZ-3812) race condition in ssl shuffle

2017-08-03 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3812: -- Summary: race condition in ssl shuffle (was: race condition in ssl shuffle?) > race condition

[jira] [Created] (TEZ-3812) race condition in ssl shuffle?

2017-08-03 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3812: - Summary: race condition in ssl shuffle? Key: TEZ-3812 URL: https://issues.apache.org/jira/browse/TEZ-3812 Project: Apache Tez Issue Type: Bug

[jira] [Created] (TEZ-3706) add option to skip Tez UI build

2017-04-28 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3706: - Summary: add option to skip Tez UI build Key: TEZ-3706 URL: https://issues.apache.org/jira/browse/TEZ-3706 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-3637) TezMerger logs too much

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3637: -- Fix Version/s: 0.9.0 > TezMerger logs too much > --- > > Key:

[jira] [Updated] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3637: -- Summary: TezMerger logs too much on INFO level (was: TezMerger logs too much) > TezMerger logs

[jira] [Created] (TEZ-3637) TezMerger logs too much

2017-02-23 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3637: - Summary: TezMerger logs too much Key: TEZ-3637 URL: https://issues.apache.org/jira/browse/TEZ-3637 Project: Apache Tez Issue Type: Bug

[jira] [Resolved] (TEZ-3186) teztask event problem when running repeated queries on LLAP

2016-03-28 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved TEZ-3186. --- Resolution: Cannot Reproduce I'll reopen if I see it after updating Tez to master, next time I

[jira] [Created] (TEZ-3153) build uses tmp, that is problematic on a shared machine

2016-03-01 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3153: - Summary: build uses tmp, that is problematic on a shared machine Key: TEZ-3153 URL: https://issues.apache.org/jira/browse/TEZ-3153 Project: Apache Tez

[jira] [Commented] (TEZ-3151) expose DAG credentials to plugins

2016-02-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172858#comment-15172858 ] Sergey Shelukhin commented on TEZ-3151: --- Yeah, I put the updated context in the description; there was

[jira] [Updated] (TEZ-3151) expose DAG credentials to plugins

2016-02-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3151: -- Attachment: TEZ-3151.01.patch Updated. > expose DAG credentials to plugins >

[jira] [Comment Edited] (TEZ-3151) expose DAG credentials to plugins

2016-02-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172641#comment-15172641 ] Sergey Shelukhin edited comment on TEZ-3151 at 2/29/16 9:56 PM: [~sseth]

[jira] [Updated] (TEZ-3151) expose DAG credentials to plugins

2016-02-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3151: -- Attachment: TEZ-3151.patch [~sseth] does it make sense? > expose DAG credentials to plugins >

[jira] [Updated] (TEZ-3151) expose DAG credentials to plugins

2016-02-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3151: -- Description: Tez plugins need to pass credentials (e.g. HBase tokens, etc.) to tasks. Right now

[jira] [Created] (TEZ-3151) expose DAG credentials to plugins

2016-02-29 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3151: - Summary: expose DAG credentials to plugins Key: TEZ-3151 URL: https://issues.apache.org/jira/browse/TEZ-3151 Project: Apache Tez Issue Type: Bug

[jira] [Created] (TEZ-3077) TezClient.waitTillReady should support timeout

2016-01-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-3077: - Summary: TezClient.waitTillReady should support timeout Key: TEZ-3077 URL: https://issues.apache.org/jira/browse/TEZ-3077 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-3077) TezClient.waitTillReady should support timeout

2016-01-26 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-3077: -- Description: Also preWarm. > TezClient.waitTillReady should support timeout >

[jira] [Commented] (TEZ-2480) TEZ-2003: exception when closing output (ignored)

2015-11-18 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011768#comment-15011768 ] Sergey Shelukhin commented on TEZ-2480: --- +1 > TEZ-2003: exception when closing output (ignored) >

[jira] [Comment Edited] (TEZ-2917) change some logs from info to debug

2015-10-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983531#comment-14983531 ] Sergey Shelukhin edited comment on TEZ-2917 at 10/30/15 10:45 PM: --

[jira] [Commented] (TEZ-2917) change some logs from info to debug

2015-10-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983531#comment-14983531 ] Sergey Shelukhin commented on TEZ-2917: --- MRInputLegacy deferring initialization - how is this useful.

[jira] [Commented] (TEZ-2917) change some logs from info to debug

2015-10-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983419#comment-14983419 ] Sergey Shelukhin commented on TEZ-2917: --- I dunno if it matters how we disable the lines, as long as we

[jira] [Commented] (TEZ-2917) change some logs from info to debug

2015-10-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981456#comment-14981456 ] Sergey Shelukhin commented on TEZ-2917: --- [~sseth] can you take a look? > change some logs from info

  1   2   >