[jira] [Commented] (TEZ-1547) Make use of state change notifier in VertexManagerPlugins

2014-11-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194491#comment-14194491 ] Siddharth Seth commented on TEZ-1547: - OK. That makes sense. The intent is to send out

[jira] [Commented] (TEZ-1731) OnDiskMerger can end up clobbering files across tasks with LocalDiskFetch

2014-11-03 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194554#comment-14194554 ] Prakash Ramachandran commented on TEZ-1731: --- {code:title=MergeManager.java:693} if

[jira] [Commented] (TEZ-1731) OnDiskMerger can end up clobbering files across tasks with LocalDiskFetch

2014-11-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194564#comment-14194564 ] Rajesh Balamohan commented on TEZ-1731: --- lgtm. Minor comment {code}

[jira] [Commented] (TEZ-1547) Make use of state change notifier in VertexManagerPlugins

2014-11-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194766#comment-14194766 ] Bikas Saha commented on TEZ-1547: - Sorry for any confusion in the code or comments. The dual

[jira] [Updated] (TEZ-1547) Make use of state change notifier in VertexManagerPlugins

2014-11-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1547: Attachment: TEZ-1547.10.patch Uploading patch with rename and javadoc changed to be more clear. Make use of

[jira] [Commented] (TEZ-1547) Make use of state change notifier in VertexManagerPlugins

2014-11-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194989#comment-14194989 ] Siddharth Seth commented on TEZ-1547: - bq. If anything nudged you towards that then let

[jira] [Updated] (TEZ-1547) Make use of state change notifier in VertexManagerPlugins and fix TEZ-1494 without latency penalty

2014-11-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1547: Summary: Make use of state change notifier in VertexManagerPlugins and fix TEZ-1494 without latency penalty

[jira] [Updated] (TEZ-1731) OnDiskMerger can end up clobbering files across tasks with LocalDiskFetch

2014-11-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1731: Attachment: TEZ-1731.2.txt Thanks Prakash and Rajesh for taking a look at the patch. bq. Should'nt

[jira] [Commented] (TEZ-1547) Make use of state change notifier in VertexManagerPlugins and fix TEZ-1494 without latency penalty

2014-11-03 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195118#comment-14195118 ] Bikas Saha commented on TEZ-1547: - To be clear, this jira is not intended to resolve out of

[jira] [Created] (TEZ-1732) Temporary mitigation for out of order scheduling

2014-11-03 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1732: --- Summary: Temporary mitigation for out of order scheduling Key: TEZ-1732 URL: https://issues.apache.org/jira/browse/TEZ-1732 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1707) Prettification ~ Standardise ui code base

2014-11-03 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-1707: Labels: TEZ-UI-TODO (was: ) Prettification ~ Standardise ui code base

[jira] [Created] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
Gopal V created TEZ-1733: Summary: TezMerger should sort FileChunks on decompressed size Key: TEZ-1733 URL: https://issues.apache.org/jira/browse/TEZ-1733 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1547) Make use of state change notifier in VertexManagerPlugins and fix TEZ-1494 without latency penalty

2014-11-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195203#comment-14195203 ] Siddharth Seth commented on TEZ-1547: - bq. To be clear, this jira is not intended to

[jira] [Updated] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1733: - Attachment: TEZ-1733.1.patch TezMerger should sort FileChunks on decompressed size

[jira] [Updated] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1733: - Priority: Critical (was: Major) TezMerger should sort FileChunks on decompressed size

[jira] [Updated] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1733: - Target Version/s: 0.5.2 (was: 0.6.0) TezMerger should sort FileChunks on decompressed size

[jira] [Commented] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195330#comment-14195330 ] Gopal V commented on TEZ-1733: -- [~rajesh.balamohan]: Can you take a look at this change-set?

[jira] [Created] (TEZ-1734) Vertex's taskNum may be -1 when recovered from NEW to FAILED/KILLED

2014-11-03 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1734: --- Summary: Vertex's taskNum may be -1 when recovered from NEW to FAILED/KILLED Key: TEZ-1734 URL: https://issues.apache.org/jira/browse/TEZ-1734 Project: Apache Tez

[jira] [Commented] (TEZ-14) Support for speculation of slow tasks

2014-11-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195367#comment-14195367 ] Jason Lowe commented on TEZ-14: --- Apologies for the late reply. I haven't had time to look at

[jira] [Updated] (TEZ-1735) Allow setting basic info per DAG for Tez UI

2014-11-03 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1735: - Attachment: TEZ-1735.1.patch [~bikassaha] [~sseth] review please. Allow setting basic info per DAG for

[jira] [Created] (TEZ-1736) Add support for Inputs/Outputs in runtime-library to generate history text data

2014-11-03 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1736: Summary: Add support for Inputs/Outputs in runtime-library to generate history text data Key: TEZ-1736 URL: https://issues.apache.org/jira/browse/TEZ-1736 Project: Apache

[jira] [Updated] (TEZ-1728) Remove local host name from Fetcher thread name

2014-11-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1728: Attachment: TEZ-1728.1.txt Simple patch. [~rajesh.balamohan] - review please. Remove local host

[jira] [Commented] (TEZ-1735) Allow setting basic info per DAG for Tez UI

2014-11-03 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195673#comment-14195673 ] Hitesh Shah commented on TEZ-1735: -- Pretty much only for visualization. The assumption is

[jira] [Commented] (TEZ-1735) Allow setting basic info per DAG for Tez UI

2014-11-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195676#comment-14195676 ] Siddharth Seth commented on TEZ-1735: - Got it. +1. Allow setting basic info per DAG

[jira] [Commented] (TEZ-1728) Remove local host name from Fetcher thread name

2014-11-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195694#comment-14195694 ] Rajesh Balamohan commented on TEZ-1728: --- +1. lgtm. Remove local host name from

[jira] [Assigned] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned TEZ-1733: Assignee: Gopal V TezMerger should sort FileChunks on decompressed size

[jira] [Updated] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1733: - Attachment: TEZ-1733.2.patch TezMerger should sort FileChunks on decompressed size

[jira] [Commented] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195726#comment-14195726 ] Rajesh Balamohan commented on TEZ-1733: --- lgtm. +1 one very minor comment {code} +

[jira] [Commented] (TEZ-1733) TezMerger should sort FileChunks on decompressed size

2014-11-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195734#comment-14195734 ] Gopal V commented on TEZ-1733: -- Thought I'd hit long/long overflow issues there - some of those