[jira] [Commented] (TEZ-1867) Create new central dispatcher for Tez AM

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254464#comment-14254464 ] Siddharth Seth commented on TEZ-1867: - >From a quick look at the patch. - rename: Spec

[jira] [Commented] (TEZ-1844) Shouldn't invoke system.exit in local mode when AM is failed to start

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254452#comment-14254452 ] Siddharth Seth commented on TEZ-1844: - Is this supposed to go into 0.6 or 0.7 ? > Shoul

[jira] [Commented] (TEZ-1844) Shouldn't invoke system.exit in local mode when AM is failed to start

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254449#comment-14254449 ] Siddharth Seth commented on TEZ-1844: - +1 Thanks [~jeffzhang]. bq. Siddharth Seth Curren

[jira] [Commented] (TEZ-1873) TestTezAMRMClient fails due to host resolution timing out

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254451#comment-14254451 ] Bikas Saha commented on TEZ-1873: - +1 > TestTezAMRMClient fails due to host resolution timi

[jira] [Created] (TEZ-1882) Tez UI build does not work on Windows

2014-12-19 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1882: --- Summary: Tez UI build does not work on Windows Key: TEZ-1882 URL: https://issues.apache.org/jira/browse/TEZ-1882 Project: Apache Tez Issue Type: Bug Report

[jira] [Commented] (TEZ-1313) Setup pre-commit build to test submitted patches

2014-12-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254410#comment-14254410 ] Hadoop QA commented on TEZ-1313: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (TEZ-228) Remove Phases from the Runtime

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-228: --- Target Version/s: 0.7.0 Yes. Primarily for tez-mapreduce though. > Remove Phases from the Runtime >

[jira] [Commented] (TEZ-120) Optimize YarnTezDagChild to be more efficient in case of re-use

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254360#comment-14254360 ] Siddharth Seth commented on TEZ-120: Yes, there's another related jira floating around so

[jira] [Commented] (TEZ-60) Add a ContainerListener to the AM

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-60?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254357#comment-14254357 ] Siddharth Seth commented on TEZ-60: --- Yes - this is still a relevant change. > Add a Contain

[jira] [Commented] (TEZ-3) Pick up bug fixes in MergeManager related classes that went in Apache Hadoop

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254356#comment-14254356 ] Siddharth Seth commented on TEZ-3: -- I believe these have already been ported in via several di

[jira] [Resolved] (TEZ-3) Pick up bug fixes in MergeManager related classes that went in Apache Hadoop

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved TEZ-3. -- Resolution: Done > Pick up bug fixes in MergeManager related classes that went in Apache Hadoop > ---

[jira] [Commented] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254354#comment-14254354 ] Siddharth Seth commented on TEZ-1877: - As far as I know, a partition for which just the

[jira] [Commented] (TEZ-1313) Setup pre-commit build to test submitted patches

2014-12-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254353#comment-14254353 ] Hadoop QA commented on TEZ-1313: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (TEZ-1313) Setup pre-commit build to test submitted patches

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1313: - Attachment: TEZ-1313.dummy.1.patch > Setup pre-commit build to test submitted patches >

[jira] [Updated] (TEZ-1878) Task-specific log level override not working in certain conditions

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1878: Attachment: TEZ-1878.1.txt Good catch. Patch to fix this. [~hitesh] - please review > Task-specific l

[jira] [Updated] (TEZ-1881) Setup initial test-patch script for TEZ-1313

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1881: - Attachment: TEZ-1881.1.patch > Setup initial test-patch script for TEZ-1313 > --

[jira] [Created] (TEZ-1881) Setup initial test-patch script for TEZ-1313

2014-12-19 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1881: Summary: Setup initial test-patch script for TEZ-1313 Key: TEZ-1881 URL: https://issues.apache.org/jira/browse/TEZ-1881 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1608) TopK example

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254349#comment-14254349 ] Bikas Saha commented on TEZ-1608: - Overall looks fine. Did not look closely at the impl for

[jira] [Comment Edited] (TEZ-119) The AM-RM heartbeat interval should not be static

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254325#comment-14254325 ] Bikas Saha edited comment on TEZ-119 at 12/20/14 12:09 AM: --- We shou

[jira] [Commented] (TEZ-119) The AM-RM heartbeat interval should not be static

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254325#comment-14254325 ] Bikas Saha commented on TEZ-119: We should do this. > The AM-RM heartbeat interval should no

[jira] [Commented] (TEZ-125) Client should provide rack information in the LocationHint

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254324#comment-14254324 ] Bikas Saha commented on TEZ-125: We should close this but open a separate jira to enable the

[jira] [Resolved] (TEZ-133) Support Binary node for efficient join

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-133. Resolution: Invalid > Support Binary node for efficient join > -- > >

[jira] [Commented] (TEZ-133) Support Binary node for efficient join

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254321#comment-14254321 ] Bikas Saha commented on TEZ-133: This is a user level construct. Closing this. > Support Bin

[jira] [Commented] (TEZ-287) Pass terminationCause information back to client-side (access via DAGClient.ApplicationReport)

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254320#comment-14254320 ] Bikas Saha commented on TEZ-287: Not done. Its only present in the history events. > Pass te

[jira] [Resolved] (TEZ-286) Add terminationCause to diagnostic messages

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-286. Resolution: Done > Add terminationCause to diagnostic messages > --- >

[jira] [Commented] (TEZ-286) Add terminationCause to diagnostic messages

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254314#comment-14254314 ] Bikas Saha commented on TEZ-286: Yes. Recent changes have added task attempt termination caus

[jira] [Updated] (TEZ-754) Investigate : skip user paylaod for same-vertex tasks when container re-use is used

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-754: Target Version/s: 0.7.0 > Investigate : skip user paylaod for same-vertex tasks when container re-use > is use

[jira] [Updated] (TEZ-307) Optionally send user payload as local resource if user payload if large then

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-307: Target Version/s: 0.7.0 > Optionally send user payload as local resource if user payload if large then > -

[jira] [Resolved] (TEZ-471) Containers not being sent shouldDie signal

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-471. Resolution: Incomplete > Containers not being sent shouldDie signal > -

[jira] [Commented] (TEZ-471) Containers not being sent shouldDie signal

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254306#comment-14254306 ] Bikas Saha commented on TEZ-471: Not sure. Too long ago. > Containers not being sent should

[jira] [Commented] (TEZ-307) Optionally send user payload as local resource if user payload if large then

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254303#comment-14254303 ] Bikas Saha commented on TEZ-307: 0.7 This comes up multiple times and requires code change on

[jira] [Resolved] (TEZ-484) Move YarnTezDAGChild into tez-engine

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-484. - Resolution: Invalid No longer valid. > Move YarnTezDAGChild into tez-engine > --

[jira] [Commented] (TEZ-471) Containers not being sent shouldDie signal

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254293#comment-14254293 ] Hitesh Shah commented on TEZ-471: - [~bikassaha] Is this still an issue? > Containers not be

[jira] [Resolved] (TEZ-365) TestVertexImpl.testVertexKill fails intermittently

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-365. - Resolution: Cannot Reproduce > TestVertexImpl.testVertexKill fails intermittently > -

[jira] [Resolved] (TEZ-333) Tezclient returning null progress all the way to job completion

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-333. - Resolution: Cannot Reproduce > Tezclient returning null progress all the way to job completion >

[jira] [Resolved] (TEZ-271) Create a post-processor of history logs for more detailed analysis

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-271. - Resolution: Duplicate tracked elsewhere via other jiras. There are already some tools around swimlane genera

[jira] [Updated] (TEZ-151) Unwrap TezRemoteException in DAGClientRPCImpl

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-151: Target Version/s: 0.7.0 > Unwrap TezRemoteException in DAGClientRPCImpl > -

[jira] [Updated] (TEZ-325) Allow work units to be assigned to running tasks

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-325: Issue Type: New Feature (was: Sub-task) Parent: (was: TEZ-328) > Allow work units to be assigned t

[jira] [Updated] (TEZ-329) Add metrics for reused containers

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-329: Issue Type: Improvement (was: Sub-task) Parent: (was: TEZ-328) > Add metrics for reused containers

[jira] [Updated] (TEZ-329) Add metrics for reused containers

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-329: Target Version/s: 0.7.0 > Add metrics for reused containers > - > >

[jira] [Commented] (TEZ-307) Optionally send user payload as local resource if user payload if large then

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254280#comment-14254280 ] Hitesh Shah commented on TEZ-307: - [~bikassaha] [~sseth] what version should we target this t

[jira] [Commented] (TEZ-285) Complete 'terminationCause' tracking to TaskImpl

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254277#comment-14254277 ] Hitesh Shah commented on TEZ-285: - [~zjffdu] Can you take a look if this is still an open iss

[jira] [Resolved] (TEZ-293) Test failure: TestDAGImpl.testInvalidEvent:651 expected: but was:

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-293. - Resolution: Not a Problem Fixed elsewhere. > Test failure: TestDAGImpl.testInvalidEvent:651 expected: but w

[jira] [Commented] (TEZ-287) Pass terminationCause information back to client-side (access via DAGClient.ApplicationReport)

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254271#comment-14254271 ] Hitesh Shah commented on TEZ-287: - [~bikassaha] Do you know if this has already been done?

[jira] [Commented] (TEZ-286) Add terminationCause to diagnostic messages

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254272#comment-14254272 ] Hitesh Shah commented on TEZ-286: - [~bikassaha] Do you know if this has already been done?

[jira] [Resolved] (TEZ-280) WordcountMrr job fails with "java.io.EOFException"

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-280. - Resolution: Invalid WordCountMrr removed from codebase. > WordcountMrr job fails with "java.io.EOFException

[jira] [Resolved] (TEZ-281) WordcountMrr job fails with "Negative key-length: -17" IOException

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-281. - Resolution: Invalid WordCountMrr removed from codebase. > WordcountMrr job fails with "Negative key-length:

[jira] [Updated] (TEZ-240) TEZ should start using the newly added NMClient in YARN

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-240: Target Version/s: 0.7.0 > TEZ should start using the newly added NMClient in YARN > ---

[jira] [Resolved] (TEZ-237) DAGSchedulerMRR should be able schedule tasks for multiple stages if slowstart is set to 0

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-237. - Resolution: Won't Fix Switched to a different scheduler. Closing this as wont fix. > DAGSchedulerMRR should

[jira] [Commented] (TEZ-228) Remove Phases from the Runtime

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254255#comment-14254255 ] Hitesh Shah commented on TEZ-228: - [~sseth] still an issue? > Remove Phases from the Runtim

[jira] [Resolved] (TEZ-193) TestDAGImpl has intermittent failures

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-193. - Resolution: Cannot Reproduce No longer reproducible > TestDAGImpl has intermittent failures > --

[jira] [Comment Edited] (TEZ-132) Vertex does not handle duplicate updates from the same task

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254242#comment-14254242 ] Hitesh Shah edited comment on TEZ-132 at 12/19/14 11:36 PM: [~zjf

[jira] [Updated] (TEZ-160) Remove 5 second sleep at the end of AM completion.

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-160: Priority: Major (was: Critical) Target Version/s: 0.7.0 > Remove 5 second sleep at the end of AM c

[jira] [Updated] (TEZ-160) Remove 5 second sleep at the end of AM completion.

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-160: Priority: Critical (was: Major) > Remove 5 second sleep at the end of AM completion. > ---

[jira] [Updated] (TEZ-138) Merge DAG/DAGImpl, Vertex/VertexImpl, Task/TaskImpl, TaskAttempt/TaskAttemptImpl

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-138: Priority: Critical (was: Major) > Merge DAG/DAGImpl, Vertex/VertexImpl, Task/TaskImpl, > TaskAttempt/TaskAtte

[jira] [Updated] (TEZ-138) Merge DAG/DAGImpl, Vertex/VertexImpl, Task/TaskImpl, TaskAttempt/TaskAttemptImpl

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-138: Priority: Major (was: Critical) Target Version/s: 0.7.0 > Merge DAG/DAGImpl, Vertex/VertexImpl, Ta

[jira] [Updated] (TEZ-138) Merge DAG/DAGImpl, Vertex/VertexImpl, Task/TaskImpl, TaskAttempt/TaskAttemptImpl

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-138: Labels: (was: TEZ-0.3.0 TEZ-1) > Merge DAG/DAGImpl, Vertex/VertexImpl, Task/TaskImpl, > TaskAttempt/TaskAtte

[jira] [Commented] (TEZ-133) Support Binary node for efficient join

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254251#comment-14254251 ] Hitesh Shah commented on TEZ-133: - [~bikassaha] [~sseth] any thoughts on this? If not, we sho

[jira] [Commented] (TEZ-132) Vertex does not handle duplicate updates from the same task

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254242#comment-14254242 ] Hitesh Shah commented on TEZ-132: - [~zjffdu] Do you know if this is still a relevant issue?

[jira] [Commented] (TEZ-125) Client should provide rack information in the LocationHint

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254240#comment-14254240 ] Hitesh Shah commented on TEZ-125: - Should this be closed out as a wont-fix? > Client should

[jira] [Updated] (TEZ-122) Finalize v1 DAGPlan and consider versioning support

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-122: Priority: Critical (was: Major) > Finalize v1 DAGPlan and consider versioning support > --

[jira] [Updated] (TEZ-122) Finalize v1 DAGPlan and consider versioning support

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-122: Target Version/s: 0.7.0 > Finalize v1 DAGPlan and consider versioning support > ---

[jira] [Commented] (TEZ-120) Optimize YarnTezDagChild to be more efficient in case of re-use

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254237#comment-14254237 ] Hitesh Shah commented on TEZ-120: - [~sseth] is this still relevant? > Optimize YarnTezDagCh

[jira] [Commented] (TEZ-119) The AM-RM heartbeat interval should not be static

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254234#comment-14254234 ] Hitesh Shah commented on TEZ-119: - [~bikassaha] Any plans on taking this on? Is this still wo

[jira] [Resolved] (TEZ-97) Fix LocalJobRunner to run multi-stage MR jobs

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-97?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-97. Resolution: Invalid Tracked elsewhere in other jiras such as TEZ-684. > Fix LocalJobRunner to run multi-stage M

[jira] [Commented] (TEZ-60) Add a ContainerListener to the AM

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-60?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254228#comment-14254228 ] Hitesh Shah commented on TEZ-60: [~sseth] is this still needed? > Add a ContainerListener to

[jira] [Created] (TEZ-1880) Fix references to MR constructs in MiniTezCluster

2014-12-19 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1880: Summary: Fix references to MR constructs in MiniTezCluster Key: TEZ-1880 URL: https://issues.apache.org/jira/browse/TEZ-1880 Project: Apache Tez Issue Type: Bug

[jira] [Resolved] (TEZ-53) Remove reference to ShuffleHandler.MAPREDUCE_SHUFFLE_SERVICEID from Tez

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-53?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-53. Resolution: Duplicate Assignee: (was: Siddharth Seth) > Remove reference to ShuffleHandler.MAPREDUCE_S

[jira] [Resolved] (TEZ-43) Get rid of MapReduce references from components in tez-engine

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-43?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-43. Resolution: Invalid tez-engine no longer exists. > Get rid of MapReduce references from components in tez-engi

[jira] [Resolved] (TEZ-11) Support for job history

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-11. Resolution: Invalid Closing this out as invalid. Implemented in various ways via UI and Timeline. > Support for

[jira] [Commented] (TEZ-3) Pick up bug fixes in MergeManager related classes that went in Apache Hadoop

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254217#comment-14254217 ] Hitesh Shah commented on TEZ-3: --- [~sseth] [~rajesh.balamohan] Are the above fixes in MR still rel

[jira] [Created] (TEZ-1879) Create local UGI instances for each task and the AM, when running in LocalMode

2014-12-19 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-1879: --- Summary: Create local UGI instances for each task and the AM, when running in LocalMode Key: TEZ-1879 URL: https://issues.apache.org/jira/browse/TEZ-1879 Project: Apach

[jira] [Commented] (TEZ-1837) Avoid updating environment when running in local mode

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254199#comment-14254199 ] Siddharth Seth commented on TEZ-1837: - Forgot to mention - applies on top of TEZ-1856.

[jira] [Updated] (TEZ-1837) Avoid updating environment when running in local mode

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1837: Attachment: TEZ-1837.1.txt Patch to remove usage of environment in local mode. It actually moves envi

[jira] [Assigned] (TEZ-1837) Avoid updating environment when running in local mode

2014-12-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned TEZ-1837: --- Assignee: Siddharth Seth > Avoid updating environment when running in local mode >

[jira] [Updated] (TEZ-1878) Task-specific log level override not working in certain conditions

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1878: - Target Version/s: 0.6.0 > Task-specific log level override not working in certain conditions > -

[jira] [Commented] (TEZ-1878) Task-specific log level override not working in certain conditions

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254174#comment-14254174 ] Hitesh Shah commented on TEZ-1878: -- However, it may be helpful to note that when setting "

[jira] [Updated] (TEZ-1878) Task-specific log level override not working in certain conditions

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1878: - Assignee: Siddharth Seth > Task-specific log level override not working in certain conditions >

[jira] [Created] (TEZ-1878) Task-specific log level override not working in certain conditions

2014-12-19 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1878: Summary: Task-specific log level override not working in certain conditions Key: TEZ-1878 URL: https://issues.apache.org/jira/browse/TEZ-1878 Project: Apache Tez Is

[jira] [Commented] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread sivakumar (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254151#comment-14254151 ] sivakumar commented on TEZ-1877: ok, thanks! > hive query using tez is referring deleted pa

[jira] [Comment Edited] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254149#comment-14254149 ] Hitesh Shah edited comment on TEZ-1877 at 12/19/14 10:38 PM: - [~

[jira] [Comment Edited] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254149#comment-14254149 ] Hitesh Shah edited comment on TEZ-1877 at 12/19/14 10:38 PM: - [~

[jira] [Commented] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254149#comment-14254149 ] Hitesh Shah commented on TEZ-1877: -- [~sbhavanari] The bug is probably in Hive as Tez does n

[jira] [Commented] (TEZ-1867) Create new central dispatcher for Tez AM

2014-12-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254147#comment-14254147 ] Bikas Saha commented on TEZ-1867: - There is no need for a DrainDispatcher because the sendin

[jira] [Commented] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread sivakumar (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254134#comment-14254134 ] sivakumar commented on TEZ-1877: Hi Hitesh, issue is occurring only after switching the exec

[jira] [Resolved] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1877. -- Resolution: Invalid Hello [~sbhavanari], thanks for reporting an issue. However, I am closing this jira o

[jira] [Updated] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread sivakumar (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivakumar updated TEZ-1877: --- Attachment: Tez is still referring deleted paritions_Issue.docx Attached doc contains steps to reproduce the iss

[jira] [Created] (TEZ-1877) hive query using tez is referring deleted partitions

2014-12-19 Thread sivakumar (JIRA)
sivakumar created TEZ-1877: -- Summary: hive query using tez is referring deleted partitions Key: TEZ-1877 URL: https://issues.apache.org/jira/browse/TEZ-1877 Project: Apache Tez Issue Type: Bug A

[jira] [Commented] (TEZ-1874) AM Inline mode property is deprecated

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254073#comment-14254073 ] Hitesh Shah commented on TEZ-1874: -- Given that we are trying to retain compatibility for no

[jira] [Commented] (TEZ-1839) TestTezClientUtils and TestTezCommonUtils leave files under the target directory after completing

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254070#comment-14254070 ] Hitesh Shah commented on TEZ-1839: -- [~sseth] Did you get a chance to look into the target d

[jira] [Commented] (TEZ-1843) AM should go to KILLED state when it is killed in RUNNING state

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254067#comment-14254067 ] Hitesh Shah commented on TEZ-1843: -- [~zjffdu] Thinking on this a bit more, the patch might

[jira] [Commented] (TEZ-1874) AM Inline mode property is deprecated

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254062#comment-14254062 ] Hitesh Shah commented on TEZ-1874: -- I believe this was for future work to run tasks inline

[jira] [Commented] (TEZ-1876) [Umbrella] Polish up support for local mode in Tez

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254058#comment-14254058 ] Hitesh Shah commented on TEZ-1876: -- Some sub-tasks can probably moved to independent jiras

[jira] [Comment Edited] (TEZ-1876) [Umbrella] Polish up support for local mode in Tez

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254058#comment-14254058 ] Hitesh Shah edited comment on TEZ-1876 at 12/19/14 9:35 PM: Some

[jira] [Updated] (TEZ-1336) Avoid interacting with the DAGAppMaster via RPC

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1336: - Parent Issue: TEZ-1876 (was: TEZ-684) > Avoid interacting with the DAGAppMaster via RPC > -

[jira] [Updated] (TEZ-869) move the uber/local mode check into vertex level

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-869: Parent Issue: TEZ-1876 (was: TEZ-684) > move the uber/local mode check into vertex level > ---

[jira] [Updated] (TEZ-1348) Ensure local directories are used when using local-mode

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1348: - Parent Issue: TEZ-1876 (was: TEZ-684) > Ensure local directories are used when using local-mode > -

[jira] [Updated] (TEZ-1337) Handling of local-dirs for Local Mode

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1337: - Parent Issue: TEZ-1876 (was: TEZ-684) > Handling of local-dirs for Local Mode > ---

[jira] [Updated] (TEZ-1363) Make use of the regular scheduler when running in LocalMode

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1363: - Parent Issue: TEZ-1876 (was: TEZ-684) > Make use of the regular scheduler when running in LocalMode > -

[jira] [Updated] (TEZ-1339) Handling of LocalResources in LocalMode

2014-12-19 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1339: - Parent Issue: TEZ-1876 (was: TEZ-684) > Handling of LocalResources in LocalMode > -

  1   2   >