[jira] [Commented] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518728#comment-14518728 ] Gopal V commented on TEZ-2383: -- [~rajesh.balamohan]: This is likely to be a fix limited to the

[jira] [Updated] (TEZ-2360) per-io counters flag should generate both overall and per-edge counters

2015-04-28 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-2360: -- Attachment: TEZ-2360.3.patch added Test case to check per io counters are aggregated. sinc

[jira] [Assigned] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-2383: - Assignee: Rajesh Balamohan > release sort buffers on close > -

[jira] [Updated] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2383: -- Attachment: TEZ-2383.1.patch [~sseth] - Can you please review when you find time? > release sort

[jira] [Updated] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2305: - Target Version/s: 0.5.4, 0.6.1 Affects Version/s: (was: 0.7.0) > MR compatibility sleep job fails w

[jira] [Commented] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518612#comment-14518612 ] Hitesh Shah commented on TEZ-2305: -- +1 pending pre-commit . > MR compatibility sleep job

[jira] [Updated] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2305: Attachment: TEZ-2305-5.patch [~hitesh] Upload new patch based on TEZ-2305.2.patch. (Add unit test to simulate

[jira] [Commented] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518581#comment-14518581 ] TezQA commented on TEZ-2256: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-2256 PreCommit Build #569

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2256 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/569/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Created] (TEZ-2383) release sort buffers on close

2015-04-28 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-2383: - Summary: release sort buffers on close Key: TEZ-2383 URL: https://issues.apache.org/jira/browse/TEZ-2383 Project: Apache Tez Issue Type: Bug Re

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518543#comment-14518543 ] TezQA commented on TEZ-776: --- {color:red}-1 overall{color}. Here are the results of testing the lat

Failed: TEZ-776 PreCommit Build #568

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-776 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/568/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2

[jira] [Resolved] (TEZ-2359) Deadlock in DAGAppMaster

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved TEZ-2359. - Resolution: Invalid My mistake, it's an issue when I work on TEZ-1273, not on the master. > Deadlock in DA

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518504#comment-14518504 ] Hitesh Shah commented on TEZ-776: - Question on the below code snippet: {code} EventRouteMet

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518493#comment-14518493 ] TezQA commented on TEZ-1897: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-1897 PreCommit Build #567

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1897 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/567/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2256: - Assignee: Hitesh Shah (was: Cyrille Chépélov) > Avoid use of BufferTooSmallException to signal end of buffe

[jira] [Commented] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518457#comment-14518457 ] Hitesh Shah commented on TEZ-2256: -- Change status to patch available to trigger pre-commit.

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2256: - Issue Type: Improvement (was: Bug) > Avoid use of BufferTooSmallException to signal end of buffer in > Uno

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2256: - Issue Type: Bug (was: Improvement) > Avoid use of BufferTooSmallException to signal end of buffer in > Uno

[jira] [Updated] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2237: - Assignee: Siddharth Seth > Complex DAG freezes and fails (was BufferTooSmallException raised in > Unordered

[jira] [Updated] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2237: - Priority: Critical (was: Major) > Complex DAG freezes and fails (was BufferTooSmallException raised in > U

[jira] [Updated] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2237: - Target Version/s: 0.6.1 > Complex DAG freezes and fails (was BufferTooSmallException raised in > UnorderedP

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2256: -- Priority: Critical (was: Minor) Target Version/s: 0.6.1 > Avoid use of BufferTooSmall

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518386#comment-14518386 ] TezQA commented on TEZ-2380: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-2380 PreCommit Build #566

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2380 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/566/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518380#comment-14518380 ] Bikas Saha commented on TEZ-776: TEZ-776.6.A and TEZ-776.6.B are 2 versions of the API with t

[jira] [Issue Comment Deleted] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2379: Comment: was deleted (was: I think the following the code may cause the issue. There may be already some even

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.6.B.patch > Reduce AM mem usage caused by storing TezEvents > ---

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518350#comment-14518350 ] Rajesh Balamohan commented on TEZ-2379: --- speculation was not enabled in this case. >

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518337#comment-14518337 ] Bikas Saha commented on TEZ-2379: - 1) Client issued dag kill that caused all tasks to get ki

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518330#comment-14518330 ] TezQA commented on TEZ-776: --- {color:green}+1 overall{color}. Here are the results of testing the l

Success: TEZ-776 PreCommit Build #565

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-776 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/565/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2

[jira] [Updated] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2379: Attachment: (was: application_1429683757595_0479.log) > org.apache.hadoop.yarn.state.InvalidStateTransiton

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518321#comment-14518321 ] Bikas Saha commented on TEZ-2379: - deleting log as it had private server names and ip addres

[jira] [Created] (TEZ-2382) Publish counters to timeline for failed/killed attempts

2015-04-28 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-2382: Summary: Publish counters to timeline for failed/killed attempts Key: TEZ-2382 URL: https://issues.apache.org/jira/browse/TEZ-2382 Project: Apache Tez Issue Type: B

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518276#comment-14518276 ] Hitesh Shah commented on TEZ-2380: -- \cc [~pramachandran] > Disable fall back to reading fr

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518277#comment-14518277 ] Chang Li commented on TEZ-2380: --- [~hitesh], I have updated DAGClientImpl, and have verified th

[jira] [Updated] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated TEZ-2380: -- Attachment: TEZ-2380.1.patch > Disable fall back to reading from timeline if timeline disabled >

[jira] [Updated] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1897: Attachment: TEZ-1897.6.patch Patch addresses comments and adds a new test. > Create a concurrent version of A

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518254#comment-14518254 ] Bikas Saha commented on TEZ-1897: - bq. Rename registerAndCreateDispatcher to registerAndCrea

[jira] [Comment Edited] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518219#comment-14518219 ] Hitesh Shah edited comment on TEZ-2379 at 4/28/15 10:19 PM: Addi

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518219#comment-14518219 ] Hitesh Shah commented on TEZ-2379: -- Additional question: speculation enabled? > org.apache

[jira] [Updated] (TEZ-568) Allow I/P/Os to report spescific time information to the AM

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-568: Target Version/s: 0.8.0 (was: 0.7.0) > Allow I/P/Os to report spescific time information to the AM > -

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518194#comment-14518194 ] Rajesh Balamohan commented on TEZ-2379: --- [~hitesh] - Yes, this is with master codebase

[jira] [Commented] (TEZ-568) Allow I/P/Os to report spescific time information to the AM

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518193#comment-14518193 ] Hitesh Shah commented on TEZ-568: - Moving to 0.8 > Allow I/P/Os to report spescific time inf

[jira] [Commented] (TEZ-2377) RandomWriter ends up using TextOutputFormat instead of SequenceFileOutputFormat

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518144#comment-14518144 ] Bikas Saha commented on TEZ-2377: - Does the same fix need to be made to MRInput(Base)? > Ra

[jira] [Updated] (TEZ-1564) State machine error: Invalid event: T_SCHEDULE at SCHEDULED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1564: - Target Version/s: 0.7.0, 0.6.1 (was: 0.7.0) > State machine error: Invalid event: T_SCHEDULE at SCHEDULED >

[jira] [Updated] (TEZ-1564) State machine error: Invalid event: T_SCHEDULE at SCHEDULED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1564: - Target Version/s: 0.7.0 (was: 0.6.0) > State machine error: Invalid event: T_SCHEDULE at SCHEDULED > --

[jira] [Updated] (TEZ-1348) Setup configs required for local mode automatically, instead of relying on changes to tez-site

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1348: - Target Version/s: 0.8.0 (was: 0.6.0) > Setup configs required for local mode automatically, instead of rely

[jira] [Updated] (TEZ-1537) Expose edge information in I/P/IContexts

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1537: - Target Version/s: 0.8.0 (was: 0.6.0) > Expose edge information in I/P/IContexts > -

[jira] [Updated] (TEZ-946) Tez loses buffer-cache performance by running interleaved vertexes

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-946: Target Version/s: 0.8.0 (was: 0.7.0) > Tez loses buffer-cache performance by running interleaved vertexes > --

[jira] [Updated] (TEZ-1912) Merge exceptions are thrown when enabling tez.runtime.shuffle.memory-to-memory.enable && tez.runtime.shuffle.memory-to-memory.segments

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1912: - Fix Version/s: 0.7.0 > Merge exceptions are thrown when enabling > tez.runtime.shuffle.memory-to-memory.ena

[jira] [Updated] (TEZ-1912) Merge exceptions are thrown when enabling tez.runtime.shuffle.memory-to-memory.enable && tez.runtime.shuffle.memory-to-memory.segments

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1912: - Assignee: Rajesh Balamohan > Merge exceptions are thrown when enabling > tez.runtime.shuffle.memory-to-memo

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.6.A.patch Re-uploading patch as the previous one had incomplete diffs. > Reduce AM mem usage

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: (was: TEZ-776.6.A.patch) > Reduce AM mem usage caused by storing TezEvents >

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.6.A.patch Patch with test issues fixed. > Reduce AM mem usage caused by storing TezEvents >

[jira] [Resolved] (TEZ-2381) Fixes after rebase 04/28

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved TEZ-2381. - Resolution: Fixed Fix Version/s: TEZ-2003 > Fixes after rebase 04/28 > --

[jira] [Updated] (TEZ-2381) Fixes after rebase 04/28

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-2381: Attachment: TEZ-2381.1.txt > Fixes after rebase 04/28 > > > K

[jira] [Created] (TEZ-2381) Fixes after rebase 04/28

2015-04-28 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-2381: --- Summary: Fixes after rebase 04/28 Key: TEZ-2381 URL: https://issues.apache.org/jira/browse/TEZ-2381 Project: Apache Tez Issue Type: Sub-task Report

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517996#comment-14517996 ] Bikas Saha commented on TEZ-1897: - the patch enabled it by default to get the jenkins run wi

[jira] [Commented] (TEZ-1897) Create a concurrent version of AsyncDispatcher

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517978#comment-14517978 ] Siddharth Seth commented on TEZ-1897: - Quick glance. This should be disabled by default.

[jira] [Updated] (TEZ-1138) Access to some mapred counters is broken after TEZ-901

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1138: Target Version/s: 0.8.0 (was: 0.7.0) > Access to some mapred counters is broken after TEZ-901 > -

[jira] [Updated] (TEZ-924) InputFailedEvent handling for Shuffle

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-924: --- Target Version/s: 0.8.0 (was: 0.7.0) > InputFailedEvent handling for Shuffle > -

[jira] [Updated] (TEZ-1522) Scheduling can result in out of order execution and slowdown of upstream work

2015-04-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1522: Target Version/s: 0.8.0 > Scheduling can result in out of order execution and slowdown of upstream wor

[jira] [Commented] (TEZ-2231) Create project by-laws

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517927#comment-14517927 ] Hitesh Shah commented on TEZ-2231: -- This one has been open for quite some time. [~sseth] [~

[jira] [Comment Edited] (TEZ-2378) In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517880#comment-14517880 ] Hitesh Shah edited comment on TEZ-2378 at 4/28/15 7:46 PM: --- Any re

[jira] [Commented] (TEZ-2378) In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517880#comment-14517880 ] Hitesh Shah commented on TEZ-2378: -- Any reason why this is failing so often? > In case Fe

[jira] [Assigned] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li reassigned TEZ-2380: - Assignee: Chang Li > Disable fall back to reading from timeline if timeline disabled > ---

Failed: TEZ-776 PreCommit Build #564

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-776 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/564/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517533#comment-14517533 ] TezQA commented on TEZ-776: --- {color:red}-1 overall{color}. Here are the results of testing the lat

[jira] [Commented] (TEZ-2372) TestAMRecovery failing in latest build

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517516#comment-14517516 ] Hitesh Shah commented on TEZ-2372: -- For the next failure, take a look at https://builds.ap

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: (was: TEZ-776.5.patch) > Reduce AM mem usage caused by storing TezEvents > --

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-28 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.5.patch Cancelling and re-uploading patch due to build error. Triggering build again. > Redu

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517405#comment-14517405 ] Hitesh Shah commented on TEZ-1421: -- [~ozawa] Did you manage to get a chance to look at this

[jira] [Commented] (TEZ-1138) Access to some mapred counters is broken after TEZ-901

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517407#comment-14517407 ] Hitesh Shah commented on TEZ-1138: -- [~sseth] [~rekhajoshm] Will either of you be looking at

[jira] [Updated] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2309: - Target Version/s: 0.8.0 (was: 0.7.0) > Fix slf4j dependencies for tez modules > --

[jira] [Commented] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517403#comment-14517403 ] Hitesh Shah commented on TEZ-2309: -- [~vasanthkumar] Mind filing a separate jira for fixing

[jira] [Commented] (TEZ-924) InputFailedEvent handling for Shuffle

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517398#comment-14517398 ] Hitesh Shah commented on TEZ-924: - [~rajesh.balamohan] [~sseth] Is this still for 0.7 ? or sh

[jira] [Updated] (TEZ-122) Finalize v1 DAGPlan and consider versioning support

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-122: Target Version/s: 0.8.0 (was: 0.7.0) > Finalize v1 DAGPlan and consider versioning support > -

[jira] [Commented] (TEZ-2164) Shade the guava version used by Tez

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517395#comment-14517395 ] Hitesh Shah commented on TEZ-2164: -- Moving to 0.8.0 as this work may result in some level o

[jira] [Updated] (TEZ-2164) Shade the guava version used by Tez

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2164: - Target Version/s: 0.8.0 (was: 0.7.0) > Shade the guava version used by Tez > --

[jira] [Resolved] (TEZ-2046) Make timeline server putDomain exceptions non-fatal - full feature

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-2046. -- Resolution: Fixed > Make timeline server putDomain exceptions non-fatal - full feature > -

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517387#comment-14517387 ] Hitesh Shah commented on TEZ-2226: -- Created TEZ-2380 for [~pramachandran]'s comment. > Di

[jira] [Created] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-28 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-2380: Summary: Disable fall back to reading from timeline if timeline disabled Key: TEZ-2380 URL: https://issues.apache.org/jira/browse/TEZ-2380 Project: Apache Tez Issu

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517354#comment-14517354 ] Hitesh Shah commented on TEZ-2226: -- Good catch [~pramachandran]. Will file a separate jira

[jira] [Commented] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517294#comment-14517294 ] TezQA commented on TEZ-1752: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-1752 PreCommit Build #563

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1752 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/563/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2379: - Priority: Blocker (was: Major) > org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517277#comment-14517277 ] Hitesh Shah commented on TEZ-2379: -- [~rajesh.balamohan] Is this with master? > org.apache

[jira] [Updated] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2379: - Target Version/s: 0.7.0 > org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: > T_A

[jira] [Updated] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1752: -- Attachment: TEZ-1752.5.patch > Inputs / Outputs in the Runtime library should be interruptable > -

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

2015-04-28 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517127#comment-14517127 ] Prakash Ramachandran commented on TEZ-2226: --- +1 LGTM. one minor item (separate J

Failed: TEZ-1752 PreCommit Build #562

2015-04-28 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1752 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/562/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517010#comment-14517010 ] Jeff Zhang commented on TEZ-2379: - I think the following the code may cause the issue. There

[jira] [Commented] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517007#comment-14517007 ] TezQA commented on TEZ-1752: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Updated] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2379: -- Attachment: application_1429683757595_0479.log Attaching AM log > org.apache.hadoop.yarn.state.In

[jira] [Created] (TEZ-2379) org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED

2015-04-28 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-2379: - Summary: org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: T_ATTEMPT_KILLED at KILLED Key: TEZ-2379 URL: https://issues.apache.org/jira/browse/TEZ-237

[jira] [Commented] (TEZ-2377) RandomWriter ends up using TextOutputFormat instead of SequenceFileOutputFormat

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516993#comment-14516993 ] Rajesh Balamohan commented on TEZ-2377: --- Thanks [~zjffdu], TEZ-2305 (.2 patch) has the

[jira] [Comment Edited] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516988#comment-14516988 ] Rajesh Balamohan edited comment on TEZ-1752 at 4/28/15 1:01 PM: --

  1   2   >