[jira] [Updated] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyrille Chépélov updated TEZ-2237: -- Summary: Complex DAG freezes and fails (was BufferTooSmallException raised in

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388153#comment-14388153 ] Cyrille Chépélov commented on TEZ-2224: --- Hello [~jeffzhang], branch-0.6 now fails to

[jira] [Comment Edited] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388153#comment-14388153 ] Cyrille Chépélov edited comment on TEZ-2224 at 3/31/15 7:07 AM:

[jira] [Comment Edited] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388153#comment-14388153 ] Cyrille Chépélov edited comment on TEZ-2224 at 3/31/15 7:23 AM:

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388252#comment-14388252 ] Jeff Zhang commented on TEZ-2224: - Build fails, checking that

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388156#comment-14388156 ] Jeff Zhang commented on TEZ-2224: - Thanks [~cchepelov] I am looking at it. EventQueue

[jira] [Updated] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2224: Attachment: TEZ-2224-2-addendum.patch Attach addendum patch for fix compilation issue in branch-0.5

[jira] [Commented] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388189#comment-14388189 ] Cyrille Chépélov commented on TEZ-2237: --- OK, that'll be TEZ-2256 :) Complex DAG

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388157#comment-14388157 ] Jeff Zhang commented on TEZ-2224: - Thanks [~cchepelov] I am looking at it. EventQueue

[jira] [Comment Edited] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388153#comment-14388153 ] Cyrille Chépélov edited comment on TEZ-2224 at 3/31/15 7:06 AM:

[jira] [Commented] (TEZ-2237) Complex DAG freezes and fails (was BufferTooSmallException raised in UnorderedPartitionedKVWriter then DAG lingers)

[ https://issues.apache.org/jira/browse/TEZ-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388170#comment-14388170 ] Cyrille Chépélov commented on TEZ-2237: --- Indeed,

[jira] [Created] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

Cyrille Chépélov created TEZ-2256: - Summary: Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter Key: TEZ-2256 URL: https://issues.apache.org/jira/browse/TEZ-2256

[jira] [Comment Edited] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388186#comment-14388186 ] Jeff Zhang edited comment on TEZ-2224 at 3/31/15 7:44 AM: -- Attach

[jira] [Reopened] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reopened TEZ-2224: - EventQueue empty doesn't mean events are consumed in RecoveryService

[jira] [Commented] (TEZ-2149) Optimizations for the timed version of DAGClient.getStatus

[ https://issues.apache.org/jira/browse/TEZ-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388295#comment-14388295 ] Jeff Zhang commented on TEZ-2149: - Build fails

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388448#comment-14388448 ] Jeff Zhang commented on TEZ-714: [~bikassaha] Minor update on the patch. * Please ignore any

[jira] [Updated] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-714: --- Attachment: TEZ-714-7.patch Rebase patch. OutputCommitters should not run in the main AM dispatcher thread

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388449#comment-14388449 ] Hadoop QA commented on TEZ-714: --- {color:red}-1 overall{color}. Here are the results of testing

Failed: TEZ-714 PreCommit Build #370

Jira: https://issues.apache.org/jira/browse/TEZ-714 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/370/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2260) AM been shutdown due to NoSuchMethodError in DAGProtos

[ https://issues.apache.org/jira/browse/TEZ-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389882#comment-14389882 ] Jeff Zhang commented on TEZ-2260: - Create TEZ-2261 for adding diagnostics in DAGAppMaster

[jira] [Created] (TEZ-2261) Should add diagnostics in DAGAppMaster when recovery error happens

Jeff Zhang created TEZ-2261: --- Summary: Should add diagnostics in DAGAppMaster when recovery error happens Key: TEZ-2261 URL: https://issues.apache.org/jira/browse/TEZ-2261 Project: Apache Tez

[jira] [Updated] (TEZ-2260) AM been shutdown due to NoSuchMethodError in DAGProtos

[ https://issues.apache.org/jira/browse/TEZ-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2260: Attachment: applog.tar attach the full app logs when running TestTezJobs.testSortMergeJoinExamplePipeline

[jira] [Updated] (TEZ-2226) Disable writing history to timeline if domain creation fails.

[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated TEZ-2226: -- Attachment: TEZ-2226.3.patch Disable writing history to timeline if domain creation fails.

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388708#comment-14388708 ] Hitesh Shah commented on TEZ-2224: -- [~zjffdu] It is better to either revert the change or

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388709#comment-14388709 ] Hitesh Shah commented on TEZ-2224: -- Also the build failed as AMRecovery timed out.

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388705#comment-14388705 ] Chang Li commented on TEZ-2226: --- [~hitesh] Thanks for suggestion of proper changes. I have

[jira] [Commented] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388713#comment-14388713 ] Hitesh Shah commented on TEZ-2256: -- [~cchepelov] You are now in the contributors list so

Failed: TEZ-2226 PreCommit Build #372

Jira: https://issues.apache.org/jira/browse/TEZ-2226 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/372/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2256: - Assignee: Cyrille Chépélov Avoid use of BufferTooSmallException to signal end of buffer in

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388724#comment-14388724 ] Hadoop QA commented on TEZ-2226: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (TEZ-2226) Disable writing history to timeline if domain creation fails.

[ https://issues.apache.org/jira/browse/TEZ-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388782#comment-14388782 ] Chang Li commented on TEZ-2226: --- These two tests pass on my machine Disable writing history

Success: TEZ-2192 PreCommit Build #373

Jira: https://issues.apache.org/jira/browse/TEZ-2192 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/373/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2192) Relocalization does not check for source

[ https://issues.apache.org/jira/browse/TEZ-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389224#comment-14389224 ] Hadoop QA commented on TEZ-2192: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (TEZ-2231) Create project by-laws

[ https://issues.apache.org/jira/browse/TEZ-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389070#comment-14389070 ] Hitesh Shah commented on TEZ-2231: -- bq. 3 day vote - drop the weekend clause ? That can

[jira] [Updated] (TEZ-2231) Create project by-laws

[ https://issues.apache.org/jira/browse/TEZ-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2231: - Attachment: by-laws.3.patch Create project by-laws -- Key: TEZ-2231

[jira] [Commented] (TEZ-2192) Relocalization does not check for source

[ https://issues.apache.org/jira/browse/TEZ-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389042#comment-14389042 ] Hitesh Shah commented on TEZ-2192: -- [~sseth] [~bikassaha] [~zjffdu] Review please. Still

[jira] [Updated] (TEZ-2192) Relocalization does not check for source

[ https://issues.apache.org/jira/browse/TEZ-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2192: - Attachment: TEZ-2192.1.patch Relocalization does not check for source

[jira] [Updated] (TEZ-2225) Remove instances of LOG.isDebugEnabled

[ https://issues.apache.org/jira/browse/TEZ-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasanth kumar RJ updated TEZ-2225: -- Attachment: TEZ-2225.1.patch Attached patch. Please review. Remove instances of

[jira] [Updated] (TEZ-2257) NPEs in TaskReporter

[ https://issues.apache.org/jira/browse/TEZ-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-2257: Description: The task reported can end up throwing NPEs when adding events, reporting exceptions or

[jira] [Updated] (TEZ-2216) Expose errors during AM initialization

[ https://issues.apache.org/jira/browse/TEZ-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated TEZ-2216: -- Attachment: TEZ-2216.1.patch Expose errors during AM initialization --

[jira] [Commented] (TEZ-2257) NPEs in TaskReporter

[ https://issues.apache.org/jira/browse/TEZ-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389375#comment-14389375 ] Hitesh Shah commented on TEZ-2257: -- Seems like a major issue. Why is this only targeted for

[jira] [Commented] (TEZ-2216) Expose errors during AM initialization

[ https://issues.apache.org/jira/browse/TEZ-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389321#comment-14389321 ] Chang Li commented on TEZ-2216: --- [~bikassaha], [~zjffdu], I am interested in working on this

Success: TEZ-714 PreCommit Build #371

Jira: https://issues.apache.org/jira/browse/TEZ-714 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/371/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388528#comment-14388528 ] Hadoop QA commented on TEZ-714: --- {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389698#comment-14389698 ] Jeff Zhang commented on TEZ-2224: - [~hitesh] I am looking at this. The build fails may due

Failed: TEZ-2216 PreCommit Build #376

Jira: https://issues.apache.org/jira/browse/TEZ-2216 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/376/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2259) Push additional data to Timeline for Recovery for better consumption in UI

[ https://issues.apache.org/jira/browse/TEZ-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389485#comment-14389485 ] Hitesh Shah commented on TEZ-2259: -- FWIW, once attempt ids are known, the DAG logs can be

[jira] [Commented] (TEZ-2216) Expose errors during AM initialization

[ https://issues.apache.org/jira/browse/TEZ-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389460#comment-14389460 ] Hadoop QA commented on TEZ-2216: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (TEZ-2216) Expose errors during AM initialization

[ https://issues.apache.org/jira/browse/TEZ-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389498#comment-14389498 ] Hitesh Shah commented on TEZ-2216: -- [~lichangleo] The problem stmt is as follows: The

[jira] [Commented] (TEZ-2216) Expose errors during AM initialization

[ https://issues.apache.org/jira/browse/TEZ-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389503#comment-14389503 ] Hitesh Shah commented on TEZ-2216: -- Obviously, there also needs to be special case handling

Failed: TEZ-2225 PreCommit Build #374

Jira: https://issues.apache.org/jira/browse/TEZ-2225 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/374/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2225) Remove instances of LOG.isDebugEnabled

[ https://issues.apache.org/jira/browse/TEZ-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389448#comment-14389448 ] Hadoop QA commented on TEZ-2225: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (TEZ-2259) Push additional data to Timeline for Recovery for better consumption in UI

[ https://issues.apache.org/jira/browse/TEZ-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389481#comment-14389481 ] Hitesh Shah commented on TEZ-2259: -- \cc [~zjffdu] Push additional data to Timeline for

[jira] [Created] (TEZ-2259) Push additional data to Timeline for Recovery for better consumption in UI

Hitesh Shah created TEZ-2259: Summary: Push additional data to Timeline for Recovery for better consumption in UI Key: TEZ-2259 URL: https://issues.apache.org/jira/browse/TEZ-2259 Project: Apache Tez

[jira] [Comment Edited] (TEZ-2259) Push additional data to Timeline for Recovery for better consumption in UI

[ https://issues.apache.org/jira/browse/TEZ-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389481#comment-14389481 ] Hitesh Shah edited comment on TEZ-2259 at 3/31/15 9:53 PM: --- \cc

[jira] [Comment Edited] (TEZ-2216) Expose errors during AM initialization

[ https://issues.apache.org/jira/browse/TEZ-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389321#comment-14389321 ] Chang Li edited comment on TEZ-2216 at 3/31/15 8:21 PM:

[jira] [Commented] (TEZ-2257) NPEs in TaskReporter

[ https://issues.apache.org/jira/browse/TEZ-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389399#comment-14389399 ] Hadoop QA commented on TEZ-2257: {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (TEZ-2257) NPEs in TaskReporter

Siddharth Seth created TEZ-2257: --- Summary: NPEs in TaskReporter Key: TEZ-2257 URL: https://issues.apache.org/jira/browse/TEZ-2257 Project: Apache Tez Issue Type: Bug Reporter:

[jira] [Commented] (TEZ-2231) Create project by-laws

[ https://issues.apache.org/jira/browse/TEZ-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389589#comment-14389589 ] Siddharth Seth commented on TEZ-2231: - Thanks bq. Could you explain? Maybe we should

[jira] [Commented] (TEZ-2258) Spurious logging if dag is not running when getDAGStatus is invoked.

[ https://issues.apache.org/jira/browse/TEZ-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389613#comment-14389613 ] Siddharth Seth commented on TEZ-2258: - Dupe of TEZ-1961 ? Spurious logging if dag is

[jira] [Resolved] (TEZ-2258) Spurious logging if dag is not running when getDAGStatus is invoked.

[ https://issues.apache.org/jira/browse/TEZ-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-2258. -- Resolution: Duplicate Spurious logging if dag is not running when getDAGStatus is invoked.