[jira] [Commented] (TEZ-3732) Reduce Object size of InputAttemptIdentifier and MapOutput for large jobs

[ https://issues.apache.org/jira/browse/TEZ-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013576#comment-16013576 ] Jonathan Eagles commented on TEZ-3732: -- [~gopalv], it will be interesting to print the jol internals

[jira] [Updated] (TEZ-3732) Reduce Object size of InputAttemptIdentifier and MapOutput for large jobs

[ https://issues.apache.org/jira/browse/TEZ-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3732: - Attachment: TEZ-3732.1.patch > Reduce Object size of InputAttemptIdentifier and MapOutput for large

[jira] [Commented] (TEZ-3732) Reduce Object size of InputAttemptIdentifier and MapOutput for large jobs

[ https://issues.apache.org/jira/browse/TEZ-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013558#comment-16013558 ] Gopal V commented on TEZ-3732: -- [~jeagles]: can you post a "jol internals" dump from the before/after? >

[jira] [Created] (TEZ-3732) Reduce Object size of InputAttemptIdentifier and MapOutput for large jobs

Jonathan Eagles created TEZ-3732: Summary: Reduce Object size of InputAttemptIdentifier and MapOutput for large jobs Key: TEZ-3732 URL: https://issues.apache.org/jira/browse/TEZ-3732 Project: Apache

[jira] [Commented] (TEZ-3701) UnorderedPartitionedKVWriter - issues with parallel Deflater usage, synchronousqueue in threadpool

[ https://issues.apache.org/jira/browse/TEZ-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013377#comment-16013377 ] TezQA commented on TEZ-3701: {color:green}+1 overall{color}. Here are the results of testing the latest

Success: TEZ-3701 PreCommit Build #2459

Jira: https://issues.apache.org/jira/browse/TEZ-3701 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2459/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3726) DeletionTracker's reflections instantiation should be simpler and generic.

[ https://issues.apache.org/jira/browse/TEZ-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3726: - Attachment: TEZ-3726.004.patch [~jlowe], added a brief javadoc and addressed other comments. Let me know if

[jira] [Commented] (TEZ-3726) DeletionTracker's reflections instantiation should be simpler and generic.

[ https://issues.apache.org/jira/browse/TEZ-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013142#comment-16013142 ] Jason Lowe commented on TEZ-3726: - Looks good overall, just some a small nit. DagContainerLauncher should

[jira] [Commented] (TEZ-3391) MR split file validation should be done in the AM

[ https://issues.apache.org/jira/browse/TEZ-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013138#comment-16013138 ] Rohini Palaniswamy commented on TEZ-3391: - Doing these two things will save couple of millis in each

[jira] [Commented] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case

[ https://issues.apache.org/jira/browse/TEZ-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013134#comment-16013134 ] Kuhu Shukla commented on TEZ-3723: -- Thanks [~jeagles] for the review. Committing this to master. >

[jira] [Comment Edited] (TEZ-3726) DeletionTracker's reflections instantiation should be simpler and generic.

[ https://issues.apache.org/jira/browse/TEZ-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013010#comment-16013010 ] Kuhu Shukla edited comment on TEZ-3726 at 5/16/17 9:18 PM: --- [~jlowe], patch with

[jira] [Resolved] (TEZ-3731) Add committer kshukla to Tez Team List

[ https://issues.apache.org/jira/browse/TEZ-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla resolved TEZ-3731. -- Resolution: Fixed Fix Version/s: 0.9.0 Committed to master. Thanks [~jeagles]. > Add committer

[jira] [Commented] (TEZ-3724) Tez UI on HTTP "corrects" HTTPS REST calls to HTTP

[ https://issues.apache.org/jira/browse/TEZ-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013049#comment-16013049 ] Sreenath Somarajapuram commented on TEZ-3724: - [~jeagles] Sorry for the delay. Existing

[jira] [Updated] (TEZ-3726) DeletionTracker's reflections instantiation should be simpler and generic.

[ https://issues.apache.org/jira/browse/TEZ-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3726: - Attachment: TEZ-3726.003.patch [~jlowe], path with additional changes from TEZ-3729 just to make the review

[jira] [Commented] (TEZ-3662) Vertex Duration in 0.9 Tez UI regression from 0.7

[ https://issues.apache.org/jira/browse/TEZ-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012961#comment-16012961 ] Sreenath Somarajapuram commented on TEZ-3662: - Thank you [~jeagles]. +1 LGTM > Vertex Duration

[jira] [Resolved] (TEZ-3729) Use a new abstract class for ContainerLauncher(s) that provide dagComplete() functionality

[ https://issues.apache.org/jira/browse/TEZ-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla resolved TEZ-3729. -- Resolution: Duplicate Closing as duplicate of TEZ-3726 where this considerably small patch will be

[jira] [Commented] (TEZ-3701) UnorderedPartitionedKVWriter - issues with parallel Deflater usage, synchronousqueue in threadpool

[ https://issues.apache.org/jira/browse/TEZ-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012905#comment-16012905 ] TezQA commented on TEZ-3701: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3701 PreCommit Build #2458

Jira: https://issues.apache.org/jira/browse/TEZ-3701 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2458/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Resolved] (TEZ-3725) Cleanup http connections and other unnecessary fields in DAG Deletion tracker classes.

[ https://issues.apache.org/jira/browse/TEZ-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla resolved TEZ-3725. -- Resolution: Fixed Fix Version/s: TEZ-3334 Committed to TEZ-3334 branch. Thanks [~jlowe] for the

Failed: TEZ-3723 PreCommit Build #2457

Jira: https://issues.apache.org/jira/browse/TEZ-3723 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2457/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case

[ https://issues.apache.org/jira/browse/TEZ-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012748#comment-16012748 ] TezQA commented on TEZ-3723: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3731) Add committer kshukla to Tez Team List

[ https://issues.apache.org/jira/browse/TEZ-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3731: - Attachment: TEZ-3731.001.patch Verified locally that the site page renders correctly. [~jeagles], Request

[jira] [Created] (TEZ-3731) Add committer kshukla to Tez Team List

Kuhu Shukla created TEZ-3731: Summary: Add committer kshukla to Tez Team List Key: TEZ-3731 URL: https://issues.apache.org/jira/browse/TEZ-3731 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case

[ https://issues.apache.org/jira/browse/TEZ-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3723: - Attachment: TEZ-3723.004.patch bq. unless this code is trying to ensure the old behavior is still valid.

[jira] [Commented] (TEZ-3725) Cleanup http connections and other unnecessary fields in DAG Deletion tracker classes.

[ https://issues.apache.org/jira/browse/TEZ-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012571#comment-16012571 ] Jason Lowe commented on TEZ-3725: - Thanks for updating the patch! +1 lgtm. > Cleanup http connections and

[jira] [Commented] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case

[ https://issues.apache.org/jira/browse/TEZ-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012558#comment-16012558 ] Jonathan Eagles commented on TEZ-3723: -- Couple of minor things I noticed this time around. # This

[jira] [Comment Edited] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case

[ https://issues.apache.org/jira/browse/TEZ-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012558#comment-16012558 ] Jonathan Eagles edited comment on TEZ-3723 at 5/16/17 3:12 PM: --- Couple of

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012451#comment-16012451 ] Rajesh Balamohan commented on TEZ-3709: --- Checked the patch. LGTM. +1. Corner case: For

[jira] [Commented] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case

[ https://issues.apache.org/jira/browse/TEZ-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012420#comment-16012420 ] Kuhu Shukla commented on TEZ-3723: -- Test failure is unrelated. Request for review/comments [~jeagles],

Failed: TEZ-3007 PreCommit Build #2456

Jira: https://issues.apache.org/jira/browse/TEZ-3007 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2456/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012090#comment-16012090 ] TezQA commented on TEZ-3007: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3007: --- Attachment: TEZ-3007.03.patch Adding copyright to the new test file. > Use AppFinalState.ENDED

[jira] [Commented] (TEZ-3691) Setup fetchers to use shared executor.

[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011938#comment-16011938 ] TezQA commented on TEZ-3691: {color:green}+1 overall{color}. Here are the results of testing the latest

Success: TEZ-3691 PreCommit Build #2455

Jira: https://issues.apache.org/jira/browse/TEZ-3691 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2455/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011931#comment-16011931 ] TezQA commented on TEZ-3007: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3007 PreCommit Build #2454

Jira: https://issues.apache.org/jira/browse/TEZ-3007 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2454/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3709) TezMerger is slow for high number of segments

[ https://issues.apache.org/jira/browse/TEZ-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011929#comment-16011929 ] Rajesh Balamohan commented on TEZ-3709: --- Sorry about the delay. Will review it today. > TezMerger is

[jira] [Updated] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3007: --- Attachment: TEZ-3007.02.patch Thanks [~sseth] * Addressed comments. * Adding a test case. >