[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884068#comment-15884068 ] Jonathan Eagles commented on TEZ-3638: -- [~rajesh.balamohan], Found the below line is already printed as

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884062#comment-15884062 ] Rajesh Balamohan commented on TEZ-3638: --- Current log line can be at debug level with {}. Adding

[jira] [Updated] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3638: - Attachment: TEZ-3638.1.patch [~rajesh.balamohan], was wonder if we should log at debug, remove, or

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884029#comment-15884029 ] Jonathan Eagles commented on TEZ-3638: -- Not sure what info if any should be logged here. Posting patch

[jira] [Created] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3638: Summary: VertexImpl logs too much at info when removing tasks after auto-reduce parallelism Key: TEZ-3638 URL: https://issues.apache.org/jira/browse/TEZ-3638

Failed: TEZ-1526 PreCommit Build #2277

2017-02-24 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-1526 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2277/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2017-02-24 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883859#comment-15883859 ] TezQA commented on TEZ-1526: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-1526) LoadingCache for TezTaskID slow for large jobs

2017-02-24 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1526: - Attachment: TEZ-1526.6.patch > LoadingCache for TezTaskID slow for large jobs >

[jira] [Comment Edited] (TEZ-3625) Dag.getVertex should obtain a readlock

2017-02-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883486#comment-15883486 ] Siddharth Seth edited comment on TEZ-3625 at 2/24/17 8:54 PM: -- This change

[jira] [Updated] (TEZ-3625) Dag.getVertex should obtain a readlock

2017-02-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3625: Attachment: am_jstack > Dag.getVertex should obtain a readlock >

[jira] [Reopened] (TEZ-3625) Dag.getVertex should obtain a readlock

2017-02-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reopened TEZ-3625: - > Dag.getVertex should obtain a readlock > -- > >

[jira] [Commented] (TEZ-3625) Dag.getVertex should obtain a readlock

2017-02-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883486#comment-15883486 ] Siddharth Seth commented on TEZ-3625: - This change ended up resulting in a race and occasional deadlock

[jira] [Commented] (TEZ-3274) Vertex with MRInput and shuffle input does not respect slow start

2017-02-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883086#comment-15883086 ] Eric Badger commented on TEZ-3274: -- [~sseth], do you have any comments on the patch in its current state

[jira] [Commented] (TEZ-996) Support for fetching credentials for mapreduce.job.hdfs-servers

2017-02-24 Thread Denis Jannot (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882452#comment-15882452 ] Denis Jannot commented on TEZ-996: -- [~rohini] Is there a way to set this parameter from the Hive shell or on

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882355#comment-15882355 ] TezQA commented on TEZ-3637: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3637 PreCommit Build #2276

2017-02-24 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3637 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2276/ ### ## LAST 60 LINES OF THE CONSOLE ###

Failed: TEZ-3637 PreCommit Build #2275

2017-02-24 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3637 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2275/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882344#comment-15882344 ] TezQA commented on TEZ-3637: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882277#comment-15882277 ] Rajesh Balamohan commented on TEZ-3637: --- Can the stats size be 0 and lead to error during division (in

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882273#comment-15882273 ] TezQA commented on TEZ-3637: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3637 PreCommit Build #2274

2017-02-24 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3637 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2274/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3637: Attachment: TEZ-3637.02.patch Updated with some aggregates for in-memory fetches. > TezMerger logs

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882175#comment-15882175 ] Rajesh Balamohan commented on TEZ-3637: --- lgtm. +1. Minor comment (lastInMemSegmentLogTime can be moved