[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537407#comment-15537407 ] Arpit Agarwal commented on HDFS-10713: -- Thanks for the backport [~zhz]. > Throttle FsNameSystem lock

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537395#comment-15537395 ] Zhe Zhang commented on HDFS-10713: -- I backported this change to branch-2.7 since the original read/write

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526786#comment-15526786 ] Erik Krogen commented on HDFS-10713: [~arpitagarwal], I'm confident that my HDFS-10817 patch would not

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526626#comment-15526626 ] Arpit Agarwal commented on HDFS-10713: -- bq. Since HDFS-10817 and related JIRAs are adding some

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525118#comment-15525118 ] Hadoop QA commented on HDFS-10713: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524943#comment-15524943 ] Arpit Agarwal commented on HDFS-10713: -- +1 for the branch-2 patch, pending Jenkins. > Throttle

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524693#comment-15524693 ] Hudson commented on HDFS-10713: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10491 (See

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-22 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514601#comment-15514601 ] Hanisha Koneru commented on HDFS-10713: --- The junit tests pass locally. -

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505320#comment-15505320 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504738#comment-15504738 ] Chris Douglas commented on HDFS-10713: -- +0 on v11. Since HDFS-10817 and related JIRAs are adding some

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501335#comment-15501335 ] Arpit Agarwal commented on HDFS-10713: -- +1 for the v11 patch. I'll hold off committing for a couple

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500103#comment-15500103 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498130#comment-15498130 ] Arpit Agarwal commented on HDFS-10713: -- v10 patch lgtm. I think this block was left in by mistake in

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497756#comment-15497756 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497753#comment-15497753 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497173#comment-15497173 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497148#comment-15497148 ] Arpit Agarwal commented on HDFS-10713: -- Thanks for the updated patch Hanisha.

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495093#comment-15495093 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488784#comment-15488784 ] Andrew Wang commented on HDFS-10713: Thanks for working on this Hanisha. I had the same review comment

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488530#comment-15488530 ] Chris Douglas commented on HDFS-10713: -- Using a {{synchronized}} block after releasing the read lock

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-13 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488521#comment-15488521 ] Erik Krogen commented on HDFS-10713: One comment on this is that it would be ideal to change it to use

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-13 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488362#comment-15488362 ] Hanisha Koneru commented on HDFS-10713: --- The unit test TestDFSUpgradeWithHA fails intermittently.

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488329#comment-15488329 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488093#comment-15488093 ] Arpit Agarwal commented on HDFS-10713: -- +1 pending Jenkins. > Throttle FsNameSystem lock warnings >

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485124#comment-15485124 ] Arpit Agarwal commented on HDFS-10713: -- Also patch will have to be rebased since HDFS-10742 just

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485104#comment-15485104 ] Arpit Agarwal commented on HDFS-10713: -- Thanks [~hanishakoneru]. Few more comments: # Log statement

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475110#comment-15475110 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474750#comment-15474750 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-06 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468265#comment-15468265 ] Arpit Agarwal commented on HDFS-10713: -- Thanks for the updated patch [~hanishakoneru]. The read lock

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460191#comment-15460191 ] Hadoop QA commented on HDFS-10713: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459771#comment-15459771 ] Erik Krogen commented on HDFS-10713: In HDFS-10475 we hope to add more detailed metrics for which

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459759#comment-15459759 ] Mingliang Liu commented on HDFS-10713: -- {quote} If we just capture the longest lock held interval but

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456206#comment-15456206 ] Arpit Agarwal commented on HDFS-10713: -- Re capturing the thread stack every time we see a higher lock

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453832#comment-15453832 ] Hanisha Koneru commented on HDFS-10713: --- We can cache the thread's stackTrace and lock time and once

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-31 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453607#comment-15453607 ] Jing Zhao commented on HDFS-10713: -- bq. we have a look at the feasibility to expose this information to

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453359#comment-15453359 ] Mingliang Liu commented on HDFS-10713: -- {code:title=DFSConfigKeys.java} 414 // Threshold for

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15452881#comment-15452881 ] Arpit Agarwal commented on HDFS-10713: -- Also we can rename the config key to

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451986#comment-15451986 ] Arpit Agarwal commented on HDFS-10713: -- Thanks [~hanishakoneru]. The patch lgtm. The test case needs

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450964#comment-15450964 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449776#comment-15449776 ] Arpit Agarwal commented on HDFS-10713: -- Thanks for the patch [~hanishakoneru]. # We can do the

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447515#comment-15447515 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||