[jira] [Updated] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9451: -- Attachment: HDFS-9451.002.patch Removed unit tests that broken due to HADOOP-12294. > TestFsPer

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023926#comment-15023926 ] Wei-Chiu Chuang commented on HDFS-9451: --- TestPermission#testBackwardCompatibility is

[jira] [Commented] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023922#comment-15023922 ] Hudson commented on HDFS-9423: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1443 (See [https://

[jira] [Commented] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023918#comment-15023918 ] Hudson commented on HDFS-9423: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2652 (See [htt

[jira] [Commented] (HDFS-5165) Remove the TotalFiles metrics

2015-11-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023888#comment-15023888 ] Akira AJISAKA commented on HDFS-5165: - Thanks [~wheat9] for the comment. Removed the do

[jira] [Updated] (HDFS-5165) Remove the TotalFiles metrics

2015-11-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5165: Summary: Remove the TotalFiles metrics (was: FSNameSystem TotalFiles and FilesTotal metrics are the

[jira] [Updated] (HDFS-5165) FSNameSystem TotalFiles and FilesTotal metrics are the same

2015-11-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5165: Labels: metrics newbie (was: BB2015-05-TBR metrics newbie) Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-5165) FSNameSystem TotalFiles and FilesTotal metrics are the same

2015-11-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5165: Attachment: HDFS-5165.3.patch > FSNameSystem TotalFiles and FilesTotal metrics are the same > ---

[jira] [Commented] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023882#comment-15023882 ] Hudson commented on HDFS-9423: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #721 (See [htt

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023872#comment-15023872 ] Hadoop QA commented on HDFS-9442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023871#comment-15023871 ] Hadoop QA commented on HDFS-9438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023847#comment-15023847 ] Hudson commented on HDFS-9423: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #710 (See

[jira] [Commented] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023826#comment-15023826 ] Hudson commented on HDFS-9423: -- FAILURE: Integrated in Hadoop-trunk-Commit #8870 (See [https:

[jira] [Commented] (HDFS-9441) Do not construct path string when choosing block placement targets

2015-11-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023779#comment-15023779 ] Uma Maheswara Rao G commented on HDFS-9441: --- [~kihwal] are you ok with it? > Do

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023778#comment-15023778 ] Rakesh R commented on HDFS-9433: Thank you [~umamaheswararao] for reviewing and committing

[jira] [Resolved] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

2015-11-23 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo resolved HDFS-8704. - Resolution: Cannot Reproduce > Erasure Coding: client fails to write large file when one datanode fails > -

[jira] [Commented] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023744#comment-15023744 ] Anu Engineer commented on HDFS-9420: Thanks for the review and committing this patch.

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Status: Patch Available (was: Reopened) Uploaded the 2nd patch > TestPipelinesFailover assumes Linux ifco

[jira] [Reopened] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HDFS-9438: -- I probably should not have clicked "Resolve Issue" because the 2nd patch still needs to be tested. > TestPi

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023731#comment-15023731 ] Hudson commented on HDFS-9433: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2651 (See [htt

[jira] [Updated] (HDFS-9297) Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9297: -- Component/s: (was: HDFS) > Update TestBlockMissingException to use > corruptBlockOnD

[jira] [Updated] (HDFS-9238) Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9238: -- Component/s: (was: HDFS) > Update TestFileCreation#testLeaseExpireHardLimit() to avoi

[jira] [Updated] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9331: -- Component/s: (was: HDFS) > Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to acco

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023721#comment-15023721 ] Hudson commented on HDFS-9433: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1442 (See [https://

[jira] [Updated] (HDFS-9190) VolumeScanner throwing NPE while scanning suspect block.

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9190: -- Component/s: (was: HDFS) datanode > VolumeScanner throwing NPE while

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8674: -- Component/s: (was: HDFS) namenode > Improve performance of postponed

[jira] [Updated] (HDFS-8431) hdfs crypto class not found in Windows

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8431: -- Component/s: (was: HDFS) scripts > hdfs crypto class not found in Wi

[jira] [Updated] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8564: -- Component/s: (was: HDFS) > BlockPoolSlice.checkDirs() will trigger excessive IO while

[jira] [Updated] (HDFS-8012) Updatable HAR Filesystem

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8012: -- Component/s: (was: HDFS) > Updatable HAR Filesystem > > >

[jira] [Updated] (HDFS-8012) Updatable HAR Filesystem

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8012: -- Component/s: (was: datanode) fs > Updatable HAR Filesystem > ---

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9083: -- Component/s: (was: HDFS) > Replication violates block placement policy. > ---

[jira] [Commented] (HDFS-8662) In failover state, HDFS commands fail on "Retrying connect to server:"

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023715#comment-15023715 ] Tsz Wo Nicholas Sze commented on HDFS-8662: --- {code} infinity2:~ # su hdfs -c "hdf

[jira] [Updated] (HDFS-8662) In failover state, HDFS commands fail on "Retrying connect to server:"

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8662: -- Component/s: (was: HDFS) > In failover state, HDFS commands fail on "Retrying connect

[jira] [Updated] (HDFS-8596) TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of "datanode" attribute

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8596: -- Component/s: (was: HDFS) datanode > TestDistributedFileSystem et al

[jira] [Updated] (HDFS-8555) Random read support on HDFS files using Indexed Namenode feature

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8555: -- Component/s: (was: HDFS) > Random read support on HDFS files using Indexed Namenode f

[jira] [Commented] (HDFS-8555) Random read support on HDFS files using Indexed Namenode feature

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023710#comment-15023710 ] Tsz Wo Nicholas Sze commented on HDFS-8555: --- > Currently Namenode does not provid

[jira] [Updated] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8562: -- Component/s: (was: HDFS) > HDFS Performance is impacted by FileInputStream Finalizer

[jira] [Updated] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8727: -- Component/s: (was: HDFS) > Allow using path style addressing for accessing the s3 end

[jira] [Resolved] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8727. --- Resolution: Not A Problem Fix Version/s: (was: 2.7.2) > Allow using path sty

[jira] [Reopened] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reopened HDFS-8727: --- Since no patch was committed, we should not resolve this as fixed. > Allow using path styl

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8470: -- Component/s: (was: HDFS) namenode > fsimage loading progress should

[jira] [Resolved] (HDFS-8464) hdfs namenode UI shows "Max Non Heap Memory" is -1 B

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8464. --- Resolution: Duplicate > hdfs namenode UI shows "Max Non Heap Memory" is -1 B >

[jira] [Updated] (HDFS-8464) hdfs namenode UI shows "Max Non Heap Memory" is -1 B

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8464: -- Component/s: (was: HDFS) namenode I believe this is the same as HADO

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023692#comment-15023692 ] Colin Patrick McCabe commented on HDFS-7060: I took another look at this, and i

[jira] [Updated] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9420: -- Resolution: Fixed Fix Version/s: HDFS-1312 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023682#comment-15023682 ] Colin Patrick McCabe commented on HDFS-8791: Thanks, [~ctrezzo]. I took a look

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-11-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.003.patch > Move block replication logic from BlockManager to a new class > Re

[jira] [Updated] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9420: -- Hadoop Flags: Reviewed Component/s: (was: HDFS) balancer & move

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023670#comment-15023670 ] Tsz Wo Nicholas Sze commented on HDFS-1312: --- Just have created a new branch HDFS-

[jira] [Commented] (HDFS-8335) FSNamesystem/FSDirStatAndListingOp getFileInfo and getListingInt construct FSPermissionChecker regardless of isPermissionEnabled()

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023668#comment-15023668 ] Hadoop QA commented on HDFS-8335: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023662#comment-15023662 ] Hudson commented on HDFS-9433: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #720 (See [htt

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Target Version/s: 3.0.0, 2.8.0, 2.7.3 (was: 3.0.0, 2.8.0) > WebHdfsFileSystem should retry reads according

[jira] [Updated] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9433: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: HDFS-7163-branch-2.7.004.patch HDFS-7163-branch-2.004.patch HDFS

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-23 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023654#comment-15023654 ] Walter Su commented on HDFS-6101: - Thanks for the update. bq. We should call cluster.setDat

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023651#comment-15023651 ] Hudson commented on HDFS-9433: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #709 (See

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Resolution: Fixed Status: Resolved (was: Patch Available) Use "/sbin/ifconfig" instead of "ifconfi

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Attachment: HDFS-9438-hdfs-9438.002.patch > TestPipelinesFailover assumes Linux ifconfig >

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023608#comment-15023608 ] Hudson commented on HDFS-9433: -- FAILURE: Integrated in Hadoop-trunk-Commit #8869 (See [https:

[jira] [Commented] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023602#comment-15023602 ] Uma Maheswara Rao G commented on HDFS-9433: --- +1. Patch looks good. Committing. >

[jira] [Commented] (HDFS-9454) Remove guava usage in the hdfs-client module

2015-11-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023600#comment-15023600 ] Andrew Wang commented on HDFS-9454: --- Have you considered just shading Guava? I've seen it

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023601#comment-15023601 ] Hadoop QA commented on HDFS-9438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HDFS-9423) Fix intermittent failure of TestEditLogTailer

2015-11-23 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-9423. - Resolution: Fixed Fix Version/s: (was: 2.8.0) 3.0.0 Target Versio

[jira] [Commented] (HDFS-7988) Replace usage of ExactSizeInputStream with LimitInputStream.

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023522#comment-15023522 ] Hudson commented on HDFS-7988: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2571 (See [https://

[jira] [Commented] (HDFS-7988) Replace usage of ExactSizeInputStream with LimitInputStream.

2015-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023488#comment-15023488 ] Hudson commented on HDFS-7988: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #633 (See [htt

[jira] [Updated] (HDFS-8335) FSNamesystem/FSDirStatAndListingOp getFileInfo and getListingInt construct FSPermissionChecker regardless of isPermissionEnabled()

2015-11-23 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated HDFS-8335: --- Attachment: HDFS-8335.3.patch [~wheat9] Rebased > FSNamesystem/FSDirStatAndListingOp getFileInfo and g

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023460#comment-15023460 ] Tsz Wo Nicholas Sze commented on HDFS-8704: --- Any update? > Erasure Coding: clien

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023447#comment-15023447 ] Mingliang Liu commented on HDFS-9438: - Agreed. Ignoring the test instead of failing is

[jira] [Updated] (HDFS-8293) Erasure Coding: test the retry logic of DFSStripedInputStream

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8293: -- Component/s: test > Erasure Coding: test the retry logic of DFSStripedInputStream > -

[jira] [Commented] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023438#comment-15023438 ] Anu Engineer commented on HDFS-9420: [~xiaobingo] Thanks for your review. From the disk

[jira] [Commented] (HDFS-8430) Erasure coding: update DFSClient.getFileChecksum() logic for stripe files

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023436#comment-15023436 ] Tsz Wo Nicholas Sze commented on HDFS-8430: --- What will be returned by getFileChec

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023431#comment-15023431 ] Hadoop QA commented on HDFS-9079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8415) Erasure coding: rotated parity placement (RAID5/6)

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023429#comment-15023429 ] Tsz Wo Nicholas Sze commented on HDFS-8415: --- What the tradeoffs do you mean? > E

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-11-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-9083: -- Fix Version/s: 2.6.3 +1. Committed it to branch-2.6. Thanks [~shahrs87]! > Replication violates block pl

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023416#comment-15023416 ] Hadoop QA commented on HDFS-9451: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9083) Replication violates block placement policy.

2015-11-23 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023403#comment-15023403 ] Rushabh S Shah commented on HDFS-9083: -- Hi [~sjlee0]: PFA the patch for branch-2.6. >

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-11-23 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9083: - Attachment: HDFS-9083-branch-2.6.patch Attaching patch for branch-2.6 > Replication violates block

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8287: -- Component/s: erasure-coding > DFSStripedOutputStream.writeChunk should not wait for writi

[jira] [Commented] (HDFS-9386) Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file

2015-11-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023387#comment-15023387 ] Zhe Zhang commented on HDFS-9386: - Unfortunately I haven't been able to reproduce this rece

[jira] [Commented] (HDFS-9386) Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file

2015-11-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023382#comment-15023382 ] Tsz Wo Nicholas Sze commented on HDFS-9386: --- Do you have a way to reproduce this?

[jira] [Commented] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023341#comment-15023341 ] Xiaobing Zhou commented on HDFS-9420: - Looks good as overall. Should the collection man

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023336#comment-15023336 ] Wei-Chiu Chuang commented on HDFS-9451: --- Hi [~wheat9] [~zxu] [~jlowe] [~lichangleo],

[jira] [Updated] (HDFS-9449) DiskBalancer : Add connectors

2015-11-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9449: --- Attachment: HDFS-9449.001.patch This patch adds connectors to the disk balancer. It has 2 connectors ,

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023316#comment-15023316 ] Hadoop QA commented on HDFS-9079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023306#comment-15023306 ] Wei-Chiu Chuang commented on HDFS-9438: --- Hi [~jzhuge] thanks for the patch and welcom

[jira] [Moved] (HDFS-9454) Remove guava usage in the hdfs-client module

2015-11-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai moved HADOOP-12592 to HDFS-9454: --- Key: HDFS-9454 (was: HADOOP-12592) Project: Hadoop HDFS (was: Hadoop

[jira] [Commented] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023305#comment-15023305 ] Hadoop QA commented on HDFS-9452: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023292#comment-15023292 ] Xiaoyu Yao commented on HDFS-8855: -- Thanks [~xiaobingo] for updating the patch. +1 for th

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Status: Patch Available (was: Open) > TestPipelinesFailover assumes Linux ifconfig > -

[jira] [Created] (HDFS-9453) Fix protobuf runtime warnings

2015-11-23 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9453: - Summary: Fix protobuf runtime warnings Key: HDFS-9453 URL: https://issues.apache.org/jira/browse/HDFS-9453 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9083) Replication violates block placement policy.

2015-11-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023284#comment-15023284 ] Sangjin Lee commented on HDFS-9083: --- Hi [~shahrs87], could you please create a patch for

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2015-11-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023269#comment-15023269 ] Sangjin Lee commented on HDFS-8676: --- Thanks for the reply [~kihwal]. Does this patch depe

[jira] [Updated] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9451: -- Status: Patch Available (was: Open) > TestFsPermission#testDeprecatedUmask is broken > -

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2015-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023239#comment-15023239 ] Hadoop QA commented on HDFS-3296: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9452: -- Status: Patch Available (was: Open) > libhdfs++ Fix memory stomp in OpenFileForRead. > -

[jira] [Updated] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9452: -- Attachment: HDFS-9452.HDFS-8707.000.patch Value of promise was being set before other other items

[jira] [Assigned] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-9451: - Assignee: Wei-Chiu Chuang > TestFsPermission#testDeprecatedUmask is broken > -

[jira] [Updated] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9451: -- Attachment: HDFS-9451.001.patch >From the description of HADOOP-12294, the behavior tested by the

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Attachment: HDFS-9438-hdfs-9438.001.patch > TestPipelinesFailover assumes Linux ifconfig >

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023225#comment-15023225 ] Xiao Chen commented on HDFS-9314: - Thanks [~mingma], good point on {{verifyBlockPlacement}}

  1   2   3   >