[jira] [Created] (HDFS-11060) make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable

2016-10-25 Thread Lantao Jin (JIRA)
Lantao Jin created HDFS-11060: - Summary: make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable Key: HDFS-11060 URL: https://issues.apache.org/jira/browse/HDFS-11060 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607648#comment-15607648 ] Kai Zheng commented on HDFS-10994: -- Thanks [~Sammi] for working on this. Would you fix so

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607451#comment-15607451 ] John Zhuge commented on HDFS-11043: --- It seems the {{connect}} in the following code retu

[jira] [Updated] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10935: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status: Resolve

[jira] [Commented] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607326#comment-15607326 ] Hudson commented on HDFS-10935: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607301#comment-15607301 ] Hadoop QA commented on HDFS-11051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607291#comment-15607291 ] Kai Zheng commented on HDFS-10935: -- Thanks [~jojochuang] for helping verify the fix. The

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607261#comment-15607261 ] Hudson commented on HDFS-11054: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11054: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10935: - Priority: Major (was: Critical) > TestFileChecksum fails in some cases >

[jira] [Updated] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10935: - Summary: TestFileChecksum fails in some cases (was: Java-based EC codec does not reconstruct blocks corre

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607207#comment-15607207 ] Arpit Agarwal commented on HDFS-11054: -- Whoa.. that's a lot of test failures and cert

[jira] [Updated] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11051: - Attachment: HDFS-11051.001.patch I make a code glance for the balancer tests and add the block-move timeou

[jira] [Updated] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11051: - Status: Patch Available (was: Open) > Test Balancer behavior when some block moves are slow > ---

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-10-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607096#comment-15607096 ] Konstantin Shvachko commented on HDFS-9500: --- Good find Erik. I agree we should de

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607081#comment-15607081 ] John Zhuge commented on HDFS-11043: --- Filed HDFS-11059 for the other failure. > TestWebH

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11043: -- Attachment: (was: HDFS-11043.001.patch) > TestWebHdfsTimeouts fails > - > >

[jira] [Created] (HDFS-11059) TestWebHdfsTimeouts fails due to null SocketTimeoutException

2016-10-25 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11059: - Summary: TestWebHdfsTimeouts fails due to null SocketTimeoutException Key: HDFS-11059 URL: https://issues.apache.org/jira/browse/HDFS-11059 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607072#comment-15607072 ] Xiaoyu Yao commented on HDFS-11001: --- Thanks [~anu] for the responses, below are some fol

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607041#comment-15607041 ] Manoj Govindassamy commented on HDFS-11058: --- * 'Mounted on' as the last column s

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607035#comment-15607035 ] Andrew Wang commented on HDFS-11058: Seems reasonable to me, though I'd prefer we put

[jira] [Commented] (HDFS-11023) I/O based throttling of DN replication work

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607010#comment-15607010 ] Andrew Wang commented on HDFS-11023: I looked at our existing replication controls in

[jira] [Updated] (HDFS-11023) I/O based throttling of DN replication work

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11023: --- Component/s: (was: erasure-coding) > I/O based throttling of DN replication work > ---

[jira] [Updated] (HDFS-11023) I/O based throttling of DN replication work

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11023: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > I/O based throttling o

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606955#comment-15606955 ] Xiaoyu Yao commented on HDFS-11005: --- Thanks [~arpitagarwal]/[~vagarychen] for the discus

[jira] [Commented] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606928#comment-15606928 ] Yiqun Lin commented on HDFS-11051: -- Hi [~zhz], I am ready to work on this. But before I d

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606922#comment-15606922 ] Manoj Govindassamy commented on HDFS-11058: --- Current {{df}} command behavior fo

[jira] [Assigned] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11051: Assignee: Yiqun Lin > Test Balancer behavior when some block moves are slow > -

[jira] [Reopened] (HDFS-11038) DiskBalancer: support running multiple commands under one setup of disk balancer

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reopened HDFS-11038: -- Reopened this ticket since HDFS-9462 will be deprecated in that some of work overlaps with Query co

[jira] [Commented] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606906#comment-15606906 ] Anu Engineer commented on HDFS-11001: - [~xyao] Thanks for a very detailed code review.

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606892#comment-15606892 ] Arpit Agarwal commented on HDFS-11005: -- [~vagarychen] just pointed out offline that u

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606884#comment-15606884 ] Xiaobing Zhou commented on HDFS-11055: -- Then, +1 the patch. Thanks. > Update log4j.p

[jira] [Commented] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606879#comment-15606879 ] Xiaobing Zhou commented on HDFS-11016: -- Thanks [~xyao], I will post a updated patch b

[jira] [Updated] (HDFS-11057) Implement 'df' for viewfs

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11057: -- Summary: Implement 'df' for viewfs (was: Implement 'df' for View) > Implement '

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606873#comment-15606873 ] Wei-Chiu Chuang commented on HDFS-11055: Thanks for review [~xiaobingo]. I think A

[jira] [Commented] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606869#comment-15606869 ] Xiaoyu Yao commented on HDFS-11016: --- The name looks similar and both use the same RPC ca

[jira] [Resolved] (HDFS-11057) Implement 'df' for View

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy resolved HDFS-11057. --- Resolution: Duplicate Assignee: Manoj Govindassamy > Implement 'df' for View

[jira] [Commented] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606870#comment-15606870 ] Xiaobing Zhou commented on HDFS-11050: -- Thank you for the work [~kihwal]. It looks go

[jira] [Created] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11058: - Summary: Implement 'hadoop fs -df' command for ViewFileSystem Key: HDFS-11058 URL: https://issues.apache.org/jira/browse/HDFS-11058 Project: Hadoop HDFS

[jira] [Issue Comment Deleted] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11055: --- Comment: was deleted (was: My bad. Should stick to INFO instead.) > Update log4j.properties f

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606859#comment-15606859 ] Wei-Chiu Chuang commented on HDFS-11055: My bad. Should stick to INFO instead. >

[jira] [Created] (HDFS-11057) Implement 'df' for View

2016-10-25 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11057: - Summary: Implement 'df' for View Key: HDFS-11057 URL: https://issues.apache.org/jira/browse/HDFS-11057 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606839#comment-15606839 ] Hadoop QA commented on HDFS-11054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606836#comment-15606836 ] Hadoop QA commented on HDFS-11047: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606833#comment-15606833 ] Xiaobing Zhou commented on HDFS-11055: -- Thanks [~jojochuang] for the work. The patch

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606816#comment-15606816 ] Xiaobing Zhou commented on HDFS-11054: -- Thanks [~vagarychen] for the fix. +1 the patc

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606794#comment-15606794 ] Xiaobing Zhou commented on HDFS-11047: -- Thanks [~jpallas]. I also did that check and

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606788#comment-15606788 ] Arpit Agarwal commented on HDFS-11005: -- Hi [~vagarychen], thanks for the fix. In the

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606777#comment-15606777 ] Joe Pallas commented on HDFS-11047: --- It looks like the directory scanner and one test ar

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606761#comment-15606761 ] Hadoop QA commented on HDFS-11054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606753#comment-15606753 ] Hadoop QA commented on HDFS-11055: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606738#comment-15606738 ] Wei-Chiu Chuang commented on HDFS-11056: This bug seems to be the root cause of HD

[jira] [Updated] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11056: --- Attachment: HDFS-11056.reproduce.patch Attach a unit test to reproduce the error. > Concurren

[jira] [Created] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11056: -- Summary: Concurrent append and read operations lead to checksum error Key: HDFS-11056 URL: https://issues.apache.org/jira/browse/HDFS-11056 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606729#comment-15606729 ] Hudson commented on HDFS-5684: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1067

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Description: DirectoryScanner does scan by deep copying FinalizedReplica. In a deployment with 50

[jira] [Updated] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11055: --- Attachment: HDFS-11055.001.patch Attach patch 001 > Update log4j.properties for httpfs to imp

[jira] [Updated] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11055: --- Status: Patch Available (was: Open) > Update log4j.properties for httpfs to imporve test logg

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Description: DirectoryScanner does scan by deep copying FinalizedReplica. In a deployment with 50

[jira] [Created] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11055: -- Summary: Update log4j.properties for httpfs to imporve test logging Key: HDFS-11055 URL: https://issues.apache.org/jira/browse/HDFS-11055 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5684: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606682#comment-15606682 ] Xiaobing Zhou commented on HDFS-11047: -- I posted patch v000, please kindly review it,

[jira] [Updated] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5684: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Annotate o.a.h.fs.viewfs.ViewFi

[jira] [Updated] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5684: -- Summary: Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting (was: o.a.h.fs.viewfs.V

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Attachment: HDFS-11047.000.patch > Remove deep copies of FinalizedReplica to alleviate heap consum

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Status: Patch Available (was: Open) > Remove deep copies of FinalizedReplica to alleviate heap co

[jira] [Commented] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606660#comment-15606660 ] Kuhu Shukla commented on HDFS-11050: [~kihwal], request for comments/review.Thanks a l

[jira] [Commented] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606656#comment-15606656 ] Andrew Wang commented on HDFS-5684: --- +1 LGTM, that failure looks like a flake. Will commi

[jira] [Commented] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606654#comment-15606654 ] Hadoop QA commented on HDFS-5684: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606653#comment-15606653 ] Xiao Chen commented on HDFS-10756: -- Thanks for revving. Patch looks good. Some comments

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11054: -- Attachment: HDFS-11054.002.patch Thanks [~xyao] for pointing out the spacing issue, fixed it in v002 pat

[jira] [Commented] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606637#comment-15606637 ] Hadoop QA commented on HDFS-11050: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606621#comment-15606621 ] Arpit Agarwal commented on HDFS-11054: -- +1 pending Jenkins. Thanks for the quick fix

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606623#comment-15606623 ] Xiaoyu Yao commented on HDFS-11054: --- Thanks [~arpitagarwal] for reporting the issue and

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11054: -- Status: Patch Available (was: Open) > Suppress verbose log message in BlockPlacementPolicyDefault > ---

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11054: -- Attachment: HDFS-11054.001.patch > Suppress verbose log message in BlockPlacementPolicyDefault > ---

[jira] [Updated] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11050: --- Attachment: HDFS-11050.002.patch Fixing test to not rely on stdout. > Change log level to 'warn' when

[jira] [Comment Edited] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606579#comment-15606579 ] Manoj Govindassamy edited comment on HDFS-5684 at 10/25/16 9:50 PM: -

[jira] [Created] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11054: Summary: Suppress verbose log message in BlockPlacementPolicyDefault Key: HDFS-11054 URL: https://issues.apache.org/jira/browse/HDFS-11054 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606579#comment-15606579 ] Manoj Govindassamy commented on HDFS-5684: -- * For now its used by tests only. We a

[jira] [Commented] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606571#comment-15606571 ] Hadoop QA commented on HDFS-11053: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606527#comment-15606527 ] Kihwal Lee edited comment on HDFS-11053 at 10/25/16 9:34 PM: -

[jira] [Updated] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-5684: - Attachment: HDFS-5684.02.patch > o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public me

[jira] [Commented] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606527#comment-15606527 ] Kihwal Lee commented on HDFS-11053: --- The check was added in the process of fixing HDFS-2

[jira] [Updated] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11053: -- Component/s: security namenode > Unnecessary superuser check in versionRequest() >

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606505#comment-15606505 ] Andrew Wang commented on HDFS-10999: Good finds Wei-chiu. Could you file JIRAs to fix

[jira] [Updated] (HDFS-10860) Switch HttpFS to use Jetty

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10860: --- Issue Type: New Feature (was: Improvement) > Switch HttpFS to use Jetty > --

[jira] [Commented] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606480#comment-15606480 ] Xiaoyu Yao commented on HDFS-11001: --- Thanks [~anu] for working on this. The patch looks

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606470#comment-15606470 ] Hadoop QA commented on HDFS-11031: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606451#comment-15606451 ] Hadoop QA commented on HDFS-11045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11053: -- Attachment: HDFS-11053.patch > Unnecessary superuser check in versionRequest() > ---

[jira] [Updated] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11053: -- Status: Patch Available (was: Open) > Unnecessary superuser check in versionRequest() > ---

[jira] [Assigned] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-11053: - Assignee: Kihwal Lee > Unnecessary superuser check in versionRequest() >

[jira] [Created] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11053: - Summary: Unnecessary superuser check in versionRequest() Key: HDFS-11053 URL: https://issues.apache.org/jira/browse/HDFS-11053 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-10-25 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606385#comment-15606385 ] Erik Krogen commented on HDFS-9500: --- The {{TestDiskspaceQuotaUpdate}} failure is unrelate

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11043: -- Status: In Progress (was: Patch Available) > TestWebHdfsTimeouts fails > - > >

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606343#comment-15606343 ] John Zhuge commented on HDFS-11043: --- Reproduced Andrew's case: expect "connect timed out

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606317#comment-15606317 ] Mingliang Liu commented on HDFS-11031: -- Checkstyle is fixed in new v3 patch and test

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15606316#comment-15606316 ] Hadoop QA commented on HDFS-9500: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu resolved HDFS-10638. -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 +1 . Thanks for the good work! I re-run th

  1   2   >