[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2017-01-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797508#comment-15797508 ] Akira Ajisaka commented on HDFS-11180: -- Filed HDFS-11290 for tracking this issue. >

[jira] [Created] (HDFS-11290) TestFSNameSystemMBean should wait until the cache is cleared

2017-01-03 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-11290: Summary: TestFSNameSystemMBean should wait until the cache is cleared Key: HDFS-11290 URL: https://issues.apache.org/jira/browse/HDFS-11290 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10675) Datanode support to read from external stores.

2017-01-03 Thread Jiajia Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797485#comment-15797485 ] Jiajia Li commented on HDFS-10675: -- Hi, [~virajith], we are interested in this feature, t

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2017-01-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797465#comment-15797465 ] Akira Ajisaka commented on HDFS-11180: -- bq. I also found the reason that the test is

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

2017-01-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Status: Patch Available (was: Open) > [SPS]: Make SPS movement monitor timeouts confi

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

2017-01-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Attachment: HDFS-11289-HDFS-10285-00.patch Attached simple patch for making the mentio

[jira] [Updated] (HDFS-11289) [SPS] Make SPS movement monitor timeouts configurable

2017-01-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Summary: [SPS] Make SPS movement monitor timeouts configurable (was: Make SPS movemen

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

2017-01-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11289: --- Summary: [SPS]: Make SPS movement monitor timeouts configurable (was: [SPS] Make SPS

[jira] [Updated] (HDFS-6874) Add GET_BLOCK_LOCATIONS operation to HttpFS

2017-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6874: -- Description: GETFILEBLOCKLOCATIONS operation is missing in HttpFS, which is already supported in WebHDFS

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6874: -- Summary: Add GETFILEBLOCKLOCATIONS operation to HttpFS (was: Add GET_BLOCK_LOCATIONS operation to HttpFS

[jira] [Updated] (HDFS-11286) GETFILESTATUS, RENAME logic breaking due to incomplete path argument

2017-01-03 Thread Sampada Dehankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sampada Dehankar updated HDFS-11286: Description: We use ADLS to store customer data and to access the data from our containers 

[jira] [Commented] (HDFS-11286) GETFILESTATUS, RENAME logic breaking due to incomplete path argument

2017-01-03 Thread Sampada Dehankar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797272#comment-15797272 ] Sampada Dehankar commented on HDFS-11286: - We have the fix ready and currently it

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797163#comment-15797163 ] Weiwei Yang commented on HDFS-11156: Sure [~andrew.wang], I just uploaded the patch fo

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11156: --- Attachment: HDFS-11156-branch-2.01.patch > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796984#comment-15796984 ] Hudson commented on HDFS-11279: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11279: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status: Resol

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796906#comment-15796906 ] Xiaoyu Yao commented on HDFS-11279: --- Thanks [~hanishakoneru] for updating the patch. Pat

[jira] [Commented] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2017-01-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796899#comment-15796899 ] Xiaoyu Yao commented on HDFS-11194: --- TestHeartbeatHandling.java Line 60: is the 300_000

[jira] [Commented] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

2017-01-03 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796898#comment-15796898 ] Yuanbo Liu commented on HDFS-11284: --- [~umamaheswararao] Thanks for your response. {code}

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796829#comment-15796829 ] Jing Zhao commented on HDFS-11273: -- Thanks for the patch, [~hkoneru]! The patch looks goo

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2017-01-03 Thread Gang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796824#comment-15796824 ] Gang Xie commented on HDFS-7784: About the GC activities, the following is the gstat output

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2017-01-03 Thread Gang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796809#comment-15796809 ] Gang Xie commented on HDFS-7784: The hardware info: CPU: Intel(R) Xeon(R) CPU E5-2620 v3 @

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2017-01-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796804#comment-15796804 ] Kai Zheng commented on HDFS-7784: - OOO today for customer visit, please expect delayed resp

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2017-01-03 Thread Gang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796797#comment-15796797 ] Gang Xie commented on HDFS-7784: The JVM setting: -Xmx102400m -Xms102400m

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796738#comment-15796738 ] Brahma Reddy Battula commented on HDFS-11280: - As changes are only in hdfs-cli

[jira] [Commented] (HDFS-11218) Add option to skip open files during HDFS Snapshots

2017-01-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796734#comment-15796734 ] Manoj Govindassamy commented on HDFS-11218: --- We are working on design proposals.

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-11273: - Issue Type: Improvement (was: Bug) > Move TransferFsImage#doGetUrl function to a Util class > ---

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-11273: - Component/s: (was: hdfs) > Move TransferFsImage#doGetUrl function to a Util class > --

[jira] [Commented] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2017-01-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796663#comment-15796663 ] Xiaoyu Yao commented on HDFS-11194: --- Thanks [~arpitagarwal] for working on this and all

[jira] [Commented] (HDFS-11287) Storage class member storageDirs should be private to avoid unprotected access by derived classes

2017-01-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796624#comment-15796624 ] Hadoop QA commented on HDFS-11287: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796527#comment-15796527 ] Manoj Govindassamy edited comment on HDFS-9391 at 1/4/17 12:03 AM: --

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796571#comment-15796571 ] Hanisha Koneru commented on HDFS-11280: --- Verified that the following unit tests are

[jira] [Commented] (HDFS-11218) Add option to skip open files during HDFS Snapshots

2017-01-03 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796535#comment-15796535 ] churro morales commented on HDFS-11218: --- This seems quite useful. Are you guys work

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796527#comment-15796527 ] Manoj Govindassamy commented on HDFS-9391: -- >> For the EnteringMaintenanceNodes p

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796525#comment-15796525 ] Hadoop QA commented on HDFS-11279: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796463#comment-15796463 ] Manoj Govindassamy commented on HDFS-9391: -- sure, makes sense. will do this. > Up

[jira] [Comment Edited] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

2017-01-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796425#comment-15796425 ] Uma Maheswara Rao G edited comment on HDFS-11284 at 1/3/17 10:46 PM: ---

[jira] [Commented] (HDFS-11288) Manually allow block replication/deletion in Safe Mode

2017-01-03 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796435#comment-15796435 ] Esteban Gutierrez commented on HDFS-11288: -- I think the safe mode semantic should

[jira] [Created] (HDFS-11289) Make SPS movement monitor timeouts configurable

2017-01-03 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-11289: -- Summary: Make SPS movement monitor timeouts configurable Key: HDFS-11289 URL: https://issues.apache.org/jira/browse/HDFS-11289 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.

2017-01-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796425#comment-15796425 ] Uma Maheswara Rao G commented on HDFS-11284: HI [~yuanbo], Retry will not happ

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796417#comment-15796417 ] Hadoop QA commented on HDFS-11280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11287) Storage class member storageDirs should be private to avoid unprotected access by derived classes

2017-01-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11287: -- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Status

[jira] [Updated] (HDFS-11287) Storage class member storageDirs should be private to avoid unprotected access by derived classes

2017-01-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11287: -- Attachment: HDFS-11287.01.patch Attached v01 patch to address the following * Made Stora

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796369#comment-15796369 ] Zheng Shao commented on HDFS-11280: --- The Test Failures were caused by the calling of "co

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: (was: HDFS-11280.for.2.7.and.below.patch) > Allow WebHDFS to reuse HTTP connections to N

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.5.patch > Allow WebHDFS to reuse HTTP connections to NN >

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796316#comment-15796316 ] Hadoop QA commented on HDFS-11279: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796310#comment-15796310 ] Hadoop QA commented on HDFS-11280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796299#comment-15796299 ] Arpit Agarwal edited comment on HDFS-11282 at 1/3/17 9:56 PM: --

[jira] [Updated] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11282: - Attachment: metrics-rendered.png Thanks [~linyiqun]. Comments below. # The rendered table looks wr

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.7.and.below.patch > Allow WebHDFS to reuse HTTP connections to NN > ---

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Updated] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11279: -- Attachment: HDFS-11279.002.patch Thank you [~xyao] and [~liuml07]. I have removed the unused imp

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796224#comment-15796224 ] Mingliang Liu commented on HDFS-11279: -- {{import java.io.File;}} in DataNode seems un

[jira] [Commented] (HDFS-11288) Manually allow block replication/deletion in Safe Mode

2017-01-03 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796189#comment-15796189 ] Lukas Majercak commented on HDFS-11288: --- Will send a proposed change momentarily >

[jira] [Created] (HDFS-11288) Manually allow block replication/deletion in Safe Mode

2017-01-03 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-11288: - Summary: Manually allow block replication/deletion in Safe Mode Key: HDFS-11288 URL: https://issues.apache.org/jira/browse/HDFS-11288 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796134#comment-15796134 ] Xiaoyu Yao commented on HDFS-11279: --- Thanks [~hanishakoneru] for the update. +1 pending

[jira] [Created] (HDFS-11287) Storage class member storageDirs should be private to avoid unprotected access by derived classes

2017-01-03 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11287: - Summary: Storage class member storageDirs should be private to avoid unprotected access by derived classes Key: HDFS-11287 URL: https://issues.apache.org/jira/browse/HDF

[jira] [Updated] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11279: -- Attachment: HDFS-11279.001.patch Thank you [~xyao] for reviewing the patch. I have addressed you

[jira] [Resolved] (HDFS-4169) Add per-disk latency metrics to DataNode

2017-01-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-4169. -- Resolution: Duplicate Fix Version/s: 3.0.0-alpha2 Target Version/s: (was: ) > Add per-

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795967#comment-15795967 ] Haohui Mai commented on HDFS-11280: --- Any ideas why Jenkins is still happy? > Allow WebH

[jira] [Commented] (HDFS-4169) Add per-disk latency metrics to DataNode

2017-01-03 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795959#comment-15795959 ] Jitendra Nath Pandey commented on HDFS-4169: This seems to be a duplicate of HD

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795913#comment-15795913 ] Andrew Wang commented on HDFS-11156: Sorry about that, I've reverted the branch-2 patc

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795897#comment-15795897 ] Daryn Sharp commented on HDFS-11156: This broke branch-2 due to inner class accessing

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795843#comment-15795843 ] Ming Ma commented on HDFS-9391: --- Thanks Manoj. Yep let us keep the existing property as Eddy

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795771#comment-15795771 ] Hudson commented on HDFS-11156: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795742#comment-15795742 ] Xiaoyu Yao commented on HDFS-11279: --- Thanks [~hanishakoneru] for working on this. The pa

[jira] [Commented] (HDFS-11076) Add unit test for extended Acls

2017-01-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795720#comment-15795720 ] Chen Liang commented on HDFS-11076: --- I was not aware of the FSAclBaseTest, Thanks [~cnau

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11156: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status: Resolv

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795644#comment-15795644 ] Andrew Wang commented on HDFS-11156: Sorry for the delay, I was on vacation. +1 LGTM,

[jira] [Commented] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-01-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795630#comment-15795630 ] Andrew Wang commented on HDFS-11285: Hi [~cltlfcjin], that code wasn't removed by the

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2017-01-03 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795401#comment-15795401 ] Colin P. McCabe commented on HDFS-6994: --- Hi [~rvs], thanks for the note. It would be

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2017-01-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795396#comment-15795396 ] Kihwal Lee commented on HDFS-7784: -- [~xiegang112], when you have a chance to test the perf

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795189#comment-15795189 ] Hudson commented on HDFS-11280: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11280: Status: Patch Available (was: Reopened) Reverted as it's broken the testcases. > A

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11280: Fix Version/s: (was: 3.0.0-alpha2) (was: 2.7.4)

[jira] [Reopened] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reopened HDFS-11280: - > Allow WebHDFS to reuse HTTP connections to NN >

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-01-03 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-11170: Status: Patch Available (was: Open) > Add create API in filesystem public class to support assign parameter

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-01-03 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-11170: Attachment: HDFS-11170-00.patch This initial patch. Thanks [~Sammi] for the great help! > Add create API in

[jira] [Created] (HDFS-11286) GETFILESTATUS, RENAME logic breaking due to incomplete path argument

2017-01-03 Thread Sampada Dehankar (JIRA)
Sampada Dehankar created HDFS-11286: --- Summary: GETFILESTATUS, RENAME logic breaking due to incomplete path argument Key: HDFS-11286 URL: https://issues.apache.org/jira/browse/HDFS-11286 Project: Ha

[jira] [Commented] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15794776#comment-15794776 ] Hadoop QA commented on HDFS-11191: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-01-03 Thread Lantao Jin (JIRA)
Lantao Jin created HDFS-11285: - Summary: Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED) Key: HDFS-11285 URL: https://issues.apache.org/jira/browse/HD

[jira] [Updated] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11191: --- Attachment: HDFS-11191.04.patch > Datanode Capacity is misleading if the dfs.datanode.data.dir is conf