[jira] [Updated] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2016-06-14 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-10530: --- Description: This issue was found by [~tfukudom]. Under RS-DEFAULT-6-3-64k EC policy, 1. Create an EC file,

[jira] [Created] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2016-06-14 Thread GAO Rui (JIRA)
GAO Rui created HDFS-10530: -- Summary: BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy Key: HDFS-10530 URL: https://issues.apache.org/jira/browse/HDFS-10530

[jira] [Commented] (HDFS-9650) Problem is logging of "Redundant addStoredBlock request received"

2016-06-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331182#comment-15331182 ] Xiaoyu Yao commented on HDFS-9650: -- Thanks [~brahma] for the heads up. Yes, we do need to backport

[jira] [Updated] (HDFS-10529) Df reports incorrect usage when appending less than block size

2016-06-14 Thread Pranav Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Prakash updated HDFS-10529: -- Attachment: HDFS-10529.000.patch Attached is a patch that attempts to fix this. Currently when

[jira] [Created] (HDFS-10529) Df reports incorrect usage when appending less than block size

2016-06-14 Thread Pranav Prakash (JIRA)
Pranav Prakash created HDFS-10529: - Summary: Df reports incorrect usage when appending less than block size Key: HDFS-10529 URL: https://issues.apache.org/jira/browse/HDFS-10529 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-06-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-9530: -- Assignee: Brahma Reddy Battula > huge Non-DFS Used in hadoop 2.6.2 & 2.7.1 >

[jira] [Commented] (HDFS-9650) Problem is logging of "Redundant addStoredBlock request received"

2016-06-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331126#comment-15331126 ] Brahma Reddy Battula commented on HDFS-9650: [~frha],can't we close this as duplicate of

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Release Note: New fsck option

[jira] [Updated] (HDFS-9005) Provide configuration support for upgrade domain

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9005: -- Fix Version/s: (was: 2.8.0) 2.9.0 > Provide configuration support for upgrade domain >

[jira] [Comment Edited] (HDFS-10512) VolumeScanner may terminate to due NPE in DataNode.reportBadBlocks

2016-06-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330989#comment-15330989 ] Yiqun Lin edited comment on HDFS-10512 at 6/15/16 1:51 AM: --- The failed test

[jira] [Commented] (HDFS-10512) VolumeScanner may terminate to due NPE in DataNode.reportBadBlocks

2016-06-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330989#comment-15330989 ] Yiqun Lin commented on HDFS-10512: -- The failed test {{TestPendingInvalidateBlock }} was tracked by

[jira] [Updated] (HDFS-1312) Re-balance disks within a Datanode

2016-06-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-1312: --- Attachment: Architecture_and_test_update.pdf Update to disk balancer arch and test plan > Re-balance

[jira] [Commented] (HDFS-10527) libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings

2016-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330895#comment-15330895 ] Hadoop QA commented on HDFS-10527: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330899#comment-15330899 ] Hadoop QA commented on HDFS-9922: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330890#comment-15330890 ] Duo Zhang commented on HDFS-9924: - My concern is that, you can not tell people that hive is only compatible

[jira] [Updated] (HDFS-10520) DiskBalancer: Fix Checkstyle issues in test code

2016-06-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10520: Status: Patch Available (was: Open) > DiskBalancer: Fix Checkstyle issues in test code >

[jira] [Updated] (HDFS-10520) DiskBalancer: Fix Checkstyle issues in test code

2016-06-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10520: Status: Open (was: Patch Available) > DiskBalancer: Fix Checkstyle issues in test code >

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330867#comment-15330867 ] stack commented on HDFS-9924: - I see. Thank you. I see what you want now. You just need renames or you need

[jira] [Commented] (HDFS-10520) DiskBalancer: Fix Checkstyle issues in test code

2016-06-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330858#comment-15330858 ] Arpit Agarwal commented on HDFS-10520: -- +1 pending Jenkins. > DiskBalancer: Fix Checkstyle issues in

[jira] [Commented] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330845#comment-15330845 ] Hadoop QA commented on HDFS-10525: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10528) Add logging to successful standby checkpointing

2016-06-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330846#comment-15330846 ] Xiaoyu Yao commented on HDFS-10528: --- Plan to add a log entry after {{ lastCheckpointTime = now;}}. >

[jira] [Commented] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330824#comment-15330824 ] Xiao Chen commented on HDFS-7597: - I tried the patch on latest trunk, it still applies. Also tried to run

[jira] [Created] (HDFS-10528) Add logging to successful standby checkpointing

2016-06-14 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10528: - Summary: Add logging to successful standby checkpointing Key: HDFS-10528 URL: https://issues.apache.org/jira/browse/HDFS-10528 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330835#comment-15330835 ] Hadoop QA commented on HDFS-9016: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9922: --- Attachment: HDFS-9922-trunk-v3.patch V3 attached. # Fixed import issues in

[jira] [Comment Edited] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330715#comment-15330715 ] Xiaobing Zhou edited comment on HDFS-9924 at 6/14/16 10:12 PM: --- bq. In my

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330737#comment-15330737 ] Lei (Eddy) Xu commented on HDFS-9016: - +1, pending jenkins. Thanks Ming! > Display upgrade domain

[jira] [Comment Edited] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330715#comment-15330715 ] Xiaobing Zhou edited comment on HDFS-9924 at 6/14/16 10:01 PM: --- bq. In my

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330715#comment-15330715 ] Xiaobing Zhou commented on HDFS-9924: - bq. In my experience, a bunch of rigging (threads) for polling,

[jira] [Commented] (HDFS-10524) libhdfs++: Implement chmod and chown

2016-06-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330670#comment-15330670 ] James Clampffer commented on HDFS-10524: Just a couple minor things, everything looks solid

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-06-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330667#comment-15330667 ] Konstantin Shvachko commented on HDFS-10301: Colin, you seem to imply that I ignored some of

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330655#comment-15330655 ] Ashutosh Chauhan commented on HDFS-9924: We can use simple Future by making lots of calls in the

[jira] [Commented] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330646#comment-15330646 ] Chris Trezzo commented on HDFS-9922: Also, thank you [~mingma] for the review and help on unit tests!

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9922: --- Attachment: HDFS-9922-trunk-v2.patch V2 attached. # Spoke with [~mingma] offline and will not modify

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330637#comment-15330637 ] Uma Maheswara Rao G commented on HDFS-10473: {quote} We also need to consider other scenarios

[jira] [Updated] (HDFS-10527) libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings

2016-06-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10527: --- Status: Patch Available (was: Open) > libhdfs++: hdfsGetBlockLocations doesn't null

[jira] [Updated] (HDFS-10527) libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings

2016-06-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10527: --- Attachment: HDFS-10527.HDFS-8707.000.patch Attached fix. Not much to it. > libhdfs++:

[jira] [Commented] (HDFS-9758) libhdfs++: Implement Python bindings

2016-06-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330602#comment-15330602 ] James Clampffer commented on HDFS-9758: --- Sorry, didn't see this until now. Just a work in progress,

[jira] [Commented] (HDFS-10511) libhdfs++: make error returning mechanism consistent across all hdfs operations

2016-06-14 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330598#comment-15330598 ] Bob Hansen commented on HDFS-10511: --- Thanks, [~anatoli.shein]. A few more little places we should touch

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330596#comment-15330596 ] Zhe Zhang commented on HDFS-10473: -- Sure! > Allow only suitable storage policies to be set on striped

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330595#comment-15330595 ] Jing Zhao commented on HDFS-10473: -- Thanks for updating the patch, Uma. And thanks for the review, Zhe.

[jira] [Updated] (HDFS-10515) libhdfs++: Implement mkdirs, rmdir, rename, and remove

2016-06-14 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10515: - Attachment: HDFS-10515.HDFS-8707.001.patch Patch with fixed 1 files test > libhdfs++:

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330587#comment-15330587 ] Arpit Agarwal commented on HDFS-10473: -- Hi [~zhz], [~umamaheswararao], Can you please hold off

[jira] [Commented] (HDFS-10441) libhdfs++: HA namenode support

2016-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330585#comment-15330585 ] Hadoop QA commented on HDFS-10441: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-8715) Checkpoint node keeps throwing exception

2016-06-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8715. --- Resolution: Duplicate > Checkpoint node keeps throwing exception >

[jira] [Updated] (HDFS-10524) libhdfs++: Implement chmod and chown

2016-06-14 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10524: - Attachment: HDFS-10524.HDFS-8707.000.patch Patch is attached. Please review. > libhdfs++:

[jira] [Updated] (HDFS-10524) libhdfs++: Implement chmod and chown

2016-06-14 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10524: - Status: Patch Available (was: Open) > libhdfs++: Implement chmod and chown >

[jira] [Commented] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330503#comment-15330503 ] Colin Patrick McCabe commented on HDFS-10525: - +1. Thanks, [~xiaochen]. > Fix NPE in

[jira] [Commented] (HDFS-10505) OIV's ReverseXML processor should support ACLs

2016-06-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330492#comment-15330492 ] Colin Patrick McCabe commented on HDFS-10505: - Thanks for this, [~surendrasingh]. It's good

[jira] [Assigned] (HDFS-9650) Problem is logging of "Redundant addStoredBlock request received"

2016-06-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-9650: Assignee: Xiaoyu Yao > Problem is logging of "Redundant addStoredBlock request received" >

[jira] [Updated] (HDFS-10441) libhdfs++: HA namenode support

2016-06-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10441: --- Attachment: HDFS-10441.HDFS-8707.004.patch Rebase onto current HDFS-8707 + fix for HDFS-10527

[jira] [Created] (HDFS-10527) libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings

2016-06-14 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10527: -- Summary: libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings Key: HDFS-10527 URL: https://issues.apache.org/jira/browse/HDFS-10527

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016-4.patch Thanks Allen. Reload trunk patch. > Display upgrade domain information in fsck >

[jira] [Assigned] (HDFS-10441) libhdfs++: HA namenode support

2016-06-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-10441: -- Assignee: James Clampffer (was: Bob Hansen) > libhdfs++: HA namenode support >

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330173#comment-15330173 ] stack commented on HDFS-9924: - bq. There are multiple comments from both sides indicating that

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330163#comment-15330163 ] Zhe Zhang commented on HDFS-10473: -- Thanks Uma for the patch and Jing for the comments. The v3 patch

[jira] [Updated] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10473: - Hadoop Flags: Reviewed > Allow only suitable storage policies to be set on striped files >

[jira] [Comment Edited] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330153#comment-15330153 ] Xiao Chen edited comment on HDFS-10525 at 6/14/16 6:52 PM: --- Thanks [~cmccabe],

[jira] [Updated] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10525: - Attachment: HDFS-10525.02.patch Thanks [~cmccabe], good idea to have more logging to track this. Patch

[jira] [Commented] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330133#comment-15330133 ] Colin Patrick McCabe commented on HDFS-10525: - Thanks, [~xiaochen]. Can you add a

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330056#comment-15330056 ] Arpit Agarwal commented on HDFS-9924: - There are multiple comments from both sides indicating that

[jira] [Updated] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10525: - Attachment: HDFS-10525.01.patch Patch 1 to fix this in the capacity check. The check added in HDFS-9549

[jira] [Updated] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10525: - Status: Patch Available (was: Open) > Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap >

[jira] [Created] (HDFS-10526) libhdfs++: Add connect timeouts to async_connect calls

2016-06-14 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-10526: - Summary: libhdfs++: Add connect timeouts to async_connect calls Key: HDFS-10526 URL: https://issues.apache.org/jira/browse/HDFS-10526 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-06-14 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330013#comment-15330013 ] Jiayi Zhou commented on HDFS-10519: --- Maybe I got something wrong, but isn't the MetaRecoveryContext

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330008#comment-15330008 ] Allen Wittenauer commented on HDFS-9016: You'll need to re-upload the trunk patch. You can't

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016-branch-2-2.patch New branch-2 patch to fix checkstyle issues. > Display upgrade domain

[jira] [Commented] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329994#comment-15329994 ] Xiao Chen commented on HDFS-10525: -- An example stack trace is {noformat} 2016-06-13 15:20:32,769 INFO

[jira] [Created] (HDFS-10525) Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap

2016-06-14 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-10525: Summary: Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap Key: HDFS-10525 URL: https://issues.apache.org/jira/browse/HDFS-10525 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10505) OIV's ReverseXML processor should support ACLs

2016-06-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329928#comment-15329928 ] Surendra Singh Lilhore commented on HDFS-10505: --- Whitespace warnings are unrelated to this

[jira] [Commented] (HDFS-8046) Allow better control of getContentSummary

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329917#comment-15329917 ] Xiao Chen commented on HDFS-8046: - Thanks for the quick action Kihwal! > Allow better control of

[jira] [Resolved] (HDFS-10521) hdfs dfs -du -s / returns incorrect summary

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-10521. -- Resolution: Duplicate This was done during the time jira wasn't stable, so I ended up creating several

[jira] [Resolved] (HDFS-10522) hdfs dfs -du -s / may return incorrect summary

2016-06-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-10522. -- Resolution: Duplicate This was done during the time jira wasn't stable, so I ended up creating several

[jira] [Created] (HDFS-10524) libhdfs++: Implement chmod and chown

2016-06-14 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10524: Summary: libhdfs++: Implement chmod and chown Key: HDFS-10524 URL: https://issues.apache.org/jira/browse/HDFS-10524 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-10524) libhdfs++: Implement chmod and chown

2016-06-14 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reassigned HDFS-10524: Assignee: Anatoli Shein > libhdfs++: Implement chmod and chown >

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-06-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329706#comment-15329706 ] Kihwal Lee commented on HDFS-10519: --- How does it actually work? Can it replay the same edit log segment

[jira] [Commented] (HDFS-10515) libhdfs++: Implement mkdirs, rmdir, rename, and remove

2016-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329639#comment-15329639 ] Hadoop QA commented on HDFS-10515: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10515) libhdfs++: Implement mkdirs, rmdir, rename, and remove

2016-06-14 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10515: - Attachment: HDFS-10515.HDFS-8707.000.patch Patch is attached. Please review. > libhdfs++:

[jira] [Updated] (HDFS-10515) libhdfs++: Implement mkdirs, rmdir, rename, and remove

2016-06-14 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10515: - Status: Patch Available (was: Open) > libhdfs++: Implement mkdirs, rmdir, rename, and remove >

[jira] [Commented] (HDFS-8046) Allow better control of getContentSummary

2016-06-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329542#comment-15329542 ] Kihwal Lee commented on HDFS-8046: -- [~xiaochen], thanks for letting me know. I've cherry-picked the fix to

[jira] [Updated] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2016-06-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8581: - Fix Version/s: (was: 2.8.0) 2.6.5 2.7.3 > ContentSummary on /

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2016-06-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329502#comment-15329502 ] Kihwal Lee commented on HDFS-8581: -- Cherry-picked to branch-2.7 and branch-2.6. Thanks again for reporting

[jira] [Commented] (HDFS-10522) hdfs dfs -du -s / may return incorrect summary

2016-06-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329331#comment-15329331 ] Wei-Chiu Chuang commented on HDFS-10522: Is this the duplication of HDFS-10521? > hdfs dfs -du -s

[jira] [Commented] (HDFS-10413) Implement asynchronous listStatus for DistributedFileSystem

2016-06-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329298#comment-15329298 ] Steve Loughran commented on HDFS-10413: --- Can I note that from the perspective of S3a, using

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329291#comment-15329291 ] Steve Loughran commented on HDFS-9924: -- Stack. I said it, You don't need any other opinions :) >