[jira] [Commented] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090426#comment-15090426 ] Hadoop QA commented on HDFS-9628: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9628: - Attachment: HDFS-9628.HDFS-8707.002.patch New patch: * made keys case-insensitive * fixed valgrind close h

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090396#comment-15090396 ] Hadoop QA commented on HDFS-9534: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090359#comment-15090359 ] Hadoop QA commented on HDFS-7101: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2016-01-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090348#comment-15090348 ] Ted Yu commented on HDFS-7101: -- Looks like the patch needs to be updated. > Potential null de

[jira] [Commented] (HDFS-9630) DistCp minor refactoring and clean up

2016-01-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090313#comment-15090313 ] Kai Zheng commented on HDFS-9630: - Thanks Zhe for the review! Your update looks all green!

[jira] [Commented] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090265#comment-15090265 ] Hadoop QA commented on HDFS-9522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090255#comment-15090255 ] Xiaobing Zhou commented on HDFS-9534: - The high level impl is the added removeStoragePo

[jira] [Updated] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9534: Status: Patch Available (was: Open) > Add CLI command to clear storage policy from a path. > ---

[jira] [Updated] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9534: Attachment: HDFS-9534.001.patch Posted patch V001, kindly review, thanks. > Add CLI command to clear

[jira] [Commented] (HDFS-9630) DistCp minor refactoring and clean up

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090238#comment-15090238 ] Hadoop QA commented on HDFS-9630: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-9493) Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk

2016-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090232#comment-15090232 ] Hudson commented on HDFS-9493: -- FAILURE: Integrated in Hadoop-trunk-Commit #9075 (See [https:

[jira] [Updated] (HDFS-9493) Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk

2016-01-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9493: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) +1.

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090163#comment-15090163 ] Hadoop QA commented on HDFS-9576: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9395) getContentSummary is audit logged as success even if failed

2016-01-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090132#comment-15090132 ] Kuhu Shukla commented on HDFS-9395: --- [~cmccabe], could you share any inputs you might hav

[jira] [Commented] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090131#comment-15090131 ] Kihwal Lee commented on HDFS-9631: -- bq. IOException in offerService java.io.EOFException:

[jira] [Commented] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090130#comment-15090130 ] James Clampffer commented on HDFS-9628: --- A couple comments, otherwise it looks good t

[jira] [Updated] (HDFS-9630) DistCp minor refactoring and clean up

2016-01-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9630: Attachment: HDFS-9630-v2.patch Thanks Kai! Patch LGTM except for the very minor new checkstyle issue. Attach

[jira] [Commented] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090111#comment-15090111 ] Xiao Chen commented on HDFS-9626: - Thank you Zhe for the review and commit! > TestBlockRep

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-01-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090085#comment-15090085 ] Anu Engineer commented on HDFS-1312: Hi [~andrew.wang], Thanks for you comments. Here

[jira] [Commented] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-01-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090071#comment-15090071 ] Zhe Zhang commented on HDFS-9621: - Thanks Jing for the fix. The patch LGTM. A nit on the Ja

[jira] [Updated] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9576: Attachment: HDFS-9576.05.patch Thanks Xiao! Updating patch to fix the checkstyle issue. > HTrace: collect po

[jira] [Commented] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089990#comment-15089990 ] Hudson commented on HDFS-9626: -- FAILURE: Integrated in Hadoop-trunk-Commit #9074 (See [https:

[jira] [Updated] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9626: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: P

[jira] [Updated] (HDFS-9626) TestBlockReplacement#testBlockReplacement fails occasionally

2016-01-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9626: Target Version/s: 2.8.0 Priority: Minor (was: Major) Component/s: test > TestBlockRepla

[jira] [Commented] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089940#comment-15089940 ] Wei-Chiu Chuang commented on HDFS-9631: --- Yes. Like this recent one: https://builds.a

[jira] [Updated] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9522: - Attachment: HDFS-9522-005.patch Patch 005: * Use subclass hierarchy instead of C-style tagged union for d

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089883#comment-15089883 ] Hadoop QA commented on HDFS-9627: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-01-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089877#comment-15089877 ] Andrew Wang commented on HDFS-1312: --- Hi Anu, some replies: bq. Generally administrators

[jira] [Commented] (HDFS-9631) Restarting namenode after deleting a directory with snapshot will fail

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089880#comment-15089880 ] Kihwal Lee commented on HDFS-9631: -- Do you have a test log with the failure? > Restarting

[jira] [Commented] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089862#comment-15089862 ] Hadoop QA commented on HDFS-9628: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089783#comment-15089783 ] Bob Hansen commented on HDFS-9627: -- +1 > libhdfs++: Add a mechanism to retrieve human rea

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Attachment: HDFS-9574.v3.br26.patch > Reduce client failures during datanode restart >

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Attachment: (was: HDFS-9574.v3.br26.patch) > Reduce client failures during datanode restart > -

[jira] [Updated] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9627: -- Attachment: HDFS-9627.HDFS-8707.001.patch -renamed headers to avoid conflict, left hdfs_ext in in

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9628: - Attachment: HDFS-9628.HDFS-8707.001.patch New patch: I double-checked that this one passes valgrind on my m

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089645#comment-15089645 ] Kihwal Lee commented on HDFS-9574: -- This is an important improvement for rolling upgrades.

[jira] [Resolved] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-9574. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.4 2.7.3

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Attachment: HDFS-9574.v3.br26.patch The 2.6 patch is identical to the 2.7 patch except, these two minor dif

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089638#comment-15089638 ] Hadoop QA commented on HDFS-9612: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089592#comment-15089592 ] Hadoop QA commented on HDFS-9628: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Attachment: HDFS-9612.006.patch Rev06: make javadocs happy. > DistCp worker threads are not term

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Attachment: HDFS-9574.v3.br27.patch The patch for branch-2.7 is not very different from the trunk/branch-2

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089560#comment-15089560 ] Hudson commented on HDFS-9574: -- FAILURE: Integrated in Hadoop-trunk-Commit #9073 (See [https:

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Status: Open (was: Patch Available) > Reduce client failures during datanode restart > ---

[jira] [Commented] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089557#comment-15089557 ] Hadoop QA commented on HDFS-9521: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089549#comment-15089549 ] Kihwal Lee commented on HDFS-9574: -- Committed to trunk, branch-2 and branch-2.8. branch-2.

[jira] [Comment Edited] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089536#comment-15089536 ] Kihwal Lee edited comment on HDFS-9574 at 1/8/16 5:11 PM: -- bq. DFS

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089536#comment-15089536 ] Kihwal Lee commented on HDFS-9574: -- bq. DFSInputStream: Instead of tracking the retryList

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089509#comment-15089509 ] Daryn Sharp commented on HDFS-9574: --- +1 Looks good, few suggestions if you think they wou

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9628: - Status: Patch Available (was: Open) > libhdfs++: Implement builder apis from C bindings >

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9628: - Attachment: HDFS-9628.HDFS-8707.000.patch Implemented C builder interface; added hdfspp.h for some extensio

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089463#comment-15089463 ] James Clampffer commented on HDFS-9627: --- Thanks [~bobhansen] for resubmitting the pat

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-01-08 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-9521: --- Status: Patch Available (was: In Progress) > TransferFsImage.receiveFile should accoun

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-01-08 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-9521: --- Status: In Progress (was: Patch Available) New patch version available > TransferFsIm

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089283#comment-15089283 ] Bob Hansen commented on HDFS-9627: -- Additional minor comment: the new method should be dec

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089282#comment-15089282 ] Bob Hansen commented on HDFS-9627: -- Additional minor comment: for consistency, we should m

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089277#comment-15089277 ] Kihwal Lee commented on HDFS-9574: -- The failed test cases all pass when run locally. {nofo

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-01-08 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-9521: --- Attachment: HDFS-9521.patch.1 New patch version including logging for combined time for

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Target Version/s: 2.7.3, 2.6.4 (was: 2.7.3) > Reduce client failures during datanode restart > ---

[jira] [Commented] (HDFS-9617) my java client use muti-thread to put a same file to a same hdfs uri, after no lease error,then client OutOfMemoryError

2016-01-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089245#comment-15089245 ] Kai Zheng commented on HDFS-9617: - Looks like you want to implement a files loading tool th

[jira] [Commented] (HDFS-9617) my java client use muti-thread to put a same file to a same hdfs uri, after no lease error,then client OutOfMemoryError

2016-01-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089226#comment-15089226 ] Kai Zheng commented on HDFS-9617: - Looking at your attached codes, you're crazily trying to

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089186#comment-15089186 ] Hadoop QA commented on HDFS-9624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9556: - Description: Include method to connect to defaultFS from configuration Summary: libhdfs++: pull Opti

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2016-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089150#comment-15089150 ] Junping Du commented on HDFS-8891: -- Thanks [~ajisakaa] and [~chris.douglas] for confirmati

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

2016-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089145#comment-15089145 ] Junping Du commented on HDFS-8767: -- Thank u, [~ajisakaa]! > RawLocalFileSystem.listStatus

[jira] [Updated] (HDFS-9632) libhdfs++: Add additional type-safe getters to the Configuration class

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9632: - Attachment: HDFS-9632.HDFS-8707.000.patch Patch: Initial cut of URI parsing. Still needs work, but wanted

[jira] [Created] (HDFS-9632) libhdfs++: Add additional type-safe getters to the Configuration class

2016-01-08 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9632: Summary: libhdfs++: Add additional type-safe getters to the Configuration class Key: HDFS-9632 URL: https://issues.apache.org/jira/browse/HDFS-9632 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089101#comment-15089101 ] Hadoop QA commented on HDFS-9627: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9627) libhdfs++: Add a mechanism to retrieve human readable error messages through the C API

2016-01-08 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9627: - Attachment: HDFS-9627.HDFS-8707.000.patch Resubmitting for yetus > libhdfs++: Add a mechanism to retrieve

[jira] [Updated] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-08 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9624: Attachment: HDFS-9624.004.patch [~drankye], thanks for comments. I refactor the testcases and update the late

[jira] [Commented] (HDFS-9522) Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088994#comment-15088994 ] Hadoop QA commented on HDFS-9522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-08 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daisuke Kobayashi updated HDFS-9455: Attachment: HDFS-9455.01.patch Thanks! Uploaded a patch as HDFS-9455.01.patch. This catches S

[jira] [Updated] (HDFS-9617) my java client use muti-thread to put a same file to a same hdfs uri, after no lease error,then client OutOfMemoryError

2016-01-08 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated HDFS-9617: -- Attachment: UploadProcess.java LoadThread.java HadoopLoader.java > my jav

[jira] [Commented] (HDFS-9617) my java client use muti-thread to put a same file to a same hdfs uri, after no lease error,then client OutOfMemoryError

2016-01-08 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088936#comment-15088936 ] zuotingbing commented on HDFS-9617: --- Looking forward to your reply, I am very grateful fo

[jira] [Updated] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-08 Thread Archana T (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Archana T updated HDFS-9455: Assignee: Daisuke Kobayashi (was: Archana T) > In distcp, Invalid Argument Error thrown in case of filesyste

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8891: Affects Version/s: 2.7.1 > HDFS concat should keep srcs order > -- >

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-08 Thread Archana T (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088929#comment-15088929 ] Archana T commented on HDFS-9455: - Hi [~daisuke.kobayashi] I agee with the above proposal.

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8891: Target Version/s: (was: 2.6.4) Thanks Chris. Removing target version 2.6.4. > HDFS concat should k

[jira] [Commented] (HDFS-9617) my java client use muti-thread to put a same file to a same hdfs uri, after no lease error,then client OutOfMemoryError

2016-01-08 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088923#comment-15088923 ] zuotingbing commented on HDFS-9617: --- I do not use "FileSystem get(final URI uri, final Co

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2016-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088915#comment-15088915 ] Chris Douglas commented on HDFS-8891: - Akira is right; this isn't in 2.6 > HDFS concat

[jira] [Commented] (HDFS-9455) In distcp, Invalid Argument Error thrown in case of filesystem operation failure

2016-01-08 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088906#comment-15088906 ] Daisuke Kobayashi commented on HDFS-9455: - Thanks Yongjun for correcting me! Indeed

[jira] [Commented] (HDFS-9617) my java client use muti-thread to put a same file to a same hdfs uri, after no lease error,then client OutOfMemoryError

2016-01-08 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088904#comment-15088904 ] zuotingbing commented on HDFS-9617: --- Thank you for your reply. my client code : 【main c

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8891: Attachment: HDFS-8891-test-only-branch-2.6.patch The regression test passes in branch-2.6. Attaching

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088891#comment-15088891 ] Akira AJISAKA commented on HDFS-8891: - bq. shall we cherry-pick this fix to 2.6.4 as we

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088877#comment-15088877 ] Kai Zheng commented on HDFS-9624: - Thanks Yiqun for the update! Is it possible to refactor

[jira] [Updated] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8767: Fix Version/s: 2.6.4 > RawLocalFileSystem.listStatus() returns null for UNIX pipefile > -

[jira] [Updated] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8767: Attachment: HDFS-8767-branch-2.6.patch Cherry-picked this to branch-2.6. I ran the regression test in

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088870#comment-15088870 ] Hadoop QA commented on HDFS-8562: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||