[jira] [Commented] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-05-28 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563817#comment-14563817 ] Ambud Sharma commented on HDFS-8485: Was missing the key provider property. Tested and

[jira] [Resolved] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-05-28 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ambud Sharma resolved HDFS-8485. Resolution: Fixed Fix Version/s: 2.7.0 Transparent Encryption Fails to work with

[jira] [Updated] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-05-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8485: --- Fix Version/s: (was: 2.7.0) Transparent Encryption Fails to work with Yarn/MapReduce

[jira] [Reopened] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-05-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HDFS-8485: Transparent Encryption Fails to work with Yarn/MapReduce

[jira] [Resolved] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-05-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-8485. Resolution: Not A Problem Transparent Encryption Fails to work with Yarn/MapReduce

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

2015-05-28 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563825#comment-14563825 ] Kai Zheng commented on HDFS-8481: - Thanks Zhe for the patch. A comment: A decoder instance

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563827#comment-14563827 ] Hadoop QA commented on HDFS-8486: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563839#comment-14563839 ] Zhe Zhang commented on HDFS-8481: - Thanks Kai for the review. In the next rev I will create

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

2015-05-28 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563861#comment-14563861 ] Kai Zheng commented on HDFS-8481: - bq. maybe it can be created with the

[jira] [Updated] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: HDFS-8322.003.patch [~aw] Thanks a lot for this great suggestion. I updated the patch to

[jira] [Updated] (HDFS-8293) Erasure Coding: test the retry logic of DFSStripedInputStream

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8293: Parent Issue: HDFS-8031 (was: HDFS-7285) Erasure Coding: test the retry logic of DFSStripedInputStream

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563748#comment-14563748 ] Hadoop QA commented on HDFS-6440: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563791#comment-14563791 ] Andrew Wang commented on HDFS-8322: --- Hi Eddy, taking a first look now. At a high-level, I

[jira] [Commented] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-05-28 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563665#comment-14563665 ] Ambud Sharma commented on HDFS-8485: I have tried 2.7 and the error still exists

[jira] [Updated] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: HDFS-8322.003.patch [~aw] Thanks a lot for this great suggestion. I updated the patch to

[jira] [Commented] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

2015-05-28 Thread Ambud Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563670#comment-14563670 ] Ambud Sharma commented on HDFS-8485: I have tried 2.7 and the error still exists

[jira] [Updated] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8481: Attachment: HDFS-8481-HDFS-7285.02.patch Thanks Walter for reviewing! It's a great idea to separate out the

[jira] [Updated] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: HDFS-8322.003.patch [~aw] Thanks a lot for this great suggestion. I updated the patch to

[jira] [Updated] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: (was: HDFS-8322.003.patch) Display warning if hadoop fs -ls is showing the local

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

2015-05-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-8486: -- Attachment: HDFS-8486.patch After multiple iterations, this is simplest low-risk patch. The crucial

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

2015-05-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-8486: -- Status: Patch Available (was: Open) DN startup may cause severe data loss

[jira] [Updated] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

2015-05-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8407: --- Summary: hdfsListDirectory must set errno to 0 on success (was: libhdfs

[jira] [Commented] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563533#comment-14563533 ] Hudson commented on HDFS-8407: -- FAILURE: Integrated in Hadoop-trunk-Commit #7919 (See

[jira] [Updated] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

2015-05-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Updated] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8489: Initial patch with the following changes: # Converts {{BlockInfo}} to abstract class # Merge

[jira] [Updated] (HDFS-6440) Support more than 2 NameNodes

2015-05-28 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Yates updated HDFS-6440: -- Attachment: hdfs-6440-trunk-v6.patch New version, hopefully fixing the findbugs/checkstyle issues and

[jira] [Work started] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8489 started by Zhe Zhang. --- Subclass BlockInfo to represent contiguous blocks

[jira] [Updated] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

2015-05-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8407: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

2015-05-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563580#comment-14563580 ] Andrew Wang commented on HDFS-8401: --- bq. It's impractical to involve the administrator

[jira] [Updated] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8489: Attachment: HDFS-8489.00.patch Subclass BlockInfo to represent contiguous blocks

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

2015-05-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563399#comment-14563399 ] Colin Patrick McCabe commented on HDFS-8401: bq. Allow using memory features

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

2015-05-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563456#comment-14563456 ] Colin Patrick McCabe commented on HDFS-7923: I posted a new patch with some

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

2015-05-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563531#comment-14563531 ] Arpit Agarwal commented on HDFS-8401: - bq. The administrator simply set a list of files

[jira] [Created] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-05-28 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8493: Summary: Consolidate truncate() related implementation in a single class Key: HDFS-8493 URL: https://issues.apache.org/jira/browse/HDFS-8493 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8429) Avoid stuck threads if there is a fatal error in DomainSocketWatcher

2015-05-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Summary: Avoid stuck threads if there is a fatal error in DomainSocketWatcher (was:

[jira] [Updated] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

2015-05-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Summary: Avoid stuck threads if there is an error in DomainSocketWatcher that stops

[jira] [Commented] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563535#comment-14563535 ] Hudson commented on HDFS-8429: -- FAILURE: Integrated in Hadoop-trunk-Commit #7919 (See

[jira] [Commented] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564009#comment-14564009 ] Hadoop QA commented on HDFS-8489: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

2015-05-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564053#comment-14564053 ] Walter Su commented on HDFS-8481: - This is user's logic of calling pread. The {{buf}} is

[jira] [Commented] (HDFS-8336) Expose some administrative erasure coding operations to HdfsAdmin

2015-05-28 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564087#comment-14564087 ] Kai Zheng commented on HDFS-8336: - This idea looks good. How about adding EC schema related

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564125#comment-14564125 ] Hudson commented on HDFS-8443: -- FAILURE: Integrated in Hadoop-trunk-Commit #7923 (See

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

2015-05-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564151#comment-14564151 ] Rakesh R commented on HDFS-8450: Thanks a lot [~drankye] for the reviews. I will address

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2015-05-28 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564106#comment-14564106 ] Takuya Fukudome commented on HDFS-8198: --- I report the results I ran teragen and

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

2015-05-28 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564108#comment-14564108 ] Akira AJISAKA commented on HDFS-8443: - +1, committing this shortly. Document

[jira] [Updated] (HDFS-7609) startup used too much time to load edits

2015-05-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7609: -- Attachment: HDFS-7609-3.patch Jing, I agree with you. Here is the updated patch. startup used too much time to

[jira] [Commented] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563907#comment-14563907 ] Hudson commented on HDFS-8429: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #200 (See

[jira] [Commented] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563905#comment-14563905 ] Hudson commented on HDFS-8407: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #200 (See

[jira] [Assigned] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-05-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-8493: -- Assignee: Rakesh R Consolidate truncate() related implementation in a single class

[jira] [Commented] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-05-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564036#comment-14564036 ] Rakesh R commented on HDFS-8493: After talking with [~wheat9], I will work on this issue.

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

2015-05-28 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564043#comment-14564043 ] Sanjay Radia commented on HDFS-8401: Consider the following use case: one wants to

[jira] [Created] (HDFS-8495) Consolidate append() related implementation into a single class

2015-05-28 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8495: -- Summary: Consolidate append() related implementation into a single class Key: HDFS-8495 URL: https://issues.apache.org/jira/browse/HDFS-8495 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564052#comment-14564052 ] Hadoop QA commented on HDFS-8481: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

2015-05-28 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-8496: -- Summary: Calling stopWriter() with FSDatasetImpl lock held may block other threads Key: HDFS-8496 URL: https://issues.apache.org/jira/browse/HDFS-8496 Project: Hadoop

[jira] [Updated] (HDFS-8490) Typo in trace enabled log in WebHDFS exception handler

2015-05-28 Thread Archana T (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Archana T updated HDFS-8490: Status: Patch Available (was: Open) Typo in trace enabled log in WebHDFS exception handler

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

2015-05-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563895#comment-14563895 ] Andrew Wang commented on HDFS-7923: --- Neato patch Colin, this is a high-ish level review,

[jira] [Updated] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-05-28 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8494: - Description: It is necessary to remove hard-coded values inside NameNode configured in {{HdfsConstants}}.

[jira] [Commented] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563890#comment-14563890 ] Hadoop QA commented on HDFS-8322: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-05-28 Thread Kai Sasaki (JIRA)
Kai Sasaki created HDFS-8494: Summary: Remove hard-coded chunk size in favor of ECZone Key: HDFS-8494 URL: https://issues.apache.org/jira/browse/HDFS-8494 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

2015-05-28 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8443: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-6440) Support more than 2 NameNodes

2015-05-28 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Yates updated HDFS-6440: -- Attachment: hdfs-6440-trunk-v7.patch Ok, looks like didn't fix whitespace like I thought :-/ However,

[jira] [Commented] (HDFS-8254) In StripedDataStreamer, it is hard to tolerate datanode failure in the leading streamer

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563982#comment-14563982 ] Zhe Zhang commented on HDFS-8254: - Thanks Nicholas for the patch! Our initial design put

[jira] [Updated] (HDFS-8490) Typo in trace enabled log in WebHDFS exception handler

2015-05-28 Thread Archana T (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Archana T updated HDFS-8490: Attachment: HDFS-8490.patch Kindly review Typo in trace enabled log in WebHDFS exception handler

[jira] [Updated] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8489: Attachment: HDFS-8489.01.patch New patch to address fixbug issues and a bug in the copy constructor of

[jira] [Commented] (HDFS-8490) Typo in trace enabled log in WebHDFS exception handler

2015-05-28 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564187#comment-14564187 ] Tsuyoshi Ozawa commented on HDFS-8490: -- +1, pending for Jenkins. Typo in trace

[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564236#comment-14564236 ] Zhe Zhang commented on HDFS-7621: - Thanks Walter for the discussion. bq. Changes like

[jira] [Resolved] (HDFS-7545) [umbrella] Data striping support in HDFS client

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7545. - Resolution: Not A Problem Closing b/c of low activity. The incorporated tasks do not seem to need the

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-05-28 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564182#comment-14564182 ] Kai Sasaki commented on HDFS-8494: -- Current {{BlockInfoStriped}} does not keep

[jira] [Created] (HDFS-8497) ErasureCodingWorker fails to do decode work

2015-05-28 Thread Li Bo (JIRA)
Li Bo created HDFS-8497: --- Summary: ErasureCodingWorker fails to do decode work Key: HDFS-8497 URL: https://issues.apache.org/jira/browse/HDFS-8497 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-05-28 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8470: - Status: Patch Available (was: Open) Attached patch. Please review.. fsimage

[jira] [Commented] (HDFS-8471) Implement read block over HTTP/2

2015-05-28 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562373#comment-14562373 ] Duo Zhang commented on HDFS-8471: - {quote} It might make sense to move some of the code out

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds for codec calculation

2015-05-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562434#comment-14562434 ] Walter Su commented on HDFS-8481: - *A* decodeAndFillBuffer(..) has multiple functions, and

[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-05-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562357#comment-14562357 ] Zhe Zhang commented on HDFS-7621: - Sorry for coming to this review late. Again, the patch

[jira] [Commented] (HDFS-8431) hdfs crypto class not found in Windows

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562358#comment-14562358 ] Hudson commented on HDFS-8431: -- FAILURE: Integrated in Hadoop-trunk-Commit #7912 (See

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-05-28 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8470: - Summary: fsimage loading progress should update inode, delegation token and cache

[jira] [Updated] (HDFS-8476) quota can't limit the file which put before setting the storage policy

2015-05-28 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8476: -- Attachment: screenshot-1.png quota can't limit the file which put before setting the storage policy

[jira] [Commented] (HDFS-8476) quota can't limit the file which put before setting the storage policy

2015-05-28 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562441#comment-14562441 ] tongshiquan commented on HDFS-8476: --- Xiaoyu Yao, My cluster have 3 nodes, 2NN and 3DN, HA

[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-05-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562487#comment-14562487 ] Walter Su commented on HDFS-7621: - My changes to {{Dispatcher}} is smaller. The patch is

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-05-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562543#comment-14562543 ] Jing Zhao commented on HDFS-7609: - Thanks for sharing the thoughts, Ming! Totally agree

[jira] [Commented] (HDFS-8471) Implement read block over HTTP/2

2015-05-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562348#comment-14562348 ] Haohui Mai commented on HDFS-8471: -- Thanks for working on this. Some high level comments:

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-05-28 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8470: - Attachment: HDFS-8470.patch fsimage loading progress should update inode,

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-05-28 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8470: - Attachment: screenshot_after_fix.png fsimage loading progress should update

[jira] [Commented] (HDFS-7582) Enforce maximum number of ACL entries separately per access and default.

2015-05-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562468#comment-14562468 ] Vinayakumar B commented on HDFS-7582: - Failures are not related. Enforce maximum

[jira] [Updated] (HDFS-8431) hdfs crypto class not found in Windows

2015-05-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8431: Labels: encryption scripts windows (was: encryption windows) hdfs crypto class not found in

[jira] [Updated] (HDFS-8431) hdfs crypto class not found in Windows

2015-05-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8431: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-05-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8270: - Attachment: HDFS-8270.1.patch Attached an initial patch. Please review and provide feedback. create()

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds for codec calculation

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562551#comment-14562551 ] Hadoop QA commented on HDFS-8481: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8471) Implement read block over HTTP/2

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562561#comment-14562561 ] Hadoop QA commented on HDFS-8471: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8135) Remove the deprecated FSConstants class

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562671#comment-14562671 ] Hudson commented on HDFS-8135: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #211 (See

[jira] [Commented] (HDFS-8482) Rename BlockInfoContiguous to BlockInfo

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562670#comment-14562670 ] Hudson commented on HDFS-8482: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #211 (See

[jira] [Commented] (HDFS-8431) hdfs crypto class not found in Windows

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562669#comment-14562669 ] Hudson commented on HDFS-8431: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #211 (See

[jira] [Updated] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-05-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-3716: - Status: Patch Available (was: Open) Purger should remove stale fsimage ckpt files

[jira] [Commented] (HDFS-5033) Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562673#comment-14562673 ] Hudson commented on HDFS-5033: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #211 (See

[jira] [Updated] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-05-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-3716: - Attachment: HDFS-3716.1.patch Attached an initial patch to remove stale fsimage ckpt files . please

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-05-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8270: - Status: Patch Available (was: Open) create() always retried with hardcoded timeout when file already

[jira] [Updated] (HDFS-8336) Expose some administrative erasure coding operations to HdfsAdmin

2015-05-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-8336: -- Attachment: HDFS-8336-001.patch Attached simple patch to expose createErasureCodingZone

[jira] [Commented] (HDFS-8135) Remove the deprecated FSConstants class

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562753#comment-14562753 ] Hudson commented on HDFS-8135: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #941 (See

[jira] [Commented] (HDFS-8482) Rename BlockInfoContiguous to BlockInfo

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562752#comment-14562752 ] Hudson commented on HDFS-8482: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #941 (See

[jira] [Commented] (HDFS-5033) Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562756#comment-14562756 ] Hudson commented on HDFS-5033: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #941 (See

[jira] [Commented] (HDFS-8431) hdfs crypto class not found in Windows

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562751#comment-14562751 ] Hudson commented on HDFS-8431: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #941 (See

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562863#comment-14562863 ] Hadoop QA commented on HDFS-8270: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

  1   2   >