[jira] [Updated] (HDFS-6441) Add ability to exclude/include specific datanodes while balancing

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6441: Summary: Add ability to exclude/include specific datanodes while balancing (was: Add ability to

[jira] [Commented] (HDFS-6441) Add ability to exclude/include specific datanodes while balancing

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080551#comment-14080551 ] Hudson commented on HDFS-6441: -- FAILURE: Integrated in Hadoop-trunk-Commit #5990 (See

[jira] [Commented] (HDFS-6441) Add ability to exclude/include specific datanodes while balancing

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080557#comment-14080557 ] Arpit Agarwal commented on HDFS-6441: - +1 for the latest patch. I committed it to trunk

[jira] [Updated] (HDFS-3482) hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without arguments

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-3482: Target Version/s: 2.6.0 Fix Version/s: 2.6.0 Looks like this fix was never merged to

[jira] [Commented] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

2014-07-31 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080580#comment-14080580 ] Ming Ma commented on HDFS-6791: --- Use the following steps to repro: 1. Create a situation

[jira] [Updated] (HDFS-3482) hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without arguments

2014-07-31 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-3482: -- Target Version/s: (was: 2.6.0) hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified

[jira] [Updated] (HDFS-6441) Add ability to exclude/include specific datanodes while balancing

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6441: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Updated] (HDFS-6010) Make balancer able to balance data among specified servers

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6010: Resolution: Duplicate Status: Resolved (was: Patch Available) I am resolving this as a

[jira] [Commented] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080584#comment-14080584 ] Colin Patrick McCabe commented on HDFS-6786: I'm not aware of any real clusters

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080588#comment-14080588 ] Colin Patrick McCabe commented on HDFS-6784: Actually, I just looked at this

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-31 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080600#comment-14080600 ] Yi Liu commented on HDFS-6784: -- Hi Colin {quote} This patch adds a place where we hold the CRM

[jira] [Updated] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Attachment: HDFS-6794.02.patch Thanks for reviewing Nicholas. Updated patch with your feedback.

[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080603#comment-14080603 ] Arpit Agarwal commented on HDFS-6685: - Hi Nicholas, could you please rebase to trunk

[jira] [Comment Edited] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080603#comment-14080603 ] Arpit Agarwal edited comment on HDFS-6685 at 7/31/14 7:26 AM: --

[jira] [Commented] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-31 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080606#comment-14080606 ] Yi Liu commented on HDFS-6786: -- How about set the interval to a large value, 5 minutes or 15

[jira] [Commented] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-31 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080614#comment-14080614 ] Yi Liu commented on HDFS-6783: -- How about we distinguish these two kinds of rescan (triggered

[jira] [Updated] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-31 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6783: - Attachment: HDFS-6783.002.patch The new patch uses a simple approach to distinguish these two kinds of

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-07-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080636#comment-14080636 ] Steve Loughran commented on HDFS-6634: -- Maybe we should be publishing audit logs in

[jira] [Commented] (HDFS-6787) Remove duplicate code in FSDirectory#unprotectedConcat

2014-07-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080645#comment-14080645 ] Uma Maheswara Rao G commented on HDFS-6787: --- Make sense to me. +1 patch looks

[jira] [Commented] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080709#comment-14080709 ] Hadoop QA commented on HDFS-6794: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080720#comment-14080720 ] Hudson commented on HDFS-6570: -- FAILURE: Integrated in Hadoop-Yarn-trunk #629 (See

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080724#comment-14080724 ] Hudson commented on HDFS-4629: -- FAILURE: Integrated in Hadoop-Yarn-trunk #629 (See

[jira] [Commented] (HDFS-6441) Add ability to exclude/include specific datanodes while balancing

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080726#comment-14080726 ] Hudson commented on HDFS-6441: -- FAILURE: Integrated in Hadoop-Yarn-trunk #629 (See

[jira] [Commented] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080723#comment-14080723 ] Hudson commented on HDFS-6768: -- FAILURE: Integrated in Hadoop-Yarn-trunk #629 (See

[jira] [Updated] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-31 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6685: -- Attachment: h6685_20140731.patch h6685_20140731.patch: synced with trunk. Balancer

[jira] [Commented] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-31 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080758#comment-14080758 ] Tsz Wo Nicholas Sze commented on HDFS-6794: --- The new patch looks good. Please

[jira] [Commented] (HDFS-6783) Fix not really wait for rescan in HDFS CacheReplicationModitor

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080777#comment-14080777 ] Hadoop QA commented on HDFS-6783: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4929) [NNBench mark] Lease mismatch error when running with multiple mappers

2014-07-31 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-4929: --- Priority: Critical (was: Major) [NNBench mark] Lease mismatch error when running

[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080916#comment-14080916 ] Hadoop QA commented on HDFS-6685: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6441) Add ability to exclude/include specific datanodes while balancing

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080923#comment-14080923 ] Hudson commented on HDFS-6441: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1823 (See

[jira] [Commented] (HDFS-6441) Add ability to exclude/include specific datanodes while balancing

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080965#comment-14080965 ] Hudson commented on HDFS-6441: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1848 (See

[jira] [Commented] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080959#comment-14080959 ] Hudson commented on HDFS-6570: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1848 (See

[jira] [Commented] (HDFS-6768) Fix a few unit tests that use hard-coded port numbers

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080962#comment-14080962 ] Hudson commented on HDFS-6768: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1848 (See

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080963#comment-14080963 ] Hudson commented on HDFS-4629: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1848 (See

[jira] [Work started] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6793 started by Juan Yu. Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Attachment: HDFS-6793.patch this patch is for 2.5. Missing changes in HftpFileSystem when Reintroduce

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Status: Patch Available (was: In Progress) Missing changes in HftpFileSystem when Reintroduce dfs.http.port /

[jira] [Commented] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081036#comment-14081036 ] Hadoop QA commented on HDFS-6793: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081048#comment-14081048 ] Hadoop QA commented on HDFS-6793: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Attachment: HDFS-6793.patch Previous one is not generated properly. Missing changes in HftpFileSystem when

[jira] [Commented] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081062#comment-14081062 ] Yongjun Zhang commented on HDFS-6793: - Hi [~j...@cloudera.com], Thanks for the work

[jira] [Commented] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081069#comment-14081069 ] Yongjun Zhang commented on HDFS-6793: - One more, when uploading multiple versions of

[jira] [Updated] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6793: -- Attachment: HDFS-6793.branch2.patch Thanks for the review. I verified related unit test against branch 2.5.

[jira] [Commented] (HDFS-6793) Missing changes in HftpFileSystem when Reintroduce dfs.http.port / dfs.https.port in branch-2

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081076#comment-14081076 ] Hadoop QA commented on HDFS-6793: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-31 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081083#comment-14081083 ] Haohui Mai commented on HDFS-6757: -- bq. But we should be able to tell whether or not we're

[jira] [Updated] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-573: --- Attachment: HDFS-573.1.patch This patch gets the current trunk/branch-2 libhdfs source code compiling

[jira] [Updated] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-573: --- Status: Patch Available (was: Open) Porting libhdfs to Windows --

[jira] [Updated] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-573: --- Component/s: (was: hdfs-client) libhdfs Target Version/s: 3.0.0,

[jira] [Updated] (HDFS-4852) libhdfs documentation is out of date

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4852: Labels: docs libhdfs noob (was: docs noob) libhdfs documentation is out of date

[jira] [Assigned] (HDFS-4852) libhdfs documentation is out of date

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-4852: --- Assignee: Chris Nauroth libhdfs documentation is out of date

[jira] [Updated] (HDFS-4852) libhdfs documentation is out of date

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4852: Target Version/s: 3.0.0, 2.6.0 libhdfs documentation is out of date

[jira] [Resolved] (HDFS-2062) Create Jenkins job for HDFS native code

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-2062. - Resolution: Fixed Jenkins now builds and tests the native code during the pre-commit job. I

[jira] [Resolved] (HDFS-3227) Mavenise libhdfs tests

2014-07-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-3227. - Resolution: Fixed The sub-tasks of this appear to be all done. I'm resolving this. Mavenise

[jira] [Created] (HDFS-6796) Improving the argument check during balancer command line parsing

2014-07-31 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-6796: -- Summary: Improving the argument check during balancer command line parsing Key: HDFS-6796 URL: https://issues.apache.org/jira/browse/HDFS-6796 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6796) Improving the argument check during balancer command line parsing

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6796: --- Status: Patch Available (was: Open) Improving the argument check during balancer command line

[jira] [Updated] (HDFS-6796) Improving the argument check during balancer command line parsing

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6796: --- Attachment: HDFS-6796.patch The patch modifies the check to so that each iteration checks if there

[jira] [Commented] (HDFS-6796) Improving the argument check during balancer command line parsing

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081187#comment-14081187 ] Benoy Antony commented on HDFS-6796: [~szetszwo], [~arpitagarwal], could you please

[jira] [Commented] (HDFS-6451) NFS should not return NFS3ERR_IO for AccessControlException

2014-07-31 Thread Abhiraj Butala (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081223#comment-14081223 ] Abhiraj Butala commented on HDFS-6451: -- Thanks for your feedback [~brandonli]. I am

[jira] [Resolved] (HDFS-1455) Record DFS client/cli id with username/kerbros session token in audit log or hdfs client trace log

2014-07-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-1455. Resolution: Fixed kerb name is stored in audit log now. Closing as fixed. Record DFS

[jira] [Updated] (HDFS-1477) Make NameNode Reconfigurable.

2014-07-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1477: --- Fix Version/s: (was: 0.24.0) Make NameNode Reconfigurable.

[jira] [Updated] (HDFS-845) Balancer documentation should not be in javadoc

2014-07-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-845: -- Assignee: (was: Allen Wittenauer) Balancer documentation should not be in javadoc

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081250#comment-14081250 ] Colin Patrick McCabe commented on HDFS-6784: Ah. You're right, both cases are

[jira] [Updated] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6794: Attachment: HDFS-6794.03.patch markBlockAsCorrupt must handle the case of unknown storageInfo, so

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081258#comment-14081258 ] Yongjun Zhang commented on HDFS-6788: - HI Arpit, this is trying to address an important

[jira] [Created] (HDFS-6797) Misleading LayoutVersion information during data node upgrade

2014-07-31 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-6797: -- Summary: Misleading LayoutVersion information during data node upgrade Key: HDFS-6797 URL: https://issues.apache.org/jira/browse/HDFS-6797 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081260#comment-14081260 ] Andrew Wang commented on HDFS-6788: --- A few quick stylistic comments: * Extra newline in

[jira] [Updated] (HDFS-6797) Misleading LayoutVersion information during data node upgrade

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6797: --- Status: Patch Available (was: Open) Misleading LayoutVersion information during data node upgrade

[jira] [Updated] (HDFS-6797) Misleading LayoutVersion information during data node upgrade

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6797: --- Attachment: HDFS-6797.patch Attaching a patch which uses the new data node layout version instead of

[jira] [Updated] (HDFS-6797) Misleading LayoutVersion information during data node upgrade

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6797: --- Description: Before upgrade, data node version was -55. The new data node version remained at -55.

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081264#comment-14081264 ] Colin Patrick McCabe commented on HDFS-6784: bq. If modifyDirective is caling

[jira] [Commented] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081276#comment-14081276 ] Andrew Wang commented on HDFS-6786: --- The downside to increasing the rescan interval is

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081278#comment-14081278 ] Arpit Agarwal commented on HDFS-6788: - The reentrant behavior of ReentrantReadWriteLock

[jira] [Updated] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6783: --- Summary: Fix HDFS CacheReplicationMonitor rescan logic (was: Fix not really wait for

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081288#comment-14081288 ] Colin Patrick McCabe commented on HDFS-6757: Ah. I see what you're saying. We

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081296#comment-14081296 ] Hadoop QA commented on HDFS-6757: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6797) Misleading LayoutVersion information during data node upgrade

2014-07-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081335#comment-14081335 ] Arpit Agarwal commented on HDFS-6797: - +1 will commit this later today. Misleading

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081336#comment-14081336 ] Colin Patrick McCabe commented on HDFS-573: --- Thanks for looking at this, Chris.

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Stephen Bovy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081356#comment-14081356 ] Stephen Bovy commented on HDFS-573: --- Gentlemen, One thing to keep in mind, is that the

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-31 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081365#comment-14081365 ] Suresh Srinivas commented on HDFS-6482: --- [~cmccabe], does this patch change the

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-07-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081396#comment-14081396 ] Yongjun Zhang commented on HDFS-6788: - Thanks [~andrew.wang] and [~arpitagarwal] a lot

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081400#comment-14081400 ] Colin Patrick McCabe commented on HDFS-573: --- bq. One thing to keep in mind, is

[jira] [Updated] (HDFS-6634) inotify in HDFS

2014-07-31 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6634: --- Attachment: inotify-design.pdf Posted design doc. inotify in HDFS ---

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-31 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081427#comment-14081427 ] James Thomas commented on HDFS-6482: [~sureshms] No, during rollback the directory

[jira] [Updated] (HDFS-5226) Trash::moveToTrash doesn't work across multiple namespace

2014-07-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5226: --- Priority: Major (was: Blocker) Trash::moveToTrash doesn't work across multiple namespace

[jira] [Updated] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6783: --- Attachment: HDFS-6783.003.patch Fix HDFS CacheReplicationMonitor rescan logic

[jira] [Updated] (HDFS-4916) DataTransfer may mask the IOException during block transfering

2014-07-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4916: --- Priority: Critical (was: Blocker) DataTransfer may mask the IOException during block

[jira] [Updated] (HDFS-5185) DN fails to startup if one of the data dir is full

2014-07-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5185: --- Priority: Critical (was: Blocker) DN fails to startup if one of the data dir is full

[jira] [Commented] (HDFS-4901) Site Scripting and Phishing Through Frames in browseDirectory.jsp

2014-07-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081493#comment-14081493 ] Allen Wittenauer commented on HDFS-4901: At this point, there is unlikely to be

[jira] [Commented] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081502#comment-14081502 ] Colin Patrick McCabe commented on HDFS-6783: Hi Yi. I didn't like v2 of the

[jira] [Commented] (HDFS-6784) Avoid rescan twice in HDFS CacheReplicationMonitor for one FS Op if it calls setNeedsRescan multiple times.

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081506#comment-14081506 ] Colin Patrick McCabe commented on HDFS-6784: I thought about this a little

[jira] [Resolved] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-6786. Resolution: Not a Problem Fix potential issue of cache refresh interval

[jira] [Commented] (HDFS-6786) Fix potential issue of cache refresh interval

2014-07-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081513#comment-14081513 ] Colin Patrick McCabe commented on HDFS-6786: I agree with Andrew that a minimum

[jira] [Created] (HDFS-6798) Add test case for incorrect data node condition during balancing

2014-07-31 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-6798: -- Summary: Add test case for incorrect data node condition during balancing Key: HDFS-6798 URL: https://issues.apache.org/jira/browse/HDFS-6798 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6798) Add test case for incorrect data node condition during balancing

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6798: --- Attachment: HDFS-6798.patch The attached patch adds the unit test for HDFS-6364. Add test case for

[jira] [Updated] (HDFS-6798) Add test case for incorrect data node condition during balancing

2014-07-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6798: --- Status: Patch Available (was: Open) Add test case for incorrect data node condition during

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Stephen Bovy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081555#comment-14081555 ] Stephen Bovy commented on HDFS-573: --- Thanks, I am probably exposing my ignorance, so

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081569#comment-14081569 ] Hadoop QA commented on HDFS-573: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6796) Improving the argument check during balancer command line parsing

2014-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081571#comment-14081571 ] Hadoop QA commented on HDFS-6796: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

2014-07-31 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6791: -- Attachment: HDFS-6791.patch The patch keeps the node in DECOMMISSION_INPROGRESS state if the node becomes dead

[jira] [Updated] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

2014-07-31 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6791: -- Assignee: Ming Ma Status: Patch Available (was: Open) A block could remain under replicated if all of

  1   2   >