[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886632#action_12886632 ] Rodrigo Schmidt commented on HDFS-1094: --- Hairong, would you mind explaining how this

[jira] Updated: (HDFS-1288) start-all.sh / stop-all.sh does not seem to work with HDFS

[ https://issues.apache.org/jira/browse/HDFS-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HDFS-1288: Fix Version/s: 0.21.0 Priority: Blocker (was: Minor) start-all.sh / stop-all.sh does not seem to

[jira] Created: (HDFS-1292) Allow artifacts to be published to the staging Apache Nexus Maven Repository

Allow artifacts to be published to the staging Apache Nexus Maven Repository Key: HDFS-1292 URL: https://issues.apache.org/jira/browse/HDFS-1292 Project: Hadoop HDFS

[jira] Commented: (HDFS-1045) In secure clusters, re-login is necessary for https clients before opening connections

[ https://issues.apache.org/jira/browse/HDFS-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886681#action_12886681 ] Hudson commented on HDFS-1045: -- Integrated in Hadoop-Common-trunk #390 (See

[jira] Created: (HDFS-1293) Allow dfs.balance.bandwidthPerSec to be specified at invocation time for balancer

Allow dfs.balance.bandwidthPerSec to be specified at invocation time for balancer - Key: HDFS-1293 URL: https://issues.apache.org/jira/browse/HDFS-1293 Project: Hadoop

[jira] Commented: (HDFS-457) better handling of volume failure in Data Node storage

[ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886751#action_12886751 ] Uma Mahesh commented on HDFS-457: - Hi, checkDirs will throw null pointer exception.

[jira] Updated: (HDFS-1085) hftp read failing silently

[ https://issues.apache.org/jira/browse/HDFS-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1085: - Component/s: data-node (was: name-node) StreamFile is a

[jira] Created: (HDFS-1294) StreamFile is a datanode servlet but it is misplaced in the namenode package

StreamFile is a datanode servlet but it is misplaced in the namenode package Key: HDFS-1294 URL: https://issues.apache.org/jira/browse/HDFS-1294 Project: Hadoop HDFS

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886768#action_12886768 ] Tsz Wo (Nicholas), SZE commented on HDFS-1094: -- Here the assumption is,

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886771#action_12886771 ] Joydeep Sen Sarma commented on HDFS-1094: - @Rodrigo - how about using a term to

[jira] Commented: (HDFS-1287) Why TreeSet is used when collecting block information FSDataSet::getBlockReport

[ https://issues.apache.org/jira/browse/HDFS-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886774#action_12886774 ] Scott Carey commented on HDFS-1287: --- As a general rule, if you need an ordered set or map

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886783#action_12886783 ] Joydeep Sen Sarma commented on HDFS-1094: - regarding T and simulataneous failures:

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886797#action_12886797 ] Scott Carey commented on HDFS-1094: --- bq. I've had some general discussions with Dhruba

[jira] Updated: (HDFS-1045) In secure clusters, re-login is necessary for https clients before opening connections

[ https://issues.apache.org/jira/browse/HDFS-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1045: -- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886823#action_12886823 ] Rodrigo Schmidt commented on HDFS-1094: --- @Joydeep: Using a term to describe the groups

[jira] Resolved: (HDFS-1272) HDFS changes corresponding to rename of TokenStorage to Credentials

[ https://issues.apache.org/jira/browse/HDFS-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HDFS-1272. --- Fix Version/s: 0.22.0 Resolution: Fixed I just committed this. Thanks, Jitendra! HDFS

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886861#action_12886861 ] Joydeep Sen Sarma commented on HDFS-1094: - one can't have a different node-group for

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886867#action_12886867 ] Rodrigo Schmidt commented on HDFS-1094: --- I'm not sure I understand what you mean by

[jira] Updated: (HDFS-1023) Allow http server to start as regular principal if https principal not defined.

[ https://issues.apache.org/jira/browse/HDFS-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1023: -- Attachment: HDFS-1023-trunk.patch Trunk patch, straight forward port of Y20 version. Updates smooshed

[jira] Updated: (HDFS-1023) Allow http server to start as regular principal if https principal not defined.

[ https://issues.apache.org/jira/browse/HDFS-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1023: -- Status: Patch Available (was: Open) Affects Version/s: 0.22.0 Fix Version/s:

[jira] Updated: (HDFS-1289) Datanode secure mode is broken

[ https://issues.apache.org/jira/browse/HDFS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1289: -- Hadoop Flags: [Reviewed] Fix Version/s: 0.22.0 Affects Version/s: 0.22.0 +1 Datanode

[jira] Commented: (HDFS-1272) HDFS changes corresponding to rename of TokenStorage to Credentials

[ https://issues.apache.org/jira/browse/HDFS-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886886#action_12886886 ] Hudson commented on HDFS-1272: -- Integrated in Hadoop-Hdfs-trunk-Commit #337 (See

[jira] Updated: (HDFS-1289) Datanode secure mode is broken

[ https://issues.apache.org/jira/browse/HDFS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1289: -- Status: Resolved (was: Patch Available) Resolution: Fixed Test results are, once again,

[jira] Updated: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-599: - Attachment: HDFS-599.y20.patch y20 version of the patch Improve Namenode robustness by

[jira] Commented: (HDFS-1023) Allow http server to start as regular principal if https principal not defined.

[ https://issues.apache.org/jira/browse/HDFS-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886899#action_12886899 ] Devaraj Das commented on HDFS-1023: --- +1 Allow http server to start as regular principal

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886900#action_12886900 ] Konstantin Shvachko commented on HDFS-1094: --- Rodrigo, I understand now that you

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886903#action_12886903 ] Joydeep Sen Sarma commented on HDFS-1094: - my mental model is that a node group is a

[jira] Commented: (HDFS-1289) Datanode secure mode is broken

[ https://issues.apache.org/jira/browse/HDFS-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886919#action_12886919 ] Hudson commented on HDFS-1289: -- Integrated in Hadoop-Hdfs-trunk-Commit #338 (See

[jira] Updated: (HDFS-1033) In secure clusters, NN and SNN should verify that the remote principal during image and edits transfer

[ https://issues.apache.org/jira/browse/HDFS-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1033: -- Attachment: HDFS-1033-3.patch Updated patch with SNN fixes. Some lines had already been done by other

[jira] Updated: (HDFS-1033) In secure clusters, NN and SNN should verify that the remote principal during image and edits transfer

[ https://issues.apache.org/jira/browse/HDFS-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1033: -- Status: Patch Available (was: Open) submitting patch. In secure clusters, NN and SNN should verify

[jira] Updated: (HDFS-1007) HFTP needs to be updated to use delegation tokens

[ https://issues.apache.org/jira/browse/HDFS-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1007: - Attachment: HDFS-1007-1.patch patch for trunk includes: 1007-bugfix.patch

[jira] Updated: (HDFS-1007) HFTP needs to be updated to use delegation tokens

[ https://issues.apache.org/jira/browse/HDFS-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1007: - Status: Patch Available (was: Open) HFTP needs to be updated to use delegation tokens

[jira] Commented: (HDFS-1023) Allow http server to start as regular principal if https principal not defined.

[ https://issues.apache.org/jira/browse/HDFS-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886947#action_12886947 ] Hadoop QA commented on HDFS-1023: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Booth updated HDFS-918: --- Attachment: hdfs-918-branch20-append.patch Managed to get back to this. Rebased on branch-20-append. Fixed

[jira] Commented: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

[ https://issues.apache.org/jira/browse/HDFS-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886948#action_12886948 ] Suresh Srinivas commented on HDFS-1093: --- Comments: # General - try-catch block is not

[jira] Commented: (HDFS-1111) getCorruptFiles() should give some hint that the list is not complete

[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886963#action_12886963 ] Rodrigo Schmidt commented on HDFS-: --- Sanjay, Konstantin: Did I address all your

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886976#action_12886976 ] Joydeep Sen Sarma commented on HDFS-1094: - - Pick random rack r2 that is within R

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886979#action_12886979 ] Rodrigo Schmidt commented on HDFS-1094: --- @Konstantin: We have a script that calculates

[jira] Commented: (HDFS-1033) In secure clusters, NN and SNN should verify that the remote principal during image and edits transfer

[ https://issues.apache.org/jira/browse/HDFS-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886981#action_12886981 ] Hadoop QA commented on HDFS-1033: - -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1007) HFTP needs to be updated to use delegation tokens

[ https://issues.apache.org/jira/browse/HDFS-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886984#action_12886984 ] Hadoop QA commented on HDFS-1007: - -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886993#action_12886993 ] Joydeep Sen Sarma commented on HDFS-1094: - :-) - of course i meant a node group =