[jira] [Commented] (HDFS-16864) HDFS advisory caching should drop cache behind block when block closed

[ https://issues.apache.org/jira/browse/HDFS-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646155#comment-17646155 ] Dave Marion commented on HDFS-16864: FWIW, this patch applies cleanly to 3.3.5. Also,

[jira] [Commented] (HDFS-16864) HDFS advisory caching should drop cache behind block when block closed

[ https://issues.apache.org/jira/browse/HDFS-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645630#comment-17645630 ] Dave Marion commented on HDFS-16864: I don't think there is much risk here, the code

[jira] [Commented] (HDFS-16864) HDFS advisory caching should drop cache behind block when block closed

[ https://issues.apache.org/jira/browse/HDFS-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645420#comment-17645420 ] Dave Marion commented on HDFS-16864: [~ste...@apache.org] - not sure how far along yo

[jira] [Created] (HDFS-16864) HDFS advisory caching should drop cache behind block when block closed

Dave Marion created HDFS-16864: -- Summary: HDFS advisory caching should drop cache behind block when block closed Key: HDFS-16864 URL: https://issues.apache.org/jira/browse/HDFS-16864 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308009#comment-15308009 ] Dave Marion commented on HDFS-10370: bq. Secure mode daemons do not have the necessary

[jira] [Updated] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-10370: --- Attachment: HDFS-10370-branch-2.004.patch HDFS-10370.004.patch Updated patches for mas

[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15298674#comment-15298674 ] Dave Marion commented on HDFS-10370: Not yet, we are just starting to test this. I don

[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15298453#comment-15298453 ] Dave Marion commented on HDFS-10370: bq. Could you please update the patch? I'll

[jira] [Updated] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-10370: --- Attachment: HDFS-10370-3.patch > Allow DataNode to be started with numactl > -

[jira] [Updated] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-10370: --- Attachment: HDFS-10370-2.patch Tested locally by applying similar changes to 2.7.0. > Allow DataNode

[jira] [Assigned] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion reassigned HDFS-10370: -- Assignee: Dave Marion > Allow DataNode to be started with numactl > ---

[jira] [Updated] (HDFS-10370) Allow DataNode to be started with numactl

[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-10370: --- Attachment: HDFS-10370-1.patch Straw man patch, looking for feedback. > Allow DataNode to be started

[jira] [Created] (HDFS-10370) Allow DataNode to be started with numactl

Dave Marion created HDFS-10370: -- Summary: Allow DataNode to be started with numactl Key: HDFS-10370 URL: https://issues.apache.org/jira/browse/HDFS-10370 Project: Hadoop HDFS Issue Type: Improve

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963432#comment-14963432 ] Dave Marion commented on HDFS-8486: --- Thanks for the quick response! > DN startup may cau

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963431#comment-14963431 ] Dave Marion commented on HDFS-8486: --- Thanks for the quick response! > DN startup may cau

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963398#comment-14963398 ] Dave Marion commented on HDFS-8486: --- Does this also affect 2.5.0? If so, can someone prov

[jira] [Commented] (HDFS-3599) Better expose when under-construction files are preventing DN decommission

[ https://issues.apache.org/jira/browse/HDFS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904424#comment-14904424 ] Dave Marion commented on HDFS-3599: --- I have seen this issue in CDH 5.3.0, which is Hadoop

[jira] [Commented] (HDFS-8067) haadmin commands doesn't work in Federation with HA

[ https://issues.apache.org/jira/browse/HDFS-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14481233#comment-14481233 ] Dave Marion commented on HDFS-8067: --- You need to specify the nameservice with which you w

[jira] [Commented] (HDFS-1213) Implement an Apache Commons VFS Driver for HDFS

[ https://issues.apache.org/jira/browse/HDFS-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268685#comment-14268685 ] Dave Marion commented on HDFS-1213: --- FWIW, the current HDFS provider in Commons VFS is re

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267925#comment-14267925 ] Dave Marion commented on HDFS-1312: --- Note that as of 2.6.0 the layout has changed on the

[jira] [Commented] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14192123#comment-14192123 ] Dave Marion commented on HDFS-7278: --- [~cmccabe] Question regarding this new command. If I

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122879#comment-14122879 ] Dave Marion commented on HDFS-6376: --- Patch 11 appears to be working fine. I am happy with

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122241#comment-14122241 ] Dave Marion commented on HDFS-6376: --- [~jingzhao] Manually applied patch 11 to CDH 5.1.2 a

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115218#comment-14115218 ] Dave Marion commented on HDFS-6376: --- I was going to apply the latest patch to CDH 5.1.0,

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109992#comment-14109992 ] Dave Marion commented on HDFS-6376: --- I don't see an entry in hdfs-site.xml for this new p

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108157#comment-14108157 ] Dave Marion commented on HDFS-6376: --- bq. Currently DFSUtil#getOnlyNameServiceIdOrNull ret

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108155#comment-14108155 ] Dave Marion commented on HDFS-6376: --- bq. I think it might make more sense to explicitly s

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108150#comment-14108150 ] Dave Marion commented on HDFS-6376: --- It looks like some folks have picked this up and mov

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105586#comment-14105586 ] Dave Marion commented on HDFS-6376: --- Thanks for reviewing this. I thought this was dead a

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Open (was: Patch Available) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Patch Available (was: Open) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-7-trunk.patch Backed out changes to DFSUtil. > Distcp data between two HA cluster

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058686#comment-14058686 ] Dave Marion commented on HDFS-6376: --- I don't like the behavior of the change in DFSUtil i

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032610#comment-14032610 ] Dave Marion commented on HDFS-6376: --- ready for review. > Distcp data between two HA clus

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Patch Available (was: Open) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-6-trunk.patch Includes change to DFSUtils. > Distcp data between two HA clusters

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Open (was: Patch Available) Realized that I need to make a change in DFSUtil also. > Distcp da

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015367#comment-14015367 ] Dave Marion commented on HDFS-6376: --- Test failed due to read timeout on socket. Don't thi

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Patch Available (was: Open) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-5-trunk.patch New patch against trunk > Distcp data between two HA clusters requi

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Target Version/s: 3.0.0, 2.5.0 (was: 3.0.0) > Distcp data between two HA clusters requires another conf

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Fix Version/s: (was: 2.4.1) 3.0.0 > Distcp data between two HA clusters requires

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Target Version/s: 3.0.0 (was: 2.4.1) > Distcp data between two HA clusters requires another configurati

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Open (was: Patch Available) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Open (was: Patch Available) forgot --no-prefix in patch 3 > Distcp data between two HA cluster

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Patch Available (was: Open) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-4-branch-2.4.patch fix patch > Distcp data between two HA clusters requires anoth

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14009201#comment-14009201 ] Dave Marion commented on HDFS-6376: --- Jenkins build failing with: HDFS-6376 patch is being

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Patch Available (was: Open) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-3-branch-2.4.patch Built locally with {noformat} dev-support/test-patch.sh ../hado

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Open (was: Patch Available) This is becoming laborious. > Distcp data between two HA clusters

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Patch Available (was: Open) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-branch-2.4.patch renamed patch > Distcp data between two HA clusters requires ano

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Open (was: Patch Available) > Distcp data between two HA clusters requires another configuratio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Environment: Hadoop 2.3.0 (was: CDH 5.0 (Apache 2.3.0 + some patches)) > Distcp data between two HA clu

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Status: Open (was: Patch Available) Cancelling patch-1 > Distcp data between two HA clusters requires

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Target Version/s: 2.4.1 Status: Patch Available (was: Open) > Distcp data between two HA

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-2.patch Patch 2 against the 2.4 branch > Distcp data between two HA clusters requ

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Fix Version/s: 2.4.1 > Distcp data between two HA clusters requires another configuration >

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Component/s: hdfs-client datanode > Distcp data between two HA clusters requires anothe

[jira] [Created] (HDFS-6376) Distcp data between two HA clusters requires another configuration

Dave Marion created HDFS-6376: - Summary: Distcp data between two HA clusters requires another configuration Key: HDFS-6376 URL: https://issues.apache.org/jira/browse/HDFS-6376 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Affects Version/s: 2.4.0 Status: Patch Available (was: Open) Note that the patch was dev

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Attachment: HDFS-6376-patch-1.patch Patch 1 adds a new hdfs-site property which allows the user to speci

[jira] [Updated] (HDFS-6307) Case Sensitivity issue with Client and HA configuration

[ https://issues.apache.org/jira/browse/HDFS-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6307: -- Description: If you create a configuration based off of the example at [1], but you use the nameservice

[jira] [Created] (HDFS-6307) Case Sensitivity issue with Client and HA configuration

Dave Marion created HDFS-6307: - Summary: Case Sensitivity issue with Client and HA configuration Key: HDFS-6307 URL: https://issues.apache.org/jira/browse/HDFS-6307 Project: Hadoop HDFS Issue Typ