RE: another HDFS configuration for scribeH

Hi Eric, Please check my recent experience with the dataloss issue. http://lucene.472066.n3.nabble.com/Blocks-are-getting-corrupted-under-very-high-load-tt3527403.html#a3532671 http://lucene.472066.n3.nabble.com/Update-RE-Blocks-are-getting-corrupted-under-very-high-load-tt3537420.html#none Per

another HDFS configuration for scribeH

Hi Eric, I was debugging a bizar data corruption case in the silver cluster today and realized that there is a very important configuration that scribeH cluster should set. Could you please set dfs.datanode.synconclose to be true in ScribeH for next week's push? This is will guarantee that bloc

Re: another HDFS configuration for scribeH

Hi Hairong, What is the risk for this change? How much more testing do you think will be needed? -Eric From: Hairong Kuang mailto:hair...@fb.com>> Date: Thu, 1 Dec 2011 20:22:10 -0800 To: Internal Use mailto:ehw...@fb.com>> Cc: Zheng Shao mailto:zs...@fb.com>>, "hdfs-dev@hadoop.apache.org

[jira] [Resolved] (HDFS-2616) Change DatanodeProtocol#sendHeartbeat to return HeartbeatResponse

[ https://issues.apache.org/jira/browse/HDFS-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2616. --- Resolution: Fixed Committed hdfs-2616-addendum.txt as r1209315. > Change DatanodeProt

[jira] [Reopened] (HDFS-2616) Change DatanodeProtocol#sendHeartbeat to return HeartbeatResponse

[ https://issues.apache.org/jira/browse/HDFS-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-2616: --- > Change DatanodeProtocol#sendHeartbeat to return HeartbeatResponse >

[jira] [Resolved] (HDFS-2623) HA: Add test case for hot standby capability

[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2623. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Committed th

[jira] [Resolved] (HDFS-2612) HA: handle refreshNameNodes in federated HA clusters

[ https://issues.apache.org/jira/browse/HDFS-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2612. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Committed to

[jira] [Resolved] (HDFS-2622) HA: fix TestDFSUpgrade on HA branch

[ https://issues.apache.org/jira/browse/HDFS-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2622. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Committed, t

[jira] [Created] (HDFS-2623) HA: Add test case for hot standby capability

HA: Add test case for hot standby capability Key: HDFS-2623 URL: https://issues.apache.org/jira/browse/HDFS-2623 Project: Hadoop HDFS Issue Type: Sub-task Components: ha, test Affect

[jira] [Created] (HDFS-2622) HA: fix TestDFSUpgrade on HA branch

HA: fix TestDFSUpgrade on HA branch --- Key: HDFS-2622 URL: https://issues.apache.org/jira/browse/HDFS-2622 Project: Hadoop HDFS Issue Type: Sub-task Components: ha, test Affects Versions: HA bra

[jira] [Resolved] (HDFS-2620) commands_manual.html balancer documentation missing -policy option

[ https://issues.apache.org/jira/browse/HDFS-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved HDFS-2620. - Resolution: Duplicate duplicate of HDFS-1685 > commands_manual.html balancer docu

[jira] [Created] (HDFS-2621) Balancer is not checking ALREADY_RUNNING state and never returns this state.

Balancer is not checking ALREADY_RUNNING state and never returns this state. Key: HDFS-2621 URL: https://issues.apache.org/jira/browse/HDFS-2621 Project: Hadoop HDFS

[jira] [Created] (HDFS-2620) commands_manual.html balancer documentation missing -policy option

commands_manual.html balancer documentation missing -policy option -- Key: HDFS-2620 URL: https://issues.apache.org/jira/browse/HDFS-2620 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-2619) Remove my personal email address from the libhdfs build file.

Remove my personal email address from the libhdfs build file. - Key: HDFS-2619 URL: https://issues.apache.org/jira/browse/HDFS-2619 Project: Hadoop HDFS Issue Type: Bug Co

Hadoop-Hdfs-HAbranch-build - Build # 2 - Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-HAbranch-build/2/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12521 lines...] [INFO] --- maven-javadoc-plugin:2.7

Jenkins build is unstable: Hadoop-Hdfs-HAbranch-build #2

See

[jira] [Created] (HDFS-2618) Implement protobuf service for NamenodeProtocol

Implement protobuf service for NamenodeProtocol --- Key: HDFS-2618 URL: https://issues.apache.org/jira/browse/HDFS-2618 Project: Hadoop HDFS Issue Type: New Feature Components: name-node

[jira] [Resolved] (HDFS-2616) Change DatanodeProtocol#sendHeartbeat to return HeartbeatResponse

[ https://issues.apache.org/jira/browse/HDFS-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-2616. --- Resolution: Fixed Hadoop Flags: Reviewed Committed it to HDFS-1623 branch.