Re: SDP support for Hadoop RPC

Have you checked out Mellanox's UDA ? There have been a lot of efforts from RoCE providers to get Hadoop optimized implementations with modern networking hardware. Even RedHat has announced HPN (High Performance Networking) interfaces to allow modern networks. It might take a few years to get ther

Re: SDP support for Hadoop RPC

Hello How do you get hadoop worked with infiniband? Do you use SDP? I only need to use RPC of hadoop for now. Any help on how to get it worked? Thanks Yasin On Tue, Oct 8, 2013 at 8:57 PM, Milind Bhandarkar wrote: > Yes, we have. It works very well, but it is considered too niche by folks > w

Re: SDP support for Hadoop RPC

Yes, we have. It works very well, but it is considered too niche by folks who insist on buying the least capable hardware for their test clusters, and therefore, recommend such underpowered clusters to customers as well. - milind > On Oct 8, 2013, at 16:49, Yasin Celik wrote: > > Hello, > >

Fwd: SDP support for Hadoop RPC

Hello, I looked around but I think it seems there is no Sockets Direct Protocol(SDP) support in Hadoop RPC. I basically want to take advantage of Infiniband when transferring data. Is there any known support for this? Has anybody tried this before? Best - Yasin Celik

[jira] [Created] (HDFS-5328) MiniDFSCluster times out at startup

Alejandro Abdelnur created HDFS-5328: Summary: MiniDFSCluster times out at startup Key: HDFS-5328 URL: https://issues.apache.org/jira/browse/HDFS-5328 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5327) Rename StandbyException to FailoverException

Jing Zhao created HDFS-5327: --- Summary: Rename StandbyException to FailoverException Key: HDFS-5327 URL: https://issues.apache.org/jira/browse/HDFS-5327 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-5326) add modifyDirective to cacheAdmin

Colin Patrick McCabe created HDFS-5326: -- Summary: add modifyDirective to cacheAdmin Key: HDFS-5326 URL: https://issues.apache.org/jira/browse/HDFS-5326 Project: Hadoop HDFS Issue Type: S

[jira] [Created] (HDFS-5325) Remove WebHdfsFileSystem#ConnRunner

Haohui Mai created HDFS-5325: Summary: Remove WebHdfsFileSystem#ConnRunner Key: HDFS-5325 URL: https://issues.apache.org/jira/browse/HDFS-5325 Project: Hadoop HDFS Issue Type: Sub-task

Re: [Proposal] Pluggable Namespace

Thanks for all the feedback, folks. I have created a jira: https://issues.apache.org/jira/browse/HDFS-5324. Let us continue detailed discussions there. - Milind --- Milind Bhandarkar Chief Scientist Pivotal +1-650-523-3858 (W) +1-408-666-8483 (C) On Mon, Oct 7, 2013 at 9:50 PM, sanjay Radia

[jira] [Created] (HDFS-5324) Make Namespace implementation pluggable in the namenode

Milind Bhandarkar created HDFS-5324: --- Summary: Make Namespace implementation pluggable in the namenode Key: HDFS-5324 URL: https://issues.apache.org/jira/browse/HDFS-5324 Project: Hadoop HDFS

[jira] [Created] (HDFS-5323) Remove some deadcode in BlockManager

Colin Patrick McCabe created HDFS-5323: -- Summary: Remove some deadcode in BlockManager Key: HDFS-5323 URL: https://issues.apache.org/jira/browse/HDFS-5323 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 2.2.0

+1. Downloaded, verified signature/md5, CHANGES.txt, NOTICE, LICENSE, README, release notes, built the source tar ball, and ran a few small jobs on a pseudo-distributed cluster. Tom On 10/7/13 2:00 AM, "Arun C Murthy" wrote: >Folks, > >I've created a release candidate (rc0) for hadoop-2.2.0

Build failed in Jenkins: Hadoop-Hdfs-trunk #1546

See Changes: [brandonli] HDFS-5316. Namenode ignores the default https port. Contributed by Haohui Mai [acmurthy] Moving recent bug-fixes to hadoop-2.2.1. [brandonli] HDFS-5317. Go back to DFS Home link does not work on datanode w

Hadoop-Hdfs-trunk - Build # 1546 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1546/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12742 lines...] [INFO] [INFO] --- maven-antrun-plugin:1.

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #754

See -- [...truncated 7677 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 754 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/754/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7870 lines...] [ERROR] location: class com.google.pro

The work-process file creation and block generation.

Hello. I want to see every detail of 1) Block generation on hdfs when I put the file which has size over at lease 64MB. 2) Generating inputsplits given several blocks in hdfs. So, at first I tried to find related unit test source codes and I found TestFileCreationClient.java. Ho