Re: Guava

Yes, Guava is a constant pain; there's lots of open JIRAs related to it, as its the one we can't seamlessly upgrade. Not unless we do our own fork and reinsert the missing classes. The most common uses in the code are @VisibleForTesting (easily replicated) and the Precondition.check() operations

Hadoop-Hdfs-trunk - Build # 1929 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1929/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6166 lines...] [INFO] Deleting /home/jenkins/jenkins-sla

Build failed in Jenkins: Hadoop-Hdfs-trunk #1929

See Changes: [acmurthy] YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles. [wheat9] HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. [sureshms] HD

[jira] [Resolved] (HDFS-7362) Proxy user refresh won't modify or remove existing groups or hosts from super user list

[ https://issues.apache.org/jira/browse/HDFS-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved HDFS-7362. -- Resolution: Duplicate This is not exactly a dup of HADOOP-10817, but changes made for HADOOP-10817 fixed

Re: Guava

IMO we should: 1* have a clean and thin client API JAR (which does not drag any 3rd party dependencies, or a well defined small set -i.e. slf4j & log4j-) 2* have a client implementation that uses a classloader to isolate client impl 3rd party deps from app dependencies. #2 can be done using a sto

Re: Guava

FYI, we have an existing ApplicationClassLoader implementation that is used to isolate client/task classes from the rest. If we're going down the route of classloader isolation on this, it would be good to come up with a coherent strategy regarding both of these. As a more practical step, I like t

Re: Guava

I'm usually an advocate for getting rid of unnecessary dependencies (cough, jetty, cough), but a lot of the things in Guava are really useful. Immutable collections, BiMap, Multisets, Arrays#asList, the stuff for writing hashCode() and equals(), String#Joiner, the list goes on. We particularly us

[jira] [Created] (HDFS-7386) Replace check "port number < 1024" with shared isPrivilegedPort method

Yongjun Zhang created HDFS-7386: --- Summary: Replace check "port number < 1024" with shared isPrivilegedPort method Key: HDFS-7386 URL: https://issues.apache.org/jira/browse/HDFS-7386 Project: Hadoop HDF

Re: Why do reads take as long as replicated writes?

I strongly suggest benchmarking a modern version of Hadoop rather than Hadoop 1.x. The native CRC stuff from HDFS-3528 greatly reduces CPU consumption on the read path. I wrote about some other read path optimizations in Hadoop 2.x here: http://www.club.cc.cmu.edu/~cmccabe/d/2014.04_ApacheCon_HDF

[jira] [Created] (HDFS-7387) NFS may only do partial commit due to a race between COMMIT and write

Brandon Li created HDFS-7387: Summary: NFS may only do partial commit due to a race between COMMIT and write Key: HDFS-7387 URL: https://issues.apache.org/jira/browse/HDFS-7387 Project: Hadoop HDFS

[jira] [Created] (HDFS-7388) Improve the log for HA failover

Jing Zhao created HDFS-7388: --- Summary: Improve the log for HA failover Key: HDFS-7388 URL: https://issues.apache.org/jira/browse/HDFS-7388 Project: Hadoop HDFS Issue Type: Sub-task Compon

[VOTE] Release Apache Hadoop 2.6.0

Folks, I've created a release candidate (rc0) for hadoop-2.6.0 that I would like to see released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0 The RC tag in git is: release-2.6.0-rc0 The maven artifacts are available via repository.apache.org at https://repositor

Re: [VOTE] Release Apache Hadoop 2.6.0

Hi Arun, Could you confirm the link and permission to the files is correct? I got a following error: Forbidden You don't have permission to access /~acmurthy/hadoop-2.6.0-rc0/hadoop-2.6.0-src.tar.gz on this server. On Tue, Nov 11, 2014 at 11:52 AM, Arun C Murthy wrote: > Folks, > > I've create

[jira] [Created] (HDFS-7389) Named user ACL cannot stop the user from accessing the FS entity.

Chunjun Xiao created HDFS-7389: -- Summary: Named user ACL cannot stop the user from accessing the FS entity. Key: HDFS-7389 URL: https://issues.apache.org/jira/browse/HDFS-7389 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.6.0

Duh! $ chmod a+r * Please try now. Thanks! Arun On Mon, Nov 10, 2014 at 7:06 PM, Tsuyoshi OZAWA wrote: > Hi Arun, > > Could you confirm the link and permission to the files is correct? I > got a following error: > > > Forbidden > You don't have permission to access > /~acmurthy/hadoop-2.6.0-