[jira] [Created] (HDFS-7498) Simplify the logic in INodesInPath

Jing Zhao created HDFS-7498: --- Summary: Simplify the logic in INodesInPath Key: HDFS-7498 URL: https://issues.apache.org/jira/browse/HDFS-7498 Project: Hadoop HDFS Issue Type: Improvement

Re: Upgrading findbugs

Thanks for initiating this, Haohui. +1 to upgrading findbugs version. Inline. On Mon, Dec 8, 2014 at 9:57 PM, Haohui Mai wrote: > Hi, > > The recent changes on moving to Java 7 triggers a bug in findbug ( > http://sourceforge.net/p/findbugs/bugs/918), which causes all pre-commit > runs (e.g., H

Upgrading findbugs

Hi, The recent changes on moving to Java 7 triggers a bug in findbug ( http://sourceforge.net/p/findbugs/bugs/918), which causes all pre-commit runs (e.g., HADOOP-11287) to fail. The current version of findbugs (1.3.9) used by Hadoop is released in 2009. Given that: (1) The current bug that we h

[jira] [Created] (HDFS-7497) Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui

Yongjun Zhang created HDFS-7497: --- Summary: Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui Key: HDFS-7497 URL: https://issues.apache.org/jira/browse/HDFS-7497 Projec

Re: Thinking ahead to hadoop-2.7

On 8 December 2014 at 19:48, Colin McCabe wrote: > Are there a lot of open JDK7 > issues that would require a release to straighten out? > I don't think so —the 2.6 release was tested pretty aggressively on JDK7, and solely on it for Windows. Pushing out a 2.7 release would be more symbolic than

Re: Switching to Java 7

On 8 December 2014 at 19:58, Colin McCabe wrote: > It would be nice if we could have a separate .m2 directory per test > executor. > > It seems like that would eliminate these race conditions once and for > all, at the cost of storing a few extra jars (proportional to the # of > simultaneous exec

[jira] [Created] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode

Colin Patrick McCabe created HDFS-7496: -- Summary: Fix FsVolume removal race conditions on the DataNode Key: HDFS-7496 URL: https://issues.apache.org/jira/browse/HDFS-7496 Project: Hadoop HDFS

[jira] [Created] (HDFS-7495) Lock inversion in DFSInputStream#getBlockAt()

Ted Yu created HDFS-7495: Summary: Lock inversion in DFSInputStream#getBlockAt() Key: HDFS-7495 URL: https://issues.apache.org/jira/browse/HDFS-7495 Project: Hadoop HDFS Issue Type: Bug R

[jira] [Created] (HDFS-7494) Checking of closed in DFSInputStream#pread() should be protected by synchronization

Ted Yu created HDFS-7494: Summary: Checking of closed in DFSInputStream#pread() should be protected by synchronization Key: HDFS-7494 URL: https://issues.apache.org/jira/browse/HDFS-7494 Project: Hadoop HDFS

[jira] [Created] (HDFS-7493) removedDst should be checked against null in finally block of FSDirRenameOp#unprotectedRenameTo()

Ted Yu created HDFS-7493: Summary: removedDst should be checked against null in finally block of FSDirRenameOp#unprotectedRenameTo() Key: HDFS-7493 URL: https://issues.apache.org/jira/browse/HDFS-7493 Project

[jira] [Created] (HDFS-7492) If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads

Colin Patrick McCabe created HDFS-7492: -- Summary: If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads Key: HDFS-7492

[jira] [Created] (HDFS-7491) Add incremental blockreport latency to DN metrics

Ming Ma created HDFS-7491: - Summary: Add incremental blockreport latency to DN metrics Key: HDFS-7491 URL: https://issues.apache.org/jira/browse/HDFS-7491 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7490) HDFS tests OOM on Java7+

Steve Loughran created HDFS-7490: Summary: HDFS tests OOM on Java7+ Key: HDFS-7490 URL: https://issues.apache.org/jira/browse/HDFS-7490 Project: Hadoop HDFS Issue Type: Bug Componen

Re: Switching to Java 7

On Mon, Dec 8, 2014 at 7:46 AM, Steve Loughran wrote: > On 8 December 2014 at 14:58, Ted Yu wrote: > >> Looks like there was still OutOfMemoryError : >> >> >> https://builds.apache.org/job/Hadoop-Hdfs-trunk/1964/testReport/junit/org.apache.hadoop.hdfs.server.namenode.snapshot/TestRenameWithSnapsh

Re: Thinking ahead to hadoop-2.7

On Fri, Dec 5, 2014 at 11:15 AM, Karthik Kambatla wrote: > It would be nice to cut the branch for the next "feature" release (not just > Java 7) in the first week of January, so we can get the RC out by the end > of the month? > > Yesterday, this came up in an offline discussion on ATS. Given peop

[jira] [Created] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

Noah Lorang created HDFS-7489: - Summary: Slow FsVolumeList checkDirs can hang datanodes Key: HDFS-7489 URL: https://issues.apache.org/jira/browse/HDFS-7489 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7488) HDFS Windows CIFS Gateway

Hari Sekhon created HDFS-7488: - Summary: HDFS Windows CIFS Gateway Key: HDFS-7488 URL: https://issues.apache.org/jira/browse/HDFS-7488 Project: Hadoop HDFS Issue Type: New Feature Affects Ver

Re: Switching to Java 7

On 8 December 2014 at 14:58, Ted Yu wrote: > Looks like there was still OutOfMemoryError : > > > https://builds.apache.org/job/Hadoop-Hdfs-trunk/1964/testReport/junit/org.apache.hadoop.hdfs.server.namenode.snapshot/TestRenameWithSnapshots/testRenameDirAcrossSnapshottableDirs/ > Well, I'm going t

Build failed in Jenkins: Hadoop-Hdfs-trunk #1965

See Changes: [harsh] MAPREDUCE-6177. Minor typo in the EncryptedShuffle document about ssl-client.xml. Contributed by Yangping Wu. (harsh) -- [...truncated 6133 lines...] Running org.apache.ha

Hadoop-Hdfs-trunk - Build # 1965 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1965/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6326 lines...] [INFO] Deleting /home/jenkins/jenkins-sla

Re: Switching to Java 7

Looks like there was still OutOfMemoryError : https://builds.apache.org/job/Hadoop-Hdfs-trunk/1964/testReport/junit/org.apache.hadoop.hdfs.server.namenode.snapshot/TestRenameWithSnapshots/testRenameDirAcrossSnapshottableDirs/ FYI On Mon, Dec 8, 2014 at 2:42 AM, Steve Loughran wrote: > yes, bum

Hadoop-Hdfs-trunk-Java8 - Build # 32 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/32/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6378 lines...] [INFO] --- maven-antrun-plugin:1.7:run

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #32

See Changes: [kasha] YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha) [harsh] MAPREDUCE-6177. Minor typo in the EncryptedShuffle document about ssl-client.xml. Contributed by Yangping

Build failed in Jenkins: Hadoop-Hdfs-trunk #1964

See Changes: [kasha] YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha) -- [...truncated 6165 lines...] Running org.apache.hadoop.hdfs.TestHFlush Tests

Hadoop-Hdfs-trunk - Build # 1964 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1964/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6358 lines...] [INFO] [INFO] --- maven-antrun-plugin:1.7

[jira] [Created] (HDFS-7487) NPE in MetricsSourceAdapter

Brahma Reddy Battula created HDFS-7487: -- Summary: NPE in MetricsSourceAdapter Key: HDFS-7487 URL: https://issues.apache.org/jira/browse/HDFS-7487 Project: Hadoop HDFS Issue Type: Bug

Re: Switching to Java 7

yes, bumped them up to export MAVEN_OPTS="-Xmx3072m -XX:MaxPermSize=768m" export ANT_OPTS=$MAVEN_OPTS also extended test runs times. On 8 December 2014 at 00:58, Ted Yu wrote: > Looking at the test failures of > https://builds.apache.org/job/Hadoop-Hdfs-trunk/1963/ which uses jdk 1.7: > > e.