[jira] [Created] (HDFS-7633) When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime thows IllegalArgumentException

2015-01-15 Thread Walter Su (JIRA)
Walter Su created HDFS-7633: --- Summary: When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime thows IllegalArgumentException Key: HDFS-7633 URL: https://issues.apache.org/jira/browse/HDFS-7633

[jira] [Resolved] (HDFS-7631) Deep learn about hadoop

2015-01-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-7631. -- Resolution: Won't Fix Instead of create a JIRA, you can subscribe the user list and ask this question. Guide: h

[jira] [Created] (HDFS-7632) MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode.

2015-01-15 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7632: --- Summary: MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. Key: HDFS-7632 URL: https://i

[jira] [Created] (HDFS-7631) Deep learn about hadoop

2015-01-15 Thread frank (JIRA)
frank created HDFS-7631: --- Summary: Deep learn about hadoop Key: HDFS-7631 URL: https://issues.apache.org/jira/browse/HDFS-7631 Project: Hadoop HDFS Issue Type: Wish Reporter: frank

[jira] [Created] (HDFS-7630) TestConnCache hardcode block size without considering native OS

2015-01-15 Thread sam liu (JIRA)
sam liu created HDFS-7630: - Summary: TestConnCache hardcode block size without considering native OS Key: HDFS-7630 URL: https://issues.apache.org/jira/browse/HDFS-7630 Project: Hadoop HDFS Issue Ty

[jira] [Created] (HDFS-7629) TestDisableConnCache hardcode block size without considering native OS

2015-01-15 Thread sam liu (JIRA)
sam liu created HDFS-7629: - Summary: TestDisableConnCache hardcode block size without considering native OS Key: HDFS-7629 URL: https://issues.apache.org/jira/browse/HDFS-7629 Project: Hadoop HDFS I

[jira] [Created] (HDFS-7628) TestNameEditsConfigs hardcode block size without considering native OS

2015-01-15 Thread sam liu (JIRA)
sam liu created HDFS-7628: - Summary: TestNameEditsConfigs hardcode block size without considering native OS Key: HDFS-7628 URL: https://issues.apache.org/jira/browse/HDFS-7628 Project: Hadoop HDFS I

[jira] [Created] (HDFS-7627) TestCacheDirectives hardcode block size without considering native OS

2015-01-15 Thread sam liu (JIRA)
sam liu created HDFS-7627: - Summary: TestCacheDirectives hardcode block size without considering native OS Key: HDFS-7627 URL: https://issues.apache.org/jira/browse/HDFS-7627 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-7626) TestPipelinesFailover hardcode block size without considering native OS

2015-01-15 Thread sam liu (JIRA)
sam liu created HDFS-7626: - Summary: TestPipelinesFailover hardcode block size without considering native OS Key: HDFS-7626 URL: https://issues.apache.org/jira/browse/HDFS-7626 Project: Hadoop HDFS

[jira] [Created] (HDFS-7625) TestPersistBlocks hardcode block size without considering native OS

2015-01-15 Thread sam liu (JIRA)
sam liu created HDFS-7625: - Summary: TestPersistBlocks hardcode block size without considering native OS Key: HDFS-7625 URL: https://issues.apache.org/jira/browse/HDFS-7625 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-7624) TestFileAppendRestart hardcode block size without considering native OS

2015-01-15 Thread sam liu (JIRA)
sam liu created HDFS-7624: - Summary: TestFileAppendRestart hardcode block size without considering native OS Key: HDFS-7624 URL: https://issues.apache.org/jira/browse/HDFS-7624 Project: Hadoop HDFS

[jira] [Created] (HDFS-7623) Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace

2015-01-15 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7623: Summary: Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace Key: HDFS-7623 URL: https://issues.apache.org/jira/browse/HDFS-7623 Pr

Re: NFSv3 Filesystem Connector

2015-01-15 Thread Gokul Soundararajan
Hi Steve, Thanks for the pointers. I looked at the FileSystemContractBaseTest and MainOperationsBaseTest and wrote the setUp() functions to setup NFS underneath. The extension of these test classes aren't very clean and I hope I can use and the rest of team's help in writing them correctly. In my

[jira] [Created] (HDFS-7622) Erasure Coding: handling truncated files

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7622: --- Summary: Erasure Coding: handling truncated files Key: HDFS-7622 URL: https://issues.apache.org/jira/browse/HDFS-7622 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7621: --- Summary: Erasure Coding: update the Balancer/Mover data migration logic Key: HDFS-7621 URL: https://issues.apache.org/jira/browse/HDFS-7621 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7620) Change disk quota calculation for EC files

2015-01-15 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7620: - Summary: Change disk quota calculation for EC files Key: HDFS-7620 URL: https://issues.apache.org/jira/browse/HDFS-7620 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7619: --- Summary: Erasure Coding: Handling files in snapshots Key: HDFS-7619 URL: https://issues.apache.org/jira/browse/HDFS-7619 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7618) Support read when a file is being encoded/decoded

2015-01-15 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7618: - Summary: Support read when a file is being encoded/decoded Key: HDFS-7618 URL: https://issues.apache.org/jira/browse/HDFS-7618 Project: Hadoop HDFS

[jira] [Created] (HDFS-7617) Add editlog transactions for EC

2015-01-15 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7617: - Summary: Add editlog transactions for EC Key: HDFS-7617 URL: https://issues.apache.org/jira/browse/HDFS-7617 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Created] (HDFS-7616) Change FSImage to support BlockGroup

2015-01-15 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7616: - Summary: Change FSImage to support BlockGroup Key: HDFS-7616 URL: https://issues.apache.org/jira/browse/HDFS-7616 Project: Hadoop HDFS Issue Type:

[jira] [Reopened] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

2015-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-7591: - Reopening for branch-2 commit. > hdfs classpath command should support same options as hadoop classpat

[DISCUSS] Porting truncate to branch 2.

2015-01-15 Thread Konstantin Shvachko
Hey devs, This is to discuss whether new truncate feature should be ported to branch 2. Colin suggested in HDFS-3071 that we merge it in a week or two. Makes sense to me too. That way we can get it out in one of the next releases. Please raise your issues, concerns, or support here. Do we need to

[jira] [Resolved] (HDFS-7593) Data Not replicate in ssd drive

2015-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7593. - Resolution: Invalid [~vivekraghuwanshi], I am resolving this as as 'Invalid' due to lack of detail.

[jira] [Created] (HDFS-7615) Remove longReadLock

2015-01-15 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-7615: Summary: Remove longReadLock Key: HDFS-7615 URL: https://issues.apache.org/jira/browse/HDFS-7615 Project: Hadoop HDFS Issue Type: Bug Reporter: Kihwal Le

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #71

2015-01-15 Thread Apache Jenkins Server
See Changes: [xgong] YARN-2807. Option "--forceactive" not works as described in usage of [cmccabe] HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. M

Hadoop-Hdfs-trunk-Java8 - Build # 71 - Still Failing

2015-01-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/71/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6705 lines...] main: [mkdir] Created dir: /home/

Hadoop-Hdfs-trunk - Build # 2006 - Still Failing

2015-01-15 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2006/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6313 lines...] main: [mkdir] Created dir: /home/jenk

Build failed in Jenkins: Hadoop-Hdfs-trunk #2006

2015-01-15 Thread Apache Jenkins Server
See Changes: [xgong] YARN-2807. Option "--forceactive" not works as described in usage of [cmccabe] HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCab

Re: NFSv3 Filesystem Connector

2015-01-15 Thread Steve Loughran
Gokul, What we expect from a filesystem is defined in (a) the HDFS code , (b) the filesystem spec as derived from (a), and (c) contract tests derived from (a) and (b) http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/index.html There's a wiki page to go with this