Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

Thanks Enis and Andrew; I think I missed the key point of conformance with other FSes' behavior. On Wed, Apr 17, 2013 at 11:29 PM, Enis Söztutar wrote: > Harsh, the discussion above includes the reasoning behind forcing the > change in hbase rather than hdfs. Although HBase has shipped with this,

[jira] [Created] (HDFS-4709) TestDFSClientRetries#testGetFileChecksum fails using IBM java 6

Tian Hong Wang created HDFS-4709: Summary: TestDFSClientRetries#testGetFileChecksum fails using IBM java 6 Key: HDFS-4709 URL: https://issues.apache.org/jira/browse/HDFS-4709 Project: Hadoop HDFS

Re: Heads up - Snapshots feature merge into trunk

I'm very excited to see that this project is nearing completion. I've been following the development pretty closely and am very much looking forward to getting this merged to trunk. One thing that I do think we should address before the merge is moving the programmatic APIs for working with snapsh

[jira] [Resolved] (HDFS-4706) disallowSnapshot does not work for root

[ https://issues.apache.org/jira/browse/HDFS-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4706. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags: R

[jira] [Resolved] (HDFS-4707) Fix FilterFileSystem and findbugs warning in Snapshot branch

[ https://issues.apache.org/jira/browse/HDFS-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4707. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags: R

[jira] [Created] (HDFS-4708) Add snapshot user guide

Tsz Wo (Nicholas), SZE created HDFS-4708: Summary: Add snapshot user guide Key: HDFS-4708 URL: https://issues.apache.org/jira/browse/HDFS-4708 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Created] (HDFS-4707) Fix FilterFileSystem and findbugs warning in Snapshot branch

Tsz Wo (Nicholas), SZE created HDFS-4707: Summary: Fix FilterFileSystem and findbugs warning in Snapshot branch Key: HDFS-4707 URL: https://issues.apache.org/jira/browse/HDFS-4707 Project: Had

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

+1 (binding) Downloaded the tar ball and ran some simple jobs. --Bobby Evans On 4/17/13 2:01 PM, "Siddharth Seth" wrote: >+1 (binding) >Verified checksums and signatures. >Built from the source tar, deployed a single node cluster and tested a >couple of simple MR jobs. > >- Sid > > >On Fri, Ap

[jira] [Created] (HDFS-4706) disallowSnapshot does not work for root

Tsz Wo (Nicholas), SZE created HDFS-4706: Summary: disallowSnapshot does not work for root Key: HDFS-4706 URL: https://issues.apache.org/jira/browse/HDFS-4706 Project: Hadoop HDFS Iss

Re: [VOTE] Release Apache Hadoop 0.23.7

+1 (binding). Verified checksums and signature. Built from source tar, deployed a single node cluster (CapacityScheduler) and tried a couple of simple MR jobs. - Sid On Thu, Apr 11, 2013 at 12:55 PM, Thomas Graves wrote: > I've created a release candidate (RC0) for hadoop-0.23.7 that I would li

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

+1 (binding) Verified checksums and signatures. Built from the source tar, deployed a single node cluster and tested a couple of simple MR jobs. - Sid On Fri, Apr 12, 2013 at 2:56 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would >

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

+1 (binding). I downloaded, verified signatures and checksums, built, and ran small jobs on a single node unsecure cluster. Tom On 4/12/13 4:56 PM, "Arun C Murthy" wrote: >Folks, > >I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I >would like to release. > >The RC is avail

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

+1 (non-binding) - downloaded binary tarball - verified signatures and checksums - deployed to 3 Ubuntu VMs: 1xNN, 1xRM, 2xDN, 2xNM, 1x2NN - tested multiple HDFS operations - ran wordcount MR job - verified that 2NN can take a checkpoint On Wed, Apr 17, 2013 at 1:24 AM, Chris Douglas wrote: >

[jira] [Reopened] (HDFS-3538) TestBlocksWithNotEnoughRacks fails

[ https://issues.apache.org/jira/browse/HDFS-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reopened HDFS-3538: -- > TestBlocksWithNotEnoughRacks fails > -- > > Key: HDFS-

Re: [VOTE] Release Apache Hadoop 0.23.7

+1 (non-binding) - downloaded binary tarball - verified signatures and checksums - deployed to 3 Ubuntu VMs: 1xNN, 1xRM, 2xDN, 2xNM, 1x2NN - tested multiple HDFS operations - ran wordcount MR job - verified that 2NN can take a checkpoint On Wed, Apr 17, 2013 at 1:17 AM, Chris Douglas wrote: >

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

Thanks for the consideration but we've just committed a change to address this as HBASE-8352 On Wednesday, April 17, 2013, Harsh J wrote: > Pardon my late inquisition here but since HBase already shipped out > with a name .snapshots/, why do we force them to change it, and not > rename HDFS' sna

HDFS pread performance

I test the HDFS pread performance, the avg time of pread is about 10ms, but pread max time reach 200ms, there is about one percent of pread time is 200ms, that result to my application is timeout. I find max time of the RemoteBlockReader.readChunk method also can reach 100ms. The RemoteBlockR

Build failed in Jenkins: Hadoop-Hdfs-trunk #1375

See Changes: [vinodkv] YARN-500. Fixed YARN webapps to not roll-over ports when explicitly asked to use non-ephemeral ports. Contributed by Kenji Kikushima. [llu] Fix HADOOP-9467 attribution. [kihwal] MAPREDUCE-5065. DistCp should

Hadoop-Hdfs-trunk - Build # 1375 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1375/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14305 lines...] at sun.reflect.NativeMethodAcces

Hadoop-Hdfs-0.23-Build - Build # 584 - Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/584/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11796 lines...] [INFO] No dependencies found. [INFO]

Jenkins build became unstable: Hadoop-Hdfs-0.23-Build #584

See

How to understand Hadoop source code ?

Hello everyone, I am new to this group. Since the source code of Hadoop is very big, I am not able to understand it entirely. Is there any document that describes the code? Is there any way to understand the functionality of each classes and its method? -- *With regards ---* *Mohammad

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

+1 Verified checksum, signatures. Ran some tests, built the package. -C On Fri, Apr 12, 2013 at 2:56 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would > like to release. > > The RC is available at: > http://people.apache.org/~acmur

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

good suggestion. On Wed, Apr 17, 2013 at 4:10 PM, Harsh J wrote: > Pardon my late inquisition here but since HBase already shipped out > with a name .snapshots/, why do we force them to change it, and not > rename HDFS' snapshots to use .hdfs-snapshots, given that HDFS > Snapshots has not been

Re: [VOTE] Release Apache Hadoop 0.23.7

+1 Verified checksums and signatures, ran some tests, built the tarball. -C On Thu, Apr 11, 2013 at 12:55 PM, Thomas Graves wrote: > I've created a release candidate (RC0) for hadoop-0.23.7 that I would like > to release. > > This release is a sustaining release with several important bug fixes

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

Pardon my late inquisition here but since HBase already shipped out with a name .snapshots/, why do we force them to change it, and not rename HDFS' snapshots to use .hdfs-snapshots, given that HDFS Snapshots has not been released for any users yet. The way I see it, that'd be much more easier to d