Which Hadoop version is preferable to make changes in HDFS??

2013-04-10 Thread Mohammad Mustaqeem
I want to make changes in replica placement. Which Hadoop version is preferable to make changes in HDFS?? Please help... -- *With regards ---* *Mohammad Mustaqeem*, M.Tech (CSE) MNNIT Allahabad 9026604270

Which java file is responsible for replica placement??

2013-04-10 Thread Mohammad Mustaqeem
Which class is responsible for replica placement?? Which class chooses the random rack for placement of 3rd replica? and which class chooses the random datanode from the same rack for placement of ?? 2nd replica??? -- *With regards ---* *Mohammad Mustaqeem*, M.Tech (CSE) MNNIT Allahabad

Re: testHDFSConf.xml

2013-04-10 Thread Konstantin Boudnik
I have split CLI test infrastructure into hierarchical pieces that allow to have different configurations for different components. E.g. you can have one for YARN that would exist independently of HDFS, etc. The change has been in since like 0.22 and committed to 0.203.x as well IIRC, hence should

Re: VOTE: HDFS-347 merge

2013-04-10 Thread Aaron T. Myers
I'm +1 as well. I've reviewed much of the code as well and have personally seen it running in production at several different sites. I agree with Todd that it's a substantial improvement in operability. Best, Aaron On Apr 8, 2013, at 1:19 PM, Todd Lipcon wrote: > +1 for the branch merge. I'v

Hurray for NN sanity! Even Pre 2.x!

2013-04-10 Thread Chris Embree
I work for a largish healthcare co. We finally started using (exploiting?) Hadoop this year. The day before our big, C-Suite sponsored launch of Hadoop celebration, we realized that we could no longer ssh to our NN. Fail of all fails! Sorta. Nothing was really wrong! NN was up, running, and

[jira] [Resolved] (HDFS-4654) FileNotFoundException: ID mismatch

2013-04-10 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-4654. -- Resolution: Not A Problem Assignee: Brandon Li Given HDFS-4339 has been committed. This JIRA is no

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-10 Thread Azuryy Yu
Sorry, don't include HDFS-4339, because HDFS-4334 is fixed for 3.0.0. On Thu, Apr 11, 2013 at 9:20 AM, Azuryy Yu wrote: > Hi, > > HDFS-4339 should be included, otherwise, HDFS cannot failover > automatically. > > > On Thu, Apr 11, 2013 at 12:11 A

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-10 Thread Azuryy Yu
Hi, HDFS-4339 should be included, otherwise, HDFS cannot failover automatically. On Thu, Apr 11, 2013 at 12:11 AM, Sangjin Lee wrote: > Hi Arun, > > Would it be possible to include HADOOP-9407 in the release? It's been > resolved for a while, and it'd be good to have this dependency problem >

[jira] [Resolved] (HDFS-4684) Snapshot: Use INode id for image serialization

2013-04-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4684. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags: R

[jira] [Created] (HDFS-4684) Snapshot: Use INode id for image serialization

2013-04-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4684: Summary: Snapshot: Use INode id for image serialization Key: HDFS-4684 URL: https://issues.apache.org/jira/browse/HDFS-4684 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-4673) Renaming file in subdirectory of a snapshotted directory does not work.

2013-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-4673. - Resolution: Duplicate I am resolving as a duplicate of HDFS-4675. I just verified it is fixed by t

[jira] [Resolved] (HDFS-4683) Per directory trash settings / trash override

2013-04-10 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Vines resolved HDFS-4683. -- Resolution: Invalid I could have sworn that was the first thing I tested. Thank you for the quick reply

Re: testHDFSConf.xml

2013-04-10 Thread Colin McCabe
On Wed, Apr 10, 2013 at 10:16 AM, Jay Vyas wrote: > Hello HDFS brethren ! > > I've noticed that the testHDFSConf.xml has alot of references to > supergroup. > > > https://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml > > 1) I wond

testHDFSConf.xml

2013-04-10 Thread Jay Vyas
Hello HDFS brethren ! I've noticed that the testHDFSConf.xml has alot of references to supergroup. https://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml 1) I wonder why this is hardcoded in the testHDFSConf.xml 2) Also, Im wonde

[jira] [Created] (HDFS-4683) Per directory trash settings / trash override

2013-04-10 Thread John Vines (JIRA)
John Vines created HDFS-4683: Summary: Per directory trash settings / trash override Key: HDFS-4683 URL: https://issues.apache.org/jira/browse/HDFS-4683 Project: Hadoop HDFS Issue Type: Improveme

Build failed in Jenkins: Hadoop-Hdfs-trunk #1368

2013-04-10 Thread Apache Jenkins Server
See Changes: [llu] HADOOP-9467. Metrics2 record filter should check name as well as tags. (Ganeshan Iyler via llu) [suresh] HADOOP-9437. TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in N

Hadoop-Hdfs-trunk - Build # 1368 - Still Failing

2013-04-10 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1368/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14212 lines...] at org.junit.internal.runners.mo

for subscription

2013-04-10 Thread Mohammad Mustaqeem
-- *With regards ---* *Mohammad Mustaqeem*, M.Tech (CSE) MNNIT Allahabad

[jira] [Resolved] (HDFS-4682) getting error while configuring the hadoop

2013-04-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-4682. -- Resolution: Invalid closing as invalid, see http://wiki.apache.org/hadoop/InvalidJiraIssues

[jira] [Created] (HDFS-4682) getting error while configuring the hadoop

2013-04-10 Thread murali (JIRA)
murali created HDFS-4682: Summary: getting error while configuring the hadoop Key: HDFS-4682 URL: https://issues.apache.org/jira/browse/HDFS-4682 Project: Hadoop HDFS Issue Type: Bug Compon

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-10 Thread Arun Murthy
Ok, I'll spin rc1 after. Thanks. Sent from my iPhone On Apr 10, 2013, at 11:44 AM, Siddharth Seth wrote: > Arun, MAPREDUCE-5094 would be a useful jira to include in the 2.0.4-alpha > release. It's not an absolute blocker since the values can be controlled > explicitly by changing tests which us

[jira] [Created] (HDFS-4681) TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java

2013-04-10 Thread Tian Hong Wang (JIRA)
Tian Hong Wang created HDFS-4681: Summary: TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java Key: HDFS-4681 URL: https://issues.apache.org/jira/browse/HDFS-4681