[jira] [Created] (HDFS-3984) TestAuditLogs#testAuditWebHdfs flaky

2012-09-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3984: - Summary: TestAuditLogs#testAuditWebHdfs flaky Key: HDFS-3984 URL: https://issues.apache.org/jira/browse/HDFS-3984 Project: Hadoop HDFS Issue Type: Bug Co

[jira] [Resolved] (HDFS-3968) TestPersistBlocks seems to fail intermittently

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3968. --- Resolution: Duplicate Dupe of HDFS-3664. > TestPersistBlocks seems to fail intermitte

[jira] [Resolved] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-3931. --- Resolution: Fixed > TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken > --

[jira] [Reopened] (HDFS-3931) TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken

2012-09-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reopened HDFS-3931: --- > TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken >

[jira] [Created] (HDFS-3983) Hftp should not use the https port

2012-09-26 Thread Eli Collins (JIRA)
Eli Collins created HDFS-3983: - Summary: Hftp should not use the https port Key: HDFS-3983 URL: https://issues.apache.org/jira/browse/HDFS-3983 Project: Hadoop HDFS Issue Type: Bug Affects Ve

[jira] [Created] (HDFS-3982) report failed replications in DN heartbeat

2012-09-26 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3982: --- Summary: report failed replications in DN heartbeat Key: HDFS-3982 URL: https://issues.apache.org/jira/browse/HDFS-3982 Project: Hadoop HDFS Issue Type: Bug

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Konstantin Boudnik
On Wed, Sep 26, 2012 at 04:17PM, Konstantin Shvachko wrote: > Hi Todd, > > > I had said previously that it's worth > > discussing if several other people believe the same. > > Well let's put it on to general list for discussion then? > Seems to me an important issue for Hadoop evolution in gener

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Konstantin Shvachko
Don't understand your argument. Else where? One way or another users will be talking to Todd. Thanks, --Konst On Wed, Sep 26, 2012 at 2:32 PM, Stack wrote: > On Tue, Sep 25, 2012 at 11:21 PM, Konstantin Shvachko > wrote: >> I think this is a great work, Todd. >> And I think we should not merge

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Konstantin Shvachko
Hi Todd, > I had said previously that it's worth > discussing if several other people believe the same. Well let's put it on to general list for discussion then? Seems to me an important issue for Hadoop evolution in general. We keep growing the HDFS umbrella with competing technologies (http/we

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Stack
On Tue, Sep 25, 2012 at 11:21 PM, Konstantin Shvachko wrote: > I think this is a great work, Todd. > And I think we should not merge it into trunk or other branches. > As I suggested earlier on this list I think this should be spinned off > as a separate project or a subproject. > I'd be -1 on th

[jira] [Created] (HDFS-3981) access time is set without holding writelock in FSNamesystem

2012-09-26 Thread Xiaobo Peng (JIRA)
Xiaobo Peng created HDFS-3981: - Summary: access time is set without holding writelock in FSNamesystem Key: HDFS-3981 URL: https://issues.apache.org/jira/browse/HDFS-3981 Project: Hadoop HDFS Iss

[jira] [Reopened] (HDFS-3910) DFSTestUtil#waitReplication should timeout

2012-09-26 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reopened HDFS-3910: - > DFSTestUtil#waitReplication should timeout > -- > >

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Aaron T. Myers
+1 for the merge. I've reviewed much of the code as individual patches and tested the whole system, both in single- and multi-node configurations. I've also tested the system with security enabled and confirmed that it works as expected. I've done all of the above testing both with and without

Re: Commits breaking compilation of MR 'classic' tests

2012-09-26 Thread Robert Evans
That is fine, we may want to then mark it so that the MR-4687 depends on the JIRA to port the tests, so the tests don't disapear before we are done. --Bobby From: Arun C Murthy mailto:a...@hortonworks.com>> Date: Wednesday, September 26, 2012 12:31 PM To: "hdfs-dev@hadoop.apache.org

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Eli Collins
On Wed, Sep 26, 2012 at 10:50 AM, Todd Lipcon wrote: > On Tue, Sep 25, 2012 at 11:21 PM, Konstantin Shvachko > wrote: >> I think this is a great work, Todd. >> And I think we should not merge it into trunk or other branches. >> As I suggested earlier on this list I think this should be spinned of

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Todd Lipcon
On Tue, Sep 25, 2012 at 11:21 PM, Konstantin Shvachko wrote: > I think this is a great work, Todd. > And I think we should not merge it into trunk or other branches. > As I suggested earlier on this list I think this should be spinned off > as a separate project or a subproject. > > - The code is

Re: Commits breaking compilation of MR 'classic' tests

2012-09-26 Thread Arun C Murthy
Fair, however there are still tests which need to be ported over. We can remove them after the port. On Sep 26, 2012, at 9:54 AM, Robert Evans wrote: > As per my comment on the bug. I though we were going to remove them. > > MAPREDUCE-4266 only needs a little bit more work, change a patch to a

[jira] [Resolved] (HDFS-3538) TestBlocksWithNotEnoughRacks fails

2012-09-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-3538. -- Resolution: Cannot Reproduce It has been a while and I don't see the problem in jenkins tests any more.

Re: Commits breaking compilation of MR 'classic' tests

2012-09-26 Thread Robert Evans
As per my comment on the bug. I though we were going to remove them. MAPREDUCE-4266 only needs a little bit more work, change a patch to a script, before they disappear entirely. I would much rather see dead code die then be maintained for a few tests that are mostly testing the dead code itself

[jira] [Resolved] (HDFS-3977) Incompatible change between hadoop-1 and hadoop-2 when the dfs.hosts and dfs.hosts.exclude files are not present

2012-09-26 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta resolved HDFS-3977. --- Resolution: Invalid Thanks Todd. Resolving it as invalid. > Incompatible change betw

Re: Commits breaking compilation of MR 'classic' tests

2012-09-26 Thread Arun C Murthy
Point. I've opened https://issues.apache.org/jira/browse/MAPREDUCE-4687 to track this. On Sep 25, 2012, at 9:33 PM, Eli Collins wrote: > How about adding this step to the MR PreCommit jenkins job so it's run > as part test-patch? > > On Tue, Sep 25, 2012 at 7:48 PM, Arun C Murthy wrote: >> Com

About The Hadoop Plugin

2012-09-26 Thread Harshal Musale
Hi All, I am new to Hadoop development. I have written a Hadoop map-reduce program which I want to debug. I wrote it using Eclipse IDE (Ganymede/Indigo). What it takes to debug my code? Is it possible? Please guide me on this. Any help in this regard is very much appreciated. Thank

Jenkins build is still unstable: Hadoop-Hdfs-0.23-Build #386

2012-09-26 Thread Apache Jenkins Server
See

Hadoop-Hdfs-0.23-Build - Build # 386 - Still Unstable

2012-09-26 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/386/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 19644 lines...] [INFO] --- maven-dependency-plugin:2.

[jira] [Created] (HDFS-3980) NPE in HttpURLConnection.java while starting SecondaryNameNode.

2012-09-26 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-3980: -- Summary: NPE in HttpURLConnection.java while starting SecondaryNameNode. Key: HDFS-3980 URL: https://issues.apache.org/jira/browse/HDFS-3980 Project: Hado