Re: [Discuss] Hadoop-Ozone repository mailing list configurations

2019-10-23 Thread Matt Foley
Definitely yes on ‘ozone-issues’. Whether we want to keep ozone-dev and hdfs-dev together or separate, I’m neutral. Thanks, —Matt On Oct 23, 2019, at 2:11 PM, Elek, Marton wrote: Thanks to report this problem Rohith, Yes, it seems to be configured with the wrong mailing list. I think the rig

Re: Hadoop Storage online sync in an hour

2019-09-04 Thread Matt Foley
Sorry I won’t be able to come today; a work meeting interferes. —Matt On Sep 4, 2019, at 9:10 AM, Wei-Chiu Chuang wrote: It's a short week so I didn't set up a predefined topic to discuss. What should we be discussing? How about Erasure Coding? I'm starting to see tricky EC bug reports coming i

Re: Hadoop storage community online sync

2019-08-22 Thread Matt Foley
+1 for publishing notes. Thanks! On Aug 21, 2019, at 4:16 PM, Aaron Fabbri wrote: Thank you Wei-Chiu for organizing this and sending out notes! On Wed, Aug 21, 2019 at 1:10 PM Wei-Chiu Chuang mailto:weic...@apache.org>> wrote: > We had a great turnout today, thanks to Konstantin for leading t

Re: Hadoop Community Sync Up Schedule

2019-08-22 Thread Matt Foley
Wangda and Eric, We can express the intent, I think, by scheduling two recurring meetings: - monthly, on the 2nd Wednesday, and - monthly, on the 4th Wednesday. This is pretty easy to understand, and not too onerous to maintain. But I’m okay with simple bi-weekly too. I’m neutral on 10 vs 11am, P

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread Matt Foley
Hi Wangda, thanks for this. A question about the schedule correction: > > 1) In the proposal, repeats are not properly. (I used bi-weekly instead of > 2nd/4th week as repeat frequency). I'd like to fix the frequency on Thu and > it will take effect starting next week. I understand that “bi-weekly

[jira] [Resolved] (HDFS-6953) HDFS file append failing in single node configuration

2016-02-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-6953. -- Resolution: Invalid Corrected resolution field to 'invalid' since there was no fix. > HDF

[jira] [Reopened] (HDFS-6953) HDFS file append failing in single node configuration

2016-02-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-6953: -- > HDFS file append failing in single node configurat

[jira] [Created] (HDFS-8809) HDFS fsck reports file corruption (Missing blocks) when HBase is running, with Hadoop 2.7.1 and HBase 1.1.1

2015-07-22 Thread Matt Foley (JIRA)
Matt Foley created HDFS-8809: Summary: HDFS fsck reports file corruption (Missing blocks) when HBase is running, with Hadoop 2.7.1 and HBase 1.1.1 Key: HDFS-8809 URL: https://issues.apache.org/jira/browse/HDFS-8809

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Matt Foley
Hi Cos, I would also request that you renumber the release candidate to just three-numbers, hence "2.0.5-alpha". Arun, are you willing to start the 2.1.x name-space for your next release, so that 2.0.x-alpha can become an intermediate stabilization branch as Cos and Konst want? I just think that

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
e. > > I am glad we agreed. > Having Jira to track the CI effort is a good idea. > > Thanks, > --Konstantin > > On Mon, Mar 4, 2013 at 3:29 PM, Matt Foley wrote: > > Thanks. I agree Windows -1's in test-patch should not block commits. > > > >

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
Thanks. I agree Windows -1's in test-patch should not block commits. --Matt On Mon, Mar 4, 2013 at 2:30 PM, Konstantin Shvachko wrote: > On Mon, Mar 4, 2013 at 12:22 PM, Matt Foley > wrote: > > Konstantine, you have voted -1, and stated some requirements before > you

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
sed work sounds like it will satisfy the requirements. Thank you, --Matt On Sun, Mar 3, 2013 at 12:16 PM, Konstantin Shvachko wrote: > Didn't I explain in details what I am asking for? > > Thanks, > --Konst > > On Sun, Mar 3, 2013 at 11:08 AM, Matt Foley > wrote: > > H

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-03 Thread Matt Foley
7:32 PM, Konstantin Shvachko wrote: > Hi Matt, > > On Sat, Mar 2, 2013 at 12:32 PM, Matt Foley > wrote: > > Konstantin, > > I would like to explore what it would take to remove this perceived > > impediment -- > > Glad you decided to explore. Thank you. > >

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-02 Thread Matt Foley
Konstantin, I would like to explore what it would take to remove this perceived impediment -- although I reserve the right to argue that this is not pre-requisite to merging the cross-platform support patch. If we implemented full "test-patch" support for Windows on trunk, would that fulfill both

Fwd: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Matt Foley
+1 (binding) Apache is supposed to be about the community. We have here a community of developers, who have actively and openly worked to add a major improvement to Hadoop: the ability to work cross-platform. Furthermore, the size of the substantive part of the needed patch is only about 1500 li

[jira] [Reopened] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-27 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-4261: -- > TestBalancerWithNodeGroup times out > --- > >

[jira] [Reopened] (HDFS-3553) Hftp proxy tokens are broken

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-3553: -- 1.1.0 was released without this patch. Changing the Target Version to 1.1.1. However, is this really

[jira] [Resolved] (HDFS-3461) HFTP should use the same port & protocol for getting the delegation token

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-3461. -- Resolution: Fixed Fix was committed by Owen on 10/1/2012. > HFTP should use the s

[jira] [Resolved] (HDFS-1108) Log newly allocated blocks

2012-08-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1108. -- Resolution: Fixed > Log newly allocated blocks > -- > >

[jira] [Reopened] (HDFS-1108) Log newly allocated blocks

2012-08-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1108: -- Incorrectly resolved as duplicate. The OTHER bug (HDFS-978) was the one closed. The fix was committed

[jira] [Created] (HDFS-3700) Backport HDFS-3568 to branch-1 (fuse_dfs: add support for security)

2012-07-22 Thread Matt Foley (JIRA)
Matt Foley created HDFS-3700: Summary: Backport HDFS-3568 to branch-1 (fuse_dfs: add support for security) Key: HDFS-3700 URL: https://issues.apache.org/jira/browse/HDFS-3700 Project: Hadoop HDFS

[jira] [Created] (HDFS-3617) Port HDFS-96 to branch-1 (support blocks greater than 2GB)

2012-07-08 Thread Matt Foley (JIRA)
Matt Foley created HDFS-3617: Summary: Port HDFS-96 to branch-1 (support blocks greater than 2GB) Key: HDFS-3617 URL: https://issues.apache.org/jira/browse/HDFS-3617 Project: Hadoop HDFS Issue

[jira] [Reopened] (HDFS-3316) jsvc should be listed as a dependency for "package" and "bin-package"

2012-05-06 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-3316: -- > jsvc should be listed as a dependency for "package" and

Re: [jira] [Resolved] (HDFS-3310) Make sure that we abort when no edit log directories are left

2012-04-26 Thread Matt Foley
Thanks Colin and Eli! Colin, for future reference, it is common to cut-and-paste the testpatch results into a comment in the Jira. Thanks.

[jira] [Reopened] (HDFS-2379) 0.20: Allow block reports to proceed without holding FSDataset lock

2012-02-03 Thread Matt Foley (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-2379: -- There's been a request to include this in 1.0.1, but the patch doesn't apply; it conflicts wi

[jira] [Reopened] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

2011-11-27 Thread Matt Foley (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-2316: -- re-opening to accomodate request to fix also in 0.22.0. > webhdfs: a complete FileSys

[jira] [Resolved] (HDFS-2588) hdfs jsp pages missing DOCTYPE

2011-11-23 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2588. -- Resolution: Fixed Fix Version/s: 0.23.1 0.20.205.1 Hadoop Flags: Reviewed

[jira] [Created] (HDFS-2588) hdfs jsp pages missing DOCTYPE

2011-11-23 Thread Matt Foley (Created) (JIRA)
hdfs jsp pages missing DOCTYPE -- Key: HDFS-2588 URL: https://issues.apache.org/jira/browse/HDFS-2588 Project: Hadoop HDFS Issue Type: Bug Components: scripts Reporter: Dave Vronay

[jira] [Resolved] (HDFS-1943) fail to start datanode while start-dfs.sh is executed by root user

2011-11-09 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1943. -- Resolution: Fixed Fix Version/s: 0.20.205.1 Target Version/s: 0.20.205.1, 0.22.0

[jira] [Reopened] (HDFS-1943) fail to start datanode while start-dfs.sh is executed by root user

2011-11-05 Thread Matt Foley (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1943: -- Reopened for back-port to 0.20.205.1, per request from Roman Shaposhnik. > fail to st

[jira] [Reopened] (HDFS-2404) webhdfs liststatus json response is not correct

2011-10-06 Thread Matt Foley (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-2404: -- Reopened for trunk fix. > webhdfs liststatus json response is not corr

[jira] [Resolved] (HDFS-2404) webhdfs liststatus json response is not correct

2011-10-06 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2404. -- Resolution: Fixed Fix Version/s: 0.20.205.0 Committed to 0.20-sec and 0.20.205. Thanks Suresh

[jira] [Resolved] (HDFS-2385) Support delegation token renewal in webhdfs

2011-10-06 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2385. -- Resolution: Fixed Fix Version/s: (was: 0.20.206.0) Merged to 0.20.205. Thanks, Nicholas

[jira] [Resolved] (HDFS-2395) webhdfs api's should return a root element in the json response

2011-10-05 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2395. -- Resolution: Fixed Fix Version/s: (was: 0.20.206.0) > webhdfs api's should retur

[jira] [Reopened] (HDFS-2395) webhdfs api's should return a root element in the json response

2011-10-05 Thread Matt Foley (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-2395: -- Bug was erroneously marked "Duplicate" instead of "Fixed". Fixing...

Re: Retire 0.20-append branch?

2011-10-04 Thread Matt Foley
+1. On Mon, Oct 3, 2011 at 10:47 PM, Jitendra Pandey wrote: > +1. > > On Mon, Oct 3, 2011 at 10:15 PM, Owen O'Malley > wrote: > > > On Mon, Oct 3, 2011 at 2:50 PM, Todd Lipcon wrote: > > > In essence, that means that we would: > > > 1) Ask contributors to provide patches against 0.20-security b

[jira] [Resolved] (HDFS-2325) Fuse-DFS fails to build on Hadoop 20.203.0

2011-09-25 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2325. -- Resolution: Fixed Fix Version/s: 0.20.205.0 > Fuse-DFS fails to build on Hadoop 20.20

[jira] [Created] (HDFS-2352) improve TestOfflineEditsViewer to accomodate comment in editsStored.xml, for Apache license header

2011-09-20 Thread Matt Foley (JIRA)
-2352 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.23.0 Reporter: Matt Foley Priority: Minor In HDFS-2344, we had to remove the license header comment from hadoop-hdfs-project/hadoop-hdfs/src/test/resources

[jira] [Reopened] (HDFS-1330) Make RPCs to DataNodes timeout

2011-08-27 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1330: -- Assignee: John George (was: Hairong Kuang) Re-opening to add enhanced unit testing in v0.23 (moved

[jira] [Resolved] (HDFS-2218) Disable TestHdfsProxy.testHdfsProxyInterface in automated test suite for 0.20-security-204 release

2011-08-01 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2218. -- Resolution: Fixed Committed to 0.20-security-204. > Disable TestHdfsProxy.testHdfsProxyInterface

[jira] [Created] (HDFS-2218) Remove TestHdfsProxy.testHdfsProxyInterface from automated test suite for 0.20-security-204 release

2011-08-01 Thread Matt Foley (JIRA)
-2218 Project: Hadoop HDFS Issue Type: Test Components: contrib/hdfsproxy, test Affects Versions: 0.20.204.0 Reporter: Matt Foley Assignee: Matt Foley Priority: Blocker Fix For: 0.20.204.0 To enable release of

[jira] [Created] (HDFS-2217) TestHdfsProxy.testHdfsProxyInterface fails in Jenkins with "org.apache.hadoop.ipc.RemoteException: hudson is not allowed to impersonate hudson"

2011-08-01 Thread Matt Foley (JIRA)
ld servers Reporter: Matt Foley See https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-0.20.204-Build/20/testReport/org.apache.hadoop.hdfsproxy/TestHdfsProxy/testHdfsProxyInterface/ Error Message hudson is not allowed to impersonate hudson Stacktrace org.apache.hadoop.ipc.RemoteExcepti

[jira] [Created] (HDFS-2136) Fault injection for StorageDirectory failures during read/write of FSImage/Edits files

2011-07-07 Thread Matt Foley (JIRA)
: Hadoop HDFS Issue Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-2126) [umbrella task] Improve Namenode startup time

2011-07-05 Thread Matt Foley (JIRA)
Affects Versions: 0.20.2 Reporter: Matt Foley This is an umbrella task to group the improvements in Namenode startup latency made over the last few months, and track remaining ideas. -- This message is automatically generated by JIRA. For more information on JIRA, see: http

[jira] [Resolved] (HDFS-1656) getDelegationToken in HftpFileSystem should renew TGT if needed.

2011-06-16 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1656. -- Resolution: Fixed Fix Version/s: 0.23.0 Committed to trunk. Thanks, Jitendra

[jira] [Resolved] (HDFS-1952) FSEditLog.open() appears to succeed even if all EDITS directories fail

2011-06-15 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1952. -- Resolution: Fixed Fix Version/s: 0.23.0 0.22.0 Committed to v22. Thanks

[jira] [Resolved] (HDFS-1836) Thousand of CLOSE_WAIT socket

2011-06-14 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1836. -- Resolution: Fixed Fix Version/s: (was: 0.20.205.0) Committed to 0.20-security for .206

[jira] [Resolved] (HDFS-1295) Improve namenode restart times by short-circuiting the first block reports from datanodes

2011-06-10 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1295. -- Resolution: Fixed Fix Version/s: Federation Branch Hadoop Flags: [Reviewed] Committed to

[jira] [Created] (HDFS-2061) two minor bugs in BlockManager block report processing

2011-06-10 Thread Matt Foley (JIRA)
: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Priority: Minor Fix For: 0.23.0 In a recent review of HDFS-1295 patches (speedup for block report processing), found two very minor bugs in BlockManager, as documented in

[jira] [Reopened] (HDFS-1295) Improve namenode restart times by short-circuiting the first block reports from datanodes

2011-06-08 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1295: -- This patch needs to be ported to yahoo-merge branch. Also, the integration of HDFS-1052 into trunk

[jira] [Resolved] (HDFS-1878) TestHDFSServerPorts unit test failure - race condition in FSNamesystem.close() causes NullPointerException without serious consequence

2011-06-08 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1878. -- Resolution: Fixed Committed to 0.20-security and 0.20-security-205. > TestHDFSServerPorts unit t

[jira] [Resolved] (HDFS-2044) TestQueueProcessingStatistics failing automatic test due to timing issues

2011-06-07 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2044. -- Resolution: Fixed Note this is a v20 issue only. > TestQueueProcessingStatistics failing automa

[jira] [Created] (HDFS-2044) TestQueueProcessingStatistics failing automatic test due to timing issues

2011-06-07 Thread Matt Foley (JIRA)
Issue Type: Test Components: test Affects Versions: 0.20.204.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.20.205.0 The test makes assumptions about timing issues that hold true in workstation environments but not in Hudson auto-test

[jira] [Resolved] (HDFS-2023) Backport of NPE for File.list and File.listFiles

2011-06-04 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2023. -- Resolution: Fixed Committed to 0.20-security. Thanks Bharath! > Backport of NPE for File.list

[jira] [Resolved] (HDFS-2019) Fix all the places where Java method File.list is used with FileUtil.list API

2011-06-04 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2019. -- Resolution: Fixed Committed to trunk. Thanks Bharath! HDFS-2019 depends upon HADOOP-7342. It is

[jira] [Created] (HDFS-2031) request test-patch to work with -Dresolvers=internal, for pre-patch and/or post-patch builds

2011-06-03 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Improvement Components: build Reporter: Matt Foley For dev test, need to test an HDFS patch that is dependent on a modified COMMON jar. For casual testing, one can build in COMMON with "ant mvn-install", then buil

[jira] [Reopened] (HDFS-1836) Thousand of CLOSE_WAIT socket

2011-06-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1836: -- Assignee: Bharath Mundlapudi (was: Todd Lipcon) Reopening because Bharath's adapted patc

[jira] [Resolved] (HDFS-1471) TestHDFSTrash times out on trunk

2011-06-02 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1471. -- Resolution: Duplicate > TestHDFSTrash times out on tr

[jira] [Resolved] (HDFS-1401) TestFileConcurrentReader test case is still timing out / failing

2011-06-01 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1401. -- Resolution: Cannot Reproduce TestFileConcurrentReader has not had a failure in the last 60+ builds over

[jira] [Created] (HDFS-1988) TestTrash infinite loops if run on a home directory with stuff in .Trash

2011-05-24 Thread Matt Foley (JIRA)
Type: Sub-task Affects Versions: 0.22.0 Reporter: Matt Foley Fix For: 0.22.0 Seems to have started failing recently in many commit builds as well as the last two nightly builds of 22: https://builds.apache.org/hudson/job/Hadoop-Hdfs-22-branch/51/testReport

[jira] [Resolved] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-22 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1921. -- Resolution: Fixed > Save namespace can cause NN to be unable to come up on rest

[jira] [Created] (HDFS-1955) CLONE - saveNamespace appears to succeed even if all directories fail to save

2011-05-18 Thread Matt Foley (JIRA)
Issue Type: Bug Affects Versions: 0.22.0, 0.23.0 Reporter: Matt Foley Assignee: Aaron T. Myers Priority: Blocker Fix For: 0.22.0 After HDFS-1071, saveNamespace now appears to "succeed" even if all of the individual directories

[jira] [Created] (HDFS-1952) FSEditLog.open() appears to succeed even if all EDITS directories fail

2011-05-17 Thread Matt Foley (JIRA)
Type: Bug Affects Versions: 0.22.0, 0.23.0 Reporter: Matt Foley Assignee: Aaron T. Myers Priority: Blocker Fix For: 0.22.0 After HDFS-1071, saveNamespace now appears to "succeed" even if all of the individual directories failed to save

[jira] [Resolved] (HDFS-1883) Recurring failures in TestBackupNode since HDFS-1052

2011-05-11 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1883. -- Resolution: Fixed Fix Version/s: 0.23.0 We are now at build 488, and have had no further

[jira] [Created] (HDFS-1923) Intermittent recurring failure in TestFiDataTransferProtocol2.pipeline_Fi_29

2011-05-11 Thread Matt Foley (JIRA)
Issue Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-11 Thread Matt Foley (JIRA)
Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HDFS-1886) Recurring failures in TestFileAppend4, TestLargeBlock, TestWriteConfigurationToDFS for > 12 days

2011-05-10 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1886. -- Resolution: Fixed > Recurring failures in TestFileAppend4, TestLargeBl

[jira] [Resolved] (HDFS-1885) Recurring failures in TestFileConcurrentReader for > 12 days

2011-05-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1885. -- Resolution: Duplicate Duplicate of HDFS-1401 > Recurring failures in TestFileConcurrentReader for &

[jira] [Resolved] (HDFS-1679) TestFileConcurrentReader fails intermittently

2011-05-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1679. -- Resolution: Duplicate > TestFileConcurrentReader fails intermitten

[jira] [Created] (HDFS-1886) Recurring failures in TestFileAppend4, TestLargeBlock, TestWriteConfigurationToDFS for > 12 days

2011-05-03 Thread Matt Foley (JIRA)
886 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1885) Recurring failures in TestFileConcurrentReader

2011-05-03 Thread Matt Foley (JIRA)
Recurring failures in TestFileConcurrentReader -- Key: HDFS-1885 URL: https://issues.apache.org/jira/browse/HDFS-1885 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Matt Foley

[jira] [Created] (HDFS-1884) Recurring failures in TestDFSStorageStateRecovery since HDFS-1052

2011-05-03 Thread Matt Foley (JIRA)
-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1883) Recurring failures in TestBackupNode since HDFS-1052

2011-05-03 Thread Matt Foley (JIRA)
: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1882) Recurring failures in TestDatanodeBlockScanner since HDFS-1052

2011-05-03 Thread Matt Foley (JIRA)
Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1879) disambiguate "datanode dead" vs "datanode heartbeat expired"

2011-05-02 Thread Matt Foley (JIRA)
ue Type: Improvement Components: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Priority: Minor HDFS-1541 changed FSNamesystem.heartbeatCheck() so it would not call removeDatanode() while the name system is in Safe Mode. However, calls to FSNamesystem.is

[jira] [Created] (HDFS-1878) race condition in FSNamesystem.close() causes NullPointerException without serious consequence - TestHDFSServerPorts unit test failure

2011-05-02 Thread Matt Foley (JIRA)
-1878 URL: https://issues.apache.org/jira/browse/HDFS-1878 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.204.0 Reporter: Matt Foley Assignee: Matt Foley Priority: Minor

[jira] [Created] (HDFS-1857) Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-list

2011-04-21 Thread Matt Foley (JIRA)
: HDFS-1857 URL: https://issues.apache.org/jira/browse/HDFS-1857 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Hudson automated testing has started failing with one javadoc

[jira] [Created] (HDFS-1856) TestDatanodeBlockScanner waits forever, errs without giving information

2011-04-21 Thread Matt Foley (JIRA)
Type: Sub-task Reporter: Matt Foley Assignee: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1855) TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy() part 2 fails in two different ways

2011-04-21 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.22.0, 0.23.0 The second part of test case

[jira] [Created] (HDFS-1854) make failure message more useful in DFSTestUtil.waitReplication()

2011-04-20 Thread Matt Foley (JIRA)
-task Reporter: Matt Foley Assignee: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1853) refactor TestNodeCount to import standard node counting and "wait for replication" methods

2011-04-20 Thread Matt Foley (JIRA)
/HDFS-1853 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Eli's suggestions for refactoring the three "wait for" loops in TestNodeCount for re-usability (similar to what was done for HDFS

[jira] [Created] (HDFS-1852) Umbrella task: Clean up HDFS unit tests for timing-sensitive conditions, improve both condition stimulators and condition detection loops

2011-04-20 Thread Matt Foley (JIRA)
: HDFS-1852 URL: https://issues.apache.org/jira/browse/HDFS-1852 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Both namenode and datanode have multiple background threads

[jira] [Resolved] (HDFS-1729) Improve metrics for measuring NN startup costs.

2011-04-20 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1729. -- Resolution: Invalid Withdrawn. > Improve metrics for measuring NN startup co

[jira] [Created] (HDFS-1830) auto-test intermittently doesn't trigger in HDFS project

2011-04-12 Thread Matt Foley (JIRA)
nents: test Reporter: Matt Foley For HDFS-1295, the Hudson QA test would not run on the 02/Apr/11 01:13 submission, IBR_shortcut_v3atrunk.patch [ 12475272 ], until Nicholas (szetszwo) triggered it manually for me. Now, with the 11/Apr/11 06:59 submission of IBR_shortcut_v4atrunk.

[jira] [Created] (HDFS-1829) TestNodeCount waits forever, errs without giving information

2011-04-11 Thread Matt Foley (JIRA)
Components: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 In three locations in the code, TestBalancer waits forever on a condition. Failures result in Hudson/Jenkins "Timeout occurred" error messa

[jira] [Created] (HDFS-1828) TestBlocksWithNotEnoughRacks intermittently fails assert

2011-04-11 Thread Matt Foley (JIRA)
: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 In server.namenode.TestBlocksWithNotEnoughRacks.testSufficientlyReplicatedBlocksWithNotEnoughRacks assert fails at curReplicas == REPLICATION_FACTOR, but it

[jira] [Created] (HDFS-1827) TestBlockReplacement waits forever, errs without giving information

2011-04-11 Thread Matt Foley (JIRA)
Components: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 In method checkBlocks(), TestBalancer waits forever on a condition. Failures result in Hudson/Jenkins "Timeout occurred" error me

[jira] [Resolved] (HDFS-733) TestBlockReport fails intermittently

2011-04-11 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-733. - Resolution: Duplicate For analysis and solution, please see HDFS-1806. > TestBlockReport fa

[jira] [Resolved] (HDFS-953) TestBlockReport times out intermittently

2011-04-11 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-953. - Resolution: Duplicate For analysis and solution, please see HDFS-1806. > TestBlockReport times

[jira] [Created] (HDFS-1808) TestBalancer waits forever, errs without giving information

2011-04-05 Thread Matt Foley (JIRA)
Components: data-node, name-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley In three locations in the code, TestBalancer waits forever on a condition. Failures result in Hudson/Jenkins "Timeout occurred" error message with no informa

[jira] [Created] (HDFS-1806) TestBlockReport.blockReport_08() and _09() are timing-dependent and likely to fail on fast servers

2011-04-05 Thread Matt Foley (JIRA)
-1806 Project: Hadoop HDFS Issue Type: Bug Components: data-node, name-node Affects Versions: 0.22.0 Reporter: Matt Foley Method waitForTempReplica() polls every 100ms during block replication, attempting to "catch" a datanode in the state

[jira] [Created] (HDFS-1798) saveNamespace should background the writing of the FSImage files when in SafeMode

2011-03-30 Thread Matt Foley (JIRA)
HDFS Issue Type: Improvement Reporter: Matt Foley Even with parallel writes of the FSImage files (HDFS-1071), large clusters still typically spend 5 minutes writing the files. When in SafeMode, it should be safe to background these writes instead of waiting for them. To

[jira] [Created] (HDFS-1790) review use of synchronized methods in FSNamesystem

2011-03-25 Thread Matt Foley (JIRA)
Affects Versions: 0.23.0 Reporter: Matt Foley Fix For: 0.23.0 While analyzing SafeMode semantics for HDFS-1726, I noticed the following usage of synchronized methods in FSNamesystem that raised questions: 1. incVolumeFailure() is synchronized on the FSNamesystem

[jira] Created: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-17 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Improvement Components: data-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 Consider a large cluster that takes 40 minutes to start up. The datanodes compete to

[jira] Created: (HDFS-1732) Enhance NNThroughputBenchmark to observe scale-dependent changes in IBR processing

2011-03-07 Thread Matt Foley (JIRA)
HDFS Issue Type: Improvement Components: name-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Rework NNThroughputBenchmark to provide more detailed info about Initial Block Report (IBR) processing time, as a function of

[jira] Created: (HDFS-1726) query method for what kind of safe mode the Namenode is in

2011-03-04 Thread Matt Foley (JIRA)
Components: name-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 If we could differentiate between "startup safemode" vs other safemode, it would be easier to do startup optimizations like HDFS-1295.

[jira] Resolved: (HDFS-1687) HDFS Federation: DirectoryScanner changes for federation

2011-03-02 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1687. -- Resolution: Fixed > HDFS Federation: DirectoryScanner changes for federat

[jira] Created: (HDFS-1700) HDFS Federation: Fsck needs to work with nameservice-suffixed configuration parameters

2011-03-02 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Bug Components: hdfs client Affects Versions: Federation Branch Reporter: Matt Foley Assignee: Matt Foley Fix For: Federation Branch Fsck fails trying to find machine "0.0.0.0", because fsck not yet

[jira] Created: (HDFS-1699) HDFS Federation: fix failure of TestBlockReport

2011-03-02 Thread Matt Foley (JIRA)
Affects Versions: Federation Branch Reporter: Matt Foley Assignee: Matt Foley Fix For: Federation Branch FS is no longer immediately available when a datanode activates; one must wait for it to negotiate with a namenode and establish a blockpool. The current

[jira] Created: (HDFS-1687) HDFS Federation: DirectoryScanner changes for federation

2011-03-01 Thread Matt Foley (JIRA)
: data-node Affects Versions: Federation Branch Reporter: Matt Foley Assignee: Matt Foley Fix For: Federation Branch DirectoryScanner scans substantially all of the directory tree of entire volumes. It needs to be extended to work with Blockpools in

  1   2   >