Re: Apache Hadoop 3.0.1 Release plan

2018-02-01 Thread Aaron T. Myers
Hey Anu, My feeling on HDFS-12990 is that we've discussed it quite a bit already and it doesn't seem at this point like either side is going to budge. I'm certainly happy to have a phone call about it, but I don't expect that we'd make much progress. My suggestion is that we simply include the

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-11 Thread Aaron T. Myers
+1 (binding) - downloaded the src tarball and built the source (-Pdist -Pnative) - verified the checksum - brought up a secure pseudo distributed cluster - did some basic file system operations (mkdir, list, put, cat) and confirmed that everything was working - confirmed that the web UI worked

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Aaron T. Myers
+1 (binding) from me. Downloaded the source, built from source, set up a pseudo cluster, and ran a few of the sample jobs. Thanks a lot for doing all this release work, Andrew. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Aug 30, 2016 at 8:51 AM, Andrew Wang <andrew.w...@cloudera.

Re: Why there are so many revert operations on trunk?

2016-06-06 Thread Aaron T. Myers
Junping, All of this is being discussed on HDFS-9924. Suggest you follow the conversation there. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Jun 6, 2016 at 7:20 AM, Junping Du <j...@hortonworks.com> wrote: > Hi Andrew, > > I just noticed you revert 8 commits on tr

Re: 'Target Version' field missing in Jira

2016-02-16 Thread Aaron T. Myers
Great news. Thanks a lot for looking into this, Vinod. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 16, 2016 at 11:42 AM, Vinod Kumar Vavilapalli < vino...@apache.org> wrote: > The data is still intact as I can see that I can continue to search on > JIRA against ta

Re: 'Target Version' field missing in Jira

2016-02-16 Thread Aaron T. Myers
Has anyone followed up with ASF Infra about getting this addressed? I worry that all the data for the target versions has disappeared as well... -- Aaron T. Myers Software Engineer, Cloudera On Fri, Feb 12, 2016 at 1:35 PM, Kihwal Lee <kih...@yahoo-inc.com.invalid> wrote: > It's s

Re: Hadoop encryption module as Apache Chimera incubator project

2016-01-28 Thread Aaron T. Myers
licly-consumed interface. c) Chimera can have its own (presumably much faster) release cadence completely separate from Hadoop. -- Aaron T. Myers Software Engineer, Cloudera

Re: Hadoop encryption module as Apache Chimera incubator project

2016-01-20 Thread Aaron T. Myers
the Apache Commons folks saying that you'd like to contribute Chimera? I'd recommend saying that Hadoop and Spark are both on board to depend on this. -- Aaron T. Myers Software Engineer, Cloudera On Wed, Jan 20, 2016 at 4:31 PM, Andrew Wang <andrew.w...@cloudera.com> wrote: > Thanks Uma fo

Re: INotify stability

2015-09-16 Thread Aaron T. Myers
fixed now, and in addition to HDFS-8964 should fully address that issue. -- Aaron T. Myers Software Engineer, Cloudera On Wed, Sep 16, 2015 at 12:41 PM, Ravi Prakash <ravi...@ymail.com> wrote: > Hi Mohammad! > > Thanks for reporting the issue. Could you please take a heap d

[jira] [Resolved] (HDFS-3660) TestDatanodeBlockScanner#testBlockCorruptionRecoveryPolicy2 times out

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3660. -- Resolution: Cannot Reproduce Target Version/s: (was: ) This is an ancient/stale

[jira] [Resolved] (HDFS-4001) TestSafeMode#testInitializeReplQueuesEarly may time out

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4001. -- Resolution: Fixed Haven't seen this fail in a very long time. Closing this out. Feel free

[jira] [Resolved] (HDFS-3811) TestPersistBlocks#TestRestartDfsWithFlush appears to be flaky

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3811. -- Resolution: Cannot Reproduce I don't think I've seen this fail in a very long time. Going

[jira] [Resolved] (HDFS-3532) TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy1 times out

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3532. -- Resolution: Cannot Reproduce This is an ancient/stale flaky test JIRA. Resolving

[jira] [Resolved] (HDFS-2433) TestFileAppend4 fails intermittently

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2433. -- Resolution: Cannot Reproduce I don't think I've seen this fail in a long, long time. Going

[jira] [Created] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

2015-04-20 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-8194: Summary: Add administrative tool to be able to examine the NN's view of DN storages Key: HDFS-8194 URL: https://issues.apache.org/jira/browse/HDFS-8194 Project

Re: upstream jenkins build broken?

2015-03-10 Thread Aaron T. Myers
/data/dfs/data/data3/ has 500 perms, so I'm guessing that's the problem. Been that way since 9:32 UTC on March 5th. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Mar 10, 2015 at 1:24 PM, Colin P. McCabe cmcc...@apache.org wrote: Hi all, A very quick (and not thorough) survey shows

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Aaron T. Myers
+1, this sounds like a good plan to me. Thanks a lot for volunteering to take this on, Andrew. Best, Aaron On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang andrew.w...@cloudera.com wrote: Hi devs, It's been a year and a half since 2.x went GA, and I think we're about due for a 3.x release.

[jira] [Resolved] (HDFS-7421) Move processing of postponed over-replicated blocks to a background task

2015-01-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-7421. -- Resolution: Duplicate Move processing of postponed over-replicated blocks to a background task

[jira] [Created] (HDFS-7421) Move processing of postponed over-replicated blocks to a background task

2014-11-21 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-7421: Summary: Move processing of postponed over-replicated blocks to a background task Key: HDFS-7421 URL: https://issues.apache.org/jira/browse/HDFS-7421 Project: Hadoop

Re: [DISCUSS] Switch to log4j 2

2014-08-15 Thread Aaron T. Myers
Not necessarily opposed to switching logging frameworks, but I believe we can actually support async logging with today's logging system if we wanted to, e.g. as was done for the HDFS audit logger in this JIRA: https://issues.apache.org/jira/browse/HDFS-5241 -- Aaron T. Myers Software Engineer

Re: [VOTE] Migration from subversion to git for version control

2014-08-11 Thread Aaron T. Myers
+1 (binding) Thanks for driving this, Karthik. -- Aaron T. Myers Software Engineer, Cloudera On Fri, Aug 8, 2014 at 7:57 PM, Karthik Kambatla ka...@cloudera.com wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs

[jira] [Created] (HDFS-6647) Edit log corruption when pipeline recovery occurs for deleted file present in snapshot

2014-07-09 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6647: Summary: Edit log corruption when pipeline recovery occurs for deleted file present in snapshot Key: HDFS-6647 URL: https://issues.apache.org/jira/browse/HDFS-6647

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-27 Thread Aaron T. Myers
it. -- Aaron T. Myers Software Engineer, Cloudera On Jun 27, 2014, at 3:04 PM, Arun C. Murthy a...@hortonworks.com wrote: Aaron, Since the amend was just to the test, I'll keep this RC as-is. I'll also comment on jira. thanks, Arun On Jun 27, 2014, at 2:40 PM, Aaron T. Myers

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Aaron T. Myers
+1 (binding) -- Aaron T. Myers Software Engineer, Cloudera On Tue, Jun 24, 2014 at 1:53 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, As discussed, I'd like to call a vote on changing our by-laws to change release votes from 7 days to 5. I've attached the change to by-laws I'm

[jira] [Created] (HDFS-6563) NameNode cannot save fsimage in certain circumstances when snapshots are in use

2014-06-18 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6563: Summary: NameNode cannot save fsimage in certain circumstances when snapshots are in use Key: HDFS-6563 URL: https://issues.apache.org/jira/browse/HDFS-6563 Project

[jira] [Created] (HDFS-6463) Incorrect permission can be created after setting ACLs

2014-05-28 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6463: Summary: Incorrect permission can be created after setting ACLs Key: HDFS-6463 URL: https://issues.apache.org/jira/browse/HDFS-6463 Project: Hadoop HDFS

[jira] [Created] (HDFS-6435) Add support for specifying a static uid/gid mapping for the NFS gateway

2014-05-20 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6435: Summary: Add support for specifying a static uid/gid mapping for the NFS gateway Key: HDFS-6435 URL: https://issues.apache.org/jira/browse/HDFS-6435 Project: Hadoop

[jira] [Created] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-25 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6289: Summary: HA failover can fail if there are pending DN messages for DNs which no longer exist Key: HDFS-6289 URL: https://issues.apache.org/jira/browse/HDFS-6289

[jira] [Resolved] (HDFS-6280) Provide option to

2014-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-6280. -- Resolution: Invalid Accidentally hit create too soon. :) Provide option

[jira] [Created] (HDFS-6280) Provide option to

2014-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6280: Summary: Provide option to Key: HDFS-6280 URL: https://issues.apache.org/jira/browse/HDFS-6280 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-6281) Provide option to use the NFS Gateway without having to use the Hadoop portmapper

2014-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6281: Summary: Provide option to use the NFS Gateway without having to use the Hadoop portmapper Key: HDFS-6281 URL: https://issues.apache.org/jira/browse/HDFS-6281

[jira] [Created] (HDFS-6112) NFS Gateway docs are incorrect for allowed hosts configuration

2014-03-17 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6112: Summary: NFS Gateway docs are incorrect for allowed hosts configuration Key: HDFS-6112 URL: https://issues.apache.org/jira/browse/HDFS-6112 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6048) DFSClient fails if native library doesn't exist

2014-03-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-6048. -- Resolution: Duplicate Hi Akira, I think this will be addressed by HDFS-6040, which should

[jira] [Created] (HDFS-6033) PBImageXmlWriter incorrectly handles processing cache directives

2014-02-27 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6033: Summary: PBImageXmlWriter incorrectly handles processing cache directives Key: HDFS-6033 URL: https://issues.apache.org/jira/browse/HDFS-6033 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Aaron T. Myers
+1 (binding) I downloaded the source tar ball, checked signatures, built from the source, ran a few of the sample jobs on a pseudo cluster. Everything was as expected. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Aaron T. Myers
I don't think any of what you describe below is a regression in behavior from earlier releases. The fs.defaultFS has been set to file:/// for a long time, and likewise you've similarly had to set up your YARN configs. Given that, I don't think this warrants a new RC. -- Aaron T. Myers Software

[jira] [Created] (HDFS-5921) Cannot browse file system via NN web UI if any directory has the sticky bit set

2014-02-10 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5921: Summary: Cannot browse file system via NN web UI if any directory has the sticky bit set Key: HDFS-5921 URL: https://issues.apache.org/jira/browse/HDFS-5921 Project

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
2.3 out today anyway, I'd like to put this in. It's a small fix, and since many people have the sticky bit set on /tmp, they won't be able to browse any of the FS hierarchy from the NN without this fix. -- Aaron T. Myers Software Engineer, Cloudera On Fri, Feb 7, 2014 at 12:45 PM, Vinod Kumar

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
OK. I think I should be able to get it in by 6pm PT, thanks to a quick +1 from Andrew, but certainly don't let it hold up the train if for some reason it takes longer than that. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Feb 10, 2014 at 12:04 PM, Arun C Murthy a...@hortonworks.com

[jira] [Created] (HDFS-5922) DN heartbeat thread can get stuck in tight loop

2014-02-10 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5922: Summary: DN heartbeat thread can get stuck in tight loop Key: HDFS-5922 URL: https://issues.apache.org/jira/browse/HDFS-5922 Project: Hadoop HDFS Issue Type

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
Just committed a fix for HDFS-5921 to branch-2.3. Fire away. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Feb 10, 2014 at 1:34 PM, Aaron T. Myers a...@cloudera.com wrote: OK. I think I should be able to get it in by 6pm PT, thanks to a quick +1 from Andrew, but certainly don't let

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
There's still ongoing discussion on HDFS-4858 and I don't think we should hold up 2.3.0 for that. IMO we should target that for 2.3.1 or 2.4.0. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Feb 10, 2014 at 5:53 PM, Konstantin Shvachko shv.had...@gmail.comwrote: Sorry for the last

Re: Re-swizzle 2.3

2014-01-30 Thread Aaron T. Myers
I just committed HADOOP-10310 to branch-2.3, so we're good to go there. (Thanks to Andrew and Daryn for the prompt reviews.) -- Aaron T. Myers Software Engineer, Cloudera On Wed, Jan 29, 2014 at 6:52 PM, Aaron T. Myers a...@cloudera.com wrote: I just filed this JIRA as a blocker for 2.3

Re: Re-swizzle 2.3

2014-01-29 Thread Aaron T. Myers
the priority, but it seems pretty important to me. Best, Aaron -- Aaron T. Myers Software Engineer, Cloudera On Wed, Jan 29, 2014 at 6:24 PM, Andrew Wang andrew.w...@cloudera.comwrote: I just finished tuning up branch-2.3 and fixing up the HDFS and Common CHANGES.txt in trunk, branch-2, and branch

[jira] [Created] (HDFS-5517) Lower the default maximum number of blocks per file

2013-11-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5517: Summary: Lower the default maximum number of blocks per file Key: HDFS-5517 URL: https://issues.apache.org/jira/browse/HDFS-5517 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5433) When reloading fsimage during checkpointing, we should clear existing snapshottable directories

2013-10-26 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5433: Summary: When reloading fsimage during checkpointing, we should clear existing snapshottable directories Key: HDFS-5433 URL: https://issues.apache.org/jira/browse/HDFS-5433

[jira] [Created] (HDFS-5403) WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306

2013-10-22 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5403: Summary: WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306 Key: HDFS-5403 URL: https://issues.apache.org/jira/browse/HDFS-5403 Project

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-13 Thread Aaron T. Myers
+1 (binding) Downloaded the release, built from tarball, tested a single node cluster. Everything worked as expected. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Oct 7, 2013 at 12:00 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0

[jira] [Created] (HDFS-5289) Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure

2013-10-02 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5289: Summary: Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure Key: HDFS-5289 URL: https://issues.apache.org/jira/browse/HDFS-5289

[jira] [Resolved] (HDFS-3133) Add support for DFS upgrade with HA enabled

2013-10-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3133. -- Resolution: Duplicate Resolving as a duplicate of HDFS-5138, which has a lot more discussion

[jira] [Resolved] (HDFS-3958) Integrate upgrade/finalize/rollback with external journals

2013-10-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3958. -- Resolution: Duplicate Resolving as a duplicate of HDFS-5138, which has a lot more discussion

[jira] [Created] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2013-09-18 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5223: Summary: Allow edit log/fsimage format changes without changing layout version Key: HDFS-5223 URL: https://issues.apache.org/jira/browse/HDFS-5223 Project: Hadoop

[jira] [Resolved] (HDFS-4299) WebHDFS Should Support HA Configuration

2013-09-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4299. -- Resolution: Duplicate Assignee: (was: Haohui Mai) Thanks, Daisuke. Closing this one

[jira] [Created] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

2013-09-03 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5159: Summary: Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint Key: HDFS-5159 URL: https://issues.apache.org/jira/browse/HDFS-5159

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha (RC1)

2013-08-21 Thread Aaron T. Myers
+1 (binding) I downloaded the bits, set up a 4-node cluster, and ran some example jobs. Looks good to me. -- Aaron T. Myers Software Engineer, Cloudera On Thu, Aug 15, 2013 at 10:29 PM, Konstantin Boudnik c...@apache.org wrote: All, I have created a release candidate (rc1) for hadoop

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Aaron T. Myers
. -- Aaron T. Myers Software Engineer, Cloudera On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw since the last go-around (rc1). The RC

[jira] [Created] (HDFS-5102) Snapshot names should not be allowed to contain slash characters

2013-08-15 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5102: Summary: Snapshot names should not be allowed to contain slash characters Key: HDFS-5102 URL: https://issues.apache.org/jira/browse/HDFS-5102 Project: Hadoop HDFS

[jira] [Created] (HDFS-5060) NN should proactively perform a saveNamespace if it has a huge number of outstanding uncheckpointed transactions

2013-08-02 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5060: Summary: NN should proactively perform a saveNamespace if it has a huge number of outstanding uncheckpointed transactions Key: HDFS-5060 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-5064) Standby checkpoints should not block concurrent readers

2013-08-02 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5064: Summary: Standby checkpoints should not block concurrent readers Key: HDFS-5064 URL: https://issues.apache.org/jira/browse/HDFS-5064 Project: Hadoop HDFS

[jira] [Created] (HDFS-5027) On startup, DN should scan volumes in parallel

2013-07-23 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5027: Summary: On startup, DN should scan volumes in parallel Key: HDFS-5027 URL: https://issues.apache.org/jira/browse/HDFS-5027 Project: Hadoop HDFS Issue Type

Re: Question for edit log retain

2013-07-01 Thread Aaron T. Myers
Hi Azuryy, On Wed, Jun 26, 2013 at 6:12 PM, Azuryy Yu azury...@gmail.com wrote: Hi Dear all, I have some confusion for edit log retain, NNStorageRetentionManager.java: 1) purgeCheckpointsOlderThan() What's mean of check point here? Here, checkpoint is referring to the fsimage files

[jira] [Created] (HDFS-4906) HDFS Output streams should not accept writes after being closed

2013-06-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4906: Summary: HDFS Output streams should not accept writes after being closed Key: HDFS-4906 URL: https://issues.apache.org/jira/browse/HDFS-4906 Project: Hadoop HDFS

[jira] [Created] (HDFS-4830) Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml

2013-05-16 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4830: Summary: Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml Key: HDFS-4830 URL: https://issues.apache.org/jira/browse/HDFS-4830

[jira] [Resolved] (HDFS-4352) Encapsulate arguments to BlockReaderFactory in a class

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4352. -- Resolution: Won't Fix Seems some folks don't think this is the best idea

[jira] [Created] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4747: Summary: Convert snapshot user guide to APT from XDOC Key: HDFS-4747 URL: https://issues.apache.org/jira/browse/HDFS-4747 Project: Hadoop HDFS Issue Type

Re: Convention question for using DFSConfigKey constants : are zeros magic?

2013-04-23 Thread Aaron T. Myers
no enforcement of it, no. We try to use consistent prefixes, append units like millis or seconds to config settings which represent time, etc. but this is just by convention. -- Aaron T. Myers Software Engineer, Cloudera

Re: Cannot communicate

2013-04-23 Thread Aaron T. Myers
Hi Kevin, Since it seems like this is a CDH-specific question, I recommend you email cdh-u...@cloudera.org where you should be able to get some help with this. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Apr 22, 2013 at 10:33 AM, rkevinbur...@charter.net wrote: I am on a Ubuntu

Re: Heads up - Snapshots feature merge into trunk

2013-04-18 Thread Aaron T. Myers
to move these operations into the HdfsAdmin interface, there's nothing to stop users from using that interface instead of FileSystem. After all, that was the point of adding the HdfsAdmin class in the first place - to have a public API for performing HDFS-specific operations. -- Aaron T. Myers Software

Re: Heads up - Snapshots feature merge into trunk

2013-04-18 Thread Aaron T. Myers
operations. Regardless, my point is not necessarily that these operations should go into the HdfsAdmin class, but rather that they shouldn't go into the FileSystem class, since the snapshots API doesn't seem to me like it will generalize to other FileSystem implementations. -- Aaron T. Myers Software

Re: Heads up - Snapshots feature merge into trunk

2013-04-17 Thread Aaron T. Myers
of these APIs is in the HdfsAdmin class, which is a public/evolving interface explicitly for these sorts of operations. What are others thoughts on this subject? Best, Aaron -- Aaron T. Myers Software Engineer, Cloudera On Sat, Apr 13, 2013 at 10:05 AM, Suresh Srinivas sur

Re: VOTE: HDFS-347 merge

2013-04-12 Thread Aaron T. Myers
Since the merge vote passed, I have merged the HDFS-347 branch to trunk. Leaving the JIRA open for now until we also do the merge to branch-2. Colin, thanks a ton for the monster contribution. This is a long time in coming. -- Aaron T. Myers Software Engineer, Cloudera On Thu, Apr 11, 2013

Re: VOTE: HDFS-347 merge

2013-04-10 Thread Aaron T. Myers
I'm +1 as well. I've reviewed much of the code as well and have personally seen it running in production at several different sites. I agree with Todd that it's a substantial improvement in operability. Best, Aaron On Apr 8, 2013, at 1:19 PM, Todd Lipcon t...@cloudera.com wrote: +1 for the

[jira] [Created] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4655: Summary: DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN Key: HDFS-4655 URL: https://issues.apache.org/jira/browse/HDFS-4655

[jira] [Created] (HDFS-4656) DN heartbeat loop can be briefly tight

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4656: Summary: DN heartbeat loop can be briefly tight Key: HDFS-4656 URL: https://issues.apache.org/jira/browse/HDFS-4656 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4657) If incremental BR is received before first full BR NN will log a line for every block on a DN

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4657: Summary: If incremental BR is received before first full BR NN will log a line for every block on a DN Key: HDFS-4657 URL: https://issues.apache.org/jira/browse/HDFS-4657

[jira] [Created] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4658: Summary: Standby NN will log that it has received a block report after becoming active Key: HDFS-4658 URL: https://issues.apache.org/jira/browse/HDFS-4658 Project

[jira] [Created] (HDFS-4614) FSNamesystem#getContentSummary should use getPermissionChecker helper method

2013-03-19 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4614: Summary: FSNamesystem#getContentSummary should use getPermissionChecker helper method Key: HDFS-4614 URL: https://issues.apache.org/jira/browse/HDFS-4614 Project

[jira] [Created] (HDFS-4592) Default values for access time precision are out of sync between hdfs-default.xml and the code

2013-03-12 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4592: Summary: Default values for access time precision are out of sync between hdfs-default.xml and the code Key: HDFS-4592 URL: https://issues.apache.org/jira/browse/HDFS-4592

[jira] [Created] (HDFS-4591) HA clients can fail to fail over while Standby NN is performing long checkpoint

2013-03-11 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4591: Summary: HA clients can fail to fail over while Standby NN is performing long checkpoint Key: HDFS-4591 URL: https://issues.apache.org/jira/browse/HDFS-4591 Project

Re: are the HDFS javadocs published on the website?

2013-02-25 Thread Aaron T. Myers
That sounds like a good plan to me. -- Aaron T. Myers Software Engineer, Cloudera On Sat, Feb 23, 2013 at 6:11 PM, Andrew Wang andrew.w...@cloudera.comwrote: Taking silence here to mean we aren't that concerned with the javadocs. Are we okay with Doug's proposed fix for the broken links

Re: VOTE: HDFS-347 merge

2013-02-22 Thread Aaron T. Myers
HDFS-2246 around in branch-2 to let HDFS-347 soak a bit on trunk and then remove HDFS-2246 from branch-2 once we're confident in HDFS-347 and trunk adds Windows support. As Colin pointed out, this VOTE has always been about only merging this branch to trunk. -- Aaron T. Myers Software Engineer

Re: VOTE: HDFS-347 merge

2013-02-20 Thread Aaron T. Myers
indefinitely. -- Aaron T. Myers Software Engineer, Cloudera

[jira] [Resolved] (HDFS-4476) HDFS-347: style cleanups

2013-02-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4476. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 branch

[jira] [Resolved] (HDFS-4453) Make a simple doc to describe the usage and design of the shortcircuit read feature

2013-02-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4453. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 branch

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-08 Thread Aaron T. Myers
just fine. -- Aaron T. Myers Software Engineer, Cloudera On Wed, Feb 6, 2013 at 7:59 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to release. This release contains several major enhancements

[jira] [Resolved] (HDFS-4485) HDFS-347: DN should chmod socket path a+w

2013-02-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4485. -- Resolution: Fixed I've just committed this to the HDFS-347 branch. Thanks a lot

[jira] [Resolved] (HDFS-4473) don't create domain socket unless we need it

2013-02-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4473. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 branch

[jira] [Created] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-01-31 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4462: Summary: 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS Key: HDFS-4462 URL: https://issues.apache.org/jira/browse/HDFS-4462

[jira] [Created] (HDFS-4448) HA NN does not start with wildcard address configured for other NN when security is enabled

2013-01-28 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4448: Summary: HA NN does not start with wildcard address configured for other NN when security is enabled Key: HDFS-4448 URL: https://issues.apache.org/jira/browse/HDFS-4448

[jira] [Resolved] (HDFS-4438) TestDomainSocket fails when system umask is set to 0002

2013-01-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4438. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 branch

[jira] [Resolved] (HDFS-4440) avoid annoying log message when dfs.domain.socket.path is not set

2013-01-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4440. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 branch

[jira] [Resolved] (HDFS-4333) Using right default value for creating files in HDFS

2013-01-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4333. -- Resolution: Duplicate Sounds good. Closing this issue as a duplicate

[jira] [Created] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-01-09 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4376: Summary: Intermittent timeout of TestBalancerWithNodeGroup Key: HDFS-4376 URL: https://issues.apache.org/jira/browse/HDFS-4376 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4315) DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access

2012-12-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4315: Summary: DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access Key: HDFS-4315 URL: https://issues.apache.org/jira/browse/HDFS-4315

Re: What is the reason that DataNode should configured the http and streamer port with a number under 1024 in secure mode?

2012-11-16 Thread Aaron T. Myers
this clears things up. -- Aaron T. Myers Software Engineer, Cloudera On Fri, Nov 16, 2012 at 6:44 AM, Xiaohan yians.x...@huawei.com wrote: Hi, guys. Now our cluster is moving to security mode. We find many difference with the non-security, one is the starting of datanode. And I am not sure how

Re: Status of CheckpointNode and BackupNode

2012-10-16 Thread Aaron T. Myers
I'm also in favor of removing them. I've fielded many questions from users about their status, how they compare to other daemons that exist, etc. All I've seen them do is increase confusion among users and be a maintenance burden on developers. -- Aaron T. Myers Software Engineer, Cloudera

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

2012-09-26 Thread Aaron T. Myers
+1 for the merge. I've reviewed much of the code as individual patches and tested the whole system, both in single- and multi-node configurations. I've also tested the system with security enabled and confirmed that it works as expected. I've done all of the above testing both with and

[jira] [Resolved] (HDFS-3926) QJM: Add user documentation for QJM

2012-09-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3926. -- Resolution: Fixed Fix Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags

[jira] [Created] (HDFS-3926) QJM: Add user documentation for QJM

2012-09-11 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-3926: Summary: QJM: Add user documentation for QJM Key: HDFS-3926 URL: https://issues.apache.org/jira/browse/HDFS-3926 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-3893) QJM: Make QJM work with security enabled

2012-09-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3893. -- Resolution: Fixed Fix Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags

  1   2   3   4   >