Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

2023-03-28 Thread Chris Nauroth
[2] https://github.com/apache/spark/blob/v3.3.2/pom.xml#L109 Chris Nauroth On Tue, Mar 28, 2023 at 11:10 AM Ayush Saxena wrote: > > > > it's already hard to migrate from JDK8 why not retarget JDK17. > > > > +1, makes sense to me, sounds like a win-win situation to

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Chris Nauroth
* Ran a MapReduce job with the native bzip2 codec for compression, and it worked fine. * Ran a MapReduce job with YARN configured to use LinuxContainerExecutor and verified launching the containers through container-executor worked. Chris Nauroth On Mon, Mar 20, 2023 at 3:45 AM Ayush Sax

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-18 Thread Chris Nauroth
Yes, I'm in progress on verification, so you can expect to get a vote from me. Thank you, Steve! Chris Nauroth On Sat, Mar 18, 2023 at 9:19 AM Ashutosh Gupta wrote: > Hi Steve > > I will also do it by today/tomorrow. > > Thanks, > Ashutosh > > On Sat, 18 Mar, 2023

[jira] [Resolved] (HDFS-16891) Avoid the overhead of copy-on-write exception list while loading inodes sub sections in parallel

2023-01-18 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-16891. -- Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Avoid the overh

[jira] [Resolved] (HDFS-16887) Log start and end of phase/step in startup progress

2023-01-12 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-16887. -- Fix Version/s: 3.4.0 3.2.5 3.3.9 Resolution: Fixed

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-04 Thread Chris Nauroth
to MiniDFSCluster and restarts within a single JVM, then I agree the impact is smaller. Then, we'd want to consider what downstream projects have tests that do restarts on a MiniDFSCluster. Chris Nauroth On Wed, Jan 4, 2023 at 4:22 PM Ayush Saxena wrote: > Hmm I'm looking at HADOOP-11867 related st

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-03 Thread Chris Nauroth
timing out. Regarding Hive and Bouncy Castle, there is an existing issue and pull request tracking an upgrade attempt. It's looking like some amount of code changes are required: https://issues.apache.org/jira/browse/HIVE-26648 https://github.com/apache/hive/pull/3744 Chris Nauroth On Tue, Jan 3, 2023

Re: [VOTE] Release Apache Hadoop 3.3.5

2022-12-27 Thread Chris Nauroth
red to use LinuxContainerExecutor and verified launching the containers through container-executor worked. Chris Nauroth On Wed, Dec 21, 2022 at 11:29 AM Steve Loughran wrote: > Mukund and I have put together a release candidate (RC0) for Hadoop 3.3.5. > > Given the time of year it's a bit unrealistic

[jira] [Resolved] (HDFS-8510) Provide different timeout settings for hdfs dfsadmin -getDatanodeInfo.

2022-10-25 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-8510. - Resolution: Won't Fix This is an old improvement proposal that I'm no longer planning

[jira] [Resolved] (HDFS-4289) FsDatasetImpl#updateReplicaUnderRecovery throws errors validating replica byte count on Windows

2022-10-25 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-4289. - Resolution: Won't Fix I'm no longer actively working on this. I no longer have easy access

Re: [VOTE] Release Apache Hadoop 3.3.4

2022-08-03 Thread Chris Nauroth
it's something flaky that's already tracked in a JIRA issue. The release looks good. Steve, thank you for driving this. Chris Nauroth On Wed, Aug 3, 2022 at 11:27 AM Steve Loughran wrote: > my vote for this is +1, binding. > > obviously I`m biased, but i do not want to have to issue

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-21 Thread Chris Nauroth
for TestFsck, where the failure was caused by missing audit log entries. This test works by toggling global logging state, so I can see why multi-threaded execution might confuse the test. Chris Nauroth On Thu, Jul 21, 2022 at 12:01 AM Ashutosh Gupta wrote: > +1(non-binding) > > * Bu

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-19 Thread Chris Nauroth
analysis on these new test failures. I don't know if it's a quirk to my environment, though I'm using the start-build-env.sh Docker container, so any build dependencies should be consistent. I'd be comfortable moving ahead if others are seeing these tests pass. Chris Nauroth On Thu, Jul 14, 2022 at 7

Re: HDFS-16577 - Request for input - Let administrator override connection details when registering datanodes

2022-06-24 Thread Chris Nauroth
seen this? Does anything look helpful there? Chris Nauroth On Fri, Jun 24, 2022 at 4:55 AM Lars Francke wrote: > Hi everyone, > > we're trying to get HDFS running in Kubernetes using Kerberos. > This has some challenges as you might expect. > We have created an issue for that in

[jira] [Resolved] (HDFS-16623) IllegalArgumentException in LifelineSender

2022-06-10 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-16623. -- Hadoop Flags: Reviewed Resolution: Fixed I have committed this to trunk, branch-3.3

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-29 Thread Chris Nauroth
enough to hold up a release, so I'm still voting +1. Chris Nauroth On Sun, May 29, 2022 at 2:35 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > Thanks for the help, Ayush. > > I committed HADOOP-16663/HADOOP-16664 and cherry-picked HADOOP-16985 to > branch-2.

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-16 Thread Chris Nauroth
+1 (binding) - Verified all checksums. - Verified all signatures. - Built from source, including native code on Linux. - Ran several examples successfully. Chris Nauroth On Mon, May 16, 2022 at 10:06 AM Chao Sun wrote: > +1 > > - Compiled from source > - Verified checksums

Re: ElasticByteBufferPool is ever growing thus can cause memory leak.

2022-01-12 Thread Chris Nauroth
merged class? Chris Nauroth On Wed, Jan 12, 2022 at 1:25 AM Mukund Madhav Thakur wrote: > Hello Everyone, > I was just browsing through the code while doing my Vectored IO stuff. It > seems like ElasticByteBufferPool is an ever growing pool and memory is not > gett

Re: [DISCUSS] Hadoop 3.3.2 release?

2021-09-08 Thread Chris Nauroth
+1 Chao, thank you very much for volunteering on the release. Chris Nauroth On Tue, Sep 7, 2021 at 10:00 PM Igor Dvorzhak wrote: > +1 > > On Tue, Sep 7, 2021 at 10:06 AM Chao Sun wrote: > >> Hi all, >> >> It has been almost 3 months since the 3.3.1 release and

[jira] [Created] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-11995: Summary: HDFS Architecture documentation incorrectly describes writing to a local temporary file. Key: HDFS-11995 URL: https://issues.apache.org/jira/browse/HDFS-11995

[jira] [Created] (HDFS-11063) Set NameNode RPC server handler thread name with more descriptive information about the RPC call.

2016-10-26 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-11063: Summary: Set NameNode RPC server handler thread name with more descriptive information about the RPC call. Key: HDFS-11063 URL: https://issues.apache.org/jira/browse/HDFS-11063

[jira] [Created] (HDFS-11034) Provide a command line tool to clear decommissioned DataNode information from the NameNode without restarting.

2016-10-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-11034: Summary: Provide a command line tool to clear decommissioned DataNode information from the NameNode without restarting. Key: HDFS-11034 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (HDFS-6277) WebHdfsFileSystem#toUrl does not perform character escaping for rename

2016-09-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-6277. - Resolution: Won't Fix This bug is present in the 1.x line, but not 2.x or 3.x. I'm resolving

Re: Permission bit 12 in getFileInfo response

2016-09-19 Thread Chris Nauroth
es defined in FSAclBaseTest check for the presence of the ACL bit where expected. --Chris Nauroth On 9/19/16, 10:55 AM, "John Zhuge" <jzh...@cloudera.com> wrote: Hi Gurus, Does anyone know the meaning of bit 12 in the permission field of "getFileInfo" response? To m

Re: [VOTE] Release Apache Hadoop 2.7.3 RC1

2016-08-18 Thread Chris Nauroth
getting a patch on the compatibility doc that addresses the HDFS audit log specifically. --Chris Nauroth On 8/18/16, 8:47 AM, "Andrew Purtell" <andrew.purt...@gmail.com> wrote: An incompatible APIs change is developer unfriendly. An incompatible behavioral ch

Re: [DISCUSS] Retire BKJM from trunk?

2016-07-27 Thread Chris Nauroth
that want to keep it, I wouldn’t object. --Chris Nauroth On 7/26/16, 11:14 PM, "Vinayakumar B" <vinayakumar...@huawei.com> wrote: Hi All, BKJM was Active and made much stable when the NameNode HA was implemented and there was no QJM implemented. No

Re: Apache MSDN Offer is Back

2016-07-20 Thread Chris Nauroth
process to see if anything has changed in the benefits. --Chris Nauroth From: Ravi Prakash <ravihad...@gmail.com<mailto:ravihad...@gmail.com>> Date: Wednesday, July 20, 2016 at 12:04 PM To: Chris Nauroth <cnaur...@hortonworks.com<mailto:cnaur...@hortonworks.com>> Cc: "

Apache MSDN Offer is Back

2016-07-19 Thread Chris Nauroth
-licenses/msdn.txt. --Chris Nauroth

[jira] [Resolved] (HDFS-10546) hadoop-hdfs-native-client fails distro build when trying to copy libhdfs binaries.

2016-06-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-10546. -- Resolution: Duplicate I just realized this duplicates HDFS-10353, which fixed the problem

[jira] [Created] (HDFS-10546) hadoop-hdfs-native-client fails distro build when trying to copy libhdfs binaries.

2016-06-17 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10546: Summary: hadoop-hdfs-native-client fails distro build when trying to copy libhdfs binaries. Key: HDFS-10546 URL: https://issues.apache.org/jira/browse/HDFS-10546

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-06-10 Thread Chris Nauroth
Interestingly, that FindBugs warning in hadoop-azure-datalake was not flagged during pre-commit before I committed HADOOP-12666. I'm going to propose that we address it in scope of HADOOP-12875. --Chris Nauroth On 6/10/16, 10:30 AM, "Apache Jenkins Server" <jenk...@builds.apac

Re: INotify and atime

2016-06-08 Thread Chris Nauroth
. There is a test in the Hadoop codebase that exercises inotify event delivery on atime update: TestDFSInotifyEventInputStream#testBasic. You might try looking at the source of that test and comparing it to what your code is doing to see if there is any difference. --Chris Nauroth On 6/8/16

[jira] [Resolved] (HDFS-10502) Enabled memory locking and now HDFS won't start up

2016-06-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-10502. -- Resolution: Invalid Hello [~machey]. I recommend taking these questions to the u

Re: Another thought on client-side support of HDFS federation

2016-05-27 Thread Chris Nauroth
Hello Tianyi HE, I noticed that a similar design for a federation proxying model has just been proposed on Apache JIRA HDFS-10467. You might want to join the conversation there. https://issues.apache.org/jira/browse/HDFS-10467 --Chris Nauroth On 5/2/16, 10:32 AM, "Colin McCabe&q

Re: Cp command is not atomic

2016-05-25 Thread Chris Nauroth
ering side effect in the form of the b.xml._COPYING_ file. Perhaps it's sufficient for your use case that the final rename step is atomic. --Chris Nauroth On 5/25/16, 8:21 AM, "Kun Ren" <ren.h...@gmail.com> wrote: >Hi Genius, > >If I understand correctly,

Re: HDFS Federation-- cross namenodes operations

2016-05-25 Thread Chris Nauroth
Hello Kun, I replied to this same question on the user@ list. For usage questions like this, the user@ list is the correct forum. It's not necessary to cross-post to the dev@ lists. --Chris Nauroth On 5/25/16, 8:58 AM, "Kun Ren" <ren.h...@gmail.com> wrote: >Hi G

Re: ASF OS X Build Infrastructure

2016-05-21 Thread Chris Nauroth
. I'll send another update when I have something more specific to share. --Chris Nauroth From: Ravi Prakash <ravihad...@gmail.com<mailto:ravihad...@gmail.com>> Date: Friday, May 20, 2016 at 4:56 PM To: Sean Busbey <bus...@cloudera.com<mailto:bus...@cloudera.com>>

Re: ASF OS X Build Infrastructure

2016-05-20 Thread Chris Nauroth
It's very disappointing to see that vanish. I'm following up to see if I can learn more about what happened or if I can do anything to help reinstate it. --Chris Nauroth On 5/20/16, 6:11 AM, "Steve Loughran" <ste...@hortonworks.com> wrote: > >> On 20 May 201

[jira] [Created] (HDFS-10438) When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server.

2016-05-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10438: Summary: When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. Key: HDFS-10438 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-10437) ReconfigurationProtocol not covered by HDFSPolicyProvider.

2016-05-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10437: Summary: ReconfigurationProtocol not covered by HDFSPolicyProvider. Key: HDFS-10437 URL: https://issues.apache.org/jira/browse/HDFS-10437 Project: Hadoop HDFS

Re: ASF OS X Build Infrastructure

2016-05-19 Thread Chris Nauroth
, but it keeps slipping. I'll try once again to bump up priority. --Chris Nauroth On 5/19/16, 9:41 AM, "Allen Wittenauer" <a...@apache.org> wrote: > > Some of you may not know that the ASF actually does have an OS X machine >(a Mac mini, so it¹s not a

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-16 Thread Chris Nauroth
Understood about the tests. --Chris Nauroth On 5/15/16, 7:30 AM, "Allen Wittenauer" <a...@apache.org> wrote: > >> On May 14, 2016, at 3:11 PM, Chris Nauroth <cnaur...@hortonworks.com> >>wrote: >> >> +1 (binding) >> >> -Tried a d

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-14 Thread Chris Nauroth
attach a full patch to HADOOP-12930 to check pre-commit results? While testing this, I discovered a bug in the distro build for Windows. Could someone please code review my patch on HADOOP-13149? --Chris Nauroth On 5/9/16, 1:26 PM, "Allen Wittenauer" <a...@apache.org> wrote

[jira] [Resolved] (HDFS-10373) HDFS ZKFC HealthMonitor Throw a Exception Cause AutoFailOver

2016-05-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-10373. -- Resolution: Invalid Hello [~piaoyu zhang]. This doesn't look like a bug. If ZKFC cannot

[jira] [Resolved] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-10359. -- Resolution: Won't Fix I think there is momentum in this conversation towards a "Won'

[jira] [Created] (HDFS-10356) Ozone: Container server needs enhancements to control of bind address for greater flexibility and testability.

2016-05-02 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10356: Summary: Ozone: Container server needs enhancements to control of bind address for greater flexibility and testability. Key: HDFS-10356 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HDFS-10351) Ozone: Optimize key writes to chunks by providing a bulk write implementation in ChunkOutputStream.

2016-04-29 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10351: Summary: Ozone: Optimize key writes to chunks by providing a bulk write implementation in ChunkOutputStream. Key: HDFS-10351 URL: https://issues.apache.org/jira/browse/HDFS-10351

[jira] [Created] (HDFS-10349) StorageContainerManager fails to compile after merge of HDFS-10312 maxDataLength enforcement.

2016-04-29 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10349: Summary: StorageContainerManager fails to compile after merge of HDFS-10312 maxDataLength enforcement. Key: HDFS-10349 URL: https://issues.apache.org/jira/browse/HDFS-10349

Re: handlerCount

2016-04-28 Thread Chris Nauroth
/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java#L473-L 474 --Chris Nauroth On 4/28/16, 2:51 PM, "Kun Ren" <ren.h...@gmail.com> wrote: >Hi Genius, > >I have a quick question: > >I remembered I saw the default value for HandlerCout is 10(The number of >Ha

[jira] [Resolved] (HDFS-10322) DomianSocket error lead to more and more DataNode thread waiting

2016-04-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-10322. -- Resolution: Duplicate [~chenfolin], thank you for investigating this further. I'm just

[jira] [Reopened] (HDFS-10322) DomianSocket error lead to more and more DataNode thread waiting

2016-04-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-10322: -- > DomianSocket error lead to more and more DataNode thread wait

[jira] [Created] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

2016-04-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10312: Summary: Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Key: HDFS-10312 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-10268) Ozone: end-to-end integration for create/get volumes, buckets and keys.

2016-04-06 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-10268: Summary: Ozone: end-to-end integration for create/get volumes, buckets and keys. Key: HDFS-10268 URL: https://issues.apache.org/jira/browse/HDFS-10268 Project

[jira] [Resolved] (HDFS-10257) Quick Thread Local Storage set-up has a small flaw

2016-04-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-10257. -- Resolution: Not A Problem Great, thanks for confirming [~stevebovy]. I'll go ahead and close

[jira] [Resolved] (HDFS-350) DFSClient more robust if the namenode is busy doing GC

2016-03-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-350. Resolution: Not A Problem I'm resolving this issue. In current versions, the client is more robust

[jira] [Created] (HDFS-9907) Exclude Ozone protobuf-generated classes from Findbugs analysis.

2016-03-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9907: --- Summary: Exclude Ozone protobuf-generated classes from Findbugs analysis. Key: HDFS-9907 URL: https://issues.apache.org/jira/browse/HDFS-9907 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-9520) PeerCache evicts too frequently causing connection restablishments

2016-02-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9520. - Resolution: Won't Fix I'm resolving this as Won't Fix as per prior discussion. (Please feel free

[jira] [Resolved] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

2016-02-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-8943. - Resolution: Won't Fix [~cmccabe], thank you for the reminder. This is resolved as Won't Fix

[jira] [Resolved] (HDFS-9798) TestHdfsNativeCodeLoader fails

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9798. - Resolution: Duplicate Hi [~ajisakaa]. A recent Yetus change is preventing pre-commit from

Re: [Release thread] 2.8.0 release activities

2016-02-04 Thread Chris Nauroth
FYI, I've just needed to raise HDFS-9761 to blocker status for the 2.8.0 release. --Chris Nauroth On 2/3/16, 6:19 PM, "Karthik Kambatla" <ka...@cloudera.com> wrote: >Thanks Vinod. Not labeling 2.8.0 stable sounds perfectly reasonable to me. >Let us not call i

[jira] [Created] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-01-27 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9711: --- Summary: Integrate CSRF prevention filter in WebHDFS. Key: HDFS-9711 URL: https://issues.apache.org/jira/browse/HDFS-9711 Project: Hadoop HDFS Issue Type: New

Re: Hadoop encryption module as Apache Chimera incubator project

2016-01-21 Thread Chris Nauroth
nce we have that existing JIRA, let's keep this mail thread focused just on Chimera. Thank you! Uma and everyone, thank you for the proposal. +1 to proceed. --Chris Nauroth On 1/20/16, 11:16 PM, "Zheng, Kai" <kai.zh...@intel.com> wrote: >Thanks Uma. > >I have a ques

[jira] [Reopened] (HDFS-6255) fuse_dfs will not adhere to ACL permissions in some cases

2016-01-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-6255: - I have a theory about what is happening. fuse_dfs is not specifically made aware of the HDFS ACLs

[jira] [Reopened] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-9569: - I have reverted this patch from trunk, branch-2, branch-2.8 and branch-2.7. This patch introduced

[jira] [Created] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-11 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9552: --- Summary: Document types of permission checks performed for HDFS operations. Key: HDFS-9552 URL: https://issues.apache.org/jira/browse/HDFS-9552 Project: Hadoop HDFS

[jira] [Created] (HDFS-9534) Add CLI command to clear storage policy from a path.

2015-12-09 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9534: --- Summary: Add CLI command to clear storage policy from a path. Key: HDFS-9534 URL: https://issues.apache.org/jira/browse/HDFS-9534 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-03 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9505: --- Summary: HDFS Architecture documentation needs to be refreshed. Key: HDFS-9505 URL: https://issues.apache.org/jira/browse/HDFS-9505 Project: Hadoop HDFS Issue

Re: Outdated "HDFS Architecture" page

2015-12-03 Thread Chris Nauroth
to assign the JIRA to yourself. --Chris Nauroth On 12/3/15, 12:15 PM, "Dmitry Simonov" <dimmobor...@gmail.com> wrote: >Hello! > >Excuse me if I'm writing to the wrong mailing list. > >The information at >http://hadoop.apache.org/docs/current/hadoop-project-dist/ha

[jira] [Resolved] (HDFS-9495) Data node opens random port for HTTPServer, not configurable

2015-12-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9495. - Resolution: Duplicate Hello, [~neha.bathra]. This issue is tracked in HDFS-9049, so I'm resolving

[jira] [Created] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-11-30 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9483: --- Summary: Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Key: HDFS-9483 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (HDFS-9471) Webhdfs not working with shell command when kerberos security+https is enabled.

2015-11-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9471. - Resolution: Not A Problem [~surendrasingh], that's a good point about the documentation. I filed

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-25 Thread Chris Nauroth
+1. Thanks, Vinod. --Chris Nauroth On 11/25/15, 1:45 PM, "Vinod Kumar Vavilapalli" <vino...@apache.org> wrote: >Okay, tx for this clarification Chris! I dug more into this and now >realized the actual scope of this. Given the the limited nature of this >

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-25 Thread Chris Nauroth
wanted to prevent any mistaken assumptions for people only reading this thread. --Chris Nauroth On 11/25/15, 11:08 AM, "Vinod Kumar Vavilapalli" <vino...@apache.org> wrote: >This is the current state from the feedback I gathered. > - Support priorities across applic

[jira] [Reopened] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-9370: - > TestDataNodeUGIProvider fails intermittently due to non-deterministic cache >

[jira] [Resolved] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9370. - Resolution: Duplicate > TestDataNodeUGIProvider fails intermittently due to non-determinis

[jira] [Created] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9459: --- Summary: hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Key: HDFS-9459 URL: https://issues.apache.org/jira/browse/HDFS-9459 Project

[jira] [Created] (HDFS-9458) TestBackupNode always binds to port 50070, which can cause bind failures.

2015-11-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9458: --- Summary: TestBackupNode always binds to port 50070, which can cause bind failures. Key: HDFS-9458 URL: https://issues.apache.org/jira/browse/HDFS-9458 Project: Hadoop

[jira] [Created] (HDFS-9450) Fix failing HDFS tests on HDFS-7240 Ozone branch.

2015-11-23 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9450: --- Summary: Fix failing HDFS tests on HDFS-7240 Ozone branch. Key: HDFS-9450 URL: https://issues.apache.org/jira/browse/HDFS-9450 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9443) Disabling HDFS client socket cache causes logging message printed to console for CLI commands.

2015-11-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9443: --- Summary: Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Key: HDFS-9443 URL: https://issues.apache.org/jira/browse/HDFS-9443

[jira] [Resolved] (HDFS-190) DataNode should be marked as final to prevent subclassing

2015-11-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-190. Resolution: Won't Fix We're now in a situation where the current codebase uses subclassing

[jira] [Created] (HDFS-9409) DataNode shutdown does not guarantee full shutdown of all threads due to race condition.

2015-11-10 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9409: --- Summary: DataNode shutdown does not guarantee full shutdown of all threads due to race condition. Key: HDFS-9409 URL: https://issues.apache.org/jira/browse/HDFS-9409

[jira] [Resolved] (HDFS-9404) Findbugs issue reported in BlockRecoveryWorker$RecoveryTaskContiguous.recover()

2015-11-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9404. - Resolution: Duplicate Hi [~yzhangal]. This is tracked in HDFS-9401. Thanks! > Findbugs is

[jira] [Created] (HDFS-9400) TestRollingUpgradeRollback fails on branch-2.

2015-11-07 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9400: --- Summary: TestRollingUpgradeRollback fails on branch-2. Key: HDFS-9400 URL: https://issues.apache.org/jira/browse/HDFS-9400 Project: Hadoop HDFS Issue Type

Re: ReadOnly WebHDFS

2015-11-06 Thread Chris Nauroth
as a "Won't Fix", or perhaps others in the community see it differently from me, and we'd want to proceed. Thanks for sharing the work you've done! --Chris Nauroth On 11/6/15, 3:02 AM, "Laxman Ch" <laxman@gmail.com> wrote: >Hi, > >We run a cluster

[jira] [Created] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9384: --- Summary: TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Key: HDFS-9384 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-9394) branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing.

2015-11-05 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9394: --- Summary: branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Key: HDFS-9394 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9378: --- Summary: hadoop-hdfs-client tests do not write logs. Key: HDFS-9378 URL: https://issues.apache.org/jira/browse/HDFS-9378 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-03 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9370: --- Summary: TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry. Key: HDFS-9370 URL: https://issues.apache.org/jira/browse/HDFS-9370

[jira] [Created] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9362: --- Summary: TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Key: HDFS-9362 URL: https://issues.apache.org/jira/browse/HDFS-9362

[jira] [Created] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

2015-10-26 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9311: --- Summary: Support optional offload of NameNode HA service health checks to a separate RPC server. Key: HDFS-9311 URL: https://issues.apache.org/jira/browse/HDFS-9311

[jira] [Created] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-10-13 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9239: --- Summary: DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness Key: HDFS-9239 URL: https://issues.apache.org/jira/browse/HDFS-9239

[jira] [Created] (HDFS-9138) TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links

2015-09-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9138: --- Summary: TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links Key: HDFS-9138 URL: https://issues.apache.org

[jira] [Resolved] (HDFS-9138) TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links

2015-09-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9138. - Resolution: Not A Problem Yes, my earlier HDFS-8554 patch fixed this already. I was only seeing

[jira] [Resolved] (HDFS-9136) TestDFSUpgrade leaks file descriptors.

2015-09-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9136. - Resolution: Not A Problem I was mistaken. This actually got fixed as part of the test changes

[jira] [Created] (HDFS-9136) TestDFSUpgrade leaks file descriptors.

2015-09-23 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9136: --- Summary: TestDFSUpgrade leaks file descriptors. Key: HDFS-9136 URL: https://issues.apache.org/jira/browse/HDFS-9136 Project: Hadoop HDFS Issue Type: Bug

Re: Even after HDFS-2856 JSVC References are require..?

2015-09-14 Thread Chris Nauroth
oint to require a performance comparison before proceeding with any proposal of deprecating the jsvc deployment option. --Chris Nauroth On 9/14/15, 4:23 PM, "Colin P. McCabe" <cmcc...@apache.org> wrote: >Has anyone measured the overhead of running SASL on >DataTransferPro

Re: kindly confirm the behavior if configs are disabled after setting

2015-09-11 Thread Chris Nauroth
ACLs are still enforced when users attempt to access the files. This behavior is by design. If you're interested in more of the background discussion that led to these design decisions, please see the comments in issues HDFS-5899 and HDFS-5925. --Chris Nauroth From: Archana talamani

Re: Even after HDFS-2856 JSVC References are require..?

2015-09-10 Thread Chris Nauroth
everyone is on 2.6 first. This includes client deployments, which are notoriously more difficult to control than server deployments. --Chris Nauroth On 9/10/15, 1:21 AM, "Steve Loughran" <ste...@hortonworks.com> wrote: >SASL authenticates the DN on Hadoop 2.6+, but it r

Re: Any Error during BPOfferService run can leads to Missing DN.

2015-09-09 Thread Chris Nauroth
there. At a high level, I think we'll need to explore either aborting the whole DataNode process or attempting to recover the failed BPServiceActor thread. I'm not yet sure which approach is preferable. --Chris Nauroth From: Nijel s f <nijel...@huawei.com<mailto:nijel...@huawei.com>> Reply-To: H

Re: Even after HDFS-2856 JSVC References are require..?

2015-09-09 Thread Chris Nauroth
be considered for 3.x if we think the clean-up benefit outweighs the incompatibility cost. Before we do that, I'd prefer to hear if end users are having success with the SASL deployment model. Brahma, are you asking because you run clusters with the SASL approach? If so, has it been working well? --Chris

  1   2   3   4   5   >