Xiaoyu Yao created HADOOP-17710:
---
Summary: Use SSLFactory to initialize KeyManagerFactory for
LdapGroupsMapping
Key: HADOOP-17710
URL: https://issues.apache.org/jira/browse/HADOOP-17710
Project
[
https://issues.apache.org/jira/browse/HADOOP-17699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao resolved HADOOP-17699.
-
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Remove hardco
Xiaoyu Yao created HADOOP-17699:
---
Summary: Remove hardcoded "SunX509" usage from SSLFactory
Key: HADOOP-17699
URL: https://issues.apache.org/jira/browse/HADOOP-17699
Project: Had
Xiaoyu Yao created HADOOP-17598:
---
Summary: Fix java doc issue introduced by HADOOP-17578
Key: HADOOP-17598
URL: https://issues.apache.org/jira/browse/HADOOP-17598
Project: Hadoop Common
Issue
Xiaoyu Yao created HADOOP-17581:
---
Summary: Fix reference to LOG is ambiguous after HADOOP-17482
Key: HADOOP-17581
URL: https://issues.apache.org/jira/browse/HADOOP-17581
Project: Hadoop Common
Xiaoyu Yao created HADOOP-17578:
---
Summary: Improve UGI debug log to help troubleshoot TokenCache
related issues
Key: HADOOP-17578
URL: https://issues.apache.org/jira/browse/HADOOP-17578
Project: Hadoop
Xiaoyu Yao created HADOOP-17304:
---
Summary: Fix TestKMS.testACLs
Key: HADOOP-17304
URL: https://issues.apache.org/jira/browse/HADOOP-17304
Project: Hadoop Common
Issue Type: Improvement
Xiaoyu Yao created HADOOP-17284:
---
Summary: Support BCFKS keystores for Hadoop Credential Provider
Key: HADOOP-17284
URL: https://issues.apache.org/jira/browse/HADOOP-17284
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-17259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao resolved HADOOP-17259.
-
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
Thanks [~ste
Xiaoyu Yao created HADOOP-17259:
---
Summary: SSLFactory should fallback to input config if ssl-*.xml
fail to load from classpath
Key: HADOOP-17259
URL: https://issues.apache.org/jira/browse/HADOOP-17259
+1 (binding)
* Verify the checksums and signatures.
* Verify basic Ozone file system and S3 operations via CLI in secure docker
compose environment
* Run MR examples and teragen/terasort with ozone secure enabled.
* Verify EN/CN document rendering with hugo serve
Thanks Sammi for driving the rele
Xiaoyu Yao created HADOOP-17208:
---
Summary: LoadBalanceKMSClientProvider#deleteKey should
invalidateCache for all the KMSClientProvider instances
Key: HADOOP-17208
URL: https://issues.apache.org/jira/browse/HADOOP
Xiaoyu Yao created HADOOP-17162:
---
Summary: Ozone /conf endpoint trigger kerberos replay error when
SPNEGO is enabled
Key: HADOOP-17162
URL: https://issues.apache.org/jira/browse/HADOOP-17162
Project
Xiaoyu Yao created HADOOP-17079:
---
Summary: Optimize UGI#getGroups by adding UGI#getGroupsSet
Key: HADOOP-17079
URL: https://issues.apache.org/jira/browse/HADOOP-17079
Project: Hadoop Common
+1 binding
Download source and verify signature.
Verify build and documents.
Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
Verify multiple RATIS-3 pipelines are created as expected.
Tried ozone shell commands via o3 and o3fs, focus on security and HA
related.
Only find a
It's my pleasure to announce that Siyao Meng has been elected as committer
on the Apache Hadoop project recognizing his continued contributions to the
project.
Please join me in congratulating him.
Congratulations & Welcome aboard Siyao!
Xiaoyu Yao
(On behalf of the Hadoop PMC)
Xiaoyu Yao created HADOOP-16885:
---
Summary: Encryption zone file copy failure leaks temp file
._COPYING_ and wrapped stream
Key: HADOOP-16885
URL: https://issues.apache.org/jira/browse/HADOOP-16885
Xiaoyu Yao created HADOOP-16884:
---
Summary: Encryption zone file copy failure leaks temp file
._COPYING_ and wrapped stream
Key: HADOOP-16884
URL: https://issues.apache.org/jira/browse/HADOOP-16884
+1 binding. Verified
* Verify the signature.
* Build from source.
* Deploy docker compose in secure mode and verify ACL, sample MR jobs
Thanks,
Xiaoyu
On Fri, Oct 11, 2019 at 5:37 PM Hanisha Koneru
wrote:
> Thank you Nanda for putting up the RC.
>
> +1 binding.
>
> Verified the following:
> -
+1 Binding. Thanks all who contributed to the release.
+ Download sources and verify signature.
+ Build from source and ran docker-based ad-hot security tests.
++ From 1 datanode scale to 3 datanodes, verify certificates were correctly
issued when security enabled
++ Smoke test for both non-secu
+1 (binding)
- Build from source
- Misc security tests with docker compose
- MR and Spark sample jobs with secure ozone cluster
—Xiaoyu
> On Apr 19, 2019, at 3:40 PM, Anu Engineer
> wrote:
>
> +1 (Binding)
>
> -- Verified the checksums.
> -- Built from sources.
> -- Sniff tested the functio
Xiaoyu Yao created HADOOP-16199:
---
Summary: KMSLoadBlanceClientProvider does not select token
correctly
Key: HADOOP-16199
URL: https://issues.apache.org/jira/browse/HADOOP-16199
Project: Hadoop Common
Xiaoyu Yao created HADOOP-16172:
---
Summary: Update apache/hadoop:3 to 3.2.0 release
Key: HADOOP-16172
URL: https://issues.apache.org/jira/browse/HADOOP-16172
Project: Hadoop Common
Issue Type
+1
-Xiaoyu
Sent from my iPhone
> On Feb 4, 2019, at 7:54 AM, Suma Shivaprasad
> wrote:
>
> +1 ( non binding)
>
> On Mon, Feb 4, 2019 at 7:23 AM Shashikant Banerjee <
> sbaner...@hortonworks.com> wrote:
>
>> +1 (non-binding)
>>
>> Thanks
>> Shashi
>>
>> On 2/4/19, 8:27 PM, "Elek, Marton"
+1, thanks for bringing this up, Wangda. This will help expanding the Hadoop
ecosystem by supporting new AI/ML workloads.
Thanks,
Xiaoyu
On 2/1/19, 10:58 AM, "Dinesh Chitlangia" wrote:
+1 This is a fantastic recommendation given the increasing interest in ML
across the globe.
Th
+1 (binding), these will useful features for enterprise adoption of Ozone/Hdds.
Thanks,
Xiaoyu
On 1/12/19, 3:43 AM, "Lokesh Jain" wrote:
+1 (non-binding)
Thanks
Lokesh
> On 12-Jan-2019, at 3:00 PM, Sandeep Nemuri wrote:
>
> +1 (non-binding)
>
> On S
Hi Akira,
Thanks for the pointer. I pulled the change of HADOOP-15916 from trunk to
HDDS-4 branch last week but we are still seeing similar failures from Jenkins
like this one
(https://builds.apache.org/job/PreCommit-HDDS-Build/1801/artifact/out/patch-unit-hadoop-ozone_common.txt).
Can you hel
Xiaoyu Yao created HADOOP-15939:
---
Summary: Filter overlapping objenesis class in
hadoop-client-minicluster
Key: HADOOP-15939
URL: https://issues.apache.org/jira/browse/HADOOP-15939
Project: Hadoop
Thanks all for the efforts to reach the 1st ozone release.
+1 (binding).
1. Download src and verify Signature and Checksum.
2. Build with sources.
3. Run Acceptance tests.
3. Run docker cluster and scale tests.
4. Verify ozone sh and ozone fs shell with basic volume/bucket/key inter-ops.
5. Run
Xiaoyu Yao created HADOOP-15641:
---
Summary: Fix ozone docker-compose illegal character in hostname
Key: HADOOP-15641
URL: https://issues.apache.org/jira/browse/HADOOP-15641
Project: Hadoop Common
s.
Thanks to Hanisha Koneru, Arpit Agarwal, Anu Engineer, Jitendra Pandey,
Xiaoyu Yao, Ajay Kumar, Mukul Kumar Singh, Marton Elek and Shashikant Banerjee
for their contributions in design, development and code reviews.
[
https://issues.apache.org/jira/browse/HADOOP-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao resolved HADOOP-15468.
-
Resolution: Invalid
Please send your questions to common-dev@hadoop.apache.org.
>
Could this caused by the docker base image changes? As shown in the error
message, we are still expecting protobuf v2.5.0 but the one in the docker image
is changed to libprotoc 2.6.1.
In hadoop/dev-support/docker/Dockerfile, we have the following lines to install
libprotoc without specifying v
Xiaoyu Yao created HADOOP-15327:
---
Summary: Upgrade MR ShuffleHandler to use Netty4
Key: HADOOP-15327
URL: https://issues.apache.org/jira/browse/HADOOP-15327
Project: Hadoop Common
Issue Type
Hi Lei,
Thank you for your interest in Ozone. Let me answer each of the
specific questions.
> As the current state of Ozone implementation, what are the major
> benefits of using today’s Ozone over HDFS?
Scale - HDFS tops out at 500/700 million keys; Ozone primary
use case is to go beyond tha
Xiaoyu Yao created HADOOP-14933:
---
Summary: CLONE - KMSClientProvider won't work with KMS delegation
token retrieved from non-Java client.
Key: HADOOP-14933
URL: https://issues.apache.org/jira/browse/HADOOP-
Xiaoyu Yao created HADOOP-14920:
---
Summary: KMSClientProvider won't work with KMS delegation token
retrieved from non-Java client.
Key: HADOOP-14920
URL: https://issues.apache.org/jira/browse/HADOOP-
[
https://issues.apache.org/jira/browse/HADOOP-14207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao resolved HADOOP-14207.
-
Resolution: Fixed
I've pushed the fix to branch-2.8 and branch-2.8.1. Thanks!
> &
Xiaoyu Yao created HADOOP-14139:
---
Summary: Tracing canonized server name from HTTP request during
SPNEGO
Key: HADOOP-14139
URL: https://issues.apache.org/jira/browse/HADOOP-14139
Project: Hadoop Common
Xiaoyu Yao created HADOOP-14029:
---
Summary: Fix KMSClientProvider for non-secure proxy user use case
Key: HADOOP-14029
URL: https://issues.apache.org/jira/browse/HADOOP-14029
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-13988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao reopened HADOOP-13988:
-
> KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyU
Xiaoyu Yao created HADOOP-13924:
---
Summary: Update checkstyle plugin to handle indentation of JDK8
Lambdas
Key: HADOOP-13924
URL: https://issues.apache.org/jira/browse/HADOOP-13924
Project: Hadoop
Xiaoyu Yao created HADOOP-13907:
---
Summary: Fix KerberosUtil#getDefaultRealm() on Windows
Key: HADOOP-13907
URL: https://issues.apache.org/jira/browse/HADOOP-13907
Project: Hadoop Common
Issue
[
https://issues.apache.org/jira/browse/HADOOP-13565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao reopened HADOOP-13565:
-
Reopen the issue as the change breaks the existing multiple HTTP principles
support. I will
Xiaoyu Yao created HADOOP-13771:
---
Summary: Adding group mapping lookup utility without dependency on
HDFS namenode
Key: HADOOP-13771
URL: https://issues.apache.org/jira/browse/HADOOP-13771
Project
Xiaoyu Yao created HADOOP-13686:
---
Summary: Adding additional unit test for Trash (I)
Key: HADOOP-13686
URL: https://issues.apache.org/jira/browse/HADOOP-13686
Project: Hadoop Common
Issue Type
Xiaoyu Yao created HADOOP-13685:
---
Summary: Document -safely option to rm command.
Key: HADOOP-13685
URL: https://issues.apache.org/jira/browse/HADOOP-13685
Project: Hadoop Common
Issue Type
Xiaoyu Yao created HADOOP-13520:
---
Summary: Document HADOOP-10158 for multi home/SPN support of HTTP
principles
Key: HADOOP-13520
URL: https://issues.apache.org/jira/browse/HADOOP-13520
Project: Hadoop
Xiaoyu Yao created HADOOP-13269:
---
Summary: Define RPC resource token for HDFS
Key: HADOOP-13269
URL: https://issues.apache.org/jira/browse/HADOOP-13269
Project: Hadoop Common
Issue Type: Sub
Xiaoyu Yao created HADOOP-13268:
---
Summary: Persist and load HDFS namenode RPC resource token
Key: HADOOP-13268
URL: https://issues.apache.org/jira/browse/HADOOP-13268
Project: Hadoop Common
Xiaoyu Yao created HADOOP-13267:
---
Summary: HDFS namenode RPC resource token implementation
Key: HADOOP-13267
URL: https://issues.apache.org/jira/browse/HADOOP-13267
Project: Hadoop Common
Xiaoyu Yao created HADOOP-13266:
---
Summary: Extend RPC headers for resource token
Key: HADOOP-13266
URL: https://issues.apache.org/jira/browse/HADOOP-13266
Project: Hadoop Common
Issue Type
Xiaoyu Yao created HADOOP-13265:
---
Summary: Add resource token protocol
Key: HADOOP-13265
URL: https://issues.apache.org/jira/browse/HADOOP-13265
Project: Hadoop Common
Issue Type: Sub-task
Xiaoyu Yao created HADOOP-13244:
---
Summary: o.a.h.ipc.Server#Server should honor handlerCount when
queueSizePerHandler is specified in consturctor
Key: HADOOP-13244
URL: https://issues.apache.org/jira/browse/HADOOP
Xiaoyu Yao created HADOOP-13197:
---
Summary: Add non-decayed call metrics for DecayRpcScheduler
Key: HADOOP-13197
URL: https://issues.apache.org/jira/browse/HADOOP-13197
Project: Hadoop Common
>
>Regards,
>Akira
>
>On 5/18/16 10:28, Sangjin Lee wrote:
>> No, I think it is this commit:
>> https://github.com/apache/hadoop/commit/e205421555841dbf482d6aa1464cc15788b2b1fb
>> (HADOOP-13157).
>>
>> On Tue, May 17, 2016 at 6:13 PM, Xiaoyu Y
Hadoop Branch-2 build is broken by this commit.
ac8fb579c6058fec60caf30682f902413d68edf3: "Remove parent's env vars from child
processes”
[ERROR] COMPILATION ERROR :
[INFO] -
[ERROR]
/Users/xyao/hadoop/hadoop-common-project/hadoop-comm
Xiaoyu Yao created HADOOP-13159:
---
Summary: Fix potential NPE in Metrics2 source for RPC scheduler
Key: HADOOP-13159
URL: https://issues.apache.org/jira/browse/HADOOP-13159
Project: Hadoop Common
Xiaoyu Yao created HADOOP-13128:
---
Summary: Manage Hadoop RPC resource usage via resource coupon
Key: HADOOP-13128
URL: https://issues.apache.org/jira/browse/HADOOP-13128
Project: Hadoop Common
Xiaoyu Yao created HADOOP-13101:
---
Summary: TestDNS.testDefaultDnsServer failed intermittently.
Key: HADOOP-13101
URL: https://issues.apache.org/jira/browse/HADOOP-13101
Project: Hadoop Common
Xiaoyu Yao created HADOOP-13040:
---
Summary: HADOOP_NAMENODE_OPTS does not pass -DconfigKey=Value to
namenode as parameter
Key: HADOOP-13040
URL: https://issues.apache.org/jira/browse/HADOOP-13040
Xiaoyu Yao created HADOOP-12993:
---
Summary: Change ShutdownHookManger complete shutdown log from INFO
to DEBUG
Key: HADOOP-12993
URL: https://issues.apache.org/jira/browse/HADOOP-12993
Project: Hadoop
Xiaoyu Yao created HADOOP-12985:
---
Summary: Support MetricsSource interface for DecayRpcScheduler
Metrics
Key: HADOOP-12985
URL: https://issues.apache.org/jira/browse/HADOOP-12985
Project: Hadoop Common
Xiaoyu Yao created HADOOP-12980:
---
Summary: Document RPC scheduler/callqueue configuration keys
Key: HADOOP-12980
URL: https://issues.apache.org/jira/browse/HADOOP-12980
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao resolved HADOOP-12966.
-
Resolution: Duplicate
> TestNativeLibraryChecker is crash
[
https://issues.apache.org/jira/browse/HADOOP-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao resolved HADOOP-12922.
-
Resolution: Duplicate
This is covered in HADOOP-12916.
> Separate Scheduler from
Xiaoyu Yao created HADOOP-12950:
---
Summary: ShutdownHookManager should have a timeout for each of the
Registered shutdown hook
Key: HADOOP-12950
URL: https://issues.apache.org/jira/browse/HADOOP-12950
Xiaoyu Yao created HADOOP-12922:
---
Summary: Separate Scheduler from FCQ
Key: HADOOP-12922
URL: https://issues.apache.org/jira/browse/HADOOP-12922
Project: Hadoop Common
Issue Type: Sub-task
Xiaoyu Yao created HADOOP-12916:
---
Summary: Allow different Hadoop IPC Call Queue throttling policies
with FCQ/BackOff
Key: HADOOP-12916
URL: https://issues.apache.org/jira/browse/HADOOP-12916
Project
Xiaoyu Yao created HADOOP-12787:
---
Summary: KMS SPNEGO sequence does not work with WEBHDFS
Key: HADOOP-12787
URL: https://issues.apache.org/jira/browse/HADOOP-12787
Project: Hadoop Common
Issue
Xiaoyu Yao created HADOOP-12716:
---
Summary: KerberosAuthenticator#doSpnegoSequence use incorrect
class to determine isKeyTab in JDK8
Key: HADOOP-12716
URL: https://issues.apache.org/jira/browse/HADOOP-12716
+1, should we start a vote on this?
On 10/29/15, 11:54 AM, "Ashish" wrote:
>+1
>
>On Thu, Oct 29, 2015 at 11:51 AM, Mingliang Liu wrote:
>> +1 (non-binding)
>>
>> Mingliang Liu
>> Member of Technical Staff - HDFS,
>> Hortonworks Inc.
>> m...@hortonworks.com
>>
>>
>>
>>> On Oct 29, 2015, at 1
Can you change ZLIB_HOME to ZLIB_HOME=C:\bin\zlib-1.2.8 and copy two header
files (zconf.h, lib.h) from %ZLIB_HOME%\include to %ZLIB_HOME%?
Also, can you check if the Platform variable is defined?
set Platform=x64 when building on a 64-bit system and set Platform=Win32 when
building on a 32-bi
Xiaoyu Yao created HADOOP-12521:
---
Summary: Document
Key: HADOOP-12521
URL: https://issues.apache.org/jira/browse/HADOOP-12521
Project: Hadoop Common
Issue Type: Improvement
Affects
Xiaoyu Yao created HADOOP-12453:
---
Summary: Support decoding KMS Delegation Token with its own
Identifier
Key: HADOOP-12453
URL: https://issues.apache.org/jira/browse/HADOOP-12453
Project: Hadoop Common
Xiaoyu Yao created HADOOP-12358:
---
Summary: FSShell should prompt before deleting directories bigger
than a configured size
Key: HADOOP-12358
URL: https://issues.apache.org/jira/browse/HADOOP-12358
Xiaoyu Yao created HADOOP-12347:
---
Summary: Fix mismatch parameter name in javadocs of
AuthToken#setMaxInactives
Key: HADOOP-12347
URL: https://issues.apache.org/jira/browse/HADOOP-12347
Project: Hadoop
Xiaoyu Yao created HADOOP-12290:
---
Summary: hadoop fs -ls command returns inconsistent results with
wildcards
Key: HADOOP-12290
URL: https://issues.apache.org/jira/browse/HADOOP-12290
Project: Hadoop
Xiaoyu Yao created HADOOP-12288:
---
Summary: test-patch.sh does not give any detail on its -1 warning
report.
Key: HADOOP-12288
URL: https://issues.apache.org/jira/browse/HADOOP-12288
Project: Hadoop
Xiaoyu Yao created HADOOP-11857:
---
Summary: Fix CommandFormat#commandFormat java doc annotation
Key: HADOOP-11857
URL: https://issues.apache.org/jira/browse/HADOOP-11857
Project: Hadoop Common
+1. (Non-binding)
- Download hadoop-2.7.0-RC0-src.tar.gz and build locally.
- Deploy a single node cluster and run some quota related hdfs/hadoop
shell commands.
- Run sample MR jobs.
All basic tests result looks good to me.
Thanks,
Xiaoyu
On 4/13/15, 5:43 AM, "Junping Du" wrote:
>+1. (No
Xiaoyu Yao created HADOOP-11795:
---
Summary: Fix Hadoop unit test failures on Windows
Key: HADOOP-11795
URL: https://issues.apache.org/jira/browse/HADOOP-11795
Project: Hadoop Common
Issue Type
[
https://issues.apache.org/jira/browse/HADOOP-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoyu Yao resolved HADOOP-11773.
-
Resolution: Duplicate
> KMSClientProvider#addDelegationTokens should use ActualUgi for pr
Xiaoyu Yao created HADOOP-11773:
---
Summary: KMSClientProvider#addDelegationTokens should use
ActualUgi for proxy user authentication
Key: HADOOP-11773
URL: https://issues.apache.org/jira/browse/HADOOP-11773
Xiaoyu Yao created HADOOP-11587:
---
Summary: TestMapFile#testMainMethodMapFile creates test files in
hadoop-common project root
Key: HADOOP-11587
URL: https://issues.apache.org/jira/browse/HADOOP-11587
Xiaoyu Yao created HADOOP-11577:
---
Summary: Need document for storage type label of data node storage
locations under dfs.data.dir
Key: HADOOP-11577
URL: https://issues.apache.org/jira/browse/HADOOP-11577
+1 (non-binding)
Successfully download the hadoop-2.6.0-rc1 source code, build and deploy a
single node clusters with the following new HDFS features configured.
* HDFS-6581 (Memory Storage),
* HDFS-6584 (Archival Storage & Storage Policy),
* HDFS-6134 (KMS & HDFS at rest data encryption)
I r
Xiaoyu Yao created HADOOP-11193:
---
Summary:
Java_org_apache_hadoop_io_nativeio_NativeIO_00024POSIX_fstat returns
uninitialized mode on Windows
Key: HADOOP-11193
URL: https://issues.apache.org/jira/browse/HADOOP
Xiaoyu Yao created HADOOP-11088:
---
Summary: TestKeyShell and TestCredShell assume UNIX path separator
for JECKS key store path
Key: HADOOP-11088
URL: https://issues.apache.org/jira/browse/HADOOP-11088
Xiaoyu Yao created HADOOP-11073:
---
Summary: Credential Provider related Unit Tests Failure on Windows
Key: HADOOP-11073
URL: https://issues.apache.org/jira/browse/HADOOP-11073
Project: Hadoop Common
90 matches
Mail list logo