[jira] [Created] (HDDS-859) Fix NPE ServerUtils#getOzoneMetaDirPath

2018-11-20 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-859: --- Summary: Fix NPE ServerUtils#getOzoneMetaDirPath Key: HDDS-859 URL: https://issues.apache.org/jira/browse/HDDS-859 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Commented] (HDDS-855) Move OMMetadataManager from hadoop-ozone/ozone-manager to hadoop-ozone/common

2018-11-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693861#comment-16693861 ] Xiaoyu Yao commented on HDDS-855: - +1 for the patch. But it seems all ozone tests are busted by some

[jira] [Commented] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693698#comment-16693698 ] Xiaoyu Yao commented on HDDS-9: --- Thanks [~ajayydv] for the review. I've addressed your 2/3 comments in patch

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Attachment: HDDS-9-HDDS-4.004.patch > Add GRPC protocol interceptors for Ozone Block Token >

[jira] [Created] (HDDS-857) Adding more DN permission info into the block token identifier

2018-11-19 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-857: --- Summary: Adding more DN permission info into the block token identifier Key: HDDS-857 URL: https://issues.apache.org/jira/browse/HDDS-857 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-856) Add Channelz support for Ozone GRPC endpoints

2018-11-19 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-856: --- Summary: Add Channelz support for Ozone GRPC endpoints Key: HDDS-856 URL: https://issues.apache.org/jira/browse/HDDS-856 Project: Hadoop Distributed Data Store Issue

[jira] [Work started] (HDDS-115) GRPC: Support secure gRPC endpoint with mTLS

2018-11-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDDS-115 started by Xiaoyu Yao. --- > GRPC: Support secure gRPC endpoint with mTLS >

[jira] [Commented] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692434#comment-16692434 ] Xiaoyu Yao commented on HDDS-9: --- Upload a new patch based on offline discussion. Delta of v3: add maxLength

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Attachment: HDDS-9-HDDS-4.003.patch > Add GRPC protocol interceptors for Ozone Block Token >

[jira] [Commented] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16690979#comment-16690979 ] Xiaoyu Yao commented on HDDS-9: --- Thanks [~jnp] for the review. The block ID is a string in block token

[jira] [Updated] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-120: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~dineshchitlangia] for the

[jira] [Updated] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-120: Fix Version/s: 0.4.0 > Adding HDDS datanode Audit Log > -- > >

[jira] [Commented] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689945#comment-16689945 ] Xiaoyu Yao commented on HDDS-9: --- File HADOOP-15939 for the shadedclient issue with a trunk patch for the fix.

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689615#comment-16689615 ] Xiaoyu Yao commented on HDDS-120: - Thanks [~dineshchitlangia] for the update. +1 for v7 patch. I plan to

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Attachment: HDDS-9-HDDS-4.002.patch > Add GRPC protocol interceptors for Ozone Block Token >

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689051#comment-16689051 ] Xiaoyu Yao commented on HDDS-120: - True, but you will have four separate if() and auditmsg object creation

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689030#comment-16689030 ] Xiaoyu Yao commented on HDDS-120: - If we could defer the auditmsg creation further down the AUDIT class,

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689014#comment-16689014 ] Xiaoyu Yao commented on HDDS-120: - Move this out of HDDS-4 subtask as the patch is for trunk.  > Adding

[jira] [Updated] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-120: Issue Type: New Feature (was: Sub-task) Parent: (was: HDDS-4) > Adding HDDS datanode Audit Log

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689010#comment-16689010 ] Xiaoyu Yao commented on HDDS-120: - [~arpitagarwal]/[~dineshchitlangia], if we conditionally create the

[jira] [Commented] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688825#comment-16688825 ] Xiaoyu Yao commented on HDDS-9: --- Summary of the change: # Add GRPC Client/Server Credential Interceptor to

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Attachment: (was: HDDS-9-HDDS-4.001.patch) > Add GRPC protocol interceptors for Ozone Block Token >

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Attachment: HDDS-9-HDDS-4.001.patch > Add GRPC protocol interceptors for Ozone Block Token >

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Status: Patch Available (was: Open) > Add GRPC protocol interceptors for Ozone Block Token >

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Attachment: HDDS-9-HDDS-4.001.patch > Add GRPC protocol interceptors for Ozone Block Token >

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptors for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Summary: Add GRPC protocol interceptors for Ozone Block Token (was: Add GRPC protocol interceptor for Ozone Block

[jira] [Updated] (HDDS-9) Add GRPC protocol interceptor for Ozone Block Token

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-9: -- Summary: Add GRPC protocol interceptor for Ozone Block Token (was: Add OzoneManager Block Token Support) > Add

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688326#comment-16688326 ] Xiaoyu Yao commented on HDDS-120: - Thanks [~dineshchitlangia] for the update. +1 for the v6 patch and I

[jira] [Commented] (HDDS-8) Add OzoneManager Delegation Token support

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687478#comment-16687478 ] Xiaoyu Yao commented on HDDS-8: --- [~ajayydv], please eliminate the changes in hadoop-common (DelegationKey.java

[jira] [Resolved] (HDDS-135) SCM CA: Update DelegationKey to retrieve private/public key

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-135. - Resolution: Implemented This has been implemented with HDDS-836. > SCM CA: Update DelegationKey to

[jira] [Comment Edited] (HDDS-836) Add TokenIdentifier Ozone for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687245#comment-16687245 ] Xiaoyu Yao edited comment on HDDS-836 at 11/14/18 10:41 PM: As [~jnpandey]

[jira] [Commented] (HDDS-836) Add TokenIdentifier Ozone for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687245#comment-16687245 ] Xiaoyu Yao commented on HDDS-836: - As [~jnpandey] pointed out in HDDS-8,  OzoneDelegationTokenSelector

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687228#comment-16687228 ] Xiaoyu Yao commented on HDDS-836: - I don't think the Jenkins javac/cc results are related to this patch. I

[jira] [Updated] (HDDS-836) Add TokenIdentifier Ozone for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-836: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~ajayydv] for the contribution.

[jira] [Comment Edited] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687228#comment-16687228 ] Xiaoyu Yao edited comment on HDDS-836 at 11/14/18 10:24 PM: I don't think the

[jira] [Updated] (HDDS-836) Add TokenIdentifier Ozone for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-836: Summary: Add TokenIdentifier Ozone for delegation token and block token (was: Create Ozone identifier for

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687011#comment-16687011 ] Xiaoyu Yao commented on HDDS-120: - Thanks [~dineshchitlangia] for the update. Patch v5 looks pretty good to

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687013#comment-16687013 ] Xiaoyu Yao commented on HDDS-836: - There is an unexpected change in HDDSKeyPEMWriter.java, can you remove

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686952#comment-16686952 ] Xiaoyu Yao commented on HDDS-836: - Thanks [~ajayydv] for the update. Two more minor issues, +1 after that

[jira] [Commented] (HDDS-8) Add OzoneManager Delegation Token support

2018-11-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685983#comment-16685983 ] Xiaoyu Yao commented on HDDS-8: --- [~jnp], AbstractDelegationTokenSecretManager has assumption on using symmetric

[jira] [Commented] (HDDS-836) Create Ozone identifier for delegation token and block token

2018-11-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685976#comment-16685976 ] Xiaoyu Yao commented on HDDS-836: - Thanks [~ajayydv] for the patch. It looks good to me overall. Just have

[jira] [Commented] (HDDS-823) OzoneRestClient is failing with NPE on getKeyDetails call

2018-11-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680552#comment-16680552 ] Xiaoyu Yao commented on HDDS-823: - Thanks [~bharatviswa] for fixing this. Patch LGTM, +1.  >

[jira] [Commented] (HDDS-778) Add an interface for CA and Clients for Certificate operations

2018-11-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680089#comment-16680089 ] Xiaoyu Yao commented on HDDS-778: - Thanks [~anu] for the update. +1 on V2 patch. [~ajayydv], let's handle

[jira] [Commented] (HDDS-120) Adding HDDS datanode Audit Log

2018-11-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678693#comment-16678693 ] Xiaoyu Yao commented on HDDS-120: - Thanks [~dineshchitlangia] for working on this. Patch v2 looks pretty

[jira] [Commented] (HDDS-767) OM should not search for STDOUT root logger for audit logging

2018-11-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678698#comment-16678698 ] Xiaoyu Yao commented on HDDS-767: - [~dineshchitlangia], fix looks good to me. Do you mind check if any of

[jira] [Updated] (HDDS-592) Fix ozone-secure.robot test

2018-11-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-592: Resolution: Fixed Fix Version/s: 0.4.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDDS-592) Fix ozone-secure.robot test

2018-11-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675940#comment-16675940 ] Xiaoyu Yao commented on HDDS-592: - Patch LGTM, +1. Thanks [~ajayydv] for fixing this. > Fix

[jira] [Commented] (HDDS-778) Add an interface for CA and Clients for Certificate operations

2018-11-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675935#comment-16675935 ] Xiaoyu Yao commented on HDDS-778: - {quote}This patch is running against trunk in Jenkins. I am

[jira] [Commented] (HDDS-753) SCM security protocol server is not starting

2018-11-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672269#comment-16672269 ] Xiaoyu Yao commented on HDDS-753: - +1 for the v2 patch. The unit test failures are not related and will be

[jira] [Commented] (HDDS-778) Add an interface for CA and Clients for Certificate operations

2018-10-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670595#comment-16670595 ] Xiaoyu Yao commented on HDDS-778: - Thanks [~anu] for the patch. It looks good to me overall. Just two minor

[jira] [Commented] (HDDS-580) Bootstrap OM/SCM with private/public key pair

2018-10-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667599#comment-16667599 ] Xiaoyu Yao commented on HDDS-580: - The current --init and --init-security are based on the non-dempotent

[jira] [Commented] (HDDS-580) Bootstrap OM/SCM with private/public key pair

2018-10-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667543#comment-16667543 ] Xiaoyu Yao commented on HDDS-580: - bq. Why do we have a command line called INIT_SECURITY since it will

[jira] [Commented] (HDDS-103) SCM CA: Add new security protocol for SCM to expose security related functions

2018-10-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665717#comment-16665717 ] Xiaoyu Yao commented on HDDS-103: - Thansk [~ajayydv] for the update. +1 for v5 patch pending Jenkins. >

[jira] [Commented] (HDDS-580) Bootstrap OM/SCM with private/public key pair

2018-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664461#comment-16664461 ] Xiaoyu Yao commented on HDDS-580: - Thanks [~ajayydv] for the update. Patch v7 looks very good to me. A few

[jira] [Commented] (HDDS-103) SCM CA: Add new security protocol for SCM to expose security related functions

2018-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664432#comment-16664432 ] Xiaoyu Yao commented on HDDS-103: - Thanks [~ajayydv] for the update. Patch v4 looks good to me. Few minor

[jira] [Updated] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-684: Resolution: Fixed Status: Resolved (was: Patch Available) > Fix HDDS-4 branch after HDDS-490 and

[jira] [Commented] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662964#comment-16662964 ] Xiaoyu Yao commented on HDDS-684: - Thanks [~ajayydv] for the review. I've commit the patch to the feature

[jira] [Commented] (HDDS-731) Add shutdown hook to shutdown XceiverServerRatis on daemon stop

2018-10-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662712#comment-16662712 ] Xiaoyu Yao commented on HDDS-731: - Thanks [~msingh] for the patch. It looks good to me overall. Here are a

[jira] [Commented] (HDDS-101) SCM CA: generate CSR for SCM CA clients

2018-10-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661300#comment-16661300 ] Xiaoyu Yao commented on HDDS-101: - [~ajayydv], we hide unnecessary extension details with this wrapper

[jira] [Updated] (HDDS-704) Fix the Dependency convergence issue on HDDS-4

2018-10-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-704: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~anu] for the review. I've commit

[jira] [Comment Edited] (HDDS-704) Fix the Dependency convergence issue on HDDS-4

2018-10-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657500#comment-16657500 ] Xiaoyu Yao edited comment on HDDS-704 at 10/20/18 4:07 AM: --- bcpkix-jdk15on

[jira] [Updated] (HDDS-704) Fix the Dependency convergence issue on HDDS-4

2018-10-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-704: Attachment: HDDS-704-HDDS-4.001.patch > Fix the Dependency convergence issue on HDDS-4 >

[jira] [Updated] (HDDS-704) Fix the Dependency convergence issue on HDDS-4

2018-10-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-704: Status: Patch Available (was: Open) > Fix the Dependency convergence issue on HDDS-4 >

[jira] [Commented] (HDDS-704) Fix the Dependency convergence issue on HDDS-4

2018-10-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657500#comment-16657500 ] Xiaoyu Yao commented on HDDS-704: - bcpkix-jdk15on depends on bcprov-jdk15on. Once way to fix this is to

[jira] [Created] (HDDS-704) Fix the Dependency convergence issue on HDDS-4

2018-10-19 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-704: --- Summary: Fix the Dependency convergence issue on HDDS-4 Key: HDDS-704 URL: https://issues.apache.org/jira/browse/HDDS-704 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDDS-700) Support Node selection based on network topology

2018-10-18 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-700: --- Summary: Support Node selection based on network topology Key: HDDS-700 URL: https://issues.apache.org/jira/browse/HDDS-700 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-699) Detect Ozone Network topology

2018-10-18 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-699: --- Summary: Detect Ozone Network topology Key: HDDS-699 URL: https://issues.apache.org/jira/browse/HDDS-699 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Created] (HDDS-698) Support Topology Awareness for Ozone

2018-10-18 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-698: --- Summary: Support Topology Awareness for Ozone Key: HDDS-698 URL: https://issues.apache.org/jira/browse/HDDS-698 Project: Hadoop Distributed Data Store Issue Type: New

[jira] [Updated] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-684: Attachment: HDDS-684-HDDS-4.002.patch > Fix HDDS-4 branch after HDDS-490 and HADOOP-15832 >

[jira] [Commented] (HDDS-580) Bootstrap OM/SCM with private/public key pair

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655803#comment-16655803 ] Xiaoyu Yao commented on HDDS-580: - Thanks [~ajayydv] for working on this. Patch looks good to me overall.

[jira] [Updated] (HDDS-103) SCM CA: Add new security protocol for SCM to expose security related functions

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-103: Attachment: HDDS-103-HDDS-4.02.patch > SCM CA: Add new security protocol for SCM to expose security related

[jira] [Commented] (HDDS-103) SCM CA: Add new security protocol for SCM to expose security related functions

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655725#comment-16655725 ] Xiaoyu Yao commented on HDDS-103: - [~ajayydv], I rebase the patch to the latest HDDS-4. A few more

[jira] [Created] (HDDS-696) Bootstrap genesis SCM(CA) with self-signed certificate.

2018-10-18 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-696: --- Summary: Bootstrap genesis SCM(CA) with self-signed certificate. Key: HDDS-696 URL: https://issues.apache.org/jira/browse/HDDS-696 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-684: Status: Patch Available (was: Open) > Fix HDDS-4 branch after HDDS-490 and HADOOP-15832 >

[jira] [Updated] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-684: Attachment: HDDS-684-HDDS-4.001.patch > Fix HDDS-4 branch after HDDS-490 and HADOOP-15832 >

[jira] [Updated] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-684: Issue Type: Sub-task (was: Bug) Parent: HDDS-4 > Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

[jira] [Commented] (HDDS-673) Suppress "Key not found" exception log with stack trace in OM

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655645#comment-16655645 ] Xiaoyu Yao commented on HDDS-673: - Thanks [~arpitagarwal] for the patch. It looks good to me, +1 pending

[jira] [Assigned] (HDDS-673) Suppress "Key not found" exception log with stack trace in OM

2018-10-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-673: --- Assignee: Arpit Agarwal (was: Xiaoyu Yao) > Suppress "Key not found" exception log with stack trace

[jira] [Updated] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-684: Description: After rebase HDDS-4, we need to fix the branch with the change introduced by HADOOP-15832 (bc

[jira] [Created] (HDDS-684) Fix HDDS-4 branch after HDDS-490 and HADOOP-15832

2018-10-17 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-684: --- Summary: Fix HDDS-4 branch after HDDS-490 and HADOOP-15832 Key: HDDS-684 URL: https://issues.apache.org/jira/browse/HDDS-684 Project: Hadoop Distributed Data Store

[jira] [Comment Edited] (HDDS-670) Hive insert fails against Ozone external table

2018-10-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652598#comment-16652598 ] Xiaoyu Yao edited comment on HDDS-670 at 10/17/18 12:25 AM: Here is the repro

[jira] [Created] (HDDS-673) Suppress "Key not found" exception log with stack trace in OM

2018-10-16 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-673: --- Summary: Suppress "Key not found" exception log with stack trace in OM Key: HDDS-673 URL: https://issues.apache.org/jira/browse/HDDS-673 Project: Hadoop Distributed Data Store

[jira] [Assigned] (HDDS-670) Hive insert fails against Ozone external table

2018-10-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-670: --- Assignee: Hanisha Koneru > Hive insert fails against Ozone external table >

[jira] [Commented] (HDDS-670) Hive insert fails against Ozone external table

2018-10-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652598#comment-16652598 ] Xiaoyu Yao commented on HDDS-670: - Here is the repro steps: {code} hadoop fs -mv

[jira] [Commented] (HDDS-637) Not able to access the part-r-00000 file after the MR job succeeds

2018-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648620#comment-16648620 ] Xiaoyu Yao commented on HDDS-637: - Thanks [~nmaheshwari] for reporting the issue. Do you restart the DN

[jira] [Assigned] (HDDS-637) Not able to access the part-r-00000 file after the MR job succeeds

2018-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-637: --- Assignee: Xiaoyu Yao > Not able to access the part-r-0 file after the MR job succeeds >

[jira] [Updated] (HDDS-555) RandomKeyGenerator runs not closing the XceiverClient properly

2018-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-555: Resolution: Fixed Fix Version/s: 0.3.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDDS-555) RandomKeyGenerator runs not closing the XceiverClient properly

2018-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648183#comment-16648183 ] Xiaoyu Yao commented on HDDS-555: - Good catch, [~msingh]! Patch LGTM, +1 and I will commit it shortly. >

[jira] [Commented] (HDDS-624) PutBlock fails with Unexpected Storage Container Exception

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647475#comment-16647475 ] Xiaoyu Yao commented on HDDS-624: - Thanks [~arpitagarwal] for the fix. Patch v1 LGTM, +1 pending Jenkins.

[jira] [Updated] (HDDS-609) On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-609: Target Version/s: 0.3.0 > On restart, SCM does not exit chill mode as it expects DNs to report > containers

[jira] [Updated] (HDDS-627) OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-627: Fix Version/s: 0.4.0 > OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException >

[jira] [Updated] (HDDS-627) OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-627: Resolution: Fixed Fix Version/s: 0.3.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDDS-627) OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647082#comment-16647082 ] Xiaoyu Yao commented on HDDS-627: - +1, I will commit it shortly. > OzoneFS read from an MR Job throws

[jira] [Updated] (HDDS-627) OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-627: Target Version/s: 0.3.0 > OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException >

[jira] [Updated] (HDDS-634) OzoneFS: support basic user group and permission for file/dir

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-634: Description: This ticket is opened to support S3AFilesystem like user/group and permission for dir/file

[jira] [Updated] (HDDS-634) OzoneFS: support basic user group and permission for file/dir

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-634: Status: Patch Available (was: Open) > OzoneFS: support basic user group and permission for file/dir >

[jira] [Updated] (HDDS-634) OzoneFS: support basic user group and permission for file/dir

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-634: Attachment: HDDS-643.001.patch > OzoneFS: support basic user group and permission for file/dir >

[jira] [Created] (HDDS-634) OzoneFS: support basic user group and permission for file/dir

2018-10-11 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-634: --- Summary: OzoneFS: support basic user group and permission for file/dir Key: HDDS-634 URL: https://issues.apache.org/jira/browse/HDDS-634 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-624) PutBlock fails with Unexpected Storage Container Exception

2018-10-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647006#comment-16647006 ] Xiaoyu Yao commented on HDDS-624: - This is very likely to be the similar rocksdb version issue as

[jira] [Commented] (HDDS-580) Bootstrap OM/SCM with private/public key pair

2018-10-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645731#comment-16645731 ] Xiaoyu Yao commented on HDDS-580: - Thanks [~ajayydv] for working on this. The patch looks good to me

<    3   4   5   6   7   8   9   10   11   12   >