[jira] [Resolved] (HDDS-1644) Overload RpcClient#createKey to pass non-default acls
[ https://issues.apache.org/jira/browse/HDDS-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1644. -- Resolution: Won't Fix > Overload RpcClient#createKey to pass non-default acls > - > > Key: HDDS-1644 > URL: https://issues.apache.org/jira/browse/HDDS-1644 > Project: Hadoop Distributed Data Store > Issue Type: New Feature >Reporter: Ajay Kumar >Assignee: Anu Engineer >Priority: Major > > Overload RpcClient#createKey to pass default acls as function parameters. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1768) Audit permission failures from authorizer
Ajay Kumar created HDDS-1768: Summary: Audit permission failures from authorizer Key: HDDS-1768 URL: https://issues.apache.org/jira/browse/HDDS-1768 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Audit permission failures from authorizer -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1657) Fix bug in volume and key native acl.
Ajay Kumar created HDDS-1657: Summary: Fix bug in volume and key native acl. Key: HDDS-1657 URL: https://issues.apache.org/jira/browse/HDDS-1657 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar Assignee: Ajay Kumar Fix bug in volume and key native acl. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1656) Fix flakey test TestWatchForCommit#testWatchForCommitWithKeyWrite
Ajay Kumar created HDDS-1656: Summary: Fix flakey test TestWatchForCommit#testWatchForCommitWithKeyWrite Key: HDDS-1656 URL: https://issues.apache.org/jira/browse/HDDS-1656 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar TestWatchForCommit#testWatchForCommitWithKeyWrite behavior is not consistent. In multiple runs sometimes it passes while on other occasions it fails with different assertion/DN related errors. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1547) Add integration tests for ozone native acls
[ https://issues.apache.org/jira/browse/HDDS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1547. -- Resolution: Implemented Handled in [HDDS-1545] > Add integration tests for ozone native acls > --- > > Key: HDDS-1547 > URL: https://issues.apache.org/jira/browse/HDDS-1547 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Reporter: Ajay Kumar >Assignee: Ajay Kumar >Priority: Major > > Add integration tests for ozone native acls -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1644) Overload RpcClient#createKey to pass default acls
Ajay Kumar created HDDS-1644: Summary: Overload RpcClient#createKey to pass default acls Key: HDDS-1644 URL: https://issues.apache.org/jira/browse/HDDS-1644 Project: Hadoop Distributed Data Store Issue Type: New Feature Reporter: Ajay Kumar Assignee: Anu Engineer add native acl support for OM operations -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1619) Changes for OM HA.
Ajay Kumar created HDDS-1619: Summary: Changes for OM HA. Key: HDDS-1619 URL: https://issues.apache.org/jira/browse/HDDS-1619 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar [HDDS-1539] adds 4 new api for Ozone rpc client. OM HA implementation needs to handle them. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1547) Add integration tests for ozone native acls
Ajay Kumar created HDDS-1547: Summary: Add integration tests for ozone native acls Key: HDDS-1547 URL: https://issues.apache.org/jira/browse/HDDS-1547 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Add integration tests for ozone native acls -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1545) Cli to add,remove,get and delete acls for Ozone objects
Ajay Kumar created HDDS-1545: Summary: Cli to add,remove,get and delete acls for Ozone objects Key: HDDS-1545 URL: https://issues.apache.org/jira/browse/HDDS-1545 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Cli to add,remove,get and delete acls for Ozone objects -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1544) Add dAcls for volume, bucket, keys and prefix
Ajay Kumar created HDDS-1544: Summary: Add dAcls for volume, bucket, keys and prefix Key: HDDS-1544 URL: https://issues.apache.org/jira/browse/HDDS-1544 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Add dAcls for volume, bucket, keys and prefix -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1543) Implement addAcl,removeAcl,setAcl,getAcl for Prefix
Ajay Kumar created HDDS-1543: Summary: Implement addAcl,removeAcl,setAcl,getAcl for Prefix Key: HDDS-1543 URL: https://issues.apache.org/jira/browse/HDDS-1543 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Implement addAcl,removeAcl,setAcl,getAcl for Prefix -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1546) Performance testing: Evaluate effect on memory, response time with few 1000 acls and deny acls
Ajay Kumar created HDDS-1546: Summary: Performance testing: Evaluate effect on memory, response time with few 1000 acls and deny acls Key: HDDS-1546 URL: https://issues.apache.org/jira/browse/HDDS-1546 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Performance testing: Evaluate effect on memory, response time with few 1000 acls and deny acls -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1542) Create Radix tree from ozone objects,getAcl ACLs on OM startup
Ajay Kumar created HDDS-1542: Summary: Create Radix tree from ozone objects,getAcl ACLs on OM startup Key: HDDS-1542 URL: https://issues.apache.org/jira/browse/HDDS-1542 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Create Radix tree from ozone objects,getAcl ACLs on OM startup -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1540) Implement addAcl,removeAcl,setAcl,getAcl for Bucket
Ajay Kumar created HDDS-1540: Summary: Implement addAcl,removeAcl,setAcl,getAcl for Bucket Key: HDDS-1540 URL: https://issues.apache.org/jira/browse/HDDS-1540 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Implement addAcl,removeAcl,setAcl,getAcl for Bucket -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1539) Implement addAcl,removeAcl,setAcl,getAcl for Volume
Ajay Kumar created HDDS-1539: Summary: Implement addAcl,removeAcl,setAcl,getAcl for Volume Key: HDDS-1539 URL: https://issues.apache.org/jira/browse/HDDS-1539 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Implement addAcl,removeAcl,setAcl,getAcl for Volume -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1541) Implement addAcl,removeAcl,setAcl,getAcl for Key
Ajay Kumar created HDDS-1541: Summary: Implement addAcl,removeAcl,setAcl,getAcl for Key Key: HDDS-1541 URL: https://issues.apache.org/jira/browse/HDDS-1541 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Implement addAcl,removeAcl,setAcl,getAcl for Key -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1538) Update ozone protobuf message for ACLs
Ajay Kumar created HDDS-1538: Summary: Update ozone protobuf message for ACLs Key: HDDS-1538 URL: https://issues.apache.org/jira/browse/HDDS-1538 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Update ozone protobuf message for ACLs -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1472) Add retry to kinit command in smoketests
Ajay Kumar created HDDS-1472: Summary: Add retry to kinit command in smoketests Key: HDDS-1472 URL: https://issues.apache.org/jira/browse/HDDS-1472 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Add retry to kinit command in smoketests -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1471) Update ratis dependency to 0.3.0
Ajay Kumar created HDDS-1471: Summary: Update ratis dependency to 0.3.0 Key: HDDS-1471 URL: https://issues.apache.org/jira/browse/HDDS-1471 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Update ratis dependency to 0.3.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1463) Add CA certificate to build chain of trust for DT and BT validation.
Ajay Kumar created HDDS-1463: Summary: Add CA certificate to build chain of trust for DT and BT validation. Key: HDDS-1463 URL: https://issues.apache.org/jira/browse/HDDS-1463 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar Add CA certificate to build chain of trust for DT and BT validation. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1450) Fix nightly run failures after HDDS-976
[ https://issues.apache.org/jira/browse/HDDS-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1450. -- Resolution: Fixed [~xyao] thanks for the patch. > Fix nightly run failures after HDDS-976 > --- > > Key: HDDS-1450 > URL: https://issues.apache.org/jira/browse/HDDS-1450 > Project: Hadoop Distributed Data Store > Issue Type: Bug >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao >Priority: Minor > Labels: pull-request-available > Time Spent: 1h 10m > Remaining Estimate: 0h > > [https://ci.anzix.net/job/ozone-nightly/72/testReport/] -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1423) Spark job fails to create ozone rpc client
[ https://issues.apache.org/jira/browse/HDDS-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1423. -- Resolution: Not A Problem > Spark job fails to create ozone rpc client > -- > > Key: HDDS-1423 > URL: https://issues.apache.org/jira/browse/HDDS-1423 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Affects Versions: 0.4.0 >Reporter: Ajay Kumar >Assignee: Ajay Kumar >Priority: Blocker > > spark job fails to run. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1442) add spark container to ozonesecure-mr compose files
Ajay Kumar created HDDS-1442: Summary: add spark container to ozonesecure-mr compose files Key: HDDS-1442 URL: https://issues.apache.org/jira/browse/HDDS-1442 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar add spark container to ozonesecure-mr compose files -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1439) ozone spark job failing with class not found error for hadoop 2
[ https://issues.apache.org/jira/browse/HDDS-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1439. -- Resolution: Not A Problem This error comes because of config issue. fs.o3fs.impl should be set to org.apache.hadoop.fs.ozone.BasicOzoneFileSystem for Hadoop 2. > ozone spark job failing with class not found error for hadoop 2 > --- > > Key: HDDS-1439 > URL: https://issues.apache.org/jira/browse/HDDS-1439 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Affects Versions: 0.4.0 >Reporter: Ajay Kumar >Assignee: Ajay Kumar >Priority: Major > > spark job fails to run. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1439) ozone spark job failing with class not found error for hadoop 2
Ajay Kumar created HDDS-1439: Summary: ozone spark job failing with class not found error for hadoop 2 Key: HDDS-1439 URL: https://issues.apache.org/jira/browse/HDDS-1439 Project: Hadoop Distributed Data Store Issue Type: Sub-task Affects Versions: 0.4.0 Reporter: Ajay Kumar Assignee: Ajay Kumar spark job fails to run. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1430) NPE if secure ozone if KMS uri is not defined.
Ajay Kumar created HDDS-1430: Summary: NPE if secure ozone if KMS uri is not defined. Key: HDDS-1430 URL: https://issues.apache.org/jira/browse/HDDS-1430 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar OzoneKMSUtil.getKeyProvider throws NPE if KMS uri is not defined. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1423) Spark job fails to create ozone rpc client
Ajay Kumar created HDDS-1423: Summary: Spark job fails to create ozone rpc client Key: HDDS-1423 URL: https://issues.apache.org/jira/browse/HDDS-1423 Project: Hadoop Distributed Data Store Issue Type: Sub-task Affects Versions: 0.4.0 Reporter: Ajay Kumar Assignee: Ajay Kumar spark job fails to run. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1377) OM failed to start with incorrect hostname set as ip address in CSR
[
https://issues.apache.org/jira/browse/HDDS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kumar resolved HDDS-1377.
--
Resolution: Fixed
[~xyao] thanks for the patch, committed to trunk and ozone-0.4.
> OM failed to start with incorrect hostname set as ip address in CSR
> ---
>
> Key: HDDS-1377
> URL: https://issues.apache.org/jira/browse/HDDS-1377
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
>Affects Versions: 0.4.0
>Reporter: Xiaoyu Yao
>Assignee: Xiaoyu Yao
>Priority: Blocker
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> OM failed to start after HDDS-1355.
> {code}
> om_1 | 2019-04-03 16:23:50 ERROR OzoneManager:865 - Failed to start the
> OzoneManager.
> om_1 | java.lang.IllegalArgumentException: IP Address is invalid
> om_1 | at org.bouncycastle.asn1.x509.GeneralName.(Unknown Source)
> om_1 | at
> org.apache.hadoop.hdds.security.x509.certificates.utils.CertificateSignRequest$Builder.addAltName(CertificateSignRequest.java:205)
> om_1 | at
> org.apache.hadoop.hdds.security.x509.certificates.utils.CertificateSignRequest$Builder.addIpAddress(CertificateSignRequest.java:197)
> om_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.getSCMSignedCert(OzoneManager.java:1387)
> om_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.initializeSecurity(OzoneManager.java:1018)
> om_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.omInit(OzoneManager.java:971)
> om_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.createOm(OzoneManager.java:928)
> om_1 | at org.apache.hadoop.ozone.om.OzoneManager.main(OzoneManager.java:859)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Reopened] (HDDS-1310) In datanode once a container becomes unhealthy, datanode restart fails.
[
https://issues.apache.org/jira/browse/HDDS-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kumar reopened HDDS-1310:
--
Tests failures seems to be related. Lets fix them before commit.
> In datanode once a container becomes unhealthy, datanode restart fails.
> ---
>
> Key: HDDS-1310
> URL: https://issues.apache.org/jira/browse/HDDS-1310
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Ozone Datanode
>Affects Versions: 0.3.0
>Reporter: Sandeep Nemuri
>Assignee: Sandeep Nemuri
>Priority: Blocker
> Attachments: HDDS-1310.001.patch, HDDS-1310.002.patch
>
>
> When a container is marked as {{UNHEALTHY}} in a datanode, subsequent restart
> of that datanode fails as it cannot generate ContainerReports anymore.
> Unhealthy state of a container is not handled in ContainerReport generation
> inside a datanode.
> We get the below exception when a datanode tries to generate the
> ContainerReport which contains unhealthy container(s)
> {noformat}
> 2019-03-19 13:51:13,646 [Datanode State Machine Thread - 0] ERROR -
> Unable to communicate to SCM server at x.x.xxx:9861 for past 3300
> seconds.
> org.apache.hadoop.hdds.scm.container.common.helpers.StorageContainerException:
> Invalid Container state found: 86
> at
> org.apache.hadoop.ozone.container.keyvalue.KeyValueContainer.getHddsState(KeyValueContainer.java:623)
> at
> org.apache.hadoop.ozone.container.keyvalue.KeyValueContainer.getContainerReport(KeyValueContainer.java:593)
> at
> org.apache.hadoop.ozone.container.common.impl.ContainerSet.getContainerReport(ContainerSet.java:204)
> at
> org.apache.hadoop.ozone.container.ozoneimpl.ContainerController.getContainerReport(ContainerController.java:82)
> at
> org.apache.hadoop.ozone.container.common.states.endpoint.RegisterEndpointTask.call(RegisterEndpointTask.java:114)
> at
> org.apache.hadoop.ozone.container.common.states.endpoint.RegisterEndpointTask.call(RegisterEndpointTask.java:47)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1314) TestOzoneDelegationTokenSecretManager is failing because of NPE
[
https://issues.apache.org/jira/browse/HDDS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kumar resolved HDDS-1314.
--
Resolution: Cannot Reproduce
> TestOzoneDelegationTokenSecretManager is failing because of NPE
> ---
>
> Key: HDDS-1314
> URL: https://issues.apache.org/jira/browse/HDDS-1314
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Security
>Affects Versions: 0.4.0
>Reporter: Mukul Kumar Singh
>Assignee: Ajay Kumar
>Priority: Major
>
> TestOzoneDelegationTokenSecretManager is failing because of NPE
> {code}
> java.lang.NullPointerException
> at
> org.apache.hadoop.ozone.security.TestOzoneDelegationTokenSecretManager.tearDown(TestOzoneDelegationTokenSecretManager.java:133)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1062) Enable service policy authorization for HDDS group
[ https://issues.apache.org/jira/browse/HDDS-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1062. -- Resolution: Fixed > Enable service policy authorization for HDDS group > -- > > Key: HDDS-1062 > URL: https://issues.apache.org/jira/browse/HDDS-1062 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Reporter: Ajay Kumar >Assignee: Ajay Kumar >Priority: Major > > Enable service policy authorization for HDDS group. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1118) OM get the certificate from SCM CA for token validation
[ https://issues.apache.org/jira/browse/HDDS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1118. -- Resolution: Fixed > OM get the certificate from SCM CA for token validation > --- > > Key: HDDS-1118 > URL: https://issues.apache.org/jira/browse/HDDS-1118 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao >Priority: Major > Labels: newbie > > This is needed when the OM received delegation token signed by other OM > instances and it does not have the certificate for foreign OM. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1055) Refactor om token db as column family.
[ https://issues.apache.org/jira/browse/HDDS-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1055. -- Resolution: Implemented > Refactor om token db as column family. > -- > > Key: HDDS-1055 > URL: https://issues.apache.org/jira/browse/HDDS-1055 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Reporter: Ajay Kumar >Assignee: Anu Engineer >Priority: Major > Labels: Security, blocker > Fix For: 0.4.0 > > > Currently OM stores delegation tokens in a separate db. i.e "om-token.db". We > should refactor this to be column family storing data in existing om db file. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1304) Ozone ha breaks service discovery
Ajay Kumar created HDDS-1304: Summary: Ozone ha breaks service discovery Key: HDDS-1304 URL: https://issues.apache.org/jira/browse/HDDS-1304 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Nanda kumar Ozone ha breaks service discovery -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1303) add native acl support for OM operations
Ajay Kumar created HDDS-1303: Summary: add native acl support for OM operations Key: HDDS-1303 URL: https://issues.apache.org/jira/browse/HDDS-1303 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1296) Fix checkstyle issue from Nightly run
[ https://issues.apache.org/jira/browse/HDDS-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-1296. -- Resolution: Fixed [~xyao] thanks for taking care of this. > Fix checkstyle issue from Nightly run > - > > Key: HDDS-1296 > URL: https://issues.apache.org/jira/browse/HDDS-1296 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Affects Versions: 0.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao >Priority: Major > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > [https://ci.anzix.net/job/ozone-nightly/32/checkstyle/moduleName.588460772/fileName.-1184872187/] > -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-595) Add robot test for OM Delegation Token
[ https://issues.apache.org/jira/browse/HDDS-595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-595. - Resolution: Won't Fix > Add robot test for OM Delegation Token > --- > > Key: HDDS-595 > URL: https://issues.apache.org/jira/browse/HDDS-595 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Reporter: Xiaoyu Yao >Assignee: Ajay Kumar >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-600) Mapreduce example fails with java.lang.IllegalArgumentException: Bucket or Volume name has an unsupported character
[
https://issues.apache.org/jira/browse/HDDS-600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kumar resolved HDDS-600.
-
Resolution: Not A Problem
> Mapreduce example fails with java.lang.IllegalArgumentException: Bucket or
> Volume name has an unsupported character
> ---
>
> Key: HDDS-600
> URL: https://issues.apache.org/jira/browse/HDDS-600
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: documentation
>Reporter: Namit Maheshwari
>Assignee: Hanisha Koneru
>Priority: Blocker
> Labels: app-compat, test-badlands
>
> Set up a hadoop cluster where ozone is also installed. Ozone can be
> referenced via o3://xx.xx.xx.xx:9889
> {code:java}
> [root@ctr-e138-1518143905142-510793-01-02 ~]# ozone sh bucket list
> o3://xx.xx.xx.xx:9889/volume1/
> 2018-10-09 07:21:24,624 WARN util.NativeCodeLoader: Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> [ {
> "volumeName" : "volume1",
> "bucketName" : "bucket1",
> "createdOn" : "Tue, 09 Oct 2018 06:48:02 GMT",
> "acls" : [ {
> "type" : "USER",
> "name" : "root",
> "rights" : "READ_WRITE"
> }, {
> "type" : "GROUP",
> "name" : "root",
> "rights" : "READ_WRITE"
> } ],
> "versioning" : "DISABLED",
> "storageType" : "DISK"
> } ]
> [root@ctr-e138-1518143905142-510793-01-02 ~]# ozone sh key list
> o3://xx.xx.xx.xx:9889/volume1/bucket1
> 2018-10-09 07:21:54,500 WARN util.NativeCodeLoader: Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> [ {
> "version" : 0,
> "md5hash" : null,
> "createdOn" : "Tue, 09 Oct 2018 06:58:32 GMT",
> "modifiedOn" : "Tue, 09 Oct 2018 06:58:32 GMT",
> "size" : 0,
> "keyName" : "mr_job_dir"
> } ]
> [root@ctr-e138-1518143905142-510793-01-02 ~]#{code}
> Hdfs is also set fine as below
> {code:java}
> [root@ctr-e138-1518143905142-510793-01-02 ~]# hdfs dfs -ls
> /tmp/mr_jobs/input/
> Found 1 items
> -rw-r--r-- 3 root hdfs 215755 2018-10-09 06:37
> /tmp/mr_jobs/input/wordcount_input_1.txt
> [root@ctr-e138-1518143905142-510793-01-02 ~]#{code}
> Now try to run Mapreduce example job against ozone o3:
> {code:java}
> [root@ctr-e138-1518143905142-510793-01-02 ~]#
> /usr/hdp/current/hadoop-client/bin/hadoop jar
> /usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-examples.jar
> wordcount /tmp/mr_jobs/input/
> o3://xx.xx.xx.xx:9889/volume1/bucket1/mr_job_dir/output
> 18/10/09 07:15:38 INFO conf.Configuration: Removed undeclared tags:
> java.lang.IllegalArgumentException: Bucket or Volume name has an unsupported
> character : :
> at
> org.apache.hadoop.hdds.scm.client.HddsClientUtils.verifyResourceName(HddsClientUtils.java:143)
> at
> org.apache.hadoop.ozone.client.rpc.RpcClient.getVolumeDetails(RpcClient.java:231)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.ozone.client.OzoneClientInvocationHandler.invoke(OzoneClientInvocationHandler.java:54)
> at com.sun.proxy.$Proxy16.getVolumeDetails(Unknown Source)
> at org.apache.hadoop.ozone.client.ObjectStore.getVolume(ObjectStore.java:92)
> at
> org.apache.hadoop.fs.ozone.OzoneFileSystem.initialize(OzoneFileSystem.java:121)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
> at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361)
> at
> org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.setOutputPath(FileOutputFormat.java:178)
> at org.apache.hadoop.examples.WordCount.main(WordCount.java:85)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
>
[jira] [Resolved] (HDDS-859) Fix NPE ServerUtils#getOzoneMetaDirPath
[
https://issues.apache.org/jira/browse/HDDS-859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kumar resolved HDDS-859.
-
Resolution: Not A Problem
> Fix NPE ServerUtils#getOzoneMetaDirPath
> ---
>
> Key: HDDS-859
> URL: https://issues.apache.org/jira/browse/HDDS-859
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
>Reporter: Xiaoyu Yao
>Assignee: Xiaoyu Yao
>Priority: Minor
> Labels: test-badlands
>
> This can be reproed with "mvn test" under hadoop-ozone project but not with
> individual test run under IntelliJ.
>
> {code:java}
> Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.33 s <<<
> FAILURE! - in org.apache.hadoop.ozone.TestOmUtils
> testNoOmDbDirConfigured(org.apache.hadoop.ozone.TestOmUtils) Time elapsed:
> 0.028 s <<< FAILURE!
> java.lang.AssertionError:
>
> Expected: an instance of java.lang.IllegalArgumentException
> but: is a java.lang.NullPointerException
> Stacktrace was: java.lang.NullPointerException
> at
> com.google.common.base.Preconditions.checkNotNull(Preconditions.java:187)
> at
> org.apache.hadoop.hdds.server.ServerUtils.getOzoneMetaDirPath(ServerUtils.java:130)
> at org.apache.hadoop.ozone.OmUtils.getOmDbDir(OmUtils.java:141)
> at
> org.apache.hadoop.ozone.TestOmUtils.testNoOmDbDirConfigured(TestOmUtils.java:89)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
>
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1255) Split security related tests in multiple robot test files for better modularity
Ajay Kumar created HDDS-1255: Summary: Split security related tests in multiple robot test files for better modularity Key: HDDS-1255 URL: https://issues.apache.org/jira/browse/HDDS-1255 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1254) Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer
Ajay Kumar created HDDS-1254: Summary: Fix failure in TestOzoneManagerHttpServer & TestStorageContainerManagerHttpServer Key: HDDS-1254 URL: https://issues.apache.org/jira/browse/HDDS-1254 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Xiaoyu Yao Investigate failure of TestDefaultCertificateClient#testSignDataStream in jenkins run. https://builds.apache.org/job/PreCommit-HDDS-Build/2217/testReport/org.apache.hadoop.hdds.security.x509.certificate.client/TestDefaultCertificateClient/testSignDataStream/ -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1230) Update OzoneServiceProvider in s3 gateway to handle OM ha
Ajay Kumar created HDDS-1230: Summary: Update OzoneServiceProvider in s3 gateway to handle OM ha Key: HDDS-1230 URL: https://issues.apache.org/jira/browse/HDDS-1230 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Update OzoneServiceProvider in s3 gateway to handle OM ha -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1216) Change name of ozoneManager service in docker compose files to om
Ajay Kumar created HDDS-1216: Summary: Change name of ozoneManager service in docker compose files to om Key: HDDS-1216 URL: https://issues.apache.org/jira/browse/HDDS-1216 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Change name of ozoneManager service in docker compose files to om for consistency. (secure ozone compose file will use "om"). -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-1111) OzoneManager NPE reading private key file.
[
https://issues.apache.org/jira/browse/HDDS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kumar resolved HDDS-.
--
Resolution: Resolved
> OzoneManager NPE reading private key file.
> --
>
> Key: HDDS-
> URL: https://issues.apache.org/jira/browse/HDDS-
> Project: Hadoop Distributed Data Store
> Issue Type: Sub-task
>Reporter: Xiaoyu Yao
>Assignee: Xiaoyu Yao
>Priority: Major
> Labels: test-badlands
>
> {code}
> ozoneManager_1 | 2019-02-14 23:21:51 ERROR OzoneManager:596 - Unable to read
> key pair for OM.
> ozoneManager_1 | org.apache.hadoop.ozone.security.OzoneSecurityException:
> Error reading private file for OzoneManager
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.readKeyPair(OzoneManager.java:638)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.startSecretManager(OzoneManager.java:594)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.startSecretManagerIfNecessary(OzoneManager.java:1216)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.start(OzoneManager.java:1007)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.main(OzoneManager.java:768)
> ozoneManager_1 | Caused by: java.lang.NullPointerException
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.readKeyPair(OzoneManager.java:635)
> ozoneManager_1 | ... 4 more
> ozoneManager_1 | 2019-02-14 23:21:51 ERROR OzoneManager:772 - Failed to
> start the OzoneManager.
> ozoneManager_1 | java.lang.RuntimeException:
> org.apache.hadoop.ozone.security.OzoneSecurityException: Error reading
> private file for OzoneManager
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.startSecretManager(OzoneManager.java:597)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.startSecretManagerIfNecessary(OzoneManager.java:1216)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.start(OzoneManager.java:1007)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.main(OzoneManager.java:768)
> ozoneManager_1 | Caused by:
> org.apache.hadoop.ozone.security.OzoneSecurityException: Error reading
> private file for OzoneManager
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.readKeyPair(OzoneManager.java:638)
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.startSecretManager(OzoneManager.java:594)
> ozoneManager_1 | ... 3 more
> ozoneManager_1 | Caused by: java.lang.NullPointerException
> ozoneManager_1 | at
> org.apache.hadoop.ozone.om.OzoneManager.readKeyPair(OzoneManager.java:635)
> ozoneManager_1 | ... 4 more
> ozoneManager_1 | 2019-02-14 23:21:51 INFO ExitUtil:210 - Exiting with
> status 1: java.lang.RuntimeException:
> org.apache.hadoop.ozone.security.OzoneSecurityException: Error reading
> private file for OzoneManager
> ozoneManager_1 | 2019-02-14 23:21:51 INFO OzoneManager:51 - SHUTDOWN_MSG:
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1197) Make ozone manager service name consistent for smoketests
Ajay Kumar created HDDS-1197: Summary: Make ozone manager service name consistent for smoketests Key: HDDS-1197 URL: https://issues.apache.org/jira/browse/HDDS-1197 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar Assignee: Ajay Kumar Make ozone manager service name consistent for smoketests -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-888) Fix TestOzoneRpcClient test
[
https://issues.apache.org/jira/browse/HDDS-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kumar resolved HDDS-888.
-
Resolution: Fixed
[~bharatviswa] can't reproduce it in local machine, also haven't seens its
failure in jenkins lately. Feel free to reopen if its still an issue.
> Fix TestOzoneRpcClient test
> ---
>
> Key: HDDS-888
> URL: https://issues.apache.org/jira/browse/HDDS-888
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
>Reporter: Bharat Viswanadham
>Priority: Major
>
> testPutAndGetKeyWithDnRestart is failing with below error.
>
> {code:java}
> org.apache.hadoop.hdds.scm.container.common.helpers.StorageContainerException:
> ContainerID 21 does not exist
> at
> org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.validateContainerResponse(ContainerProtocolCalls.java:496)
> at
> org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.getBlock(ContainerProtocolCalls.java:109)
> at
> org.apache.hadoop.ozone.client.io.ChunkGroupInputStream.getFromOmKeyInfo(ChunkGroupInputStream.java:300)
> at org.apache.hadoop.ozone.client.rpc.RpcClient.getKey(RpcClient.java:539)
> at
> org.apache.hadoop.ozone.web.client.TestKeys.runTestPutAndGetKeyWithDnRestart(TestKeys.java:358)
> at
> org.apache.hadoop.ozone.web.client.TestKeys.testPutAndGetKeyWithDnRestart(TestKeys.java:337)
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1177) Add validation to AuthorizationHeaderV4
Ajay Kumar created HDDS-1177: Summary: Add validation to AuthorizationHeaderV4 Key: HDDS-1177 URL: https://issues.apache.org/jira/browse/HDDS-1177 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Add validation to AuthorizationHeaderV4. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1176) Fix storage of certificate in scm db
Ajay Kumar created HDDS-1176:
Summary: Fix storage of certificate in scm db
Key: HDDS-1176
URL: https://issues.apache.org/jira/browse/HDDS-1176
Project: Hadoop Distributed Data Store
Issue Type: Sub-task
Reporter: Ajay Kumar
put operation in {{SCMCertStore}} is failing due to unregistered codec format.
Either we can add new codec format or put pem encoded cert. Second option is
more preferable i think as every where else we are using pem encoded string.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1087) Investigate failure of TestDefaultCertificateClient#testSignDataStream in jenkins run
Ajay Kumar created HDDS-1087: Summary: Investigate failure of TestDefaultCertificateClient#testSignDataStream in jenkins run Key: HDDS-1087 URL: https://issues.apache.org/jira/browse/HDDS-1087 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar Assignee: Ajay Kumar Investigate failure of TestDefaultCertificateClient#testSignDataStream in jenkins run. https://builds.apache.org/job/PreCommit-HDDS-Build/2217/testReport/org.apache.hadoop.hdds.security.x509.certificate.client/TestDefaultCertificateClient/testSignDataStream/ -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1066) Enable reset of keypair/certificate via heartbeat in DataNodes
Ajay Kumar created HDDS-1066: Summary: Enable reset of keypair/certificate via heartbeat in DataNodes Key: HDDS-1066 URL: https://issues.apache.org/jira/browse/HDDS-1066 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Enable reset of keypair/certificate via heartbeat in DataNodes -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1065) OM and DN should persist SCM certificate as the trust root.
Ajay Kumar created HDDS-1065: Summary: OM and DN should persist SCM certificate as the trust root. Key: HDDS-1065 URL: https://issues.apache.org/jira/browse/HDDS-1065 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar OM and DN should persist SCM certificate as the trust root. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1064) Support OM -reinitSecurity as needed for existing non-secure deployment
Ajay Kumar created HDDS-1064: Summary: Support OM -reinitSecurity as needed for existing non-secure deployment Key: HDDS-1064 URL: https://issues.apache.org/jira/browse/HDDS-1064 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Support OM -reinitSecurity as needed for existing non-secure deployment -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1063) Implement OM init in secure cluster
Ajay Kumar created HDDS-1063: Summary: Implement OM init in secure cluster Key: HDDS-1063 URL: https://issues.apache.org/jira/browse/HDDS-1063 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Implement OM init in secure cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1062) Enable service policy authorization for HDDS group
Ajay Kumar created HDDS-1062: Summary: Enable service policy authorization for HDDS group Key: HDDS-1062 URL: https://issues.apache.org/jira/browse/HDDS-1062 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Enable service policy authorization for HDDS group. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1061) DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier
Ajay Kumar created HDDS-1061: Summary: DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier Key: HDDS-1061 URL: https://issues.apache.org/jira/browse/HDDS-1061 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Add certificate serial id to Ozone Delegation Token Identifier. Required for OM HA support. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1060) Block Token: Enable DN to get SCM signed certificate of OM
Ajay Kumar created HDDS-1060: Summary: Block Token: Enable DN to get SCM signed certificate of OM Key: HDDS-1060 URL: https://issues.apache.org/jira/browse/HDDS-1060 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Datanodes need OM certificate to validate block tokens. Datanode should fetch certificate from SCM on first occurrence of block token verification. (for given certificate serial id) Block token already have certificate serial id as field. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1059) Certificate Client recovery - private key missing
Ajay Kumar created HDDS-1059: Summary: Certificate Client recovery - private key missing Key: HDDS-1059 URL: https://issues.apache.org/jira/browse/HDDS-1059 Project: Hadoop Distributed Data Store Issue Type: Sub-task Affects Versions: 0.4.0 Reporter: Ajay Kumar Handle recovery for CertificateClient when Keypair is missing but certificate is present. Possible path: 1. Audit the event 2. Generate new key pair and fetch new certificate on next Datanode bootup -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1058) Certificate Client recovery - keypair not found
Ajay Kumar created HDDS-1058: Summary: Certificate Client recovery - keypair not found Key: HDDS-1058 URL: https://issues.apache.org/jira/browse/HDDS-1058 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Handle recovery for CertificateClient when Keypair is missing but certificate is present. Possible path: 1. Audit the event 2. Generate new key pair and fetch new certificate on next Datanode bootup -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1055) Refactor om token db as column family.
Ajay Kumar created HDDS-1055: Summary: Refactor om token db as column family. Key: HDDS-1055 URL: https://issues.apache.org/jira/browse/HDDS-1055 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar Currently OM stores delegation tokens in a separate db. i.e "om-token.db". We should refactor this to be column family storing data in existing om db file. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1043) Enable token based authentication for S3 api
Ajay Kumar created HDDS-1043: Summary: Enable token based authentication for S3 api Key: HDDS-1043 URL: https://issues.apache.org/jira/browse/HDDS-1043 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar Assignee: Ajay Kumar Ozone already S3 api and mechanism create S3 like secrets for user. This jira proposes a hadoop compatible token based authentication for S3 api which utilizes S3 secret stored in OM. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1039) OzoneManager fails to connect with secure SCM
Ajay Kumar created HDDS-1039:
Summary: OzoneManager fails to connect with secure SCM
Key: HDDS-1039
URL: https://issues.apache.org/jira/browse/HDDS-1039
Project: Hadoop Distributed Data Store
Issue Type: Bug
Reporter: Ajay Kumar
Assignee: Ajay Kumar
In a secure Ozone cluster. Datanodes fail to connect to SCM on
{{StorageContainerDatanodeProtocol}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1038) Datanode fails to connect with secure SCM
Ajay Kumar created HDDS-1038:
Summary: Datanode fails to connect with secure SCM
Key: HDDS-1038
URL: https://issues.apache.org/jira/browse/HDDS-1038
Project: Hadoop Distributed Data Store
Issue Type: Bug
Reporter: Ajay Kumar
In a secure Ozone cluster. Datanodes fail to connect to SCM on
{{StorageContainerDatanodeProtocol}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-1012) Add Default CertificateClient implementation
Ajay Kumar created HDDS-1012: Summary: Add Default CertificateClient implementation Key: HDDS-1012 URL: https://issues.apache.org/jira/browse/HDDS-1012 Project: Hadoop Distributed Data Store Issue Type: New Feature Reporter: Ajay Kumar Assignee: Ajay Kumar Add Default CertificateClient implementation -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-991) Fix failures in TestSecureOzoneCluster
Ajay Kumar created HDDS-991: --- Summary: Fix failures in TestSecureOzoneCluster Key: HDDS-991 URL: https://issues.apache.org/jira/browse/HDDS-991 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar Assignee: Ajay Kumar Fix failures in TestSecureOzoneCluster -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-980) add new api for OM in SCMSecurityProtocol
Ajay Kumar created HDDS-980: --- Summary: add new api for OM in SCMSecurityProtocol Key: HDDS-980 URL: https://issues.apache.org/jira/browse/HDDS-980 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Add new api in SCMSecurityProtocol for OM to request a SCM signed certificate. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-975) Create ozone cli commands for ozone shell
Ajay Kumar created HDDS-975: --- Summary: Create ozone cli commands for ozone shell Key: HDDS-975 URL: https://issues.apache.org/jira/browse/HDDS-975 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Create ozone cli commands for ozone shell -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-970) Fix classnotfound error for bouncy castle classes in OM,SCM init
Ajay Kumar created HDDS-970: --- Summary: Fix classnotfound error for bouncy castle classes in OM,SCM init Key: HDDS-970 URL: https://issues.apache.org/jira/browse/HDDS-970 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Fix classnotfound error for bouncy castle classes in OM,SCM init. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-942) Fix TestOzoneConfigrationFields
[ https://issues.apache.org/jira/browse/HDDS-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-942. - Resolution: Duplicate > Fix TestOzoneConfigrationFields > > > Key: HDDS-942 > URL: https://issues.apache.org/jira/browse/HDDS-942 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Anu Engineer >Assignee: Anu Engineer >Priority: Major > > A bunch of fields is missing in the ozone-default.xml in the HDDS-4 branch. > We need to fix these before the merge. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-967) Fix failures in TestOzoneConfigurationFields
Ajay Kumar created HDDS-967: --- Summary: Fix failures in TestOzoneConfigurationFields Key: HDDS-967 URL: https://issues.apache.org/jira/browse/HDDS-967 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Attachments: HDDS-967-HDDS-4.00.patch -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-964) Fix test failure in TestOmMetrics
Ajay Kumar created HDDS-964: --- Summary: Fix test failure in TestOmMetrics Key: HDDS-964 URL: https://issues.apache.org/jira/browse/HDDS-964 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Fix test failure in TestOmMetrics -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-963) Fix failure in TestOzoneShell due to null check in SecurityConfig
Ajay Kumar created HDDS-963: --- Summary: Fix failure in TestOzoneShell due to null check in SecurityConfig Key: HDDS-963 URL: https://issues.apache.org/jira/browse/HDDS-963 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar Fix failure in TestOzoneShell due to null check in SecurityConfig. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-945) Fix generics warnings in delegation token
Ajay Kumar created HDDS-945:
---
Summary: Fix generics warnings in delegation token
Key: HDDS-945
URL: https://issues.apache.org/jira/browse/HDDS-945
Project: Hadoop Distributed Data Store
Issue Type: New Feature
Reporter: Ajay Kumar
Assignee: Ajay Kumar
There are warnings in genrics related code in
{{OzoneDelegationTokenSecretManager}} and {{OzoneSecretStore}}. Since we
already have base class which can be used for other kind of identifiers we can
remove this generics related code as fixing it will make it bit more
complicated (also looks unnecessary for current use cases)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-943) Changes in HddsDispatcher/XceiverServer to handle block token validation
Ajay Kumar created HDDS-943:
---
Summary: Changes in HddsDispatcher/XceiverServer to handle block
token validation
Key: HDDS-943
URL: https://issues.apache.org/jira/browse/HDDS-943
Project: Hadoop Distributed Data Store
Issue Type: New Feature
Reporter: Ajay Kumar
[HDDS-805] embeds an encoded token in {{ContainerCommandRequestProto}}. This
token should be validated at HddsDispatcher or XceiverServer.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-929) Remove ozone.max.key.len property
Ajay Kumar created HDDS-929:
---
Summary: Remove ozone.max.key.len property
Key: HDDS-929
URL: https://issues.apache.org/jira/browse/HDDS-929
Project: Hadoop Distributed Data Store
Issue Type: New Feature
Reporter: Ajay Kumar
Generation of secret key in OzoneSecretManager is different hadoop
SecretManager. Since key-pair generation is not the responsibility of
\{{OzoneSecretManager}}/\{{OzoneSecretKey}} we don't need maxKeyLen related
checks inside them. Jira proposes to remove ozone.max.key.len.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-927) Add negetive test case for grpc mTLS auth
Ajay Kumar created HDDS-927: --- Summary: Add negetive test case for grpc mTLS auth Key: HDDS-927 URL: https://issues.apache.org/jira/browse/HDDS-927 Project: Hadoop Distributed Data Store Issue Type: New Feature Reporter: Ajay Kumar Add negetive test case for grpc mTLS auth -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-923) Pass token to grpc container calls in secure cluster
Ajay Kumar created HDDS-923: --- Summary: Pass token to grpc container calls in secure cluster Key: HDDS-923 URL: https://issues.apache.org/jira/browse/HDDS-923 Project: Hadoop Distributed Data Store Issue Type: New Feature Reporter: Ajay Kumar [HADOOP-805] breaks calls to following 4 operations used in SCMCli: # deleteContainer # readContainer # closeContainer # createContainer Passing a valid token from OM will fix this. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-909) Default implementation for Ozone acls
Ajay Kumar created HDDS-909: --- Summary: Default implementation for Ozone acls Key: HDDS-909 URL: https://issues.apache.org/jira/browse/HDDS-909 Project: Hadoop Distributed Data Store Issue Type: New Feature Reporter: Ajay Kumar Assignee: Ajay Kumar Default implementation for Ozone acls -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-908) NPE in TestOzoneRpcClient
Ajay Kumar created HDDS-908: --- Summary: NPE in TestOzoneRpcClient Key: HDDS-908 URL: https://issues.apache.org/jira/browse/HDDS-908 Project: Hadoop Distributed Data Store Issue Type: Bug Reporter: Ajay Kumar Assignee: Ajay Kumar Fix NPE in TestOzoneRpcClient. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-880) Create api for ACL handling in Ozone
Ajay Kumar created HDDS-880:
---
Summary: Create api for ACL handling in Ozone
Key: HDDS-880
URL: https://issues.apache.org/jira/browse/HDDS-880
Project: Hadoop Distributed Data Store
Issue Type: Bug
Components: documentation
Reporter: Ajay Kumar
Assignee: Anu Engineer
The valid uri pattern for an Ozone fs uri should be
{{o3fs://://}}.
But OzoneFileSystem accepts uri's of the form {{o3fs://.}} only.
{code:java}
# In OzoneFileSyste.java
private static final Pattern URL_SCHEMA_PATTERN =
Pattern.compile("(.+)\\.([^\\.]+)");
if (!matcher.matches()) {
throw new IllegalArgumentException("Ozone file system url should be "
+ "in the form o3fs://bucket.volume");
}{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-855) Move OMMetadataManager from hadoop-ozone/ozone-manager to hadoop-ozone/common
Ajay Kumar created HDDS-855:
---
Summary: Move OMMetadataManager from hadoop-ozone/ozone-manager to
hadoop-ozone/common
Key: HDDS-855
URL: https://issues.apache.org/jira/browse/HDDS-855
Project: Hadoop Distributed Data Store
Issue Type: Bug
Components: documentation
Reporter: Ajay Kumar
Assignee: Anu Engineer
The valid uri pattern for an Ozone fs uri should be
{{o3fs://://}}.
But OzoneFileSystem accepts uri's of the form {{o3fs://.}} only.
{code:java}
# In OzoneFileSyste.java
private static final Pattern URL_SCHEMA_PATTERN =
Pattern.compile("(.+)\\.([^\\.]+)");
if (!matcher.matches()) {
throw new IllegalArgumentException("Ozone file system url should be "
+ "in the form o3fs://bucket.volume");
}{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-836) Create Ozone identifier for delegation token and block token
Ajay Kumar created HDDS-836: --- Summary: Create Ozone identifier for delegation token and block token Key: HDDS-836 URL: https://issues.apache.org/jira/browse/HDDS-836 Project: Hadoop Distributed Data Store Issue Type: Sub-task Components: Security Reporter: Ajay Kumar Assignee: Ajay Kumar Fix For: 0.4.0 Add delegation token functionality to Ozone layer. We will re-use hadoop rpc layer TOKEN authentication. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-805) Block token: Client api changes for block token
Ajay Kumar created HDDS-805: --- Summary: Block token: Client api changes for block token Key: HDDS-805 URL: https://issues.apache.org/jira/browse/HDDS-805 Project: Hadoop Distributed Data Store Issue Type: Sub-task Components: Security Reporter: Ajay Kumar Assignee: Ajay Kumar -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-804) Block token: Add secret token manager
Ajay Kumar created HDDS-804: --- Summary: Block token: Add secret token manager Key: HDDS-804 URL: https://issues.apache.org/jira/browse/HDDS-804 Project: Hadoop Distributed Data Store Issue Type: Sub-task Components: Security Reporter: Ajay Kumar Assignee: Xiaoyu Yao -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-760) Add asf license to TestCertificateSignRequest
Ajay Kumar created HDDS-760: --- Summary: Add asf license to TestCertificateSignRequest Key: HDDS-760 URL: https://issues.apache.org/jira/browse/HDDS-760 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-756) Functionality to handle key rotation in OM
Ajay Kumar created HDDS-756: --- Summary: Functionality to handle key rotation in OM Key: HDDS-756 URL: https://issues.apache.org/jira/browse/HDDS-756 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Functionality to handle key rotation in SCM, OM and DN. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-757) Functionality to handle key rotation in DN.
Ajay Kumar created HDDS-757: --- Summary: Functionality to handle key rotation in DN. Key: HDDS-757 URL: https://issues.apache.org/jira/browse/HDDS-757 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Functionality to handle key rotation in SCM, OM and DN. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-753) Fix failure in TestSecureOzoneCluster
Ajay Kumar created HDDS-753: --- Summary: Fix failure in TestSecureOzoneCluster Key: HDDS-753 URL: https://issues.apache.org/jira/browse/HDDS-753 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-752) Functionality to handle key rotation in SCM, OM and DN.
Ajay Kumar created HDDS-752: --- Summary: Functionality to handle key rotation in SCM, OM and DN. Key: HDDS-752 URL: https://issues.apache.org/jira/browse/HDDS-752 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Write Security Audit entry to track security tasks performed on SCM, OM and DN. Tasks: * Private Keys: bootstrap/rotation * Certificates: CSR submission, rotation -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-750) Write an Security Audit Entry to track activities (bootstrap/deletion/rotation etc) related to Private Keys and certificates
Ajay Kumar created HDDS-750: --- Summary: Write an Security Audit Entry to track activities (bootstrap/deletion/rotation etc) related to Private Keys and certificates Key: HDDS-750 URL: https://issues.apache.org/jira/browse/HDDS-750 Project: Hadoop Distributed Data Store Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar We will need to add API that leverage the key generator from HDDS-100 to generate public/private key pair for OM/SCM, this will be called by the scm/om admin cli with "-init" cmd. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-747) Update MiniOzoneCluster to work with security protocol from SCM
Ajay Kumar created HDDS-747: --- Summary: Update MiniOzoneCluster to work with security protocol from SCM Key: HDDS-747 URL: https://issues.apache.org/jira/browse/HDDS-747 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar [HDDS-103] introduces a new security protocol in SCM. MiniOzoneCluster should be updated to utilize it once its implementation is completed. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-14026) Overload BlockPoolTokenSecretManager.checkAccess to make storageId and storageType optional
Ajay Kumar created HDFS-14026:
-
Summary: Overload BlockPoolTokenSecretManager.checkAccess to make
storageId and storageType optional
Key: HDFS-14026
URL: https://issues.apache.org/jira/browse/HDFS-14026
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Ajay Kumar
Assignee: Ajay Kumar
Fix For: 3.2.0, 3.0.4, 3.1.2, 3.3.0
Change in {{BlockPoolTokenSecretManager.checkAccess}} by
[HDDS-9807|https://issues.apache.org/jira/browse/HDFS-9807] breaks backward
compatibility for applications using the private API (we've run into such apps).
Although there is no compatibility guarantee for the private interface, we can
restore the original version of checkAccess as an overload.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-574) Replace binary file required for kdc with script
Ajay Kumar created HDDS-574: --- Summary: Replace binary file required for kdc with script Key: HDDS-574 URL: https://issues.apache.org/jira/browse/HDDS-574 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar KDC Docker image used to boot up secure Ozone cluster contains a binary file. We should replace it with script/source-code with same functionality. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-570) Update SCM chill mode exit criteria to optionally wait for n datanodes
[ https://issues.apache.org/jira/browse/HDDS-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HDDS-570. - Resolution: Duplicate > Update SCM chill mode exit criteria to optionally wait for n datanodes > -- > > Key: HDDS-570 > URL: https://issues.apache.org/jira/browse/HDDS-570 > Project: Hadoop Distributed Data Store > Issue Type: Improvement >Reporter: Ajay Kumar >Priority: Major > > As suggested by [~arpitagarwal], [~anu] in [HDDS-512], this jira is to update > SCM chill mode exit criteria to optionally wait for n datanodes. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-570) Update SCM chill mode exit criteria to optionally wait for n datanodes
Ajay Kumar created HDDS-570: --- Summary: Update SCM chill mode exit criteria to optionally wait for n datanodes Key: HDDS-570 URL: https://issues.apache.org/jira/browse/HDDS-570 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar As suggested by [~arpitagarwal], [~anu] in [HDDS-512], this jira is to update SCM chill mode exit criteria to optionally wait for n datanodes. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-571) Update SCM chill mode exit criteria to optionally wait for n datanodes
Ajay Kumar created HDDS-571: --- Summary: Update SCM chill mode exit criteria to optionally wait for n datanodes Key: HDDS-571 URL: https://issues.apache.org/jira/browse/HDDS-571 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar As suggested by [~arpitagarwal], [~anu] in [HDDS-512], this jira is to update SCM chill mode exit criteria to optionally wait for n datanodes. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-557) DeadNodeHandler should handle exception from removeContainerHandler api
Ajay Kumar created HDDS-557: --- Summary: DeadNodeHandler should handle exception from removeContainerHandler api Key: HDDS-557 URL: https://issues.apache.org/jira/browse/HDDS-557 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar DeadNodeHandler should handle exception from removeContainerHandler api -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13941) make storageId in BlockPoolTokenSecretManager.checkAccess optional
Ajay Kumar created HDFS-13941: - Summary: make storageId in BlockPoolTokenSecretManager.checkAccess optional Key: HDFS-13941 URL: https://issues.apache.org/jira/browse/HDFS-13941 Project: Hadoop HDFS Issue Type: Improvement Reporter: Ajay Kumar change in BlockPoolTokenSecretManager.checkAccess by [HDDS-9807] breaks backward compatibility for Hadoop 2 clients. Since SecretManager is marked for public audience we should add a overloaded function to allow Hadoop 2 clients to work with it. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-546) Remove bouncy castle dependency from hadoop-hdds-common
Ajay Kumar created HDDS-546:
---
Summary: Remove bouncy castle dependency from hadoop-hdds-common
Key: HDDS-546
URL: https://issues.apache.org/jira/browse/HDDS-546
Project: Hadoop Distributed Data Store
Issue Type: Improvement
Reporter: Ajay Kumar
Assignee: Ajay Kumar
{code}
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (depcheck) @
hadoop-hdds-common ---
[WARNING]
Dependency convergence error for org.bouncycastle:bcprov-jdk15on:1.54 paths to
dependency are:
+-org.apache.hadoop:hadoop-hdds-common:0.3.0-SNAPSHOT
+-org.apache.ratis:ratis-server:0.3.0-eca3531-20180918.052141-2
+-org.apache.ratis:ratis-proto-shaded:0.3.0-eca3531-SNAPSHOT
+-org.bouncycastle:bcpkix-jdk15on:1.54
+-org.bouncycastle:bcprov-jdk15on:1.54
and
+-org.apache.hadoop:hadoop-hdds-common:0.3.0-SNAPSHOT
+-org.bouncycastle:bcprov-jdk15on:1.49
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-528) add cli command to checkChill mode status and exit chill mode
Ajay Kumar created HDDS-528: --- Summary: add cli command to checkChill mode status and exit chill mode Key: HDDS-528 URL: https://issues.apache.org/jira/browse/HDDS-528 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar add cli command to checkChill mode status and exit chill mode -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-527) Show SCM chill mode status in SCM UI.
Ajay Kumar created HDDS-527: --- Summary: Show SCM chill mode status in SCM UI. Key: HDDS-527 URL: https://issues.apache.org/jira/browse/HDDS-527 Project: Hadoop Distributed Data Store Issue Type: Improvement Reporter: Ajay Kumar Show SCM chill mode status in SCM UI. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
