This is an automated email from the ASF dual-hosted git repository.
dimas pushed a change to branch view-drop-no-purge
in repository https://gitbox.apache.org/repos/asf/polaris.git
discard 85dbcbf46 Update
polaris-core/src/main/java/org/apache/polaris/core/config/FeatureConfiguration.java
discard 51511c9d6 Add feature config to allow dropping views without purging
add f7745c2ce IntelliJ: fix project icon in IJ project list (#2366)
add 7af85be7f Use asMap property helpers (#2347)
add e45be14dd SigV4 Auth Support for Catalog Federation - Part 2:
Connection Config Persistence (#2190)
add 73a06f51f fix(deps): update dependency software.amazon.awssdk:bom to
v2.32.24 (#2371)
add 5a7686bdf Rat-check: exclude venv, cleanup excludes, include .svg
(#2363)
add 96f1459de Refactor Authenticator and PolarisPrincipal (#2307)
add 22e0c1cd2 Add PolarisDiagnostics field to
TransactionalMetaStoreManagerImpl (#2361)
add 7f5066754 Support HMS Federation (#2355)
add dc23a1c6e Add PolarisDiagnostics field to
TransactionWorkspaceMetaStoreManager (#2359)
add f64703450 Rat-ignore user-settings for hugo-run-in-docker (#2376)
add 83d09cc0a Modularize generic table federation (#2379)
add a18614180 Update community meeting dates (#2382)
add e1b98333d Reduce getRealmConfig calls (#2337)
add 358c790dc Python client: make S3 role-ARN optional and add missing
endpoint-internal property (#2339)
add 42225b318 fix(deps): update dependency
io.prometheus:prometheus-metrics-exporter-servlet-jakarta to v1.4.1 (#2377)
add 850792c14 chore(deps): bump s3mock from 3.11.0 to 4.7.0 (#2375)
add 76c5d54e4 Nit: extract getResolvedCatalogEntity method in
IcebergCatalogHandler (#2387)
add 42245cb25 Nit: remove transitive dependencies from
runtime/server/build.gradle.kts (#2385)
add 1fe620557 Nit: add methods isExternal and isStaticFacade to
CatalogEntity (#2386)
add 12ab61851 Minor refactor of integration test classes (#2384)
add a07ea0126 Remove BaseMetaStoreManager.serializeProperties (#2374)
add 8d4cacb27 fix: minor corrections of documentation (#2397)
add f51e0b513 Add feature config to allow dropping views without purging
add ccd521435 review: rename to PURGE_VIEW_METADATA_ON_DROP
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (85dbcbf46)
\
N -- N -- N refs/heads/view-drop-no-purge (ccd521435)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
CHANGELOG.md | 2 +-
build.gradle.kts | 65 ++---
client/python/cli/command/__init__.py | 1 +
client/python/cli/command/catalogs.py | 23 +-
client/python/cli/constants.py | 4 +-
client/python/cli/options/option_tree.py | 1 +
.../hadoop/HadoopFederatedCatalogFactory.java | 9 +
.../federation/hive}/README.md | 15 +-
.../federation/{hadoop => hive}/build.gradle.kts | 14 +-
.../hive/HiveFederatedCatalogFactory.java | 83 ++++++
gradle/libs.versions.toml | 6 +-
gradle/projects.main.properties | 1 +
integration-tests/build.gradle.kts | 6 +-
.../polaris/service/it/env/CatalogConfig.java | 26 +-
.../polaris/service/it/env/IcebergHelper.java | 7 +-
.../service/it/env/IntegrationTestsHelper.java | 69 +++++
.../polaris/service/it/env/RestCatalogConfig.java | 24 +-
.../it/ext/PolarisSparkIntegrationTestBase.java | 50 +---
.../test/PolarisPolicyServiceIntegrationTest.java | 85 +++---
.../it/test/PolarisRestCatalogIntegrationBase.java | 150 +++++-----
.../PolarisEclipseLinkMetaStoreManagerTest.java | 2 +-
.../spark/quarkus/it/SparkIntegrationBase.java | 28 +-
.../core/auth/AuthenticatedPolarisPrincipal.java | 63 -----
.../polaris/core/auth/PolarisAuthorizer.java | 4 +-
.../polaris/core/auth/PolarisAuthorizerImpl.java | 37 ++-
.../apache/polaris/core/auth/PolarisPrincipal.java | 89 ++++++
.../core/catalog/ExternalCatalogFactory.java | 11 +
.../polaris/core/catalog}/GenericTableCatalog.java | 2 +-
.../polaris/core/config/FeatureConfiguration.java | 8 +-
.../connection/AuthenticationParametersDpo.java | 27 +-
.../core/connection/AuthenticationType.java | 3 +-
.../BearerAuthenticationParametersDpo.java | 10 +-
.../core/connection/ConnectionConfigInfoDpo.java | 63 ++++-
.../polaris/core/connection/ConnectionType.java | 4 +
.../OAuthClientCredentialsParametersDpo.java | 12 +-
.../SigV4AuthenticationParametersDpo.java | 131 +++++++++
.../hadoop/HadoopConnectionConfigInfoDpo.java | 18 +-
.../HiveConnectionConfigInfoDpo.java} | 36 ++-
.../IcebergRestConnectionConfigInfoDpo.java | 19 +-
.../apache/polaris/core/entity/CatalogEntity.java | 20 +-
.../polaris/core/entity/PolarisBaseEntity.java | 40 +--
.../ServiceIdentityType.java} | 37 ++-
.../identity/dpo/AwsIamServiceIdentityInfoDpo.java | 69 +++++
.../core/identity/dpo/ServiceIdentityInfoDpo.java | 86 ++++++
.../AtomicOperationMetaStoreManager.java | 47 +---
.../core/persistence/BaseMetaStoreManager.java | 38 +--
.../LocalPolarisMetaStoreManagerFactory.java | 2 +-
.../TransactionWorkspaceMetaStoreManager.java | 114 +++-----
.../resolver/PolarisResolutionManifest.java | 4 +-
.../core/persistence/resolver/Resolver.java | 17 +-
.../TransactionalMetaStoreManagerImpl.java | 307 ++++++++-------------
...erSecretReference.java => SecretReference.java} | 21 +-
.../core/secrets/ServiceSecretReference.java | 53 ++++
.../core/secrets/UnsafeInMemorySecretsManager.java | 11 +-
.../polaris/core/secrets/UserSecretsManager.java | 19 +-
.../connection/ConnectionConfigInfoDpoTest.java | 61 ++++
.../PolarisTreeMapMetaStoreManagerTest.java | 2 +-
.../polaris/core/persistence/ResolverTest.java | 4 +-
.../persistence/cache/InMemoryEntityCacheTest.java | 2 +-
...ReferenceTest.java => SecretReferenceTest.java} | 17 +-
.../core/secrets/UserSecretsManagerBaseTest.java | 20 +-
.../storage/cache/StorageCredentialCacheTest.java | 9 +-
.../BasePolarisMetaStoreManagerTest.java | 4 +-
.../polaris/core/persistence/BaseResolverTest.java | 6 +-
.../persistence/PolarisTestMetaStoreManager.java | 29 +-
runtime/server/build.gradle.kts | 7 +-
runtime/service/build.gradle.kts | 3 +
.../service/it/PolarisRestCatalogMinIOIT.java | 15 +-
.../polaris/service/admin/PolarisAdminService.java | 67 +++--
.../polaris/service/admin/PolarisServiceImpl.java | 20 +-
.../polaris/service/auth/ActiveRolesAugmentor.java | 7 +-
.../polaris/service/auth/ActiveRolesProvider.java | 4 +-
.../service/auth/AuthenticatingAugmentor.java | 23 +-
.../apache/polaris/service/auth/Authenticator.java | 25 +-
.../apache/polaris/service/auth/DecodedToken.java | 4 +-
.../service/auth/DefaultActiveRolesProvider.java | 22 +-
.../polaris/service/auth/DefaultAuthenticator.java | 15 +-
.../service/auth/PersistedPolarisPrincipal.java | 66 +++++
...incipalAuthInfo.java => PolarisCredential.java} | 28 +-
.../service/auth/external/OidcConfiguration.java | 1 +
...or.java => OidcPolarisCredentialAugmentor.java} | 29 +-
.../external/mapping/DefaultPrincipalMapper.java | 2 +-
.../mapping/DefaultPrincipalRolesMapper.java | 2 +-
.../external/tenant/DefaultOidcTenantResolver.java | 1 -
.../{ => tenant}/OidcTenantConfiguration.java | 2 +-
.../auth/external/tenant/OidcTenantResolver.java | 1 -
.../{ => tenant}/OidcTenantResolvingAugmentor.java | 8 +-
.../internal/InternalAuthenticationMechanism.java | 33 +--
.../internal/InternalAuthenticationRequest.java | 18 +-
.../auth/internal/InternalIdentityProvider.java | 24 +-
.../service/catalog/common/CatalogAdapter.java | 4 +-
.../service/catalog/common/CatalogHandler.java | 50 ++--
.../generic/GenericTableCatalogAdapter.java | 21 +-
.../generic/GenericTableCatalogHandler.java | 64 ++++-
.../generic/PolarisGenericTableCatalog.java | 1 +
.../service/catalog/iceberg/IcebergCatalog.java | 67 ++---
.../catalog/iceberg/IcebergCatalogAdapter.java | 5 +-
.../catalog/iceberg/IcebergCatalogHandler.java | 180 ++++--------
.../iceberg/IcebergRESTExternalCatalogFactory.java | 9 +
.../catalog/policy/PolicyCatalogAdapter.java | 21 +-
.../catalog/policy/PolicyCatalogHandler.java | 22 +-
.../polaris/service/config/ServiceProducers.java | 9 +-
.../context/catalog/CallContextCatalogFactory.java | 4 +-
.../catalog/PolarisCallContextCatalogFactory.java | 4 +-
.../service/admin/ManagementServiceTest.java | 18 +-
.../admin/PolarisAdminServiceAuthzTest.java | 8 +-
.../service/admin/PolarisAdminServiceTest.java | 4 +-
.../service/admin/PolarisAuthzTestBase.java | 28 +-
.../service/auth/ActiveRolesAugmentorTest.java | 6 +-
.../service/auth/AuthenticatingAugmentorTest.java | 34 +--
.../auth/AuthenticationConfigurationTest.java | 7 +-
...ava => OidcPolarisCredentialAugmentorTest.java} | 19 +-
.../external/OidcTenantResolvingAugmentorTest.java | 4 +-
.../mapping/DefaultPrincipalMapperTest.java | 6 +-
.../mapping/DefaultPrincipalRolesMapperTest.java | 4 +-
.../tenant/DefaultOidcTenantResolverTest.java | 1 -
.../InternalAuthenticationMechanismTest.java | 7 +-
.../internal/InternalIdentityProviderTest.java | 24 +-
.../catalog/AbstractIcebergCatalogTest.java | 12 +-
.../catalog/AbstractIcebergCatalogViewTest.java | 9 +-
.../AbstractPolarisGenericTableCatalogTest.java | 13 +-
.../service/catalog/AbstractPolicyCatalogTest.java | 13 +-
.../catalog/IcebergCatalogHandlerAuthzTest.java | 24 +-
...PolarisGenericTableCatalogHandlerAuthzTest.java | 12 +-
.../catalog/PolicyCatalogHandlerAuthzTest.java | 12 +-
.../org/apache/polaris/service/TestServices.java | 18 +-
runtime/test-common/build.gradle.kts | 1 +
.../apache/polaris/test/commons/s3mock/S3Mock.java | 56 ++++
.../Dockerfile-s3mock-version} | 2 +-
site/content/community/meetings/_index.adoc | 5 +-
site/content/in-dev/unreleased/entities.md | 2 +-
site/content/in-dev/unreleased/external-idp.md | 6 +-
.../unreleased/getting-started/using-polaris.md | 2 +-
site/content/in-dev/unreleased/helm.md | 5 +-
site/static/favicons/favicon.svg | 19 ++
site/static/img/apache-incubator.svg | 21 +-
site/static/img/example-workflow.svg | 21 +-
.../img/logos/polaris-catalog-stacked-logo.svg | 19 ++
site/static/img/overview.svg | 18 ++
site/static/img/rbac-example.svg | 21 +-
site/static/img/rbac-model.svg | 21 +-
site/static/img/sample-catalog-structure.svg | 21 +-
spec/polaris-management-service.yml | 12 +
143 files changed, 2170 insertions(+), 1500 deletions(-)
copy {runtime/defaults => extensions/federation/hive}/README.md (57%)
copy extensions/federation/{hadoop => hive}/build.gradle.kts (79%)
create mode 100644
extensions/federation/hive/src/main/java/org/apache/polaris/extensions/federation/hive/HiveFederatedCatalogFactory.java
copy
tools/minio-testcontainer/src/main/java/org/apache/polaris/test/minio/Minio.java
=>
integration-tests/src/main/java/org/apache/polaris/service/it/env/CatalogConfig.java
(61%)
copy
tools/minio-testcontainer/src/main/java/org/apache/polaris/test/minio/Minio.java
=>
integration-tests/src/main/java/org/apache/polaris/service/it/env/RestCatalogConfig.java
(67%)
delete mode 100644
polaris-core/src/main/java/org/apache/polaris/core/auth/AuthenticatedPolarisPrincipal.java
create mode 100644
polaris-core/src/main/java/org/apache/polaris/core/auth/PolarisPrincipal.java
rename
{runtime/service/src/main/java/org/apache/polaris/service/catalog/generic =>
polaris-core/src/main/java/org/apache/polaris/core/catalog}/GenericTableCatalog.java
(97%)
create mode 100644
polaris-core/src/main/java/org/apache/polaris/core/connection/SigV4AuthenticationParametersDpo.java
copy
polaris-core/src/main/java/org/apache/polaris/core/connection/{hadoop/HadoopConnectionConfigInfoDpo.java
=> hive/HiveConnectionConfigInfoDpo.java} (71%)
copy
polaris-core/src/main/java/org/apache/polaris/core/{connection/AuthenticationType.java
=> identity/ServiceIdentityType.java} (59%)
create mode 100644
polaris-core/src/main/java/org/apache/polaris/core/identity/dpo/AwsIamServiceIdentityInfoDpo.java
create mode 100644
polaris-core/src/main/java/org/apache/polaris/core/identity/dpo/ServiceIdentityInfoDpo.java
rename
polaris-core/src/main/java/org/apache/polaris/core/secrets/{UserSecretReference.java
=> SecretReference.java} (94%)
create mode 100644
polaris-core/src/main/java/org/apache/polaris/core/secrets/ServiceSecretReference.java
rename
polaris-core/src/test/java/org/apache/polaris/core/secrets/{UserSecretReferenceTest.java
=> SecretReferenceTest.java} (80%)
create mode 100644
runtime/service/src/main/java/org/apache/polaris/service/auth/PersistedPolarisPrincipal.java
rename
runtime/service/src/main/java/org/apache/polaris/service/auth/{PrincipalAuthInfo.java
=> PolarisCredential.java} (67%)
rename
runtime/service/src/main/java/org/apache/polaris/service/auth/external/{PrincipalAuthInfoAugmentor.java
=> OidcPolarisCredentialAugmentor.java} (79%)
rename
runtime/service/src/main/java/org/apache/polaris/service/auth/external/{ =>
tenant}/OidcTenantConfiguration.java (98%)
rename
runtime/service/src/main/java/org/apache/polaris/service/auth/external/{ =>
tenant}/OidcTenantResolvingAugmentor.java (90%)
copy
polaris-core/src/main/java/org/apache/polaris/core/policy/exceptions/NoSuchPolicyException.java
=>
runtime/service/src/main/java/org/apache/polaris/service/auth/internal/InternalAuthenticationRequest.java
(63%)
rename
runtime/service/src/test/java/org/apache/polaris/service/auth/external/{PrincipalAuthInfoAugmentorTest.java
=> OidcPolarisCredentialAugmentorTest.java} (86%)
create mode 100644
runtime/test-common/src/main/java/org/apache/polaris/test/commons/s3mock/S3Mock.java
copy
runtime/test-common/src/main/resources/org/apache/polaris/test/commons/{keycloak/Dockerfile-keycloak-version
=> s3mock/Dockerfile-s3mock-version} (96%)
