This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/github_actions/codeql-action-9d88a12d2b
in repository https://gitbox.apache.org/repos/asf/iceberg.git
omit 06ec3c02fe Build: Bump the codeql-action group across 1 directory with
3 updates
add bc56e77283 Build: Bump actions/upload-artifact from 7.0.1 to 7.0.2
(#18559)
add beddbaec8c Build: Bump astral-sh/setup-uv from 10.2.0 to 10.3.0
(#18560)
add d11441a59e Build: Bump org.roaringbitmap:RoaringBitmap from 1.6.23 to
1.6.24 (#18562)
add c115109ff5 Build: Bump jetty from 12.1.13 to 12.1.14 (#18563)
add f60e84bc94 Build: Bump com.diffplug.spotless:spotless-plugin-gradle
from 8.10.2 to 8.10.4 (#18564)
add 0eef7aa046 Build: Bump
org.openapitools:openapi-generator-gradle-plugin from 7.25.0 to 7.26.0 (#18572)
add 4c24d8e876 Build: Bump io.netty:netty-buffer from 4.2.18.Final to
4.2.19.Final (#18565)
add 2eed6894c0 Build: Bump org.immutables:value from 2.12.2 to 2.12.3
(#18566)
add 6b549dc377 Build: Bump software.amazon.awssdk:bom from 2.55.11 to
2.55.14 (#18571)
add 7c1e2fbe0c Build: Bump org.xerial.snappy:snappy-java from 1.1.10.10 to
1.1.10.12 (#18570)
add b2161a9cc9 Build: Bump org.apache.httpcomponents.client5:httpclient5
from 5.6.4 to 5.6.5 (#18569)
add 9bbee076a5 Build: Bump io.grpc:grpc-netty-shaded from 1.84.0 to 1.84.2
(#18568)
add 02de2200eb Build: Bump apache/infrastructure-actions/allowlist-check
(#18576)
add 0369905390 Build: Bump nessie from 0.108.8 to 0.109.0 (#18574)
add c3d726afa5 Build: Bump gradle-wrapper from 8.14.5 to 8.14.6 (#18575)
add 5a08415ec7 Flink: Backport deep copy RowData in
DynamicRecordInternalSerializer#copy to 1.20 (#18548)
add 318e01de78 Flink: Backport deep copy RowData in
DynamicRecordInternalSerializer#copy to Flink 2.2 (#18547)
add f2b45bdff1 OpenAPI: Add missing type: object to AssertViewUUID (#18099)
add 09c80c42e4 Data: Add generic File Format API TCK binding and
geometry/geography generators (#18537)
add 6890694bd3 Flink: Backport: Remap equality field ids on table update
(v1.20, v2.2) (#18542)
add 6cd6183336 Spark 4.2: Set Iceberg field IDs as Spark column IDs for
DSv2 validation (#17958)
add 59ccccb19a SPEC: Add File Type to v4 spec (#17918)
add ddbd99073c Spark 3.5, 4.0, 4.1: Fix view rename target namespace
(#18432)
add 19a98f3440 Docs: Add Databricks Unity Catalog to the third-party
catalogs nav (#18588)
add e2b6212276 Core: Make metadata refresh retries configurable in JDBC
catalog (#18539)
add f723526ca7 Hive: Write format-version to HMS table parameters (#18534)
add 42f5d46ce6 Flink: Refresh unresolved input schemas in dynamic sink
metadata cache (#18541)
add 3c315c8df4 Flink: Forward watermarks in EqualityConvertCommitter with
no active cycle (#18439)
add 69972dbe39 Core: V4 write direction wrappers (#16936)
add 14a7c5e1ac Core: Fix deprecation versions for InputFilesDecryptor
(#18593)
add 16bbd8c885 Flink 2.3: Close the Sink V2 aggregator's table loader
(#18496)
add 3738f4a97b Build: Bump apache/infrastructure-actions/allowlist-check
from 1.0.1 to 1.0.4 (#18558)
add 932f9aae9c AWS: Apply Glue and KMS endpoint overrides in
AssumeRoleAwsClientFactory (#18586)
add 56b10d7e35 Build: Cancel superseded PR runs in lightweight CI
workflows (#16771)
add 834441b960 Azure: Return fully-qualified locations from
ADLSFileIO.listPrefix (#18400)
add 65cb42d6e6 Azure: Ignore null values for ADLS block size properties
(#18528)
add 31b643b350 Azure: Report ADLS bulk deletion failures (#18533)
add 7fd1364ced Build: Bump zizmorcore/zizmor-action from 0.6.3 to 0.6.4
(#18184)
add e70a2efcd0 Flink: Backport: Refresh unresolved input schemas in
dynamic sink cache (#18594)
add 16bb7a9903 Parquet: Fix UnsupportedOperationException for boolean
filters (#18580)
add 7a74178db9 Parquet: Validate geospatial projection parameters (#17578)
add cdeb84d341 Spark 4.2: Support iterative runtime filtering with
PartitionPredicate (#18600)
add 60897e0b82 Arrow: Fix vectorized reads of dictionary-encoded
TIMESTAMP_MILLIS columns (#18592)
add 7461b50476 Core: Add V4 file planner (#17541)
add 9303e4c897 Core: Add toString to root manifest file (#18612)
add 1122bced20 Build: Run zizmor on ubuntu-24.04 instead of ubuntu-latest
(#18611)
add 2856631da4 Docs: fix broken revapi command in AGENTS.md (#18616)
add 0e4a68cec1 Core: Read total bytes in MapBackedContentStats (#18614)
add c285171ea8 Docs: Clarify how to subscribe to mailing lists (#18628)
add fb58513787 Core: Add mutable Mumbling bitmap implementation (#18544)
add 839ef065b0 Build: Bump the codeql-action group across 1 directory with
3 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (06ec3c02fe)
\
N -- N -- N
refs/heads/dependabot/github_actions/codeql-action-9d88a12d2b (839ef065b0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/api-binary-compatibility.yml | 2 +-
.github/workflows/asf-allowlist-check.yml | 6 +-
.github/workflows/codeql.yml | 4 +-
.github/workflows/cve-scan.yml | 2 +-
.github/workflows/delta-conversion-ci.yml | 4 +-
.github/workflows/docs-ci.yml | 4 +
.github/workflows/flink-ci.yml | 2 +-
.github/workflows/hive-ci.yml | 2 +-
.github/workflows/java-ci.yml | 2 +-
.github/workflows/jmh-benchmarks.yml | 2 +-
.github/workflows/kafka-connect-ci.yml | 2 +-
.github/workflows/license-check.yml | 4 +
.github/workflows/open-api.yml | 2 +-
.github/workflows/recurring-jmh-benchmarks.yml | 2 +-
.github/workflows/spark-ci.yml | 2 +-
.github/workflows/zizmor.yml | 8 +-
AGENTS.md | 2 +-
.../main/java/org/apache/iceberg/ManifestFile.java | 20 +
.../apache/iceberg/geospatial/GeospatialBound.java | 24 +-
.../java/org/apache/iceberg/util/ByteBuffers.java | 41 +-
.../iceberg/geospatial/TestGeospatialBound.java | 30 +
.../org/apache/iceberg/util/TestByteBuffers.java | 109 ++++
.../GenericArrowVectorAccessorFactory.java | 21 +-
.../iceberg/arrow/vectorized/TestArrowReader.java | 79 +++
.../iceberg/aws/AssumeRoleAwsClientFactory.java | 2 +
.../LakeFormationAwsClientFactory.java | 1 +
.../apache/iceberg/aws/TestAwsClientFactories.java | 71 +++
.../iceberg/azure/adlsv2/TestADLSFileIO.java | 19 +-
.../org/apache/iceberg/azure/AzureProperties.java | 9 +-
.../apache/iceberg/azure/adlsv2/ADLSFileIO.java | 10 +-
.../apache/iceberg/azure/adlsv2/ADLSLocation.java | 7 +
.../apache/iceberg/azure/TestAzureProperties.java | 12 +
.../iceberg/azure/adlsv2/TestADLSFileIO.java | 27 +
.../iceberg/azure/adlsv2/TestADLSLocation.java | 2 +
build.gradle | 4 +-
.../org/apache/iceberg/BaseOverwriteFiles.java | 32 +-
.../main/java/org/apache/iceberg/FilePlanner.java | 207 +++++++
.../org/apache/iceberg/MapBackedContentStats.java | 249 ++++++++
.../java/org/apache/iceberg/RootManifestFile.java | 161 +++++
.../org/apache/iceberg/TrackedFileAdapters.java | 569 +++++++++++++++++-
.../iceberg/encryption/InputFilesDecryptor.java | 4 +-
.../java/org/apache/iceberg/jdbc/JdbcCatalog.java | 13 +-
.../apache/iceberg/jdbc/JdbcTableOperations.java | 7 +-
.../java/org/apache/iceberg/jdbc/JdbcUtil.java | 18 +
.../apache/iceberg/jdbc/JdbcViewOperations.java | 20 +-
.../apache/iceberg/mumbling/MumblingBitmap.java | 348 ++++++++++-
.../org/apache/iceberg/mumbling/MutableBitmap.java | 9 +-
.../java/org/apache/iceberg/TestFilePlanner.java | 660 +++++++++++++++++++++
.../apache/iceberg/TestMapBackedContentStats.java | 377 ++++++++++++
.../org/apache/iceberg/TestRootManifestFile.java | 130 ++++
.../apache/iceberg/TestTrackedFileAdapters.java | 352 ++++++++++-
.../java/org/apache/iceberg/V4TestHelpers.java | 21 +-
.../org/apache/iceberg/jdbc/TestJdbcCatalog.java | 40 ++
.../apache/iceberg/jdbc/TestJdbcViewCatalog.java | 47 +-
.../apache/iceberg/mumbling/MumblingTestUtil.java | 4 +
.../iceberg/mumbling/TestMumblingBitmap.java | 502 ++++++++++++++++
.../org/apache/iceberg/data/DataGenerators.java | 38 +-
.../apache/iceberg/data/ReadFormatModelTests.java | 76 ++-
.../iceberg/data/TestGenericFormatModel.java | 73 +++
docs/docs/jdbc.md | 1 +
flink/v1.20/flink-runtime/runtime-deps.txt | 4 +-
.../dynamic/DynamicRecordInternalSerializer.java | 8 +-
.../sink/dynamic/DynamicTableUpdateOperator.java | 26 +-
.../flink/sink/dynamic/TableMetadataCache.java | 77 +--
.../iceberg/flink/data/TestFlinkFormatModel.java | 7 +-
.../flink/sink/dynamic/TestDynamicIcebergSink.java | 178 ++++--
.../TestDynamicRecordInternalSerializer.java | 68 +++
.../sink/dynamic/TestDynamicRecordProcessor.java | 95 +++
.../dynamic/TestDynamicTableUpdateOperator.java | 38 ++
.../flink/sink/dynamic/TestTableMetadataCache.java | 22 +
flink/v2.2/flink-runtime/runtime-deps.txt | 4 +-
.../dynamic/DynamicRecordInternalSerializer.java | 8 +-
.../sink/dynamic/DynamicTableUpdateOperator.java | 26 +-
.../flink/sink/dynamic/TableMetadataCache.java | 77 +--
.../iceberg/flink/data/TestFlinkFormatModel.java | 3 +-
.../flink/sink/dynamic/TestDynamicIcebergSink.java | 178 ++++--
.../TestDynamicRecordInternalSerializer.java | 68 +++
.../sink/dynamic/TestDynamicRecordProcessor.java | 95 +++
.../dynamic/TestDynamicTableUpdateOperator.java | 38 ++
.../flink/sink/dynamic/TestTableMetadataCache.java | 22 +
flink/v2.3/flink-runtime/runtime-deps.txt | 4 +-
.../operator/EqualityConvertCommitter.java | 11 +-
.../maintenance/operator/EqualityConvertPlan.java | 11 +
.../operator/EqualityConvertPlanner.java | 11 +-
.../iceberg/flink/sink/IcebergWriteAggregator.java | 9 +
.../flink/sink/dynamic/TableMetadataCache.java | 77 +--
.../iceberg/flink/data/TestFlinkFormatModel.java | 3 +-
.../api/TestConvertEqualityDeletesE2E.java | 116 ++++
.../operator/TestEqualityConvertCommitter.java | 61 ++
.../operator/TestEqualityConvertDVWriter.java | 31 +
.../operator/TestEqualityConvertPlanner.java | 19 +-
.../iceberg/flink/sink/TestIcebergCommitter.java | 27 +
.../sink/dynamic/TestDynamicRecordProcessor.java | 95 +++
.../flink/sink/dynamic/TestTableMetadataCache.java | 22 +
format/spec.md | 43 +-
gradle/libs.versions.toml | 14 +-
gradle/wrapper/gradle-wrapper.properties | 4 +-
gradlew | 2 +-
.../iceberg/hive/HMSTablePropertyHelper.java | 1 +
.../org/apache/iceberg/hive/TestHiveCatalog.java | 49 ++
kafka-connect/build.gradle | 4 +-
open-api/rest-catalog-open-api.yaml | 1 +
.../apache/iceberg/parquet/MessageTypeToType.java | 4 +
.../org/apache/iceberg/parquet/ParquetFilters.java | 6 +-
.../apache/iceberg/parquet/ParquetSchemaUtil.java | 3 +
.../org/apache/iceberg/parquet/PruneColumns.java | 78 +++
.../org/apache/iceberg/parquet/TestParquet.java | 60 +-
.../apache/iceberg/parquet/TestPruneColumns.java | 220 +++++++
site/docs/community.md | 33 +-
site/nav.yml | 1 +
.../v2/ExtendedDataSourceV2Strategy.scala | 25 +-
.../datasources/v2/RenameV2ViewExec.scala | 8 +-
.../apache/iceberg/spark/extensions/TestViews.java | 28 +
spark/v3.5/spark-runtime/runtime-deps.txt | 4 +-
.../java/org/apache/iceberg/spark/Spark3Util.java | 3 +
.../iceberg/spark/data/TestSparkFormatModel.java | 7 +-
.../v2/ExtendedDataSourceV2Strategy.scala | 25 +-
.../datasources/v2/RenameV2ViewExec.scala | 8 +-
.../apache/iceberg/spark/extensions/TestViews.java | 28 +
spark/v4.0/spark-runtime/runtime-deps.txt | 4 +-
.../java/org/apache/iceberg/spark/Spark3Util.java | 3 +
.../iceberg/spark/data/TestSparkFormatModel.java | 6 +-
.../v2/ExtendedDataSourceV2Strategy.scala | 25 +-
.../datasources/v2/RenameV2ViewExec.scala | 8 +-
.../apache/iceberg/spark/extensions/TestViews.java | 28 +
spark/v4.1/spark-runtime/runtime-deps.txt | 4 +-
.../java/org/apache/iceberg/spark/Spark3Util.java | 3 +
.../iceberg/spark/data/TestSparkFormatModel.java | 10 +-
.../TestIncrementallyConstructedQueries.java | 11 +-
spark/v4.2/spark-runtime/runtime-deps.txt | 4 +-
.../org/apache/iceberg/spark/TypeToSparkType.java | 4 +-
.../spark/source/SparkPartitioningAwareScan.java | 12 +
.../spark/source/SparkRuntimeFilterableScan.java | 50 ++
.../iceberg/spark/TestSparkCatalogOperations.java | 4 +-
.../apache/iceberg/spark/TestSparkSchemaUtil.java | 30 +
.../iceberg/spark/data/TestSparkFormatModel.java | 10 +-
.../TestMetadataTablesWithPartitionEvolution.java | 10 +-
.../iceberg/spark/source/TestRuntimeFiltering.java | 232 +++++++-
138 files changed, 6756 insertions(+), 398 deletions(-)
create mode 100644 core/src/main/java/org/apache/iceberg/FilePlanner.java
create mode 100644
core/src/main/java/org/apache/iceberg/MapBackedContentStats.java
create mode 100644 core/src/main/java/org/apache/iceberg/RootManifestFile.java
copy api/src/main/java/org/apache/iceberg/io/DelegatingInputStream.java =>
core/src/main/java/org/apache/iceberg/mumbling/MutableBitmap.java (79%)
create mode 100644 core/src/test/java/org/apache/iceberg/TestFilePlanner.java
create mode 100644
core/src/test/java/org/apache/iceberg/TestMapBackedContentStats.java
create mode 100644
core/src/test/java/org/apache/iceberg/TestRootManifestFile.java
create mode 100644
data/src/test/java/org/apache/iceberg/data/TestGenericFormatModel.java
