This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/texera.git
The following commit(s) were added to refs/heads/main by this push:
new db00f94164 fix(deps): upgrade Apache Iceberg to 1.9.2 to resolve
parquet-avro CVEs (#6208)
db00f94164 is described below
commit db00f941646739688aad8251c6ab37527b9f1092
Author: Yicong Huang <[email protected]>
AuthorDate: Mon Jul 6 19:26:59 2026 -0700
fix(deps): upgrade Apache Iceberg to 1.9.2 to resolve parquet-avro CVEs
(#6208)
### What changes were proposed in this PR?
Upgrade Apache Iceberg from 1.7.1 to 1.9.2 in `common/workflow-core`.
Iceberg 1.7.1 transitively pulls `org.apache.parquet:parquet-avro`
1.13.1, which is flagged by two open Dependabot alerts:
- **CVE-2025-30065** (critical): schema parsing in the parquet-avro
module allows arbitrary code execution; fixed in parquet 1.15.1.
- **CVE-2025-46762** (high): fixed in parquet 1.15.2.
Iceberg 1.9.2 is the smallest Iceberg release whose official dependency
set pairs with parquet 1.15.2, clearing both alerts with the
upstream-tested combination (rather than force-pinning parquet under an
older Iceberg). Parquet is purely transitive — there is no direct
`org.apache.parquet` usage in our code.
The four `LICENSE-binary`(-java) / `NOTICE-binary` manifest sets (amber,
file-service, workflow-compiling-service,
computing-unit-managing-service) are regenerated against dists rebuilt
on this branch, covering the iceberg/parquet bumps and the transitive
version drift they bring (zstd-jni, aircompressor,
httpclient5/httpcore5, orc, audience-annotations, snappy-java).
One source change was required: Iceberg 1.9 added a `BiFunction`
overload to `Parquet.DataWriteBuilder#createWriterFunc` and deprecated
`GenericParquetWriter.buildWriter(MessageType)`, so the bare method
reference in `IcebergTableWriter.flushBuffer` no longer eta-expands in
Scala. Switched to the replacement API
`GenericParquetWriter.create(Schema, MessageType)` via an explicit
lambda.
Resolved versions after this change: all `org.apache.parquet:*`
artifacts at 1.15.2, all `org.apache.iceberg:*` artifacts at 1.9.2, avro
at 1.12.0.
### Any related issues, documentation, discussions?
Resolves #6207. Dependabot alerts:
[#714](https://github.com/apache/texera/security/dependabot/714),
[#716](https://github.com/apache/texera/security/dependabot/716).
### How was this PR tested?
- `sbt WorkflowCore/test` and the Iceberg integration specs all pass
locally; a new `IcebergTableWriterSpec` unit-tests the modified writer
directly (flush-on-close, batch auto-flush, removeOne, file prefixes).
- Verified the bundled parquet family resolves to 1.15.2.
- `check_binary_deps.py` (strict mode) and `generate_notice_binary.py`
pass against locally built dists of all four affected services.
### Was this PR authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Claude Fable 5)
---------
Co-authored-by: Claude Fable 5 <[email protected]>
---
amber/LICENSE-binary-java | 46 ++--
amber/NOTICE-binary | 161 +++++++++-----
common/workflow-core/build.sbt | 13 +-
.../result/iceberg/IcebergTableWriter.scala | 5 +-
.../result/iceberg/IcebergTableWriterSpec.scala | 160 ++++++++++++++
computing-unit-managing-service/LICENSE-binary | 46 ++--
computing-unit-managing-service/NOTICE-binary | 236 ++++++++++-----------
file-service/LICENSE-binary | 46 ++--
file-service/NOTICE-binary | 236 ++++++++++-----------
workflow-compiling-service/LICENSE-binary | 46 ++--
workflow-compiling-service/NOTICE-binary | 236 ++++++++++-----------
11 files changed, 693 insertions(+), 538 deletions(-)
diff --git a/amber/LICENSE-binary-java b/amber/LICENSE-binary-java
index 1e2cf16cf9..e81bd83408 100644
--- a/amber/LICENSE-binary-java
+++ b/amber/LICENSE-binary-java
@@ -297,7 +297,7 @@ Scala/Java jars:
- commons-net.commons-net-3.9.0.jar
- commons-pool.commons-pool-1.6.jar
- dev.failsafe.failsafe-3.3.2.jar
- - io.airlift.aircompressor-0.27.jar
+ - io.airlift.aircompressor-2.0.2.jar
- io.altoo.pekko-kryo-serialization_2.13-1.3.0.jar
- io.altoo.scala-kryo-serialization_2.13-1.3.0.jar
- io.dropwizard-bundles.dropwizard-redirect-bundle-1.0.5.jar
@@ -397,21 +397,21 @@ Scala/Java jars:
- org.apache.hadoop.hadoop-yarn-common-3.4.3.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-guava-1.5.0.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-protobuf_3_25-1.5.0.jar
- - org.apache.httpcomponents.client5.httpclient5-5.4.jar
- - org.apache.httpcomponents.core5.httpcore5-5.3.jar
- - org.apache.httpcomponents.core5.httpcore5-h2-5.3.jar
+ - org.apache.httpcomponents.client5.httpclient5-5.4.3.jar
+ - org.apache.httpcomponents.core5.httpcore5-5.3.4.jar
+ - org.apache.httpcomponents.core5.httpcore5-h2-5.3.4.jar
- org.apache.httpcomponents.httpasyncclient-4.1.5.jar
- org.apache.httpcomponents.httpclient-4.5.14.jar
- org.apache.httpcomponents.httpcore-4.4.16.jar
- org.apache.httpcomponents.httpcore-nio-4.4.13.jar
- org.apache.httpcomponents.httpmime-4.5.13.jar
- - org.apache.iceberg.iceberg-api-1.7.1.jar
- - org.apache.iceberg.iceberg-aws-1.7.1.jar
- - org.apache.iceberg.iceberg-bundled-guava-1.7.1.jar
- - org.apache.iceberg.iceberg-common-1.7.1.jar
- - org.apache.iceberg.iceberg-core-1.7.1.jar
- - org.apache.iceberg.iceberg-data-1.7.1.jar
- - org.apache.iceberg.iceberg-parquet-1.7.1.jar
+ - org.apache.iceberg.iceberg-api-1.9.2.jar
+ - org.apache.iceberg.iceberg-aws-1.9.2.jar
+ - org.apache.iceberg.iceberg-bundled-guava-1.9.2.jar
+ - org.apache.iceberg.iceberg-common-1.9.2.jar
+ - org.apache.iceberg.iceberg-core-1.9.2.jar
+ - org.apache.iceberg.iceberg-data-1.9.2.jar
+ - org.apache.iceberg.iceberg-parquet-1.9.2.jar
- org.apache.kerby.kerb-core-2.0.3.jar
- org.apache.kerby.kerb-crypto-2.0.3.jar
- org.apache.kerby.kerb-util-2.0.3.jar
@@ -428,15 +428,15 @@ Scala/Java jars:
- org.apache.lucene.lucene-queries-8.7.0.jar
- org.apache.lucene.lucene-queryparser-8.7.0.jar
- org.apache.lucene.lucene-sandbox-8.7.0.jar
- - org.apache.orc.orc-core-1.9.4-nohive.jar
- - org.apache.orc.orc-shims-1.9.4.jar
- - org.apache.parquet.parquet-avro-1.13.1.jar
- - org.apache.parquet.parquet-column-1.13.1.jar
- - org.apache.parquet.parquet-common-1.13.1.jar
- - org.apache.parquet.parquet-encoding-1.13.1.jar
- - org.apache.parquet.parquet-format-structures-1.13.1.jar
- - org.apache.parquet.parquet-hadoop-1.13.1.jar
- - org.apache.parquet.parquet-jackson-1.13.1.jar
+ - org.apache.orc.orc-core-1.9.5-nohive.jar
+ - org.apache.orc.orc-shims-1.9.5.jar
+ - org.apache.parquet.parquet-avro-1.15.2.jar
+ - org.apache.parquet.parquet-column-1.15.2.jar
+ - org.apache.parquet.parquet-common-1.15.2.jar
+ - org.apache.parquet.parquet-encoding-1.15.2.jar
+ - org.apache.parquet.parquet-format-structures-1.15.2.jar
+ - org.apache.parquet.parquet-hadoop-1.15.2.jar
+ - org.apache.parquet.parquet-jackson-1.15.2.jar
- org.apache.pekko.pekko-actor_2.13-1.6.0.jar
- org.apache.pekko.pekko-cluster-metrics_2.13-1.6.0.jar
- org.apache.pekko.pekko-cluster-tools_2.13-1.6.0.jar
@@ -448,7 +448,7 @@ Scala/Java jars:
- org.apache.pekko.pekko-remote_2.13-1.6.0.jar
- org.apache.pekko.pekko-slf4j_2.13-1.6.0.jar
- org.apache.pekko.pekko-stream_2.13-1.6.0.jar
- - org.apache.yetus.audience-annotations-0.13.0.jar
+ - org.apache.yetus.audience-annotations-0.12.0.jar
- org.apache.zookeeper.zookeeper-3.8.4.jar
- org.apache.zookeeper.zookeeper-jute-3.8.4.jar
- org.bitbucket.b_c.jose4j-0.9.6.jar
@@ -505,7 +505,7 @@ Scala/Java jars:
- org.typelevel.cats-effect-std_2.13-3.6.3.jar
- org.typelevel.cats-effect_2.13-3.6.3.jar
- org.typelevel.cats-mtl_2.13-1.3.1.jar
- - org.xerial.snappy.snappy-java-1.1.10.4.jar
+ - org.xerial.snappy.snappy-java-1.1.10.7.jar
- org.yaml.snakeyaml-1.23.jar
- software.amazon.awssdk.annotations-2.29.51.jar
- software.amazon.awssdk.apache-client-2.29.51.jar
@@ -607,7 +607,7 @@ Dependencies under the BSD 2-Clause License
--------------------------------------------------------------------------------
Scala/Java jars:
- - com.github.luben.zstd-jni-1.5.0-1.jar
+ - com.github.luben.zstd-jni-1.5.6-6.jar
- com.github.marianobarrios.lbmq-0.6.0.jar
- dnsjava.dnsjava-3.6.1.jar
- org.codehaus.woodstox.stax2-api-4.2.1.jar
diff --git a/amber/NOTICE-binary b/amber/NOTICE-binary
index 86b88e3c37..1a5a625632 100644
--- a/amber/NOTICE-binary
+++ b/amber/NOTICE-binary
@@ -217,7 +217,7 @@ org.apache.iceberg
--------------------------------------------------------------------------------
Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
+Copyright 2017-2025 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
@@ -853,6 +853,83 @@ Copyright 2014-2022 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
+--------------------------------------------------------------------------------
+org.apache.parquet.parquet-jackson
+--------------------------------------------------------------------------------
+
+# Jackson JSON processor
+
+Jackson is a high-performance, Free/Open Source JSON processing library.
+It was originally written by Tatu Saloranta ([email protected]), and has
+been in development since 2007.
+It is currently developed by a community of developers.
+
+## Copyright
+
+Copyright 2007-, Tatu Saloranta ([email protected])
+
+## Licensing
+
+Jackson 2.x core and extension components are licensed under Apache License 2.0
+To find the details that apply to this artifact see the accompanying LICENSE
file.
+
+## Credits
+
+A list of contributors may be found from CREDITS(-2.x) file, which is included
+in some artifacts (usually source distributions); but is always available
+from the source code management (SCM) system project uses.
+
+## FastDoubleParser
+
+jackson-core bundles a shaded copy of FastDoubleParser
<https://github.com/wrandelshofer/FastDoubleParser>.
+That code is available under an MIT license
<https://github.com/wrandelshofer/FastDoubleParser/blob/main/LICENSE>
+under the following copyright.
+
+Copyright © 2023 Werner Randelshofer, Switzerland. MIT License.
+
+See FastDoubleParser-NOTICE for details of other source code included in
FastDoubleParser
+and the licenses and copyrights that apply to that code.
+
+# FastDoubleParser
+
+This is a Java port of Daniel Lemire's fast_float project.
+This project provides parsers for double, float, BigDecimal and BigInteger
values.
+
+## Copyright
+
+Copyright © 2024 Werner Randelshofer, Switzerland.
+
+## Licensing
+
+This code is licensed under MIT License.
+https://github.com/wrandelshofer/FastDoubleParser/blob/522be16e145f43308c43b23094e31d5efcaa580e/LICENSE
+(The file 'LICENSE' is included in the sources and classes Jar files that are
released by this project
+- as is required by that license.)
+
+Some portions of the code have been derived from other projects.
+All these projects require that we include a copyright notice, and some
require that we also include some text of their
+license file.
+
+fast_double_parser, Copyright (c) 2022 Daniel Lemire. BSL License.
+https://github.com/lemire/fast_double_parser
+https://github.com/lemire/fast_double_parser/blob/07d9189a8fb815fe800cb15ca022e7a07093236e/LICENSE.BSL
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+fast_float, Copyright (c) 2021 The fast_float authors. MIT License.
+https://github.com/fastfloat/fast_float
+https://github.com/fastfloat/fast_float/blob/cc1e01e9eee74128e48d51488a6b1df4a767a810/LICENSE-MIT
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+bigint, Copyright 2020 Tim Buktu. 2-clause BSD License.
+https://github.com/tbuktu/bigint/tree/floatfft
+https://github.com/tbuktu/bigint/blob/617c8cd8a7c5e4fb4d919c6a4d11e2586107f029/LICENSE
+https://github.com/wrandelshofer/FastDoubleParser/blob/39e123b15b71f29a38a087d16a0bc620fc879aa6/bigint-LICENSE
+(We only use those portions of the bigint project that can be licensed under
2-clause BSD License.)
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
--------------------------------------------------------------------------------
org.apache.curator.curator-recipes
--------------------------------------------------------------------------------
@@ -1164,27 +1241,6 @@ Copyright 2001-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (https://www.apache.org/).
---------------------------------------------------------------------------------
-org.apache.parquet.parquet-avro
---------------------------------------------------------------------------------
-
-Apache Parquet MR (Incubating)
-Copyright 2014-2015 The Apache Software Foundation
-
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-
-This product includes code from Apache Avro, which includes the following in
-its NOTICE file:
-
- Apache Avro
- Copyright 2010-2015 The Apache Software Foundation
-
- This product includes software developed at
- The Apache Software Foundation (http://www.apache.org/).
-
--------------------------------------------------------------------------------
org.apache.commons.commons-vfs2
--------------------------------------------------------------------------------
@@ -1451,6 +1507,16 @@ JUnit (4.12)
* License: Eclipse Public License
+--------------------------------------------------------------------------------
+com.google.guava.guava
+--------------------------------------------------------------------------------
+
+Apache Iceberg
+Copyright 2017-2025 The Apache Software Foundation
+
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
+
--------------------------------------------------------------------------------
org.apache.pekko.pekko-protobuf-v3_2.13
--------------------------------------------------------------------------------
@@ -1797,46 +1863,45 @@ Copyright 2016 AddThis
This product includes software developed by AddThis.
--------------------------------------------------------------------------------
-org.apache.parquet.parquet-jackson
+org.apache.kerby.kerby-util
--------------------------------------------------------------------------------
-# Jackson JSON processor
+Kerby Util
+Copyright 2014-2022 The Apache Software Foundation
-Jackson is a high-performance, Free/Open Source JSON processing library.
-It was originally written by Tatu Saloranta ([email protected]), and has
-been in development since 2007.
-It is currently developed by a community of developers.
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
-## Licensing
+--------------------------------------------------------------------------------
+com.fasterxml.classmate
+--------------------------------------------------------------------------------
-Jackson 2.x core and extension components are licensed under Apache License 2.0
-To find the details that apply to this artifact see the accompanying LICENSE
file.
+Java ClassMate library was originally written by Tatu Saloranta
([email protected])
-## Credits
+Other developers who have contributed code are:
-A list of contributors may be found from CREDITS(-2.x) file, which is included
-in some artifacts (usually source distributions); but is always available
-from the source code management (SCM) system project uses.
+* Brian Langel
--------------------------------------------------------------------------------
-org.apache.kerby.kerby-util
+org.apache.parquet.parquet-avro
--------------------------------------------------------------------------------
-Kerby Util
-Copyright 2014-2022 The Apache Software Foundation
+Apache Parquet Avro
+Copyright 2014-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
---------------------------------------------------------------------------------
-com.fasterxml.classmate
--------------------------------------------------------------------------------
-Java ClassMate library was originally written by Tatu Saloranta
([email protected])
+This product includes code from Apache Avro, which includes the following in
+its NOTICE file:
-Other developers who have contributed code are:
+ Apache Avro
+ Copyright 2010-2015 The Apache Software Foundation
-* Brian Langel
+ This product includes software developed at
+ The Apache Software Foundation (http://www.apache.org/).
--------------------------------------------------------------------------------
com.fasterxml.jackson.core.jackson-core
@@ -2103,16 +2168,6 @@ Apache Log4j 1.x Compatibility API
Copyright 1999-2026 The Apache Software Foundation
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-com.google.guava.guava
---------------------------------------------------------------------------------
-
-Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
-
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
diff --git a/common/workflow-core/build.sbt b/common/workflow-core/build.sbt
index 312eb397b5..87037c159c 100644
--- a/common/workflow-core/build.sbt
+++ b/common/workflow-core/build.sbt
@@ -169,22 +169,25 @@ val excludeJackson = ExclusionRule(organization =
"com.fasterxml.jackson.core")
val excludeJacksonModule = ExclusionRule(organization =
"com.fasterxml.jackson.module")
val excludeNetty = ExclusionRule(organization = "io.netty")
val log4jVersion = "2.26.1"
+// Iceberg 1.9.2 pairs with parquet 1.15.2, clearing the parquet-avro CVEs
+// (CVE-2025-30065, CVE-2025-46762) pulled in transitively by older releases.
+val icebergVersion = "1.9.2"
libraryDependencies ++= Seq(
- "org.apache.iceberg" % "iceberg-api" % "1.7.1",
- "org.apache.iceberg" % "iceberg-parquet" % "1.7.1" excludeAll(
+ "org.apache.iceberg" % "iceberg-api" % icebergVersion,
+ "org.apache.iceberg" % "iceberg-parquet" % icebergVersion excludeAll(
excludeJackson,
excludeJacksonModule
),
- "org.apache.iceberg" % "iceberg-core" % "1.7.1" excludeAll(
+ "org.apache.iceberg" % "iceberg-core" % icebergVersion excludeAll(
excludeJackson,
excludeJacksonModule
),
- "org.apache.iceberg" % "iceberg-data" % "1.7.1" excludeAll(
+ "org.apache.iceberg" % "iceberg-data" % icebergVersion excludeAll(
excludeJackson,
excludeJacksonModule
),
- "org.apache.iceberg" % "iceberg-aws" % "1.7.1" excludeAll(
+ "org.apache.iceberg" % "iceberg-aws" % icebergVersion excludeAll(
excludeJackson,
excludeJacksonModule
),
diff --git
a/common/workflow-core/src/main/scala/org/apache/texera/amber/core/storage/result/iceberg/IcebergTableWriter.scala
b/common/workflow-core/src/main/scala/org/apache/texera/amber/core/storage/result/iceberg/IcebergTableWriter.scala
index e6d7395d64..81b27d1139 100644
---
a/common/workflow-core/src/main/scala/org/apache/texera/amber/core/storage/result/iceberg/IcebergTableWriter.scala
+++
b/common/workflow-core/src/main/scala/org/apache/texera/amber/core/storage/result/iceberg/IcebergTableWriter.scala
@@ -28,6 +28,7 @@ import org.apache.iceberg.data.parquet.GenericParquetWriter
import org.apache.iceberg.io.{DataWriter, OutputFile}
import org.apache.iceberg.parquet.Parquet
import org.apache.iceberg.{Schema, Table}
+import org.apache.parquet.schema.MessageType
import scala.collection.mutable.ArrayBuffer
@@ -115,7 +116,9 @@ private[storage] class IcebergTableWriter[T](
val dataWriter: DataWriter[Record] = Parquet
.writeData(outputFile)
.forTable(table)
- .createWriterFunc(GenericParquetWriter.buildWriter)
+ .createWriterFunc((schema: Schema, messageType: MessageType) =>
+ GenericParquetWriter.create(schema, messageType)
+ )
.overwrite()
.build()
// Write each buffered item to the data file
diff --git
a/common/workflow-core/src/test/scala/org/apache/texera/amber/core/storage/result/iceberg/IcebergTableWriterSpec.scala
b/common/workflow-core/src/test/scala/org/apache/texera/amber/core/storage/result/iceberg/IcebergTableWriterSpec.scala
new file mode 100644
index 0000000000..5c82392417
--- /dev/null
+++
b/common/workflow-core/src/test/scala/org/apache/texera/amber/core/storage/result/iceberg/IcebergTableWriterSpec.scala
@@ -0,0 +1,160 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.texera.amber.core.storage.result.iceberg
+
+import org.apache.texera.amber.core.tuple.{AttributeType, Schema, Tuple}
+import org.apache.texera.amber.util.IcebergUtil
+import org.apache.iceberg.catalog.Catalog
+import org.apache.iceberg.data.IcebergGenerics
+import org.apache.iceberg.{Schema => IcebergSchema, Table}
+import org.scalatest.BeforeAndAfterAll
+import org.scalatest.flatspec.AnyFlatSpec
+
+import java.nio.file.{Files, Path}
+import java.util.UUID
+import scala.jdk.CollectionConverters._
+
+class IcebergTableWriterSpec extends AnyFlatSpec with BeforeAndAfterAll {
+
+ private val tableNamespace = "writer_spec"
+ private var warehouseDir: Path = _
+ private var catalog: Catalog = _
+
+ private val amberSchema: Schema = Schema()
+ .add("id", AttributeType.INTEGER)
+ .add("name", AttributeType.STRING)
+
+ private val icebergSchema: IcebergSchema =
IcebergUtil.toIcebergSchema(amberSchema)
+
+ override def beforeAll(): Unit = {
+ warehouseDir = Files.createTempDirectory("iceberg-table-writer-spec")
+ catalog = IcebergUtil.createHadoopCatalog("writer-spec", warehouseDir)
+ }
+
+ override def afterAll(): Unit = {
+ catalog match {
+ case closeable: AutoCloseable => closeable.close()
+ case _ =>
+ }
+ }
+
+ private def tuple(id: Int): Tuple =
+ Tuple
+ .builder(amberSchema)
+ .addSequentially(Array(Int.box(id), s"name-$id"))
+ .build()
+
+ private def createWriter(tableName: String, writerIdentifier: String =
"writer_0") = {
+ IcebergUtil.createTable(
+ catalog,
+ tableNamespace,
+ tableName,
+ icebergSchema,
+ overrideIfExists = true
+ )
+ new IcebergTableWriter[Tuple](
+ writerIdentifier,
+ catalog,
+ tableNamespace,
+ tableName,
+ icebergSchema,
+ IcebergUtil.toGenericRecord
+ )
+ }
+
+ private def loadTable(tableName: String): Table =
+ IcebergUtil.loadTableMetadata(catalog, tableNamespace, tableName).get
+
+ private def readTuples(tableName: String): List[Tuple] = {
+ val records = IcebergGenerics.read(loadTable(tableName)).build()
+ try {
+ records.iterator().asScala.map(IcebergUtil.fromRecord(_,
amberSchema)).toList
+ } finally {
+ records.close()
+ }
+ }
+
+ private def freshTableName(): String =
+ s"table_${UUID.randomUUID().toString.replace("-", "")}"
+
+ "IcebergTableWriter" should "flush remaining buffered tuples to the table on
close" in {
+ val tableName = freshTableName()
+ val writer = createWriter(tableName)
+ writer.open()
+ val tuples = (0 until 10).map(tuple)
+ tuples.foreach(writer.putOne)
+
+ // Nothing is committed until the buffer fills or the writer closes
+ assert(readTuples(tableName).isEmpty)
+
+ writer.close()
+ assert(readTuples(tableName).sortBy(_.getField[Int]("id")) ==
tuples.toList)
+ }
+
+ it should "auto-flush when the buffer reaches the configured batch size" in {
+ val tableName = freshTableName()
+ val writer = createWriter(tableName)
+ val batchSize = writer.bufferSize
+ writer.open()
+ (0 until batchSize).foreach(i => writer.putOne(tuple(i)))
+
+ // The full batch is committed without an explicit close
+ assert(readTuples(tableName).size == batchSize)
+
+ writer.putOne(tuple(batchSize))
+ writer.close()
+ val tuples = readTuples(tableName)
+ assert(tuples.size == batchSize + 1)
+ // Each flush creates its own data file
+ assert(loadTable(tableName).snapshots().asScala.size == 2)
+ }
+
+ it should "not write tuples removed from the buffer before a flush" in {
+ val tableName = freshTableName()
+ val writer = createWriter(tableName)
+ writer.open()
+ val kept = tuple(1)
+ val removed = tuple(2)
+ writer.putOne(kept)
+ writer.putOne(removed)
+ writer.removeOne(removed)
+ writer.close()
+
+ assert(readTuples(tableName) == List(kept))
+ }
+
+ it should "prefix created data files with the writer identifier" in {
+ val tableName = freshTableName()
+ val writer = createWriter(tableName, writerIdentifier = "worker_42")
+ writer.open()
+ writer.putOne(tuple(1))
+ writer.close()
+
+ val table = loadTable(tableName)
+ val dataFiles = table
+ .currentSnapshot()
+ .addedDataFiles(table.io())
+ .asScala
+ .map(_.location())
+ .toList
+ assert(dataFiles.nonEmpty)
+ assert(dataFiles.forall(_.contains("worker_42_")))
+ }
+}
diff --git a/computing-unit-managing-service/LICENSE-binary
b/computing-unit-managing-service/LICENSE-binary
index a519845fbd..ab06ee9372 100644
--- a/computing-unit-managing-service/LICENSE-binary
+++ b/computing-unit-managing-service/LICENSE-binary
@@ -281,7 +281,7 @@ Scala/Java jars:
- commons-net.commons-net-3.9.0.jar
- commons-pool.commons-pool-1.6.jar
- dev.failsafe.failsafe-3.3.2.jar
- - io.airlift.aircompressor-0.27.jar
+ - io.airlift.aircompressor-2.0.2.jar
- io.dropwizard.dropwizard-auth-4.0.7.jar
- io.dropwizard.dropwizard-configuration-4.0.7.jar
- io.dropwizard.dropwizard-core-4.0.7.jar
@@ -404,18 +404,18 @@ Scala/Java jars:
- org.apache.hadoop.hadoop-yarn-common-3.4.3.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-guava-1.5.0.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-protobuf_3_25-1.5.0.jar
- - org.apache.httpcomponents.client5.httpclient5-5.4.jar
- - org.apache.httpcomponents.core5.httpcore5-5.3.jar
- - org.apache.httpcomponents.core5.httpcore5-h2-5.3.jar
+ - org.apache.httpcomponents.client5.httpclient5-5.4.3.jar
+ - org.apache.httpcomponents.core5.httpcore5-5.3.4.jar
+ - org.apache.httpcomponents.core5.httpcore5-h2-5.3.4.jar
- org.apache.httpcomponents.httpclient-4.5.13.jar
- org.apache.httpcomponents.httpcore-4.4.16.jar
- - org.apache.iceberg.iceberg-api-1.7.1.jar
- - org.apache.iceberg.iceberg-aws-1.7.1.jar
- - org.apache.iceberg.iceberg-bundled-guava-1.7.1.jar
- - org.apache.iceberg.iceberg-common-1.7.1.jar
- - org.apache.iceberg.iceberg-core-1.7.1.jar
- - org.apache.iceberg.iceberg-data-1.7.1.jar
- - org.apache.iceberg.iceberg-parquet-1.7.1.jar
+ - org.apache.iceberg.iceberg-api-1.9.2.jar
+ - org.apache.iceberg.iceberg-aws-1.9.2.jar
+ - org.apache.iceberg.iceberg-bundled-guava-1.9.2.jar
+ - org.apache.iceberg.iceberg-common-1.9.2.jar
+ - org.apache.iceberg.iceberg-core-1.9.2.jar
+ - org.apache.iceberg.iceberg-data-1.9.2.jar
+ - org.apache.iceberg.iceberg-parquet-1.9.2.jar
- org.apache.kerby.kerb-core-2.0.3.jar
- org.apache.kerby.kerb-crypto-2.0.3.jar
- org.apache.kerby.kerb-util-2.0.3.jar
@@ -426,16 +426,16 @@ Scala/Java jars:
- org.apache.logging.log4j.log4j-1.2-api-2.26.1.jar
- org.apache.logging.log4j.log4j-api-2.26.1.jar
- org.apache.logging.log4j.log4j-to-slf4j-2.26.1.jar
- - org.apache.orc.orc-core-1.9.4-nohive.jar
- - org.apache.orc.orc-shims-1.9.4.jar
- - org.apache.parquet.parquet-avro-1.13.1.jar
- - org.apache.parquet.parquet-column-1.13.1.jar
- - org.apache.parquet.parquet-common-1.13.1.jar
- - org.apache.parquet.parquet-encoding-1.13.1.jar
- - org.apache.parquet.parquet-format-structures-1.13.1.jar
- - org.apache.parquet.parquet-hadoop-1.13.1.jar
- - org.apache.parquet.parquet-jackson-1.13.1.jar
- - org.apache.yetus.audience-annotations-0.13.0.jar
+ - org.apache.orc.orc-core-1.9.5-nohive.jar
+ - org.apache.orc.orc-shims-1.9.5.jar
+ - org.apache.parquet.parquet-avro-1.15.2.jar
+ - org.apache.parquet.parquet-column-1.15.2.jar
+ - org.apache.parquet.parquet-common-1.15.2.jar
+ - org.apache.parquet.parquet-encoding-1.15.2.jar
+ - org.apache.parquet.parquet-format-structures-1.15.2.jar
+ - org.apache.parquet.parquet-hadoop-1.15.2.jar
+ - org.apache.parquet.parquet-jackson-1.15.2.jar
+ - org.apache.yetus.audience-annotations-0.12.0.jar
- org.apache.zookeeper.zookeeper-3.8.4.jar
- org.apache.zookeeper.zookeeper-jute-3.8.4.jar
- org.bitbucket.b_c.jose4j-0.9.6.jar
@@ -473,7 +473,7 @@ Scala/Java jars:
- org.slf4j.jcl-over-slf4j-2.0.12.jar
- org.slf4j.log4j-over-slf4j-2.0.12.jar
- org.snakeyaml.snakeyaml-engine-2.7.jar
- - org.xerial.snappy.snappy-java-1.1.10.4.jar
+ - org.xerial.snappy.snappy-java-1.1.10.7.jar
- org.yaml.snakeyaml-2.2.jar
- software.amazon.awssdk.annotations-2.29.51.jar
- software.amazon.awssdk.apache-client-2.29.51.jar
@@ -558,7 +558,7 @@ Dependencies under the BSD 2-Clause License
--------------------------------------------------------------------------------
Scala/Java jars:
- - com.github.luben.zstd-jni-1.5.0-1.jar
+ - com.github.luben.zstd-jni-1.5.6-6.jar
- dnsjava.dnsjava-3.6.1.jar
- org.codehaus.woodstox.stax2-api-4.2.1.jar
- org.postgresql.postgresql-42.7.10.jar
diff --git a/computing-unit-managing-service/NOTICE-binary
b/computing-unit-managing-service/NOTICE-binary
index d1913d4449..8022cfb43b 100644
--- a/computing-unit-managing-service/NOTICE-binary
+++ b/computing-unit-managing-service/NOTICE-binary
@@ -176,7 +176,7 @@ org.apache.iceberg
--------------------------------------------------------------------------------
Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
+Copyright 2017-2025 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
@@ -571,6 +571,83 @@ A list of contributors may be found from CREDITS file,
which is included
in some artifacts (usually source distributions); but is always available
from the source code management (SCM) system project uses.
+--------------------------------------------------------------------------------
+com.fasterxml.jackson.core.jackson-core
+--------------------------------------------------------------------------------
+
+# Jackson JSON processor
+
+Jackson is a high-performance, Free/Open Source JSON processing library.
+It was originally written by Tatu Saloranta ([email protected]), and has
+been in development since 2007.
+It is currently developed by a community of developers.
+
+## Copyright
+
+Copyright 2007-, Tatu Saloranta ([email protected])
+
+## Licensing
+
+Jackson 2.x core and extension components are licensed under Apache License 2.0
+To find the details that apply to this artifact see the accompanying LICENSE
file.
+
+## Credits
+
+A list of contributors may be found from CREDITS(-2.x) file, which is included
+in some artifacts (usually source distributions); but is always available
+from the source code management (SCM) system project uses.
+
+## FastDoubleParser
+
+jackson-core bundles a shaded copy of FastDoubleParser
<https://github.com/wrandelshofer/FastDoubleParser>.
+That code is available under an MIT license
<https://github.com/wrandelshofer/FastDoubleParser/blob/main/LICENSE>
+under the following copyright.
+
+Copyright © 2023 Werner Randelshofer, Switzerland. MIT License.
+
+See FastDoubleParser-NOTICE for details of other source code included in
FastDoubleParser
+and the licenses and copyrights that apply to that code.
+
+# FastDoubleParser
+
+This is a Java port of Daniel Lemire's fast_float project.
+This project provides parsers for double, float, BigDecimal and BigInteger
values.
+
+## Copyright
+
+Copyright © 2024 Werner Randelshofer, Switzerland.
+
+## Licensing
+
+This code is licensed under MIT License.
+https://github.com/wrandelshofer/FastDoubleParser/blob/522be16e145f43308c43b23094e31d5efcaa580e/LICENSE
+(The file 'LICENSE' is included in the sources and classes Jar files that are
released by this project
+- as is required by that license.)
+
+Some portions of the code have been derived from other projects.
+All these projects require that we include a copyright notice, and some
require that we also include some text of their
+license file.
+
+fast_double_parser, Copyright (c) 2022 Daniel Lemire. BSL License.
+https://github.com/lemire/fast_double_parser
+https://github.com/lemire/fast_double_parser/blob/07d9189a8fb815fe800cb15ca022e7a07093236e/LICENSE.BSL
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+fast_float, Copyright (c) 2021 The fast_float authors. MIT License.
+https://github.com/fastfloat/fast_float
+https://github.com/fastfloat/fast_float/blob/cc1e01e9eee74128e48d51488a6b1df4a767a810/LICENSE-MIT
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+bigint, Copyright 2020 Tim Buktu. 2-clause BSD License.
+https://github.com/tbuktu/bigint/tree/floatfft
+https://github.com/tbuktu/bigint/blob/617c8cd8a7c5e4fb4d919c6a4d11e2586107f029/LICENSE
+https://github.com/wrandelshofer/FastDoubleParser/blob/39e123b15b71f29a38a087d16a0bc620fc879aa6/bigint-LICENSE
+(We only use those portions of the bigint project that can be licensed under
2-clause BSD License.)
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
--------------------------------------------------------------------------------
jakarta.el.jakarta.el-api
--------------------------------------------------------------------------------
@@ -749,83 +826,6 @@ Copyright 2014-2022 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
---------------------------------------------------------------------------------
-com.fasterxml.jackson.core.jackson-core
---------------------------------------------------------------------------------
-
-# Jackson JSON processor
-
-Jackson is a high-performance, Free/Open Source JSON processing library.
-It was originally written by Tatu Saloranta ([email protected]), and has
-been in development since 2007.
-It is currently developed by a community of developers.
-
-## Copyright
-
-Copyright 2007-, Tatu Saloranta ([email protected])
-
-## Licensing
-
-Jackson 2.x core and extension components are licensed under Apache License 2.0
-To find the details that apply to this artifact see the accompanying LICENSE
file.
-
-## Credits
-
-A list of contributors may be found from CREDITS(-2.x) file, which is included
-in some artifacts (usually source distributions); but is always available
-from the source code management (SCM) system project uses.
-
-## FastDoubleParser
-
-jackson-core bundles a shaded copy of FastDoubleParser
<https://github.com/wrandelshofer/FastDoubleParser>.
-That code is available under an MIT license
<https://github.com/wrandelshofer/FastDoubleParser/blob/main/LICENSE>
-under the following copyright.
-
-Copyright © 2023 Werner Randelshofer, Switzerland. MIT License.
-
-See FastDoubleParser-NOTICE for details of other source code included in
FastDoubleParser
-and the licenses and copyrights that apply to that code.
-
-# FastDoubleParser
-
-This is a Java port of Daniel Lemire's fast_float project.
-This project provides parsers for double, float, BigDecimal and BigInteger
values.
-
-## Copyright
-
-Copyright © 2024 Werner Randelshofer, Switzerland.
-
-## Licensing
-
-This code is licensed under MIT License.
-https://github.com/wrandelshofer/FastDoubleParser/blob/522be16e145f43308c43b23094e31d5efcaa580e/LICENSE
-(The file 'LICENSE' is included in the sources and classes Jar files that are
released by this project
-- as is required by that license.)
-
-Some portions of the code have been derived from other projects.
-All these projects require that we include a copyright notice, and some
require that we also include some text of their
-license file.
-
-fast_double_parser, Copyright (c) 2022 Daniel Lemire. BSL License.
-https://github.com/lemire/fast_double_parser
-https://github.com/lemire/fast_double_parser/blob/07d9189a8fb815fe800cb15ca022e7a07093236e/LICENSE.BSL
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
-fast_float, Copyright (c) 2021 The fast_float authors. MIT License.
-https://github.com/fastfloat/fast_float
-https://github.com/fastfloat/fast_float/blob/cc1e01e9eee74128e48d51488a6b1df4a767a810/LICENSE-MIT
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
-bigint, Copyright 2020 Tim Buktu. 2-clause BSD License.
-https://github.com/tbuktu/bigint/tree/floatfft
-https://github.com/tbuktu/bigint/blob/617c8cd8a7c5e4fb4d919c6a4d11e2586107f029/LICENSE
-https://github.com/wrandelshofer/FastDoubleParser/blob/39e123b15b71f29a38a087d16a0bc620fc879aa6/bigint-LICENSE
-(We only use those portions of the bigint project that can be licensed under
2-clause BSD License.)
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
--------------------------------------------------------------------------------
org.apache.curator.curator-recipes
--------------------------------------------------------------------------------
@@ -1179,27 +1179,6 @@ Copyright 2001-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (https://www.apache.org/).
---------------------------------------------------------------------------------
-org.apache.parquet.parquet-avro
---------------------------------------------------------------------------------
-
-Apache Parquet MR (Incubating)
-Copyright 2014-2015 The Apache Software Foundation
-
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-
-This product includes code from Apache Avro, which includes the following in
-its NOTICE file:
-
- Apache Avro
- Copyright 2010-2015 The Apache Software Foundation
-
- This product includes software developed at
- The Apache Software Foundation (http://www.apache.org/).
-
--------------------------------------------------------------------------------
org.glassfish.jersey.ext.jersey-bean-validation
--------------------------------------------------------------------------------
@@ -1656,6 +1635,16 @@ Copyright 2006-2020 Google, Inc.
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
+--------------------------------------------------------------------------------
+com.google.guava.guava
+--------------------------------------------------------------------------------
+
+Apache Iceberg
+Copyright 2017-2025 The Apache Software Foundation
+
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
+
--------------------------------------------------------------------------------
org.apache.arrow.arrow-format
--------------------------------------------------------------------------------
@@ -1933,37 +1922,36 @@ This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
--------------------------------------------------------------------------------
-org.apache.parquet.parquet-jackson
+org.apache.kerby.kerby-util
--------------------------------------------------------------------------------
-# Jackson JSON processor
-
-Jackson is a high-performance, Free/Open Source JSON processing library.
-It was originally written by Tatu Saloranta ([email protected]), and has
-been in development since 2007.
-It is currently developed by a community of developers.
-
-## Licensing
-
-Jackson 2.x core and extension components are licensed under Apache License 2.0
-To find the details that apply to this artifact see the accompanying LICENSE
file.
-
-## Credits
+Kerby Util
+Copyright 2014-2022 The Apache Software Foundation
-A list of contributors may be found from CREDITS(-2.x) file, which is included
-in some artifacts (usually source distributions); but is always available
-from the source code management (SCM) system project uses.
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
--------------------------------------------------------------------------------
-org.apache.kerby.kerby-util
+org.apache.parquet.parquet-avro
--------------------------------------------------------------------------------
-Kerby Util
-Copyright 2014-2022 The Apache Software Foundation
+Apache Parquet Avro
+Copyright 2014-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
+--------------------------------------------------------------------------------
+
+This product includes code from Apache Avro, which includes the following in
+its NOTICE file:
+
+ Apache Avro
+ Copyright 2010-2015 The Apache Software Foundation
+
+ This product includes software developed at
+ The Apache Software Foundation (http://www.apache.org/).
+
--------------------------------------------------------------------------------
commons-io.commons-io
--------------------------------------------------------------------------------
@@ -2294,16 +2282,6 @@ Apache Log4j 1.x Compatibility API
Copyright 1999-2026 The Apache Software Foundation
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-com.google.guava.guava
---------------------------------------------------------------------------------
-
-Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
-
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
diff --git a/file-service/LICENSE-binary b/file-service/LICENSE-binary
index 807edeaee9..635f3b2965 100644
--- a/file-service/LICENSE-binary
+++ b/file-service/LICENSE-binary
@@ -275,7 +275,7 @@ Scala/Java jars:
- commons-net.commons-net-3.9.0.jar
- commons-pool.commons-pool-1.6.jar
- dev.failsafe.failsafe-3.3.2.jar
- - io.airlift.aircompressor-0.27.jar
+ - io.airlift.aircompressor-2.0.2.jar
- io.dropwizard.dropwizard-auth-4.0.7.jar
- io.dropwizard.dropwizard-configuration-4.0.7.jar
- io.dropwizard.dropwizard-core-4.0.7.jar
@@ -368,18 +368,18 @@ Scala/Java jars:
- org.apache.hadoop.hadoop-yarn-common-3.4.3.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-guava-1.5.0.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-protobuf_3_25-1.5.0.jar
- - org.apache.httpcomponents.client5.httpclient5-5.4.jar
- - org.apache.httpcomponents.core5.httpcore5-5.3.jar
- - org.apache.httpcomponents.core5.httpcore5-h2-5.3.jar
+ - org.apache.httpcomponents.client5.httpclient5-5.4.3.jar
+ - org.apache.httpcomponents.core5.httpcore5-5.3.4.jar
+ - org.apache.httpcomponents.core5.httpcore5-h2-5.3.4.jar
- org.apache.httpcomponents.httpclient-4.5.13.jar
- org.apache.httpcomponents.httpcore-4.4.16.jar
- - org.apache.iceberg.iceberg-api-1.7.1.jar
- - org.apache.iceberg.iceberg-aws-1.7.1.jar
- - org.apache.iceberg.iceberg-bundled-guava-1.7.1.jar
- - org.apache.iceberg.iceberg-common-1.7.1.jar
- - org.apache.iceberg.iceberg-core-1.7.1.jar
- - org.apache.iceberg.iceberg-data-1.7.1.jar
- - org.apache.iceberg.iceberg-parquet-1.7.1.jar
+ - org.apache.iceberg.iceberg-api-1.9.2.jar
+ - org.apache.iceberg.iceberg-aws-1.9.2.jar
+ - org.apache.iceberg.iceberg-bundled-guava-1.9.2.jar
+ - org.apache.iceberg.iceberg-common-1.9.2.jar
+ - org.apache.iceberg.iceberg-core-1.9.2.jar
+ - org.apache.iceberg.iceberg-data-1.9.2.jar
+ - org.apache.iceberg.iceberg-parquet-1.9.2.jar
- org.apache.kerby.kerb-core-2.0.3.jar
- org.apache.kerby.kerb-crypto-2.0.3.jar
- org.apache.kerby.kerb-util-2.0.3.jar
@@ -390,16 +390,16 @@ Scala/Java jars:
- org.apache.logging.log4j.log4j-1.2-api-2.26.1.jar
- org.apache.logging.log4j.log4j-api-2.26.1.jar
- org.apache.logging.log4j.log4j-to-slf4j-2.26.1.jar
- - org.apache.orc.orc-core-1.9.4-nohive.jar
- - org.apache.orc.orc-shims-1.9.4.jar
- - org.apache.parquet.parquet-avro-1.13.1.jar
- - org.apache.parquet.parquet-column-1.13.1.jar
- - org.apache.parquet.parquet-common-1.13.1.jar
- - org.apache.parquet.parquet-encoding-1.13.1.jar
- - org.apache.parquet.parquet-format-structures-1.13.1.jar
- - org.apache.parquet.parquet-hadoop-1.13.1.jar
- - org.apache.parquet.parquet-jackson-1.13.1.jar
- - org.apache.yetus.audience-annotations-0.13.0.jar
+ - org.apache.orc.orc-core-1.9.5-nohive.jar
+ - org.apache.orc.orc-shims-1.9.5.jar
+ - org.apache.parquet.parquet-avro-1.15.2.jar
+ - org.apache.parquet.parquet-column-1.15.2.jar
+ - org.apache.parquet.parquet-common-1.15.2.jar
+ - org.apache.parquet.parquet-encoding-1.15.2.jar
+ - org.apache.parquet.parquet-format-structures-1.15.2.jar
+ - org.apache.parquet.parquet-hadoop-1.15.2.jar
+ - org.apache.parquet.parquet-jackson-1.15.2.jar
+ - org.apache.yetus.audience-annotations-0.12.0.jar
- org.apache.zookeeper.zookeeper-3.8.4.jar
- org.apache.zookeeper.zookeeper-jute-3.8.4.jar
- org.bitbucket.b_c.jose4j-0.9.6.jar
@@ -438,7 +438,7 @@ Scala/Java jars:
- org.scala-lang.scala-reflect-2.13.18.jar
- org.slf4j.jcl-over-slf4j-2.0.12.jar
- org.slf4j.log4j-over-slf4j-2.0.12.jar
- - org.xerial.snappy.snappy-java-1.1.10.4.jar
+ - org.xerial.snappy.snappy-java-1.1.10.7.jar
- org.yaml.snakeyaml-2.2.jar
- software.amazon.awssdk.annotations-2.29.51.jar
- software.amazon.awssdk.apache-client-2.29.51.jar
@@ -521,7 +521,7 @@ Dependencies under the BSD 2-Clause License
--------------------------------------------------------------------------------
Scala/Java jars:
- - com.github.luben.zstd-jni-1.5.0-1.jar
+ - com.github.luben.zstd-jni-1.5.6-6.jar
- dnsjava.dnsjava-3.6.1.jar
- org.codehaus.woodstox.stax2-api-4.2.1.jar
- org.postgresql.postgresql-42.7.10.jar
diff --git a/file-service/NOTICE-binary b/file-service/NOTICE-binary
index aa442d5a82..1b3228fee3 100644
--- a/file-service/NOTICE-binary
+++ b/file-service/NOTICE-binary
@@ -176,7 +176,7 @@ org.apache.iceberg
--------------------------------------------------------------------------------
Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
+Copyright 2017-2025 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
@@ -571,6 +571,83 @@ A list of contributors may be found from CREDITS file,
which is included
in some artifacts (usually source distributions); but is always available
from the source code management (SCM) system project uses.
+--------------------------------------------------------------------------------
+com.fasterxml.jackson.core.jackson-core
+--------------------------------------------------------------------------------
+
+# Jackson JSON processor
+
+Jackson is a high-performance, Free/Open Source JSON processing library.
+It was originally written by Tatu Saloranta ([email protected]), and has
+been in development since 2007.
+It is currently developed by a community of developers.
+
+## Copyright
+
+Copyright 2007-, Tatu Saloranta ([email protected])
+
+## Licensing
+
+Jackson 2.x core and extension components are licensed under Apache License 2.0
+To find the details that apply to this artifact see the accompanying LICENSE
file.
+
+## Credits
+
+A list of contributors may be found from CREDITS(-2.x) file, which is included
+in some artifacts (usually source distributions); but is always available
+from the source code management (SCM) system project uses.
+
+## FastDoubleParser
+
+jackson-core bundles a shaded copy of FastDoubleParser
<https://github.com/wrandelshofer/FastDoubleParser>.
+That code is available under an MIT license
<https://github.com/wrandelshofer/FastDoubleParser/blob/main/LICENSE>
+under the following copyright.
+
+Copyright © 2023 Werner Randelshofer, Switzerland. MIT License.
+
+See FastDoubleParser-NOTICE for details of other source code included in
FastDoubleParser
+and the licenses and copyrights that apply to that code.
+
+# FastDoubleParser
+
+This is a Java port of Daniel Lemire's fast_float project.
+This project provides parsers for double, float, BigDecimal and BigInteger
values.
+
+## Copyright
+
+Copyright © 2024 Werner Randelshofer, Switzerland.
+
+## Licensing
+
+This code is licensed under MIT License.
+https://github.com/wrandelshofer/FastDoubleParser/blob/522be16e145f43308c43b23094e31d5efcaa580e/LICENSE
+(The file 'LICENSE' is included in the sources and classes Jar files that are
released by this project
+- as is required by that license.)
+
+Some portions of the code have been derived from other projects.
+All these projects require that we include a copyright notice, and some
require that we also include some text of their
+license file.
+
+fast_double_parser, Copyright (c) 2022 Daniel Lemire. BSL License.
+https://github.com/lemire/fast_double_parser
+https://github.com/lemire/fast_double_parser/blob/07d9189a8fb815fe800cb15ca022e7a07093236e/LICENSE.BSL
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+fast_float, Copyright (c) 2021 The fast_float authors. MIT License.
+https://github.com/fastfloat/fast_float
+https://github.com/fastfloat/fast_float/blob/cc1e01e9eee74128e48d51488a6b1df4a767a810/LICENSE-MIT
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+bigint, Copyright 2020 Tim Buktu. 2-clause BSD License.
+https://github.com/tbuktu/bigint/tree/floatfft
+https://github.com/tbuktu/bigint/blob/617c8cd8a7c5e4fb4d919c6a4d11e2586107f029/LICENSE
+https://github.com/wrandelshofer/FastDoubleParser/blob/39e123b15b71f29a38a087d16a0bc620fc879aa6/bigint-LICENSE
+(We only use those portions of the bigint project that can be licensed under
2-clause BSD License.)
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
--------------------------------------------------------------------------------
jakarta.el.jakarta.el-api
--------------------------------------------------------------------------------
@@ -749,83 +826,6 @@ Copyright 2014-2022 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
---------------------------------------------------------------------------------
-com.fasterxml.jackson.core.jackson-core
---------------------------------------------------------------------------------
-
-# Jackson JSON processor
-
-Jackson is a high-performance, Free/Open Source JSON processing library.
-It was originally written by Tatu Saloranta ([email protected]), and has
-been in development since 2007.
-It is currently developed by a community of developers.
-
-## Copyright
-
-Copyright 2007-, Tatu Saloranta ([email protected])
-
-## Licensing
-
-Jackson 2.x core and extension components are licensed under Apache License 2.0
-To find the details that apply to this artifact see the accompanying LICENSE
file.
-
-## Credits
-
-A list of contributors may be found from CREDITS(-2.x) file, which is included
-in some artifacts (usually source distributions); but is always available
-from the source code management (SCM) system project uses.
-
-## FastDoubleParser
-
-jackson-core bundles a shaded copy of FastDoubleParser
<https://github.com/wrandelshofer/FastDoubleParser>.
-That code is available under an MIT license
<https://github.com/wrandelshofer/FastDoubleParser/blob/main/LICENSE>
-under the following copyright.
-
-Copyright © 2023 Werner Randelshofer, Switzerland. MIT License.
-
-See FastDoubleParser-NOTICE for details of other source code included in
FastDoubleParser
-and the licenses and copyrights that apply to that code.
-
-# FastDoubleParser
-
-This is a Java port of Daniel Lemire's fast_float project.
-This project provides parsers for double, float, BigDecimal and BigInteger
values.
-
-## Copyright
-
-Copyright © 2024 Werner Randelshofer, Switzerland.
-
-## Licensing
-
-This code is licensed under MIT License.
-https://github.com/wrandelshofer/FastDoubleParser/blob/522be16e145f43308c43b23094e31d5efcaa580e/LICENSE
-(The file 'LICENSE' is included in the sources and classes Jar files that are
released by this project
-- as is required by that license.)
-
-Some portions of the code have been derived from other projects.
-All these projects require that we include a copyright notice, and some
require that we also include some text of their
-license file.
-
-fast_double_parser, Copyright (c) 2022 Daniel Lemire. BSL License.
-https://github.com/lemire/fast_double_parser
-https://github.com/lemire/fast_double_parser/blob/07d9189a8fb815fe800cb15ca022e7a07093236e/LICENSE.BSL
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
-fast_float, Copyright (c) 2021 The fast_float authors. MIT License.
-https://github.com/fastfloat/fast_float
-https://github.com/fastfloat/fast_float/blob/cc1e01e9eee74128e48d51488a6b1df4a767a810/LICENSE-MIT
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
-bigint, Copyright 2020 Tim Buktu. 2-clause BSD License.
-https://github.com/tbuktu/bigint/tree/floatfft
-https://github.com/tbuktu/bigint/blob/617c8cd8a7c5e4fb4d919c6a4d11e2586107f029/LICENSE
-https://github.com/wrandelshofer/FastDoubleParser/blob/39e123b15b71f29a38a087d16a0bc620fc879aa6/bigint-LICENSE
-(We only use those portions of the bigint project that can be licensed under
2-clause BSD License.)
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
--------------------------------------------------------------------------------
org.apache.curator.curator-recipes
--------------------------------------------------------------------------------
@@ -1179,27 +1179,6 @@ Copyright 2001-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (https://www.apache.org/).
---------------------------------------------------------------------------------
-org.apache.parquet.parquet-avro
---------------------------------------------------------------------------------
-
-Apache Parquet MR (Incubating)
-Copyright 2014-2015 The Apache Software Foundation
-
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-
-This product includes code from Apache Avro, which includes the following in
-its NOTICE file:
-
- Apache Avro
- Copyright 2010-2015 The Apache Software Foundation
-
- This product includes software developed at
- The Apache Software Foundation (http://www.apache.org/).
-
--------------------------------------------------------------------------------
org.glassfish.jersey.ext.jersey-bean-validation
--------------------------------------------------------------------------------
@@ -1656,6 +1635,16 @@ Copyright 2006-2020 Google, Inc.
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
+--------------------------------------------------------------------------------
+com.google.guava.guava
+--------------------------------------------------------------------------------
+
+Apache Iceberg
+Copyright 2017-2025 The Apache Software Foundation
+
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
+
--------------------------------------------------------------------------------
org.apache.arrow.arrow-format
--------------------------------------------------------------------------------
@@ -1886,37 +1875,36 @@ This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
--------------------------------------------------------------------------------
-org.apache.parquet.parquet-jackson
+org.apache.kerby.kerby-util
--------------------------------------------------------------------------------
-# Jackson JSON processor
-
-Jackson is a high-performance, Free/Open Source JSON processing library.
-It was originally written by Tatu Saloranta ([email protected]), and has
-been in development since 2007.
-It is currently developed by a community of developers.
-
-## Licensing
-
-Jackson 2.x core and extension components are licensed under Apache License 2.0
-To find the details that apply to this artifact see the accompanying LICENSE
file.
-
-## Credits
+Kerby Util
+Copyright 2014-2022 The Apache Software Foundation
-A list of contributors may be found from CREDITS(-2.x) file, which is included
-in some artifacts (usually source distributions); but is always available
-from the source code management (SCM) system project uses.
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
--------------------------------------------------------------------------------
-org.apache.kerby.kerby-util
+org.apache.parquet.parquet-avro
--------------------------------------------------------------------------------
-Kerby Util
-Copyright 2014-2022 The Apache Software Foundation
+Apache Parquet Avro
+Copyright 2014-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
+--------------------------------------------------------------------------------
+
+This product includes code from Apache Avro, which includes the following in
+its NOTICE file:
+
+ Apache Avro
+ Copyright 2010-2015 The Apache Software Foundation
+
+ This product includes software developed at
+ The Apache Software Foundation (http://www.apache.org/).
+
--------------------------------------------------------------------------------
commons-io.commons-io
--------------------------------------------------------------------------------
@@ -2290,16 +2278,6 @@ Apache Log4j 1.x Compatibility API
Copyright 1999-2026 The Apache Software Foundation
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-com.google.guava.guava
---------------------------------------------------------------------------------
-
-Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
-
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
diff --git a/workflow-compiling-service/LICENSE-binary
b/workflow-compiling-service/LICENSE-binary
index 9662365491..23f31515f5 100644
--- a/workflow-compiling-service/LICENSE-binary
+++ b/workflow-compiling-service/LICENSE-binary
@@ -277,7 +277,7 @@ Scala/Java jars:
- commons-net.commons-net-3.9.0.jar
- commons-pool.commons-pool-1.6.jar
- dev.failsafe.failsafe-3.3.2.jar
- - io.airlift.aircompressor-0.27.jar
+ - io.airlift.aircompressor-2.0.2.jar
- io.dropwizard.dropwizard-auth-4.0.7.jar
- io.dropwizard.dropwizard-configuration-4.0.7.jar
- io.dropwizard.dropwizard-core-4.0.7.jar
@@ -370,21 +370,21 @@ Scala/Java jars:
- org.apache.hadoop.hadoop-yarn-common-3.4.3.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-guava-1.5.0.jar
- org.apache.hadoop.thirdparty.hadoop-shaded-protobuf_3_25-1.5.0.jar
- - org.apache.httpcomponents.client5.httpclient5-5.4.jar
- - org.apache.httpcomponents.core5.httpcore5-5.3.jar
- - org.apache.httpcomponents.core5.httpcore5-h2-5.3.jar
+ - org.apache.httpcomponents.client5.httpclient5-5.4.3.jar
+ - org.apache.httpcomponents.core5.httpcore5-5.3.4.jar
+ - org.apache.httpcomponents.core5.httpcore5-h2-5.3.4.jar
- org.apache.httpcomponents.httpasyncclient-4.1.5.jar
- org.apache.httpcomponents.httpclient-4.5.13.jar
- org.apache.httpcomponents.httpcore-4.4.16.jar
- org.apache.httpcomponents.httpcore-nio-4.4.13.jar
- org.apache.httpcomponents.httpmime-4.5.13.jar
- - org.apache.iceberg.iceberg-api-1.7.1.jar
- - org.apache.iceberg.iceberg-aws-1.7.1.jar
- - org.apache.iceberg.iceberg-bundled-guava-1.7.1.jar
- - org.apache.iceberg.iceberg-common-1.7.1.jar
- - org.apache.iceberg.iceberg-core-1.7.1.jar
- - org.apache.iceberg.iceberg-data-1.7.1.jar
- - org.apache.iceberg.iceberg-parquet-1.7.1.jar
+ - org.apache.iceberg.iceberg-api-1.9.2.jar
+ - org.apache.iceberg.iceberg-aws-1.9.2.jar
+ - org.apache.iceberg.iceberg-bundled-guava-1.9.2.jar
+ - org.apache.iceberg.iceberg-common-1.9.2.jar
+ - org.apache.iceberg.iceberg-core-1.9.2.jar
+ - org.apache.iceberg.iceberg-data-1.9.2.jar
+ - org.apache.iceberg.iceberg-parquet-1.9.2.jar
- org.apache.kerby.kerb-core-2.0.3.jar
- org.apache.kerby.kerb-crypto-2.0.3.jar
- org.apache.kerby.kerb-util-2.0.3.jar
@@ -401,16 +401,16 @@ Scala/Java jars:
- org.apache.lucene.lucene-queries-8.7.0.jar
- org.apache.lucene.lucene-queryparser-8.7.0.jar
- org.apache.lucene.lucene-sandbox-8.7.0.jar
- - org.apache.orc.orc-core-1.9.4-nohive.jar
- - org.apache.orc.orc-shims-1.9.4.jar
- - org.apache.parquet.parquet-avro-1.13.1.jar
- - org.apache.parquet.parquet-column-1.13.1.jar
- - org.apache.parquet.parquet-common-1.13.1.jar
- - org.apache.parquet.parquet-encoding-1.13.1.jar
- - org.apache.parquet.parquet-format-structures-1.13.1.jar
- - org.apache.parquet.parquet-hadoop-1.13.1.jar
- - org.apache.parquet.parquet-jackson-1.13.1.jar
- - org.apache.yetus.audience-annotations-0.13.0.jar
+ - org.apache.orc.orc-core-1.9.5-nohive.jar
+ - org.apache.orc.orc-shims-1.9.5.jar
+ - org.apache.parquet.parquet-avro-1.15.2.jar
+ - org.apache.parquet.parquet-column-1.15.2.jar
+ - org.apache.parquet.parquet-common-1.15.2.jar
+ - org.apache.parquet.parquet-encoding-1.15.2.jar
+ - org.apache.parquet.parquet-format-structures-1.15.2.jar
+ - org.apache.parquet.parquet-hadoop-1.15.2.jar
+ - org.apache.parquet.parquet-jackson-1.15.2.jar
+ - org.apache.yetus.audience-annotations-0.12.0.jar
- org.apache.zookeeper.zookeeper-3.8.4.jar
- org.apache.zookeeper.zookeeper-jute-3.8.4.jar
- org.bitbucket.b_c.jose4j-0.9.6.jar
@@ -447,7 +447,7 @@ Scala/Java jars:
- org.scala-lang.scala-reflect-2.13.18.jar
- org.slf4j.jcl-over-slf4j-2.0.12.jar
- org.slf4j.log4j-over-slf4j-2.0.12.jar
- - org.xerial.snappy.snappy-java-1.1.10.4.jar
+ - org.xerial.snappy.snappy-java-1.1.10.7.jar
- org.yaml.snakeyaml-2.2.jar
- software.amazon.awssdk.annotations-2.29.51.jar
- software.amazon.awssdk.apache-client-2.29.51.jar
@@ -532,7 +532,7 @@ Dependencies under the BSD 2-Clause License
--------------------------------------------------------------------------------
Scala/Java jars:
- - com.github.luben.zstd-jni-1.5.0-1.jar
+ - com.github.luben.zstd-jni-1.5.6-6.jar
- dnsjava.dnsjava-3.6.1.jar
- org.codehaus.woodstox.stax2-api-4.2.1.jar
- org.postgresql.postgresql-42.7.10.jar
diff --git a/workflow-compiling-service/NOTICE-binary
b/workflow-compiling-service/NOTICE-binary
index 6923d1a19b..ecd3eb304a 100644
--- a/workflow-compiling-service/NOTICE-binary
+++ b/workflow-compiling-service/NOTICE-binary
@@ -176,7 +176,7 @@ org.apache.iceberg
--------------------------------------------------------------------------------
Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
+Copyright 2017-2025 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
@@ -785,6 +785,83 @@ A list of contributors may be found from CREDITS file,
which is included
in some artifacts (usually source distributions); but is always available
from the source code management (SCM) system project uses.
+--------------------------------------------------------------------------------
+com.fasterxml.jackson.core.jackson-core
+--------------------------------------------------------------------------------
+
+# Jackson JSON processor
+
+Jackson is a high-performance, Free/Open Source JSON processing library.
+It was originally written by Tatu Saloranta ([email protected]), and has
+been in development since 2007.
+It is currently developed by a community of developers.
+
+## Copyright
+
+Copyright 2007-, Tatu Saloranta ([email protected])
+
+## Licensing
+
+Jackson 2.x core and extension components are licensed under Apache License 2.0
+To find the details that apply to this artifact see the accompanying LICENSE
file.
+
+## Credits
+
+A list of contributors may be found from CREDITS(-2.x) file, which is included
+in some artifacts (usually source distributions); but is always available
+from the source code management (SCM) system project uses.
+
+## FastDoubleParser
+
+jackson-core bundles a shaded copy of FastDoubleParser
<https://github.com/wrandelshofer/FastDoubleParser>.
+That code is available under an MIT license
<https://github.com/wrandelshofer/FastDoubleParser/blob/main/LICENSE>
+under the following copyright.
+
+Copyright © 2023 Werner Randelshofer, Switzerland. MIT License.
+
+See FastDoubleParser-NOTICE for details of other source code included in
FastDoubleParser
+and the licenses and copyrights that apply to that code.
+
+# FastDoubleParser
+
+This is a Java port of Daniel Lemire's fast_float project.
+This project provides parsers for double, float, BigDecimal and BigInteger
values.
+
+## Copyright
+
+Copyright © 2024 Werner Randelshofer, Switzerland.
+
+## Licensing
+
+This code is licensed under MIT License.
+https://github.com/wrandelshofer/FastDoubleParser/blob/522be16e145f43308c43b23094e31d5efcaa580e/LICENSE
+(The file 'LICENSE' is included in the sources and classes Jar files that are
released by this project
+- as is required by that license.)
+
+Some portions of the code have been derived from other projects.
+All these projects require that we include a copyright notice, and some
require that we also include some text of their
+license file.
+
+fast_double_parser, Copyright (c) 2022 Daniel Lemire. BSL License.
+https://github.com/lemire/fast_double_parser
+https://github.com/lemire/fast_double_parser/blob/07d9189a8fb815fe800cb15ca022e7a07093236e/LICENSE.BSL
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+fast_float, Copyright (c) 2021 The fast_float authors. MIT License.
+https://github.com/fastfloat/fast_float
+https://github.com/fastfloat/fast_float/blob/cc1e01e9eee74128e48d51488a6b1df4a767a810/LICENSE-MIT
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
+bigint, Copyright 2020 Tim Buktu. 2-clause BSD License.
+https://github.com/tbuktu/bigint/tree/floatfft
+https://github.com/tbuktu/bigint/blob/617c8cd8a7c5e4fb4d919c6a4d11e2586107f029/LICENSE
+https://github.com/wrandelshofer/FastDoubleParser/blob/39e123b15b71f29a38a087d16a0bc620fc879aa6/bigint-LICENSE
+(We only use those portions of the bigint project that can be licensed under
2-clause BSD License.)
+(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
+- as is required by that license.)
+
--------------------------------------------------------------------------------
org.apache.lucene
--------------------------------------------------------------------------------
@@ -1177,83 +1254,6 @@ Copyright 2014-2022 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
---------------------------------------------------------------------------------
-com.fasterxml.jackson.core.jackson-core
---------------------------------------------------------------------------------
-
-# Jackson JSON processor
-
-Jackson is a high-performance, Free/Open Source JSON processing library.
-It was originally written by Tatu Saloranta ([email protected]), and has
-been in development since 2007.
-It is currently developed by a community of developers.
-
-## Copyright
-
-Copyright 2007-, Tatu Saloranta ([email protected])
-
-## Licensing
-
-Jackson 2.x core and extension components are licensed under Apache License 2.0
-To find the details that apply to this artifact see the accompanying LICENSE
file.
-
-## Credits
-
-A list of contributors may be found from CREDITS(-2.x) file, which is included
-in some artifacts (usually source distributions); but is always available
-from the source code management (SCM) system project uses.
-
-## FastDoubleParser
-
-jackson-core bundles a shaded copy of FastDoubleParser
<https://github.com/wrandelshofer/FastDoubleParser>.
-That code is available under an MIT license
<https://github.com/wrandelshofer/FastDoubleParser/blob/main/LICENSE>
-under the following copyright.
-
-Copyright © 2023 Werner Randelshofer, Switzerland. MIT License.
-
-See FastDoubleParser-NOTICE for details of other source code included in
FastDoubleParser
-and the licenses and copyrights that apply to that code.
-
-# FastDoubleParser
-
-This is a Java port of Daniel Lemire's fast_float project.
-This project provides parsers for double, float, BigDecimal and BigInteger
values.
-
-## Copyright
-
-Copyright © 2024 Werner Randelshofer, Switzerland.
-
-## Licensing
-
-This code is licensed under MIT License.
-https://github.com/wrandelshofer/FastDoubleParser/blob/522be16e145f43308c43b23094e31d5efcaa580e/LICENSE
-(The file 'LICENSE' is included in the sources and classes Jar files that are
released by this project
-- as is required by that license.)
-
-Some portions of the code have been derived from other projects.
-All these projects require that we include a copyright notice, and some
require that we also include some text of their
-license file.
-
-fast_double_parser, Copyright (c) 2022 Daniel Lemire. BSL License.
-https://github.com/lemire/fast_double_parser
-https://github.com/lemire/fast_double_parser/blob/07d9189a8fb815fe800cb15ca022e7a07093236e/LICENSE.BSL
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
-fast_float, Copyright (c) 2021 The fast_float authors. MIT License.
-https://github.com/fastfloat/fast_float
-https://github.com/fastfloat/fast_float/blob/cc1e01e9eee74128e48d51488a6b1df4a767a810/LICENSE-MIT
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
-bigint, Copyright 2020 Tim Buktu. 2-clause BSD License.
-https://github.com/tbuktu/bigint/tree/floatfft
-https://github.com/tbuktu/bigint/blob/617c8cd8a7c5e4fb4d919c6a4d11e2586107f029/LICENSE
-https://github.com/wrandelshofer/FastDoubleParser/blob/39e123b15b71f29a38a087d16a0bc620fc879aa6/bigint-LICENSE
-(We only use those portions of the bigint project that can be licensed under
2-clause BSD License.)
-(The file 'thirdparty-LICENSE' is included in the sources and classes Jar
files that are released by this project
-- as is required by that license.)
-
--------------------------------------------------------------------------------
org.apache.curator.curator-recipes
--------------------------------------------------------------------------------
@@ -1617,27 +1617,6 @@ Copyright 2001-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (https://www.apache.org/).
---------------------------------------------------------------------------------
-org.apache.parquet.parquet-avro
---------------------------------------------------------------------------------
-
-Apache Parquet MR (Incubating)
-Copyright 2014-2015 The Apache Software Foundation
-
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-
-This product includes code from Apache Avro, which includes the following in
-its NOTICE file:
-
- Apache Avro
- Copyright 2010-2015 The Apache Software Foundation
-
- This product includes software developed at
- The Apache Software Foundation (http://www.apache.org/).
-
--------------------------------------------------------------------------------
org.glassfish.jersey.ext.jersey-bean-validation
--------------------------------------------------------------------------------
@@ -2094,6 +2073,16 @@ Copyright 2006-2020 Google, Inc.
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
+--------------------------------------------------------------------------------
+com.google.guava.guava
+--------------------------------------------------------------------------------
+
+Apache Iceberg
+Copyright 2017-2025 The Apache Software Foundation
+
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
+
--------------------------------------------------------------------------------
org.apache.arrow.arrow-format
--------------------------------------------------------------------------------
@@ -2324,37 +2313,36 @@ This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
--------------------------------------------------------------------------------
-org.apache.parquet.parquet-jackson
+org.apache.kerby.kerby-util
--------------------------------------------------------------------------------
-# Jackson JSON processor
-
-Jackson is a high-performance, Free/Open Source JSON processing library.
-It was originally written by Tatu Saloranta ([email protected]), and has
-been in development since 2007.
-It is currently developed by a community of developers.
-
-## Licensing
-
-Jackson 2.x core and extension components are licensed under Apache License 2.0
-To find the details that apply to this artifact see the accompanying LICENSE
file.
-
-## Credits
+Kerby Util
+Copyright 2014-2022 The Apache Software Foundation
-A list of contributors may be found from CREDITS(-2.x) file, which is included
-in some artifacts (usually source distributions); but is always available
-from the source code management (SCM) system project uses.
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
--------------------------------------------------------------------------------
-org.apache.kerby.kerby-util
+org.apache.parquet.parquet-avro
--------------------------------------------------------------------------------
-Kerby Util
-Copyright 2014-2022 The Apache Software Foundation
+Apache Parquet Avro
+Copyright 2014-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
+--------------------------------------------------------------------------------
+
+This product includes code from Apache Avro, which includes the following in
+its NOTICE file:
+
+ Apache Avro
+ Copyright 2010-2015 The Apache Software Foundation
+
+ This product includes software developed at
+ The Apache Software Foundation (http://www.apache.org/).
+
--------------------------------------------------------------------------------
commons-io.commons-io
--------------------------------------------------------------------------------
@@ -2738,16 +2726,6 @@ Apache Log4j 1.x Compatibility API
Copyright 1999-2026 The Apache Software Foundation
-This product includes software developed at
-The Apache Software Foundation (http://www.apache.org/).
-
---------------------------------------------------------------------------------
-com.google.guava.guava
---------------------------------------------------------------------------------
-
-Apache Iceberg
-Copyright 2017-2024 The Apache Software Foundation
-
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
