This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch bot/trino-pin
in repository https://gitbox.apache.org/repos/asf/hudi.git
discard eb16fc8f49d4 chore(trino): advance trino master pin to 18bb24a482c6
add 64904e894191 fix(flink): repair test compilation after metadata field
mode migration (#19873)
add 6ac27904f71b test(clustering): re-enable testClusteringPlanInflight
and fix its timeline transition (#19865)
add bb6f52c185d3 feat(timeline-ui): [HUDI-9315] Add Hudi Timeline UI
(#13147)
add 7b4ad9d6c962 fix(common): scan jar entries in
ReflectionUtils#getTopLevelClassesInClasspath (#19624)
add eccfee6dfe7d docs(rfc): RFC-109 native vector search support in Apache
Hudi (#19309)
add 4c6e75b2d2be Fix truncated return type in RFC-101 sample and typos
across docs (#19885)
add 58c9e64e58a0 chore(spark): bump Spark 3.5 to 3.5.9 and fast-path the
CI download (#19884)
add e6b8ef6c92f8 fix(core): use incoming record keys in native log writers
(#19874)
add 91f32af2403e test(aws): cover the Glue sync client, DynamoTableUtils
and HoodieAWSConfig (#19876)
add 96858170d02c docs(flink): document Lance runtime dependencies (#19866)
add 4be4864082d7 chore(docker): move demo/IT images to Spark 3.5.9 (#19888)
add 634110752b2f test(cli): cover timeline, export, metadata commands and
the SparkMain helpers (#19877)
add 8af07e1e1534 fix(utilities): validator Config.equals and
drop-partitions hive sync, with tests for the standalone tools (#19875)
add 648996f002c3 feat(agent): add Hudi Architect design-time skill (#19380)
add 44b7ed322575 chore(ci): align Codecov range with 80% target (#19896)
add 11527aecb083 fix(flink): bootstrap operator for bounded source (#19844)
add a46909b09bbb fix: close InflaterInputStream in
HoodieAvroDataBlock.decompress() to prevent native memory leak (#19861)
new 80b4d62a0b87 chore(trino): advance trino master pin to b2581fb32fcb
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (eb16fc8f49d4)
\
N -- N -- N refs/heads/bot/trino-pin (80b4d62a0b87)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.codecov.yml | 4 +-
.github/workflows/bot.yml | 45 +-
LICENSE | 78 ++
docker/README.md | 10 +-
docker/build_docker_images.sh | 2 +-
...-compose_hadoop284_hive2310_spark359_amd64.yml} | 14 +-
...-compose_hadoop284_hive2310_spark359_arm64.yml} | 14 +-
...r-compose_hadoop334_hive313_spark359_amd64.yml} | 14 +-
...r-compose_hadoop334_hive313_spark359_arm64.yml} | 14 +-
docker/hoodie/hadoop/pom.xml | 2 +-
docker/hoodie/hadoop/spark_base/Dockerfile | 2 +-
docker/hoodie/hadoop/sparkadhoc/Dockerfile | 2 +-
docker/hoodie/hadoop/sparkmaster/Dockerfile | 2 +-
docker/hoodie/hadoop/sparkworker/Dockerfile | 2 +-
docker/setup_demo.sh | 4 +-
docker/stop_demo.sh | 4 +-
hudi-agent-gateway/skills/hudi-architect/README.md | 111 ++
.../skills/hudi-architect/RUNBOOK.md | 154 +++
hudi-agent-gateway/skills/hudi-architect/SKILL.md | 193 +++
.../hudi-architect/references/adr-template.md | 311 +++++
.../hudi-architect/references/config-templates.md | 1018 ++++++++++++++++
.../hudi-architect/references/decision-tables.md | 874 +++++++++++++
.../hudi-architect/references/question-flow.md | 813 +++++++++++++
.../skills/hudi-architect/references/warnings.md | 298 +++++
.../skills/hudi-architect/validate_config_keys.py | 225 ++++
.../validate_config_keys_allowlist.txt | 38 +
.../hudi/aws/sync/TestAWSGlueSyncClient.java | 717 +++++++++++
.../apache/hudi/aws/testutils/GlueTestUtil.java | 59 +-
.../transaction/lock/TestS3StorageLockClient.java | 29 +
.../hudi/aws/utils/TestDynamoTableUtils.java | 184 +++
.../apache/hudi/config/TestHoodieAWSConfig.java | 114 ++
.../org/apache/hudi/cli/commands/SparkMain.java | 46 +-
.../hudi/cli/commands/TestClusteringCommand.java | 106 ++
.../hudi/cli/commands/TestCompactionCommand.java | 232 ++++
.../hudi/cli/commands/TestExportCommand.java | 169 +++
.../hudi/cli/commands/TestMetadataCommand.java | 229 ++++
.../hudi/cli/commands/TestRollbacksCommand.java | 39 +-
.../hudi/cli/commands/TestSavepointsCommand.java | 62 +
.../hudi/cli/commands/TestTimelineCommand.java | 316 +++++
.../cli/functional/CLIFunctionalTestHarness.java | 99 ++
.../hudi/io/HoodieNativeLogAppendHandle.java | 10 +-
.../hudi/io/cdc/HoodieNativeLogFormatWriter.java | 9 +-
.../hudi/io/TestHoodieNativeLogAppendHandle.java | 17 +-
.../io/cdc/TestHoodieNativeLogFormatWriter.java | 66 +-
.../hudi/io/TestFlinkNativeLogAppendHandle.java | 4 +-
.../table/log/block/HoodieAvroDataBlock.java | 3 +-
.../hudi/common/util/TestReflectionUtils.java | 236 +++-
.../java/org/apache/hudi/sink/utils/Pipelines.java | 45 +-
.../org/apache/hudi/sink/utils/TestPipelines.java | 114 ++
.../table/format/TestHoodieRowDataLanceReader.java | 5 +-
.../format/cow/TestCopyOnWriteInputFormat.java | 3 +-
.../hudi/common/util/TestClusteringUtils.java | 45 +-
hudi-integ-test/README.md | 2 +-
hudi-integ-test/pom.xml | 4 +-
.../testsuite/HoodieContinuousTestSuiteWriter.java | 2 +-
.../testsuite/HoodieMultiWriterTestSuiteJob.java | 2 +-
.../SparkDataSourceContinuousIngestTool.java | 2 +-
hudi-io/hfile_format.md | 2 +-
.../apache/hudi/common/util/ReflectionUtils.java | 92 +-
hudi-kafka-connect/README.md | 2 +-
.../hudi/timeline/service/RequestHandler.java | 81 +-
.../hudi/timeline/service/TimelineService.java | 29 +
.../timeline/service/handlers/TimelineHandler.java | 280 +++++
.../apache/hudi/timeline/service/ui/UiHandler.java | 57 +
.../hudi/timeline/service/ui/UiInstantDTO.java | 40 +-
.../hudi/timeline/service/ui/UiTimelineDTO.java | 37 +-
.../src/main/resources/public/css/style.css | 234 ++++
.../src/main/resources/public/index.html | 334 +++++
.../src/main/resources/public/js/timeline.js | 1286 ++++++++++++++++++++
.../public/lib/bootstrap/bootstrap.bundle.min.js | 7 +
.../public/lib/bootstrap/bootstrap.min.css | 6 +
.../resources/public/lib/renderjson/renderjson.js | 216 ++++
.../lib/vis-timeline/vis-timeline-graph2d.min.css | 2 +
.../lib/vis-timeline/vis-timeline-graph2d.min.js | 48 +
.../apache/hudi/timeline/service/TestUiApi.java | 790 ++++++++++++
.../hudi/utilities/HoodieDataTableValidator.java | 6 +-
.../hudi/utilities/HoodieDropPartitionsTool.java | 25 +-
.../utilities/HoodieMetadataTableValidator.java | 4 +-
.../org/apache/hudi/utilities/TableSizeStats.java | 4 +-
.../utilities/TestHoodieDataTableValidator.java | 229 ++++
.../utilities/TestHoodieDropPartitionsTool.java | 358 ++++++
.../TestHoodieMetadataTableValidator.java | 18 +
.../apache/hudi/utilities/TestHoodieTTLJob.java | 130 ++
.../apache/hudi/utilities/TestTableSizeStats.java | 311 +++++
.../utilities/testutils/CapturingLogAppender.java | 85 ++
.../hudi/utilities/testutils/ToolTestUtils.java | 59 +
packaging/hudi-flink-bundle/README.md | 40 +
packaging/hudi-flink-bundle/pom.xml | 21 +
packaging/hudi-integ-test-bundle/pom.xml | 7 +
packaging/hudi-kafka-connect-bundle/pom.xml | 7 +
packaging/hudi-spark-bundle/pom.xml | 7 +
packaging/hudi-timeline-server-bundle/pom.xml | 6 +
packaging/hudi-utilities-bundle/pom.xml | 7 +
pom.xml | 6 +-
release/release_guide.md | 2 +-
rfc/README.md | 6 +-
rfc/rfc-101/rfc-101.md | 2 +-
rfc/rfc-107/rfc-107.md | 2 +-
rfc/rfc-109/diagrams/01-architecture-overview.svg | 80 ++
rfc/rfc-109/diagrams/02-read-path.svg | 74 ++
rfc/rfc-109/diagrams/03-write-maintenance.svg | 74 ++
rfc/rfc-109/rfc-109.md | 1082 ++++++++++++++++
rfc/rfc-27/rfc-27.md | 2 +-
rfc/rfc-38/rfc-38.md | 2 +-
rfc/rfc-39/rfc-39.md | 6 +-
rfc/rfc-40/rfc-40.md | 4 +-
rfc/rfc-42/rfc-42.md | 4 +-
rfc/rfc-45/rfc-45.md | 4 +-
rfc/rfc-51/rfc-51.md | 2 +-
rfc/rfc-56/rfc-56.md | 2 +-
rfc/rfc-65/rfc-65.md | 2 +-
rfc/rfc-68/rfc-68.md | 2 +-
rfc/rfc-76/rfc-76.md | 2 +-
rfc/rfc-78/rfc-78.md | 2 +-
rfc/rfc-80/rfc-80.md | 4 +-
rfc/rfc-93/rfc-93.md | 2 +-
rfc/rfc-99/vector-appendix.md | 10 +-
scripts/release/validate_bundle_ui_assets.sh | 161 +++
scripts/release/validate_source_copyright.sh | 6 +-
119 files changed, 13356 insertions(+), 274 deletions(-)
rename docker/compose/{docker-compose_hadoop284_hive2310_spark353_amd64.yml =>
docker-compose_hadoop284_hive2310_spark359_amd64.yml} (96%)
rename docker/compose/{docker-compose_hadoop284_hive2310_spark353_arm64.yml =>
docker-compose_hadoop284_hive2310_spark359_arm64.yml} (96%)
rename docker/compose/{docker-compose_hadoop334_hive313_spark353_amd64.yml =>
docker-compose_hadoop334_hive313_spark359_amd64.yml} (97%)
rename docker/compose/{docker-compose_hadoop334_hive313_spark353_arm64.yml =>
docker-compose_hadoop334_hive313_spark359_arm64.yml} (96%)
create mode 100644 hudi-agent-gateway/skills/hudi-architect/README.md
create mode 100644 hudi-agent-gateway/skills/hudi-architect/RUNBOOK.md
create mode 100644 hudi-agent-gateway/skills/hudi-architect/SKILL.md
create mode 100644
hudi-agent-gateway/skills/hudi-architect/references/adr-template.md
create mode 100644
hudi-agent-gateway/skills/hudi-architect/references/config-templates.md
create mode 100644
hudi-agent-gateway/skills/hudi-architect/references/decision-tables.md
create mode 100644
hudi-agent-gateway/skills/hudi-architect/references/question-flow.md
create mode 100644
hudi-agent-gateway/skills/hudi-architect/references/warnings.md
create mode 100644
hudi-agent-gateway/skills/hudi-architect/validate_config_keys.py
create mode 100644
hudi-agent-gateway/skills/hudi-architect/validate_config_keys_allowlist.txt
create mode 100644
hudi-aws/src/test/java/org/apache/hudi/aws/utils/TestDynamoTableUtils.java
create mode 100644
hudi-aws/src/test/java/org/apache/hudi/config/TestHoodieAWSConfig.java
create mode 100644
hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestClusteringCommand.java
create mode 100644
hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestExportCommand.java
create mode 100644
hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestTimelineCommand.java
create mode 100644
hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/ui/UiHandler.java
copy
hudi-common/src/main/java/org/apache/hudi/common/table/timeline/dto/InstantDTO.java
=>
hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/ui/UiInstantDTO.java
(63%)
copy
hudi-common/src/main/java/org/apache/hudi/common/table/timeline/dto/FilePathDTO.java
=>
hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/ui/UiTimelineDTO.java
(58%)
create mode 100644
hudi-timeline-service/src/main/resources/public/css/style.css
create mode 100644 hudi-timeline-service/src/main/resources/public/index.html
create mode 100644
hudi-timeline-service/src/main/resources/public/js/timeline.js
create mode 100644
hudi-timeline-service/src/main/resources/public/lib/bootstrap/bootstrap.bundle.min.js
create mode 100644
hudi-timeline-service/src/main/resources/public/lib/bootstrap/bootstrap.min.css
create mode 100644
hudi-timeline-service/src/main/resources/public/lib/renderjson/renderjson.js
create mode 100644
hudi-timeline-service/src/main/resources/public/lib/vis-timeline/vis-timeline-graph2d.min.css
create mode 100644
hudi-timeline-service/src/main/resources/public/lib/vis-timeline/vis-timeline-graph2d.min.js
create mode 100644
hudi-timeline-service/src/test/java/org/apache/hudi/timeline/service/TestUiApi.java
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHoodieDataTableValidator.java
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHoodieDropPartitionsTool.java
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHoodieTTLJob.java
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestTableSizeStats.java
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/testutils/CapturingLogAppender.java
create mode 100644
hudi-utilities/src/test/java/org/apache/hudi/utilities/testutils/ToolTestUtils.java
create mode 100644 packaging/hudi-flink-bundle/README.md
create mode 100644 rfc/rfc-109/diagrams/01-architecture-overview.svg
create mode 100644 rfc/rfc-109/diagrams/02-read-path.svg
create mode 100644 rfc/rfc-109/diagrams/03-write-maintenance.svg
create mode 100644 rfc/rfc-109/rfc-109.md
create mode 100755 scripts/release/validate_bundle_ui_assets.sh
