This is an automated email from the ASF dual-hosted git repository.
vhs pushed a change to branch release-1.0.2
in repository https://gitbox.apache.org/repos/asf/hudi.git
discard 6ab7eecfe0d Bumping release candidate number 1
discard dd986f77975 [HUDI-8601] By default disable native hfile reader (#13150)
discard 0dbc4a32945 [HUDI-9203] Fix usability w/ upgrading from 0.x to 1.x and
wish to stay in table version 6 (#13145)
discard 042cd0c524b [HUDI-9312] Fix the default enable/disable inference for
indices for column_stats, RLI, partition_stats and bloom_filter (#13140)
discard 21b16c7e9ad [HUDI-9159] S3 implementation of StorageLock for
StorageBasedLockProvider (#13126)
discard eab92234bc9 [HUDI-9311] Revert HUDI-7146 which causes perf overhead
for merging MDT log files (#13136)
discard e85ef150365 [HUDI-9309] Fix perf regression from supporting display
dag of insert/update statment in spark ui (#13139)
discard 1957a4ee5b5 [HUDI-9308] Fix incorrect usage of
mapreduce.input.fileinputformat.split.maxsize in HoodieCombineHiveInputFormat
(#13134)
discard 703be8df644 [HUDI-5092] Support Databricks Spark runtime (#13129)
discard 4b35786911e [HUDI-9158] Add storage-based lock provider abstract
implementation (#13103)
discard 4e384fa66e0 [HUDI-9267] Fix the file group reader log file read
sequence (#13115)
discard 5a0232993cd [HUDI-9286] Fix the atomicity of archived timeline write
(#13128)
discard 5b0101fd755 [HUDI-9262] Skip building stats for decimal field with
very high precision (#13097)
discard 6baa5b74d1a [HUDI-9270] Support displaying complete dag for update
statement in spark web ui (#13110)
discard e113a54ad64 [MINOR] Overload HoodieFileGroupReader constructor to
bring back old API without allowInflightInstants parameter (#13116)
discard ff7e47448a2 [HUDI-9288] Fixing HoodieFileGroup api related to
uncommitted slices (#13125)
discard 264caf56bef [HUDI-9269] Handle tight bound field in columns stats
metadata (#13117)
discard e89adcde499 [HUDI-9263] Archived timeline downgrade fails with
EightToSevenDowngradeHandler (#13098)
discard 3c9f46b7c68 [MINOR] Force UT hudi-hadoop-common & Hudi Utilities
others Azure CI to use ubuntu 24 (#13124)
discard 05cdae005f2 [HUDI-9258] Disable partial update for CUSTOM merge mode
(#13092)
discard 4a431a0cc2f [HUDI-9156] Add lock provider heartbeat manager (#12958)
discard f7778afe759 [HUDI-9155] Add scaffolding for lock provider using
conditional writes (#12954)
discard 36df87759aa [MINOR] Fix logging issue with
EightToSevenDowngradeHandler (#13096)
discard e238fa50f6d [MINOR] Update javadocs in MergeIntoHoodieTableCommand
(#13093)
discard e18e8b7d7d9 [MINOR] Upgrade jetty version to 9.4.57.v20241219 to fix
CVE-2024-8184 (#13058)
discard 5378b3e92de [HUDI-9247] Flip default value of reuse of TimeGenerator
instance (#13077)
discard 4c1c30f60e0 [HUDI-9258] Disable partial update when global index is
used (#13086)
discard e9789cb5e43 [HUDI-9259] Fixing marker reconciliation for failures
during deleting additional files (#13088)
discard 5dad9b046a7 [HUDI-9255] Fix inferring correct merge behavior for few
scenarios (#13079)
discard b3fd2144cbc [MINOR] Fix NumberFormatException while updating metrics
for MDT in table version 6 (#13056)
discard 59092d9c2d9 [MINOR] Fixing master for build failure (#13085)
discard 688b9bdd13e [MINOR] Remove warning around table version six (#13080)
discard 76989ad9eb0 [HUDI-9252] BaseHoodieWriteClient should only check for
upgrade (#13073)
discard ca2e29e3e94 [HUDI-9206] Support reading inflight instants with
HoodieLogRecordReader (#13010)
discard 1ec91e5cd94 [MINOR]Fix typo and Add implementation class name in
interface method of HoodieRecordMerger (#13059)
discard 0d36693b8b1 [HUDI-8635] Support numWrites metric for compaction
(#13047)
discard 5c64e3d8eb3 [HUDI-8409] Fixing merge mode config during upgrade and
downgrade from version 7 to 8 and back (#13046)
discard 64799bcecc6 [HUDI-9236] Handle markers for log files in table version
6 (#13007)
discard 6ce55788692 [HUDI-9231] Show complete DAG for one single query in
spark web ui while inserting into hudi table (#13044)
discard 6a4cbc6bfe2 [HUDI-9133] Fallback to legacy schema fetching in case of
IllegalAccessError from schema registry client (#13030)
discard f0860cf009f [HUDI-9239] Fix the bug of Spark Cache not releasing
cleanly (#13050)
discard 01050086a37 [HUDI-9238] Fix bug with HudiIncrSource when source is
table version 6 (#13048)
discard a0f98ffb7d2 [HUDI-9167] Remove redundant classes in
hudi-utilities-slim-bundle (#12962)
discard 4530c1f3e28 [HUDI-9233] Handle empty table edge case for col stats
initialization (#13045)
discard 8795bb726f2 [HUDI-9227] Fix bulk insert overwrite after a failed
insert overwrite (#13041)
discard 4d4a9867a1b [MINOR] Use configutils to handle defaults for all zk lock
provider configs (#13039)
discard 0b3aab2e08a [HUDI-9088] Fix unnecessary scanning of target table in
MERGE INTO on Spark (#12934)
discard 7ddeba57cd2 [MINOR] Follow up HUDI-8803, optimize vectorized reader by
cache 'batchIdxField' (#13023)
discard 857e98ea044 [HUDI-9216] Ignore validation of empty databaseName in
HoodieTableMetaClient (#13033)
discard 1374e7f9e0d [MINOR] Fix flaky test testCreateNewInstantTimes (#13032)
add 7ff0635096a [MINOR] Improve CI to parallelize tests more and reduce
completion time (#13031)
add 4d3880c0e7b [MINOR] Fix flaky test testCreateNewInstantTimes (#13032)
add dcb74764379 [HUDI-9216] Ignore validation of empty databaseName in
HoodieTableMetaClient (#13033)
add 40635515c2e [MINOR] Follow up HUDI-8803, optimize vectorized reader by
cache 'batchIdxField' (#13023)
add 9a9b3495caa [HUDI-9088] Fix unnecessary scanning of target table in
MERGE INTO on Spark (#12934)
add 1c96c6ac4fc [MINOR] Use configutils to handle defaults for all zk lock
provider configs (#13039)
add 607db939bd0 [HUDI-9227] Fix bulk insert overwrite after a failed
insert overwrite (#13041)
add cc27d287715 [HUDI-9233] Handle empty table edge case for col stats
initialization (#13045)
add b0368359f3c [HUDI-9167] Remove redundant classes in
hudi-utilities-slim-bundle (#12962)
add c1807e9bbfa [HUDI-9238] Fix bug with HudiIncrSource when source is
table version 6 (#13048)
add 4c484ac3722 [HUDI-9239] Fix the bug of Spark Cache not releasing
cleanly (#13050)
add 769d3c57297 [HUDI-9133] Fallback to legacy schema fetching in case of
IllegalAccessError from schema registry client (#13030)
add 9cb7df1ddee [HUDI-9231] Show complete DAG for one single query in
spark web ui while inserting into hudi table (#13044)
add 14e40699275 [HUDI-9236] Handle markers for log files in table version
6 (#13007)
add 7bbbc99ed52 [HUDI-8409] Fixing merge mode config during upgrade and
downgrade from version 7 to 8 and back (#13046)
add e46e5d17333 [HUDI-8635] Support numWrites metric for compaction
(#13047)
add daacbc3402f [MINOR]Fix typo and Add implementation class name in
interface method of HoodieRecordMerger (#13059)
add fd659674b6d [HUDI-9206] Support reading inflight instants with
HoodieLogRecordReader (#13010)
add 805e31e2b96 [HUDI-9252] BaseHoodieWriteClient should only check for
upgrade (#13073)
add f473aed5360 [MINOR] Remove warning around table version six (#13080)
add d915a35373b [MINOR] Fixing master for build failure (#13085)
add 477624b0308 [MINOR] Fix NumberFormatException while updating metrics
for MDT in table version 6 (#13056)
add 766844a92ea [HUDI-9255] Fix inferring correct merge behavior for few
scenarios (#13079)
add 0a1945265e5 [HUDI-9259] Fixing marker reconciliation for failures
during deleting additional files (#13088)
add 11dbbfea91a [HUDI-9258] Disable partial update when global index is
used (#13086)
add b98d34bcf33 [HUDI-9247] Flip default value of reuse of TimeGenerator
instance (#13077)
add 9752af763f0 [MINOR] Upgrade jetty version to 9.4.57.v20241219 to fix
CVE-2024-8184 (#13058)
add 0e6c4e3019d [MINOR] Update javadocs in MergeIntoHoodieTableCommand
(#13093)
add b1c76c3cd02 [MINOR] Fix logging issue with
EightToSevenDowngradeHandler (#13096)
add 93a82de2bd2 [HUDI-9155] Add scaffolding for lock provider using
conditional writes (#12954)
add 8ae1413612f [HUDI-9156] Add lock provider heartbeat manager (#12958)
add 63fa47b3637 [HUDI-9258] Disable partial update for CUSTOM merge mode
(#13092)
add e63d6ef2ecf [MINOR] Force UT hudi-hadoop-common & Hudi Utilities
others Azure CI to use ubuntu 24 (#13124)
add b6b9afdb8e5 [HUDI-9263] Archived timeline downgrade fails with
EightToSevenDowngradeHandler (#13098)
add dc0b0c902bc [HUDI-9269] Handle tight bound field in columns stats
metadata (#13117)
add 2a3bdb3ed68 [HUDI-9288] Fixing HoodieFileGroup api related to
uncommitted slices (#13125)
add 5df63dcdb9f [MINOR] Overload HoodieFileGroupReader constructor to
bring back old API without allowInflightInstants parameter (#13116)
add 6c3c6983857 [HUDI-9270] Support displaying complete dag for update
statement in spark web ui (#13110)
add 081158f12be [HUDI-9262] Skip building stats for decimal field with
very high precision (#13097)
add 83cfbf1eba1 [HUDI-9286] Fix the atomicity of archived timeline write
(#13128)
add 65057e2ea2d [HUDI-9267] Fix the file group reader log file read
sequence (#13115)
add dcaa03453cb [HUDI-9158] Add storage-based lock provider abstract
implementation (#13103)
add daff66f7ef3 [HUDI-5092] Support Databricks Spark runtime (#13129)
add 35461407f94 [HUDI-9308] Fix incorrect usage of
mapreduce.input.fileinputformat.split.maxsize in HoodieCombineHiveInputFormat
(#13134)
add e4af81c4ab9 [HUDI-9309] Fix perf regression from supporting display
dag of insert/update statment in spark ui (#13139)
add bc160938b06 [HUDI-9311] Revert HUDI-7146 which causes perf overhead
for merging MDT log files (#13136)
add 2e0432a73de [HUDI-9159] S3 implementation of StorageLock for
StorageBasedLockProvider (#13126)
add c7acd4e131d [HUDI-9312] Fix the default enable/disable inference for
indices for column_stats, RLI, partition_stats and bloom_filter (#13140)
add 3d0208834a5 [HUDI-9203] Fix usability w/ upgrading from 0.x to 1.x and
wish to stay in table version 6 (#13145)
add a4cf7858d27 [HUDI-8601] By default disable native hfile reader (#13150)
add 7b95b5776e0 Bumping release candidate number 1
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6ab7eecfe0d)
\
N -- N -- N refs/heads/release-1.0.2 (7b95b5776e0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/bot.yml | 380 +++++++++++++++++++--
azure-pipelines-20230430.yml | 43 +--
...e.java => HoodieSparkFunctionalTestSuiteA.java} | 3 +-
...e.java => HoodieSparkFunctionalTestSuiteB.java} | 5 +-
.../functional/TestNewHoodieParquetFileFormat.java | 2 +-
.../hudi/functional/ColumnStatIndexTestBase.scala | 14 +-
.../hudi/functional/TestColumnStatsIndex.scala | 5 +-
.../hudi/functional/TestPartitionStatsIndex.scala | 2 +-
pom.xml | 61 +++-
9 files changed, 446 insertions(+), 69 deletions(-)
copy
hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/functional/{HoodieSparkFunctionalTestSuite.java
=> HoodieSparkFunctionalTestSuiteA.java} (95%)
rename
hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/functional/{HoodieSparkFunctionalTestSuite.java
=> HoodieSparkFunctionalTestSuiteB.java} (93%)
