yihua commented on code in PR #6003:
URL: https://github.com/apache/hudi/pull/6003#discussion_r989728519
##
rfc/rfc-56/rfc-56.md:
##
@@ -0,0 +1,238 @@
+
+
+# RFC-56: Early Conflict Detection For Multi-writer
+
+## Proposers
+
+- @zhangyue19921010
+
+## Approvers
+
+- @yihua
+
+#
yihua commented on code in PR #6003:
URL: https://github.com/apache/hudi/pull/6003#discussion_r989728329
##
rfc/rfc-56/rfc-56.md:
##
@@ -0,0 +1,238 @@
+
+
+# RFC-56: Early Conflict Detection For Multi-writer
+
+## Proposers
+
+- @zhangyue19921010
+
+## Approvers
+
+- @yihua
+
+#
yihua commented on code in PR #6003:
URL: https://github.com/apache/hudi/pull/6003#discussion_r988457829
##
rfc/rfc-56/rfc-56.md:
##
@@ -0,0 +1,238 @@
+
+
+# RFC-56: Early Conflict Detection For Multi-writer
+
+## Proposers
+
+- @zhangyue19921010
+
+## Approvers
+
+- @yihua
+
+#
hudi-bot commented on PR #5416:
URL: https://github.com/apache/hudi/pull/5416#issuecomment-1271160967
## CI report:
* b838e1f406902c9bdfb5e84d53ef5a5effd0765b UNKNOWN
* 6114ee2aa59f087e5ef0b1b53979eec143b33f5e UNKNOWN
* 92760dbf5a047fe1f9941fa4b36c944eb3bec5c7 UNKNOWN
* 67
hudi-bot commented on PR #5416:
URL: https://github.com/apache/hudi/pull/5416#issuecomment-1271157459
## CI report:
* b838e1f406902c9bdfb5e84d53ef5a5effd0765b UNKNOWN
* 6114ee2aa59f087e5ef0b1b53979eec143b33f5e UNKNOWN
* 92760dbf5a047fe1f9941fa4b36c944eb3bec5c7 UNKNOWN
* 3e
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989705143
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/DisruptorExecutor.java:
##
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989704619
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/DisruptorMessageQueue.java:
##
@@ -0,0 +1,80 @@
+/*
+ * Licensed to the Apache Software Foundation (
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989704508
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/DisruptorExecutor.java:
##
@@ -0,0 +1,163 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989702909
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/DisruptorExecutor.java:
##
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989700987
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/DisruptorExecutor.java:
##
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989700875
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/DisruptorBasedProducer.java:
##
@@ -0,0 +1,29 @@
+/*
+ * Licensed to the Apache Software Foundation
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989699671
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/HoodieDaemonThreadFactory.java:
##
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundati
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989699543
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/HoodieDaemonThreadFactory.java:
##
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundati
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989699375
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/HoodieDaemonThreadFactory.java:
##
@@ -0,0 +1,45 @@
+/*
+ * Licensed to the Apache Software Foundati
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989698772
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/HoodieDisruptorEvent.java:
##
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (A
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989697092
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/HoodieMessageQueue.java:
##
@@ -0,0 +1,28 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-1271113810
## CI report:
* 58c2a12352944f2d1794968ebcc676970bdb0bd0 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #5416:
URL: https://github.com/apache/hudi/pull/5416#issuecomment-1271113037
## CI report:
* b838e1f406902c9bdfb5e84d53ef5a5effd0765b UNKNOWN
* 6114ee2aa59f087e5ef0b1b53979eec143b33f5e UNKNOWN
* 92760dbf5a047fe1f9941fa4b36c944eb3bec5c7 UNKNOWN
* 3e
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-127132
## CI report:
* 58c2a12352944f2d1794968ebcc676970bdb0bd0 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-1271108167
## CI report:
* 58c2a12352944f2d1794968ebcc676970bdb0bd0 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989664909
##
hudi-common/src/main/java/org/apache/hudi/common/util/queue/HoodieExecutor.java:
##
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) un
zhangyue19921010 commented on code in PR #5416:
URL: https://github.com/apache/hudi/pull/5416#discussion_r989664466
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##
@@ -230,6 +240,16 @@ public class HoodieWriteConfig extends Hoodi
hudi-bot commented on PR #5416:
URL: https://github.com/apache/hudi/pull/5416#issuecomment-1271079081
## CI report:
* b838e1f406902c9bdfb5e84d53ef5a5effd0765b UNKNOWN
* 6114ee2aa59f087e5ef0b1b53979eec143b33f5e UNKNOWN
* 92760dbf5a047fe1f9941fa4b36c944eb3bec5c7 UNKNOWN
* 3e
hudi-bot commented on PR #6883:
URL: https://github.com/apache/hudi/pull/6883#issuecomment-1271075750
## CI report:
* c528116cecfd35edc4b6829cb091c4924dc1758f Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-1271034096
## CI report:
* d99df9d68f351bd97aa8fee33cffc399f69efa9c Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-1271029515
## CI report:
* d99df9d68f351bd97aa8fee33cffc399f69efa9c Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
eshu commented on issue #6692:
URL: https://github.com/apache/hudi/issues/6692#issuecomment-1271026057
hadoop-common have a dependency on avro, hbase-hadoop-compat,
hadoop-mapreduce-client-core.
I do not have dependencies on spark-avro, but probably Glue 3 contains it.
And it is out
eshu commented on issue #6692:
URL: https://github.com/apache/hudi/issues/6692#issuecomment-1271018152
@xushiyan But I see spark-avro as a transitive dependency for
hudi-aws-bundle. And hudi-aws-bundle has it as a direct and transitive
dependency too.
--
This is an automated message from
wzx140 closed pull request #6884: [Minor] fix comments
URL: https://github.com/apache/hudi/pull/6884
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: com
alexeykudinkin commented on code in PR #6883:
URL: https://github.com/apache/hudi/pull/6883#discussion_r989616904
##
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/storage/row/TestHoodieInternalRowParquetWriter.java:
##
@@ -68,44 +72,55 @@ public void tearDown()
wzx140 opened a new pull request, #6884:
URL: https://github.com/apache/hudi/pull/6884
### Change Logs
_Describe context and summary for this change. Highlight if any code was
copied._
### Impact
_Describe any public API or user-facing feature change or any performance
nsivabalan commented on code in PR #6883:
URL: https://github.com/apache/hudi/pull/6883#discussion_r989615334
##
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/storage/row/TestHoodieInternalRowParquetWriter.java:
##
@@ -68,44 +72,55 @@ public void tearDown() thro
[
https://issues.apache.org/jira/browse/HUDI-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4992:
--
Status: Patch Available (was: In Progress)
> Spark Row-writing Bulk Insert produces incorrect B
[
https://issues.apache.org/jira/browse/HUDI-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4992:
--
Sprint: 2022/10/04
> Spark Row-writing Bulk Insert produces incorrect Bloom Filter metadata
> --
hudi-bot commented on PR #6883:
URL: https://github.com/apache/hudi/pull/6883#issuecomment-1270989045
## CI report:
* 024bcf68a222e98835e0b61fa784bc1040f65f62 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=120
hudi-bot commented on PR #6883:
URL: https://github.com/apache/hudi/pull/6883#issuecomment-1270982443
## CI report:
* 024bcf68a222e98835e0b61fa784bc1040f65f62 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6806:
URL: https://github.com/apache/hudi/pull/6806#issuecomment-1270981845
## CI report:
* 57f8b811946c7c013cbc31e9bd8db469f70cda2a Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #5958:
URL: https://github.com/apache/hudi/pull/5958#issuecomment-1270969413
## CI report:
* 00eefd74074b2e0e04dc308ab9b775e09ed7803b Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
alexeykudinkin commented on PR #6883:
URL: https://github.com/apache/hudi/pull/6883#issuecomment-1270940646
@nsivabalan yes, i'm adding comprehensive tests for Parquet writers to make
sure we properly validate both records and metadata written to Parquet
--
This is an automated message fr
alexeykudinkin commented on code in PR #6883:
URL: https://github.com/apache/hudi/pull/6883#discussion_r989585629
##
hudi-common/src/main/java/org/apache/hudi/avro/HoodieBloomFilterWriteSupport.java:
##
@@ -0,0 +1,78 @@
+package org.apache.hudi.avro;
+
+import org.apache.hudi.co
nsivabalan commented on PR #6883:
URL: https://github.com/apache/hudi/pull/6883#issuecomment-1270864726
can we please add tests as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
nsivabalan commented on code in PR #6883:
URL: https://github.com/apache/hudi/pull/6883#discussion_r989564188
##
hudi-common/src/main/java/org/apache/hudi/avro/HoodieBloomFilterWriteSupport.java:
##
@@ -0,0 +1,78 @@
+package org.apache.hudi.avro;
+
+import org.apache.hudi.common
hudi-bot commented on PR #6883:
URL: https://github.com/apache/hudi/pull/6883#issuecomment-1270857238
## CI report:
* 024bcf68a222e98835e0b61fa784bc1040f65f62 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6883:
URL: https://github.com/apache/hudi/pull/6883#issuecomment-1270854312
## CI report:
* 024bcf68a222e98835e0b61fa784bc1040f65f62 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #6575:
URL: https://github.com/apache/hudi/pull/6575#issuecomment-1270851273
## CI report:
* 1600e31836157c8d05e3bc8b9e08e1717471f1a6 UNKNOWN
* 4d02f2c64a5fc4b89889677ee639a20b53cec26a UNKNOWN
* 48147d19c835e7868102fd2d083659e6ee2ac343 UNKNOWN
* b5
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989554325
##
hudi-common/src/main/java/org/apache/hudi/common/table/view/HoodieTableFileSystemView.java:
##
@@ -167,6 +167,12 @@ public HoodieTableFileSystemView(HoodieTableMetaClient
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989554325
##
hudi-common/src/main/java/org/apache/hudi/common/table/view/HoodieTableFileSystemView.java:
##
@@ -167,6 +167,12 @@ public HoodieTableFileSystemView(HoodieTableMetaClient
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989554325
##
hudi-common/src/main/java/org/apache/hudi/common/table/view/HoodieTableFileSystemView.java:
##
@@ -167,6 +167,12 @@ public HoodieTableFileSystemView(HoodieTableMetaClient
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989554325
##
hudi-common/src/main/java/org/apache/hudi/common/table/view/HoodieTableFileSystemView.java:
##
@@ -167,6 +167,12 @@ public HoodieTableFileSystemView(HoodieTableMetaClient
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989552176
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestCOWDataSource.scala:
##
@@ -98,6 +98,67 @@ class TestCOWDataSource extends HoodieClientTestBa
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989551863
##
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java:
##
@@ -473,21 +479,26 @@ public Option
getColumnStatMetadata() {
/**
* Returns the fi
[
https://issues.apache.org/jira/browse/HUDI-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-4992:
-
Labels: pull-request-available (was: )
> Spark Row-writing Bulk Insert produces incorrect Bloom F
alexeykudinkin opened a new pull request, #6883:
URL: https://github.com/apache/hudi/pull/6883
### Change Logs
Troubleshooting duplicates issue, we've found that the min/max record key
stats are being currently persisted incorrectly into Parquet metadata by
Row-writing Bulk Insert, l
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989549950
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##
@@ -158,27 +161,29 @@ private String makeWriteToken() {
return FSUtils.makeW
Alexey Kudinkin created HUDI-4992:
-
Summary: Spark Row-writing Bulk Insert produces incorrect Bloom
Filter metadata
Key: HUDI-4992
URL: https://issues.apache.org/jira/browse/HUDI-4992
Project: Apache
[
https://issues.apache.org/jira/browse/HUDI-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4992:
--
Status: In Progress (was: Open)
> Spark Row-writing Bulk Insert produces incorrect Bloom Filter
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989549646
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieCreateHandle.java:
##
@@ -235,10 +234,10 @@ protected void setupWriteStatus() throws IOException {
CTTY commented on code in PR #6882:
URL: https://github.com/apache/hudi/pull/6882#discussion_r989548780
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieCreateHandle.java:
##
@@ -92,19 +92,18 @@ public HoodieCreateHandle(HoodieWriteConfig config, String
hudi-bot commented on PR #6806:
URL: https://github.com/apache/hudi/pull/6806#issuecomment-1270792039
## CI report:
* f03f9610cf4e2c490d33ca734ca9b3241b2be778 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #5958:
URL: https://github.com/apache/hudi/pull/5958#issuecomment-1270789716
## CI report:
* bfb3668bfbeb8c461e7d5293b67aac32be59d8ab Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1199
hudi-bot commented on PR #6806:
URL: https://github.com/apache/hudi/pull/6806#issuecomment-1270782032
## CI report:
* f03f9610cf4e2c490d33ca734ca9b3241b2be778 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #5958:
URL: https://github.com/apache/hudi/pull/5958#issuecomment-1270780921
## CI report:
* bfb3668bfbeb8c461e7d5293b67aac32be59d8ab Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1199
hudi-bot commented on PR #6882:
URL: https://github.com/apache/hudi/pull/6882#issuecomment-1270776160
## CI report:
* 1b456c26360a564f7695b2f683c929add7b55daf Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6806:
URL: https://github.com/apache/hudi/pull/6806#issuecomment-1270775878
## CI report:
* f03f9610cf4e2c490d33ca734ca9b3241b2be778 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
[
https://issues.apache.org/jira/browse/HUDI-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4937:
--
Reviewers: sivabalan narayanan
> Fix HoodieTable injecting HoodieBackedTableMetadat not reusing
hudi-bot commented on PR #6575:
URL: https://github.com/apache/hudi/pull/6575#issuecomment-1270720914
## CI report:
* 1600e31836157c8d05e3bc8b9e08e1717471f1a6 UNKNOWN
* 4d02f2c64a5fc4b89889677ee639a20b53cec26a UNKNOWN
* 48147d19c835e7868102fd2d083659e6ee2ac343 UNKNOWN
* b5
[
https://issues.apache.org/jira/browse/HUDI-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4937:
--
Priority: Blocker (was: Critical)
> Fix HoodieTable injecting HoodieBackedTableMetadat not reus
[
https://issues.apache.org/jira/browse/HUDI-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4937:
--
Status: Patch Available (was: In Progress)
> Fix HoodieTable injecting HoodieBackedTableMetadat
[
https://issues.apache.org/jira/browse/HUDI-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4937:
--
Status: In Progress (was: Open)
> Fix HoodieTable injecting HoodieBackedTableMetadat not reusin
[
https://issues.apache.org/jira/browse/HUDI-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4812:
--
Status: In Progress (was: Open)
> Lazy partition listing and file groups fetching in Spark Quer
[
https://issues.apache.org/jira/browse/HUDI-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-3963:
--
Status: In Progress (was: Open)
> [RFC-53] Use Lock-Free Message Queue Improving Hoodie Writing
[
https://issues.apache.org/jira/browse/HUDI-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4489:
--
Status: In Progress (was: Open)
> Break down HoodieAnalysis rules into Spark-specific component
[
https://issues.apache.org/jira/browse/HUDI-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-3963:
--
Status: Patch Available (was: In Progress)
> [RFC-53] Use Lock-Free Message Queue Improving Hoo
[
https://issues.apache.org/jira/browse/HUDI-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4812:
--
Status: Patch Available (was: In Progress)
> Lazy partition listing and file groups fetching in
[
https://issues.apache.org/jira/browse/HUDI-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4472:
--
Status: Patch Available (was: In Progress)
> Revisit schema handling in HoodieSparkSqlWriter
>
hudi-bot commented on PR #6575:
URL: https://github.com/apache/hudi/pull/6575#issuecomment-1270716460
## CI report:
* 1600e31836157c8d05e3bc8b9e08e1717471f1a6 UNKNOWN
* 4d02f2c64a5fc4b89889677ee639a20b53cec26a UNKNOWN
* 48147d19c835e7868102fd2d083659e6ee2ac343 UNKNOWN
* b5
alexeykudinkin commented on issue #6842:
URL: https://github.com/apache/hudi/issues/6842#issuecomment-1270699265
Created HUDI-4991 to track
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the spe
[
https://issues.apache.org/jira/browse/HUDI-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-4991:
--
Sprint: 2022/10/04
> Make sure DeltaStreamer passes SSL key/truststore configs connecting to
>
Alexey Kudinkin created HUDI-4991:
-
Summary: Make sure DeltaStreamer passes SSL key/truststore configs
connecting to Schema Registry
Key: HUDI-4991
URL: https://issues.apache.org/jira/browse/HUDI-4991
hudi-bot commented on PR #6882:
URL: https://github.com/apache/hudi/pull/6882#issuecomment-1270632495
## CI report:
* 1b456c26360a564f7695b2f683c929add7b55daf Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6806:
URL: https://github.com/apache/hudi/pull/6806#issuecomment-1270632241
## CI report:
* f03f9610cf4e2c490d33ca734ca9b3241b2be778 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
hudi-bot commented on PR #6882:
URL: https://github.com/apache/hudi/pull/6882#issuecomment-1270627280
## CI report:
* 1b456c26360a564f7695b2f683c929add7b55daf UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #6806:
URL: https://github.com/apache/hudi/pull/6806#issuecomment-1270626983
## CI report:
* f03f9610cf4e2c490d33ca734ca9b3241b2be778 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1201
hudi-bot commented on PR #6806:
URL: https://github.com/apache/hudi/pull/6806#issuecomment-1270621569
## CI report:
* f03f9610cf4e2c490d33ca734ca9b3241b2be778 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
CTTY commented on PR #6882:
URL: https://github.com/apache/hudi/pull/6882#issuecomment-1270619909
See [RFC-60](https://github.com/apache/hudi/pull/5113)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
CTTY opened a new pull request, #6882:
URL: https://github.com/apache/hudi/pull/6882
### Change Logs
_Describe context and summary for this change. Highlight if any code was
copied._
### Impact
_Describe any public API or user-facing feature change or any performance
im
kazdy commented on issue #6869:
URL: https://github.com/apache/hudi/issues/6869#issuecomment-1270599382
Hi,
record key works like a PK on a table (unique, non-nullable field).
In your case, you end up with two records with different record key and
that's expected.
Precombine a
This is an automated email from the ASF dual-hosted git repository.
yuzhaojing pushed a commit to branch release-0.12.1
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/release-0.12.1 by this push:
new 28cb191df7 [MINOR] Update rele
hudi-bot commented on PR #5416:
URL: https://github.com/apache/hudi/pull/5416#issuecomment-1270546112
## CI report:
* b838e1f406902c9bdfb5e84d53ef5a5effd0765b UNKNOWN
* 6114ee2aa59f087e5ef0b1b53979eec143b33f5e UNKNOWN
* 92760dbf5a047fe1f9941fa4b36c944eb3bec5c7 UNKNOWN
* 3e
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-1270540880
## CI report:
* d99df9d68f351bd97aa8fee33cffc399f69efa9c Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1203
[
https://issues.apache.org/jira/browse/HUDI-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-4990:
Description: The CLI tool command `repair deduplicate` repair one partition
at a time. To repair hundreds o
Ethan Guo created HUDI-4990:
---
Summary: Parallelize deduplication in CLI tool
Key: HUDI-4990
URL: https://issues.apache.org/jira/browse/HUDI-4990
Project: Apache Hudi
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HUDI-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-4990:
Fix Version/s: 0.13.0
> Parallelize deduplication in CLI tool
> -
>
>
mikeashley87 commented on issue #6819:
URL: https://github.com/apache/hudi/issues/6819#issuecomment-1270450572
I am getting the same error when using
https://mvnrepository.com/artifact/org.apache.hudi/hudi-spark2.4-bundle_2.11/0.12.0
```
py4j.protocol.Py4JJavaError: An e
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-1270375233
## CI report:
* 34e4db327b0d8394aa92126c97e833d75a0543b1 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=120
hudi-bot commented on PR #6745:
URL: https://github.com/apache/hudi/pull/6745#issuecomment-1270366636
## CI report:
* Unknown: [CANCELED](TBD)
* 34e4db327b0d8394aa92126c97e833d75a0543b1 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039
hudi-bot commented on PR #5416:
URL: https://github.com/apache/hudi/pull/5416#issuecomment-1270364112
## CI report:
* b838e1f406902c9bdfb5e84d53ef5a5effd0765b UNKNOWN
* 6114ee2aa59f087e5ef0b1b53979eec143b33f5e UNKNOWN
* 67d8cd3c14c8539a4033c9e4a99b16eef9a03c25 Azure:
[SUCCES
hudi-bot commented on PR #6873:
URL: https://github.com/apache/hudi/pull/6873#issuecomment-1270357645
## CI report:
* 83ef76c2bc6763f16ee342cc83435e907302f19f UNKNOWN
* 9c309b8a1a9a843e60efb866361a8cf0bd077ba7 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
gtwuser commented on issue #6869:
URL: https://github.com/apache/hudi/issues/6869#issuecomment-1270330139
> ` 'hoodie.datasource.write.precombine.field': 'payload.recordedAt',
>
> did you use a wrong precombine field?
@fengjian428 sorry i recreated the payload for data privacy and m
the-other-tim-brown commented on code in PR #6806:
URL: https://github.com/apache/hudi/pull/6806#discussion_r989232387
##
hudi-utilities/pom.xml:
##
@@ -85,7 +85,6 @@
com.google.protobuf
protobuf-java-util
- test
Review Comment:
@alexeykudinkin and @
1 - 100 of 142 matches
Mail list logo
