danny0405 commented on PR #5357:
URL: https://github.com/apache/hudi/pull/5357#issuecomment-1103536120
Thanks for the contribution @wxplovecc , i have left some minor comments.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub a
danny0405 commented on code in PR #5357:
URL: https://github.com/apache/hudi/pull/5357#discussion_r853787325
##
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/compact/CompactionCommitSink.java:
##
@@ -132,6 +127,15 @@ private void commitIfNecessary(String in
hudi-bot commented on PR #5370:
URL: https://github.com/apache/hudi/pull/5370#issuecomment-1103532673
## CI report:
* df32ef8792075fff6f08820820f5f68c62f8415d Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8166
hudi-bot commented on PR #5370:
URL: https://github.com/apache/hudi/pull/5370#issuecomment-1103530681
## CI report:
* df32ef8792075fff6f08820820f5f68c62f8415d UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
[
https://issues.apache.org/jira/browse/HUDI-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3907:
-
Labels: pull-request-available (was: )
> RFC for lucene based record level index
> --
huberylee opened a new pull request, #5370:
URL: https://github.com/apache/hudi/pull/5370
## What is the purpose of the pull request
RFC for Lucene Based Record Level Index
## Brief change log
- Modify rfc/README.md
- Add rfc/rfc-51 dir
## Verify this pull r
hudi-bot commented on PR #5196:
URL: https://github.com/apache/hudi/pull/5196#issuecomment-1103528444
## CI report:
* b619120204a002260b453c90aa8a910da3b7 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7680
hudi-bot commented on PR #5196:
URL: https://github.com/apache/hudi/pull/5196#issuecomment-1103526343
## CI report:
* b619120204a002260b453c90aa8a910da3b7 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7680
xiarixiaoyao commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103525747
@alexeykudinkin thanks for your address.
@alexeykudinkin @nsivabalan @yihua now schema evolution is not worked with
this pr, let me find the reason, pls wait a moment
--
This
Guanpx opened a new issue, #5369:
URL: https://github.com/apache/hudi/issues/5369
**Describe the problem you faced**
write data with flink, sometimes throw exception : **Job leader for job id
?? lost leadership.**
but other flink task wasnt find this exception.
*
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 6a3ce928b1 [HUDI-3904] Claim RFC number for Impr
xushiyan merged PR #5354:
URL: https://github.com/apache/hudi/pull/5354
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.
hudi-bot commented on PR #5368:
URL: https://github.com/apache/hudi/pull/5368#issuecomment-1103511942
## CI report:
* fea2f156c48828a3dc8ab12aec3721a847814144 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8163
hudi-bot commented on PR #5368:
URL: https://github.com/apache/hudi/pull/5368#issuecomment-1103510016
## CI report:
* fea2f156c48828a3dc8ab12aec3721a847814144 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
[
https://issues.apache.org/jira/browse/HUDI-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3815:
-
Labels: pull-request-available (was: )
> Hudi Option metadata.compaction.delta_commits
>
lipusheng opened a new pull request, #5368:
URL: https://github.com/apache/hudi/pull/5368
… default value error
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before
opening a pull request.
hudi-bot commented on PR #5362:
URL: https://github.com/apache/hudi/pull/5362#issuecomment-1103506131
## CI report:
* 4426590f9cb6609b41fbb923e674b573fd7f79ad Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8158
hudi-bot commented on PR #5357:
URL: https://github.com/apache/hudi/pull/5357#issuecomment-1103502141
## CI report:
* d9c0a047103cb4d72ba5d46ee45d5b2c10319458 UNKNOWN
* 611fd1129e76bcfe2332356d4148e31dc49d85c7 UNKNOWN
* b9bfb0af2a66a00a1fcc50f58996c85077e37615 UNKNOWN
* 33
harsh1231 commented on issue #5189:
URL: https://github.com/apache/hudi/issues/5189#issuecomment-1103496012
@lowmmrfeeder Got it , got distracted because of private package `com.navi`
, let me try to reproduce this then we can work on fix
--
This is an automated message from the Apache
hudi-bot commented on PR #5185:
URL: https://github.com/apache/hudi/pull/5185#issuecomment-1103492567
## CI report:
* 823f02dc228d4d8a27e701f3f699d53e842ac00e Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7920
hudi-bot commented on PR #5185:
URL: https://github.com/apache/hudi/pull/5185#issuecomment-1103490934
## CI report:
* 823f02dc228d4d8a27e701f3f699d53e842ac00e Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7920
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103481704
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* 27d58e93df6310a8f35f93e73bff5ae3f2378bdd UNKNOWN
* 3dc0bd1b03d19253dd4034e72f365d6e63e0fce0 UNKNOWN
* e5
hudi-bot commented on PR #5199:
URL: https://github.com/apache/hudi/pull/5199#issuecomment-1103472488
## CI report:
* 010fe228104153b4b0dc7bdb1b607ffb944ba920 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8156
[
https://issues.apache.org/jira/browse/HUDI-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524714#comment-17524714
]
Danny Chen commented on HUDI-3917:
--
Fixed via master branch: 7a9e411e9d7c687efa1309c53ac2
[
https://issues.apache.org/jira/browse/HUDI-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen resolved HUDI-3917.
--
> Flink write task hangs if last checkpoint has no data input
>
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 28fdddfee0 [HUDI-3920] Fix partition path construction in metadata
table validator (#5365)
add 7a9e411e9d [HUDI
danny0405 merged PR #5360:
URL: https://github.com/apache/hudi/pull/5360
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103467255
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* 27d58e93df6310a8f35f93e73bff5ae3f2378bdd UNKNOWN
* 3dc0bd1b03d19253dd4034e72f365d6e63e0fce0 UNKNOWN
* e5
hudi-bot commented on PR #5357:
URL: https://github.com/apache/hudi/pull/5357#issuecomment-1103467218
## CI report:
* d9c0a047103cb4d72ba5d46ee45d5b2c10319458 UNKNOWN
* 611fd1129e76bcfe2332356d4148e31dc49d85c7 UNKNOWN
* b9bfb0af2a66a00a1fcc50f58996c85077e37615 UNKNOWN
* d7
alexeykudinkin commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103465853
@xiarixiaoyao addressed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific co
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103465752
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* 27d58e93df6310a8f35f93e73bff5ae3f2378bdd UNKNOWN
* 3dc0bd1b03d19253dd4034e72f365d6e63e0fce0 UNKNOWN
* e5
hudi-bot commented on PR #5362:
URL: https://github.com/apache/hudi/pull/5362#issuecomment-1103465728
## CI report:
* fabdbf1c87824b1d39aa211f3eaea867ff96a2cc Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8142
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103464381
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* 27d58e93df6310a8f35f93e73bff5ae3f2378bdd UNKNOWN
* 3dc0bd1b03d19253dd4034e72f365d6e63e0fce0 UNKNOWN
* f4
hudi-bot commented on PR #5362:
URL: https://github.com/apache/hudi/pull/5362#issuecomment-1103464363
## CI report:
* fabdbf1c87824b1d39aa211f3eaea867ff96a2cc Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8142
hudi-bot commented on PR #5357:
URL: https://github.com/apache/hudi/pull/5357#issuecomment-1103462877
## CI report:
* d9c0a047103cb4d72ba5d46ee45d5b2c10319458 UNKNOWN
* 611fd1129e76bcfe2332356d4148e31dc49d85c7 UNKNOWN
* b9bfb0af2a66a00a1fcc50f58996c85077e37615 UNKNOWN
* d7
[
https://issues.apache.org/jira/browse/HUDI-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-2954:
Priority: Minor (was: Blocker)
> Code cleanup: HFileDataBock - using integer keys is never used
>
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103454476
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* 27d58e93df6310a8f35f93e73bff5ae3f2378bdd UNKNOWN
* 3dc0bd1b03d19253dd4034e72f365d6e63e0fce0 UNKNOWN
* f4
hudi-bot commented on PR #5360:
URL: https://github.com/apache/hudi/pull/5360#issuecomment-1103451500
## CI report:
* d5efac3b62681191bce360b2f2d1012f354078e3 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8155
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103448431
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* 27d58e93df6310a8f35f93e73bff5ae3f2378bdd UNKNOWN
* 3dc0bd1b03d19253dd4034e72f365d6e63e0fce0 UNKNOWN
* f4
hudi-bot commented on PR #4958:
URL: https://github.com/apache/hudi/pull/4958#issuecomment-1103433649
## CI report:
* de60394e7eb2553adf6e5224bc3ffc739b9b1001 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=813
codope commented on code in PR #5197:
URL: https://github.com/apache/hudi/pull/5197#discussion_r853695986
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/SerDeUtils.scala:
##
@@ -30,7 +30,10 @@ object SerDeUtils {
private val kryoLocal = ne
codope commented on issue #5351:
URL: https://github.com/apache/hudi/issues/5351#issuecomment-1103427563
Ok. I tried with latest Hudi master. Can you give build from the latest
master?
I'll try Hudi 0.9. I think latest EMR already has it.
--
This is an automated message from the Apache
hudi-bot commented on PR #5199:
URL: https://github.com/apache/hudi/pull/5199#issuecomment-1103423737
## CI report:
* 63bdb482c03af917059c2299bb4c47151f9f9808 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7687
[
https://issues.apache.org/jira/browse/HUDI-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YangXuan updated HUDI-3768:
---
Description: In JDBCServer multi-tenant mode, spark.kryo.classesToRegister
and spark.kryo.referenceTracking ar
hudi-bot commented on PR #5199:
URL: https://github.com/apache/hudi/pull/5199#issuecomment-1103422265
## CI report:
* 63bdb482c03af917059c2299bb4c47151f9f9808 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7687
watermelon12138 commented on code in PR #5199:
URL: https://github.com/apache/hudi/pull/5199#discussion_r853686298
##
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/HoodieFlinkWriteClient.java:
##
@@ -372,6 +372,8 @@ public void completeCompaction(
} fin
xiarixiaoyao commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103415549
@alexeykudinkin now we use hoodieparquetFile,
we may need to modfy this function to reduce the impact of schema evolution
HoodieDataSourceHelper.getConfigurationWithInternalSchema
watermelon12138 commented on code in PR #5199:
URL: https://github.com/apache/hudi/pull/5199#discussion_r853671852
##
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/HoodieFlinkWriteClient.java:
##
@@ -372,6 +372,8 @@ public void completeCompaction(
} fin
hudi-bot commented on PR #5246:
URL: https://github.com/apache/hudi/pull/5246#issuecomment-1103415385
## CI report:
* b0518ff7ab38ca449a47046563f13cae57130cde Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8153
watermelon12138 commented on PR #5199:
URL: https://github.com/apache/hudi/pull/5199#issuecomment-1103412910
@yihua
Hello，Thank you for your review. I answered your questions in the comments
and hope you can review my code again.
--
This is an automated message from the Apache Git Ser
xiarixiaoyao commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853677692
##
hudi-spark-datasource/hudi-spark3.1.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark312HoodieParquetFileFormat.scala:
##
@@ -17,279 +17,301
hudi-bot commented on PR #5360:
URL: https://github.com/apache/hudi/pull/5360#issuecomment-1103404876
## CI report:
* 3b69640fb8bbd66767d32cccf67ba42345db2f36 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8140
hudi-bot commented on PR #5360:
URL: https://github.com/apache/hudi/pull/5360#issuecomment-1103401643
## CI report:
* 3b69640fb8bbd66767d32cccf67ba42345db2f36 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8140
[
https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2151:
-
Epic Link: HUDI-3249 (was: HUDI-1239)
> Make performant out-of-box configs
>
shaqf commented on issue #5345:
URL: https://github.com/apache/hudi/issues/5345#issuecomment-1103395668
Hadoop3.*.* use like this:
`
112 try (FSDataOutputStream outputStream = new FSDataOutputStream(baos,
null)) {
113 try (HoodieParquetStreamWriter parquetWriter = new
hudi-bot commented on PR #4958:
URL: https://github.com/apache/hudi/pull/4958#issuecomment-1103380630
## CI report:
* de60394e7eb2553adf6e5224bc3ffc739b9b1001 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=813
YuweiXiao commented on PR #4958:
URL: https://github.com/apache/hudi/pull/4958#issuecomment-1103378430
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
T
[
https://issues.apache.org/jira/browse/HUDI-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu reassigned HUDI-2597:
Assignee: (was: Raymond Xu)
> Improve code quality around Generics with Java 8
> --
[
https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2598:
-
Fix Version/s: 0.12.0
> Redesign record payload class to decouple HoodieRecordPayload from Avro
>
[
https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2598:
-
Epic Link: HUDI-3217 (was: HUDI-538)
> Redesign record payload class to decouple HoodieRecordPayload from
[
https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2598:
-
Fix Version/s: (was: 0.12.0)
> Redesign record payload class to decouple HoodieRecordPayload from Avro
[
https://issues.apache.org/jira/browse/HUDI-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-3614:
-
Epic Link: HUDI-538
> Fix Flink/JavaDeleteHelper deduplication logic
> ---
[
https://issues.apache.org/jira/browse/HUDI-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-3535:
-
Epic Status: Done (was: To Do)
> Integrate with LinkedIn DataHub
> ---
>
>
hudi-bot commented on PR #5246:
URL: https://github.com/apache/hudi/pull/5246#issuecomment-1103339561
## CI report:
* fdfcd0d06ecd0bd45d895522d5a9fff0bdea Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7886
hudi-bot commented on PR #5246:
URL: https://github.com/apache/hudi/pull/5246#issuecomment-1103336283
## CI report:
* fdfcd0d06ecd0bd45d895522d5a9fff0bdea Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7886
umehrot2 commented on issue #5298:
URL: https://github.com/apache/hudi/issues/5298#issuecomment-1103323341
@kasured is it possible for you to have 3 separete spark applications that
do not share spark context ?
--
This is an automated message from the Apache Git Service.
To respond to the
umehrot2 commented on issue #5298:
URL: https://github.com/apache/hudi/issues/5298#issuecomment-1103314606
@kasured I am from AWS EMR team. I hope you have opened a ticket with AWS
support and we can work through that channel to backport this fix and provide
you patched jars.
--
This is
alexeykudinkin commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853634821
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -289,6 +324,16 @@
moustafaalaa commented on issue #5291:
URL: https://github.com/apache/hudi/issues/5291#issuecomment-1103302907
I also tried to add the primaryKey and the preCombineField key, but the
output table properties doesn't reflect the default config file. For example,
The output table is `cow` and
moustafaalaa commented on issue #5291:
URL: https://github.com/apache/hudi/issues/5291#issuecomment-1103299526
@zhedoubushishi it seems not working
```python
import sys
from pyspark.context import SparkContext
from pyspark.sql.session import SparkSession
from awsglue.c
alexeykudinkin commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853630693
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala:
##
@@ -114,16 +114,38 @@ class BaseFileOnlyRelation(sqlContext:
[
https://issues.apache.org/jira/browse/HUDI-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo closed HUDI-3905.
---
Resolution: Fixed
> Update Hudi Sink quick start with S3 setup
> --
>
[
https://issues.apache.org/jira/browse/HUDI-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo closed HUDI-3920.
---
Resolution: Fixed
> Fix partition path construction in metadata table validator
>
[
https://issues.apache.org/jira/browse/HUDI-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-3920:
Sprint: Hudi-Sprint-Apr-19
> Fix partition path construction in metadata table validator
> -
harishraju-govindaraju opened a new issue, #5367:
URL: https://github.com/apache/hudi/issues/5367
**Describe the problem you faced**
Do we have any step by step document on how to use Hudi in conjunction with
DBT. the help seem to be very less from the hudi apache portal.
yihua commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853620708
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -27,233 +25,262 @@ import o
yihua commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853619711
##
hudi-spark-datasource/hudi-spark3.1.x/src/main/scala/org/apache/spark/sql/adapter/Spark3_1Adapter.scala:
##
@@ -55,14 +54,7 @@ class Spark3_1Adapter extends BaseSpark3Adap
harishraju-govindaraju closed issue #4745: [SUPPORT] Bulk Insert into COW table
slow
URL: https://github.com/apache/hudi/issues/4745
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comm
harishraju-govindaraju commented on issue #4745:
URL: https://github.com/apache/hudi/issues/4745#issuecomment-1103282734
Please mark this closed. The issue was our source files were csv gzip and it
was not splittable to read the files parallely. we used a custom library that
reads csv gzip
nsivabalan merged PR #5365:
URL: https://github.com/apache/hudi/pull/5365
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apach
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 6f3fe880d2 [HUDI-3905] Add S3 related setup in Kafka Connect quick
start (#5356)
add 28fdddfee0 [HUDI-3920] Fix
nsivabalan commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853598977
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -289,6 +324,16 @@ clas
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103256312
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* 27d58e93df6310a8f35f93e73bff5ae3f2378bdd UNKNOWN
* 3dc0bd1b03d19253dd4034e72f365d6e63e0fce0 UNKNOWN
* f4
hudi-bot commented on PR #5341:
URL: https://github.com/apache/hudi/pull/5341#issuecomment-1103253132
## CI report:
* e7b633cceda6fedb7ffb36b06aae0ce7d22a8bcf UNKNOWN
* 58319027a8475b52f374a4934ca68e8026f6a838 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
alexeykudinkin commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853568411
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -27,233 +25,262 @@
alexeykudinkin commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853567337
##
hudi-spark-datasource/hudi-spark3.1.x/src/main/scala/org/apache/spark/sql/adapter/Spark3_1Adapter.scala:
##
@@ -55,14 +54,7 @@ class Spark3_1Adapter extends BaseS
moustafaalaa commented on issue #5291:
URL: https://github.com/apache/hudi/issues/5291#issuecomment-1103244072
The warning disappeared, I will verify it is working fine and share the
output.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log
yihua commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853541246
##
hudi-spark-datasource/hudi-spark3.1.x/src/main/scala/org/apache/spark/sql/adapter/Spark3_1Adapter.scala:
##
@@ -55,14 +54,7 @@ class Spark3_1Adapter extends BaseSpark3Adap
alexeykudinkin commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103241149
@xiarixiaoyao please take a look as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
hudi-bot commented on PR #5366:
URL: https://github.com/apache/hudi/pull/5366#issuecomment-1103225518
## CI report:
* 92f49a1b8ea49941c582ac23739fc6caa9f63bc6 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8148
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103217469
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* c040d5c57e551bc7e0fbbad03236b70ab48b2cf8 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 6f3fe880d2 [HUDI-3905] Add S3 related setup in Kafk
yihua merged PR #5356:
URL: https://github.com/apache/hudi/pull/5356
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
hudi-bot commented on PR #5365:
URL: https://github.com/apache/hudi/pull/5365#issuecomment-1103215308
## CI report:
* d13ebe715c323a13ecc9db28dba9986bd43455c1 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8147
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103207245
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* c040d5c57e551bc7e0fbbad03236b70ab48b2cf8 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
alexeykudinkin commented on code in PR #5364:
URL: https://github.com/apache/hudi/pull/5364#discussion_r853515259
##
hudi-spark-datasource/hudi-spark3.1.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark312HoodieParquetFileFormat.scala:
##
@@ -17,279 +17,3
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103199446
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* c040d5c57e551bc7e0fbbad03236b70ab48b2cf8 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103190387
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* c040d5c57e551bc7e0fbbad03236b70ab48b2cf8 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5364:
URL: https://github.com/apache/hudi/pull/5364#issuecomment-1103185550
## CI report:
* 6fa8f1506ac4cfeb00e2296b4a7f9fe5338fde96 UNKNOWN
* c040d5c57e551bc7e0fbbad03236b70ab48b2cf8 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5341:
URL: https://github.com/apache/hudi/pull/5341#issuecomment-1103183021
## CI report:
* e7b633cceda6fedb7ffb36b06aae0ce7d22a8bcf UNKNOWN
* 8cdf174009f9ccd8ce9c9c28026de4f12bced78f Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
1 - 100 of 264 matches
Mail list logo
