codope commented on code in PR #9406:
URL: https://github.com/apache/hudi/pull/9406#discussion_r1292107760
##
website/docs/metadata.md:
##
@@ -3,80 +3,173 @@ title: Metadata Table
keywords: [ hudi, metadata, S3 file listings]
---
-## Motivation for a Metadata Table
+## Metad
hudi-bot commented on PR #9434:
URL: https://github.com/apache/hudi/pull/9434#issuecomment-1675703699
## CI report:
* e895bfb27350f497100c3cd50246badcba99f27d Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
prashantwason commented on PR #9434:
URL: https://github.com/apache/hudi/pull/9434#issuecomment-1675703170
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific com
Zouxxyy commented on code in PR #9416:
URL: https://github.com/apache/hudi/pull/9416#discussion_r1291978221
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java:
##
@@ -452,107 +431,137 @@ private Stream
getCommitInstantsToArchive()
Riddle4045 opened a new issue, #9435:
URL: https://github.com/apache/hudi/issues/9435
I am creating a hudi table using Flink Hudi connector
```sql
CREATE TABLE flink.flink_hudi_hms3 (
uuid VARCHAR(20),
name VARCHAR(10),
age INT,
ts TIMESTAMP(3),
`pa
danny0405 commented on code in PR #9297:
URL: https://github.com/apache/hudi/pull/9297#discussion_r1291957282
##
hudi-sync/hudi-hive-sync/pom.xml:
##
@@ -200,6 +200,9 @@
+
+ false
+
Review Comment:
Thanks, can we m
danny0405 commented on issue #9344:
URL: https://github.com/apache/hudi/issues/9344#issuecomment-1675598997
It seems the MDT encountered inconsistency, can you fix the errored table
separately and restart the job, the table metadata can be re-bootstrapped
through HUDI CLI.
--
This is an
danny0405 commented on code in PR #9416:
URL: https://github.com/apache/hudi/pull/9416#discussion_r1291949979
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java:
##
@@ -452,107 +431,137 @@ private Stream
getCommitInstantsToArchive
danny0405 commented on issue #9402:
URL: https://github.com/apache/hudi/issues/9402#issuecomment-1675592849
The hive seems have no good support for schema evolution. step7 may caused
by the position change of the columns.
--
This is an automated message from the Apache Git Service.
To res
hudi-bot commented on PR #9434:
URL: https://github.com/apache/hudi/pull/9434#issuecomment-1675552821
## CI report:
* e895bfb27350f497100c3cd50246badcba99f27d Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
hudi-bot commented on PR #9433:
URL: https://github.com/apache/hudi/pull/9433#issuecomment-1675545141
## CI report:
* 32538d15eea7ed25ca8f0f8efbdd2bd1c21fa41e Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
[
https://issues.apache.org/jira/browse/HUDI-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lokesh Lingarajan updated HUDI-6687:
Description:
1.
Current batched commit string is of the type "commit#key", given this if we
[
https://issues.apache.org/jira/browse/HUDI-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lokesh Lingarajan updated HUDI-6687:
Description:
1.
Current batched commit string is of the type "commit#key", given this if we
lokesh-lingarajan-0310 commented on code in PR #9433:
URL: https://github.com/apache/hudi/pull/9433#discussion_r1291842978
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/IncrSourceHelper.java:
##
@@ -219,7 +218,7 @@ public static Pair>
filterAndGenera
Lokesh Lingarajan created HUDI-6687:
---
Summary: S3/GCS incr job improvements
Key: HUDI-6687
URL: https://issues.apache.org/jira/browse/HUDI-6687
Project: Apache Hudi
Issue Type: Improvement
amrishlal commented on code in PR #9433:
URL: https://github.com/apache/hudi/pull/9433#discussion_r1291826591
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/IncrSourceHelper.java:
##
@@ -219,7 +218,7 @@ public static Pair>
filterAndGenerateChe
}
hudi-bot commented on PR #9434:
URL: https://github.com/apache/hudi/pull/9434#issuecomment-1675411037
## CI report:
* e895bfb27350f497100c3cd50246badcba99f27d Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
hudi-bot commented on PR #9434:
URL: https://github.com/apache/hudi/pull/9434#issuecomment-1675404896
## CI report:
* e895bfb27350f497100c3cd50246badcba99f27d UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #9433:
URL: https://github.com/apache/hudi/pull/9433#issuecomment-1675404838
## CI report:
* 32538d15eea7ed25ca8f0f8efbdd2bd1c21fa41e Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
prashantwason closed pull request #9431: Bumping release candidate number 1
URL: https://github.com/apache/hudi/pull/9431
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To uns
hudi-bot commented on PR #9433:
URL: https://github.com/apache/hudi/pull/9433#issuecomment-1675397975
## CI report:
* 32538d15eea7ed25ca8f0f8efbdd2bd1c21fa41e UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
prashantwason opened a new pull request, #9434:
URL: https://github.com/apache/hudi/pull/9434
### Change Logs
_Describe context and summary for this change. Highlight if any code was
copied._
### Impact
_Describe any public API or user-facing feature change or any perfor
[
https://issues.apache.org/jira/browse/HUDI-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6686:
-
Labels: pull-request-available (was: )
> Handling empty commit for s3 Incr job
>
lokesh-lingarajan-0310 opened a new pull request, #9433:
URL: https://github.com/apache/hudi/pull/9433
### Change Logs
Handling empty commit and returning current batch's endpoint to handle
scenarios of customer configuring filters for specific objects in s3 among
other objects.
hudi-bot commented on PR #9431:
URL: https://github.com/apache/hudi/pull/9431#issuecomment-1675300491
## CI report:
* 0169afc0895d3d5fb7ad23a6ecf744cdf54a5a86 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
This is an automated email from the ASF dual-hosted git repository.
bhavanisudha pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new b8a0e75494b [DOCS] Update Indexing and F
bhasudha merged PR #9346:
URL: https://github.com/apache/hudi/pull/9346
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.
Lokesh Lingarajan created HUDI-6686:
---
Summary: Handling empty commit for s3 Incr job
Key: HUDI-6686
URL: https://issues.apache.org/jira/browse/HUDI-6686
Project: Apache Hudi
Issue Type: Tas
nsivabalan commented on code in PR #9346:
URL: https://github.com/apache/hudi/pull/9346#discussion_r1291705672
##
website/docs/indexing.md:
##
@@ -20,34 +24,90 @@ _Figure: Comparison of merge cost for updates (yellow
blocks) against base files
## Index Types in Hudi
-Curre
bhasudha commented on code in PR #9346:
URL: https://github.com/apache/hudi/pull/9346#discussion_r1291692336
##
website/docs/indexing.md:
##
@@ -20,34 +24,90 @@ _Figure: Comparison of merge cost for updates (yellow
blocks) against base files
## Index Types in Hudi
-Current
[
https://issues.apache.org/jira/browse/HUDI-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6685:
-
Labels: pull-request-available (was: )
> Fix code typo in quick start guide under pyspark "Insert
amrishlal opened a new pull request, #9432:
URL: https://github.com/apache/hudi/pull/9432
Fix code typo in pyspark 'Insert Overwrite' section of Quick Start Guide.
### Change Logs
Fix code typo in pyspark 'Insert Overwrite' section of Quick Start Guide.
### Impact
bhasudha commented on code in PR #9346:
URL: https://github.com/apache/hudi/pull/9346#discussion_r1291685815
##
website/docs/indexing.md:
##
@@ -20,34 +24,90 @@ _Figure: Comparison of merge cost for updates (yellow
blocks) against base files
## Index Types in Hudi
-Current
Amrish Lal created HUDI-6685:
Summary: Fix code typo in quick start guide under pyspark "Insert
Overwrite" section.
Key: HUDI-6685
URL: https://issues.apache.org/jira/browse/HUDI-6685
Project: Apache Hudi
bhasudha commented on code in PR #9346:
URL: https://github.com/apache/hudi/pull/9346#discussion_r1291682097
##
website/docs/indexing.md:
##
@@ -20,34 +24,90 @@ _Figure: Comparison of merge cost for updates (yellow
blocks) against base files
## Index Types in Hudi
-Current
bhasudha commented on code in PR #9346:
URL: https://github.com/apache/hudi/pull/9346#discussion_r1291674781
##
website/docs/indexing.md:
##
@@ -20,34 +24,90 @@ _Figure: Comparison of merge cost for updates (yellow
blocks) against base files
## Index Types in Hudi
-Current
nsivabalan commented on code in PR #9346:
URL: https://github.com/apache/hudi/pull/9346#discussion_r1291627907
##
website/docs/indexing.md:
##
@@ -20,34 +24,90 @@ _Figure: Comparison of merge cost for updates (yellow
blocks) against base files
## Index Types in Hudi
-Curre
hudi-bot commented on PR #9431:
URL: https://github.com/apache/hudi/pull/9431#issuecomment-1675168634
## CI report:
* 0169afc0895d3d5fb7ad23a6ecf744cdf54a5a86 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
bhasudha merged PR #9429:
URL: https://github.com/apache/hudi/pull/9429
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.
This is an automated email from the ASF dual-hosted git repository.
bhavanisudha pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new a0dc7e93b5e [DOCS] Update clustering pag
yihua merged PR #9428:
URL: https://github.com/apache/hudi/pull/9428
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 735bfb16597 [DOCS] Update compaction page (#942
hudi-bot commented on PR #9431:
URL: https://github.com/apache/hudi/pull/9431#issuecomment-1675118764
## CI report:
* 0169afc0895d3d5fb7ad23a6ecf744cdf54a5a86 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
prashantwason opened a new pull request, #9431:
URL: https://github.com/apache/hudi/pull/9431
### Change Logs
_Describe context and summary for this change. Highlight if any code was
copied._
### Impact
_Describe any public API or user-facing feature change or any perfor
This is an automated email from the ASF dual-hosted git repository.
pwason pushed a commit to branch release-0.14.0
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 0169afc0895d3d5fb7ad23a6ecf744cdf54a5a86
Author: Prashant Wason
AuthorDate: Tue Aug 8 14:12:17 2023 -0700
Bum
This is an automated email from the ASF dual-hosted git repository.
pwason pushed a change to branch release-0.14.0
in repository https://gitbox.apache.org/repos/asf/hudi.git
discard dddfe85f1c1 Create release branch for version 0.14.0.
new 0169afc0895 Bumping release candidate number 1
T
This is an automated email from the ASF dual-hosted git repository.
codope pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 05ac0113165 [HUDI-6553] Speedup column stats and b
codope merged PR #9223:
URL: https://github.com/apache/hudi/pull/9223
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.or
hudi-bot commented on PR #9223:
URL: https://github.com/apache/hudi/pull/9223#issuecomment-1674749373
## CI report:
* d773045840e52ecc767bfa8716a3a3287ee6aa93 UNKNOWN
* 482f63ffe2df3fbaf0176a175b530082e0f31154 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #9425:
URL: https://github.com/apache/hudi/pull/9425#issuecomment-1674643707
## CI report:
* fd8df70aa04ad91eb10da4cf1e94a7978626a40c Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1926
bhasudha commented on PR #9429:
URL: https://github.com/apache/hudi/pull/9429#issuecomment-1674588209
Tested locally!
 were added to refs/heads/master by this push:
new f4832d9903f [HUDI-6663] New Parquet File Format re
empcl commented on PR #9425:
URL: https://github.com/apache/hudi/pull/9425#issuecomment-1674480250
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To u
codope merged PR #9409:
URL: https://github.com/apache/hudi/pull/9409
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.or
xuzifu666 opened a new issue, #9427:
URL: https://github.com/apache/hudi/issues/9427
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
- Join the mailing list to engage in conversations and get faster support at
dev-subscr
SteNicholas commented on issue #9424:
URL: https://github.com/apache/hudi/issues/9424#issuecomment-1674472732
@JingFengWang, you could use `TIMESTAMP_LTZ` type to solve the above
problem. I have tested that uses `TIMESTAMP_LTZ` type and worked well.
--
This is an automated message from th
Hans-Raintree opened a new issue, #9426:
URL: https://github.com/apache/hudi/issues/9426
**Describe the problem you faced**
When reading cdc logs the partition path is included in the before/after
columns, but not as a top level column, so I can't filter to specific
partitions before
SteNicholas opened a new pull request, #8437:
URL: https://github.com/apache/hudi/pull/8437
### Change Logs
`HoodieTableSource` supports the implementation of `SupportsFilterPushDown`
interface that pushes down the `CallExpression` filter into `FileIndex`.
`HoodieTableSource` should
SteNicholas closed pull request #8437: [HUDI-6066] HoodieTableSource supports
parquet predicate push down
URL: https://github.com/apache/hudi/pull/8437
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
hudi-bot commented on PR #9425:
URL: https://github.com/apache/hudi/pull/9425#issuecomment-1674371956
## CI report:
* fd8df70aa04ad91eb10da4cf1e94a7978626a40c Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1926
hudi-bot commented on PR #8437:
URL: https://github.com/apache/hudi/pull/8437#issuecomment-1674369184
## CI report:
* 4fdb9dc536d97832f1dc16dd1c754ce7015b1bc6 UNKNOWN
* 9c3005ffd94d8ed4d1d0e50ad1511b46365519ac UNKNOWN
* c85fe5d97a90a9a93eac7d126b42657d65fb96b6 Azure:
[SUCCES
hudi-bot commented on PR #9425:
URL: https://github.com/apache/hudi/pull/9425#issuecomment-1674361960
## CI report:
* fd8df70aa04ad91eb10da4cf1e94a7978626a40c UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #8437:
URL: https://github.com/apache/hudi/pull/8437#issuecomment-1674360221
## CI report:
* 4fdb9dc536d97832f1dc16dd1c754ce7015b1bc6 UNKNOWN
* 9c3005ffd94d8ed4d1d0e50ad1511b46365519ac UNKNOWN
* c85fe5d97a90a9a93eac7d126b42657d65fb96b6 Azure:
[SUCCES
SteNicholas commented on code in PR #8437:
URL: https://github.com/apache/hudi/pull/8437#discussion_r1291005999
##
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/table/ITTestHoodieDataSource.java:
##
@@ -1553,14 +1553,14 @@ void testBuiltinFunctionWithCatalog(Str
empcl opened a new pull request, #9425:
URL: https://github.com/apache/hudi/pull/9425
… hive-async database exists
### Change Logs
When invalidate the table in the spark sql query cache, verify if the
hive-async database exists
### Impact
When invalidate the table in
PhantomHunt commented on issue #9344:
URL: https://github.com/apache/hudi/issues/9344#issuecomment-1674331138
Yes, this file is not there in our S3 bucket.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
SteNicholas commented on PR #8437:
URL: https://github.com/apache/hudi/pull/8437#issuecomment-1674329768
@danny0405, I have added test case whether the parquet predicate push down.
PTAL.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
empcl commented on code in PR #9297:
URL: https://github.com/apache/hudi/pull/9297#discussion_r1290981444
##
hudi-sync/hudi-hive-sync/pom.xml:
##
@@ -200,6 +200,9 @@
+
+ false
+
Review Comment:
`
org.apa
empcl commented on code in PR #9297:
URL: https://github.com/apache/hudi/pull/9297#discussion_r1290981444
##
hudi-sync/hudi-hive-sync/pom.xml:
##
@@ -200,6 +200,9 @@
+
+ false
+
Review Comment:
`
org.apa
empcl commented on code in PR #9297:
URL: https://github.com/apache/hudi/pull/9297#discussion_r1290981072
##
hudi-sync/hudi-hive-sync/pom.xml:
##
@@ -200,6 +200,9 @@
+
+ false
+
Review Comment:
org.apac
leosanqing commented on code in PR #9297:
URL: https://github.com/apache/hudi/pull/9297#discussion_r1290969842
##
hudi-sync/hudi-hive-sync/pom.xml:
##
@@ -200,6 +200,9 @@
+
+ false
+
Review Comment:
And when I add
75 matches
Mail list logo
