codecov-io edited a comment on pull request #2640:
URL: https://github.com/apache/hudi/pull/2640#issuecomment-791887408
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2640?src=pr=h1) Report
> Merging
[#2640](https://codecov.io/gh/apache/hudi/pull/2640?src=pr=desc) (16b2d89)
into
codecov-io commented on pull request #2640:
URL: https://github.com/apache/hudi/pull/2640#issuecomment-791887408
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2640?src=pr=h1) Report
> Merging
[#2640](https://codecov.io/gh/apache/hudi/pull/2640?src=pr=desc) (16b2d89)
into
[
https://issues.apache.org/jira/browse/HUDI-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1663:
-
Labels: pull-request-available (was: )
> Streaming read for Flink MOR table
>
danny0405 opened a new pull request #2640:
URL: https://github.com/apache/hudi/pull/2640
## What is the purpose of the pull request
Support streaming read for HUDI Flink MOR table.
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in
codecov-io edited a comment on pull request #2628:
URL: https://github.com/apache/hudi/pull/2628#issuecomment-790378502
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2628?src=pr=h1) Report
> Merging
[#2628](https://codecov.io/gh/apache/hudi/pull/2628?src=pr=desc) (71b53bd)
into
afeldman1 opened a new issue #2639:
URL: https://github.com/apache/hudi/issues/2639
Using Hudi 0.6.0, updated from Spark 2.4.7 on EMR 5.32.0 to Spark 3.0.1 on
EMR 6.2.0, there is a significant slowdown on writing into Hudi tables. With
Spark 2.4.7 the process writing into the Hudi table
yanghua commented on a change in pull request #2638:
URL: https://github.com/apache/hudi/pull/2638#discussion_r588828682
##
File path: hudi-flink/src/main/java/org/apache/hudi/util/StreamerUtil.java
##
@@ -19,6 +19,7 @@
package org.apache.hudi.util;
import
yanghua commented on a change in pull request #2638:
URL: https://github.com/apache/hudi/pull/2638#discussion_r588828682
##
File path: hudi-flink/src/main/java/org/apache/hudi/util/StreamerUtil.java
##
@@ -19,6 +19,7 @@
package org.apache.hudi.util;
import
Nishith Agarwal created HUDI-1671:
-
Summary: Update docker demo with an example of how to do
concurrent writes
Key: HUDI-1671
URL: https://issues.apache.org/jira/browse/HUDI-1671
Project: Apache Hudi
Nishith Agarwal created HUDI-1670:
-
Summary: Documentation of configs and use of Optimistic Locks
Key: HUDI-1670
URL: https://issues.apache.org/jira/browse/HUDI-1670
Project: Apache Hudi
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588775163
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/lock/LockProvider.java
##
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache Software
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588774464
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/model/WriteConcurrencyMode.java
##
@@ -0,0 +1,66 @@
+/*
+ * Licensed to the Apache
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588771691
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/bootstrap/SparkBootstrapCommitActionExecutor.java
##
@@ -222,6
xushiyan commented on pull request #2638:
URL: https://github.com/apache/hudi/pull/2638#issuecomment-791744407
@vinothchandar how would this bypass CI 樂
This is an automated message from the Apache Git Service.
To respond
codecov-io commented on pull request #2638:
URL: https://github.com/apache/hudi/pull/2638#issuecomment-791741011
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2638?src=pr=h1) Report
> Merging
[#2638](https://codecov.io/gh/apache/hudi/pull/2638?src=pr=desc) (1c476b7)
into
xushiyan opened a new pull request #2638:
URL: https://github.com/apache/hudi/pull/2638
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 11ad4ed [HUDI-1661] Exclude clustering commits
n3nash merged pull request #2632:
URL: https://github.com/apache/hudi/pull/2632
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
Nishith Agarwal created HUDI-1669:
-
Summary: Add tests for checking candidate instants to rollback
Key: HUDI-1669
URL: https://issues.apache.org/jira/browse/HUDI-1669
Project: Apache Hudi
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588685863
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieLockConfig.java
##
@@ -0,0 +1,191 @@
+/*
+ * Licensed to the
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588684413
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java
##
@@ -43,7 +43,8 @@
public static
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588682179
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/ZookeeperBasedLockProvider.java
##
@@ -0,0 +1,161
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588672526
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/SimpleConcurrentFileWritesConflictResolutionStrategy.java
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588662387
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/SimpleConcurrentFileWritesConflictResolutionStrategy.java
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588660702
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/lock/ZookeeperBasedLockProvider.java
##
@@ -0,0 +1,157 @@
+/*
+ *
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588656248
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/lock/SimpleConcurrentFileWritesConflictResolutionStrategy.java
##
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588655275
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/lock/LockManager.java
##
@@ -0,0 +1,125 @@
+/*
+ * Licensed to the
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588654337
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/lock/HoodieCommitOperation.java
##
@@ -0,0 +1,142 @@
+/*
+ *
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588651406
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/lock/ConflictResolutionStrategy.java
##
@@ -0,0 +1,64 @@
+/*
+ *
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588650200
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -359,10 +388,21 @@ public
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588648870
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -359,10 +388,21 @@ public
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588647208
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -30,16 +31,19 @@
import
[
https://issues.apache.org/jira/browse/HUDI-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1660:
-
Labels: pull-request-available (was: )
> Exclude pending compaction & clustering from rollback
>
This is an automated email from the ASF dual-hosted git repository.
satish pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new f2159c4 [HUDI-1660] Excluding compaction and
satishkotha merged pull request #2631:
URL: https://github.com/apache/hudi/pull/2631
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
satishkotha commented on pull request #2631:
URL: https://github.com/apache/hudi/pull/2631#issuecomment-791626693
LGTM. Maybe create a ticket for adding unit test so this wont be missed (if
you havent already created one)
n3nash commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r588086851
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/lock/SimpleConcurrentFileWritesConflictResolutionStrategy.java
##
@@ -0,0
[
https://issues.apache.org/jira/browse/HUDI-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
pengzhiwei updated HUDI-1659:
-
Description:
The Basic Implement include the follow things based on DataSource V1:
1、CREATE TABLE FOR
[
https://issues.apache.org/jira/browse/HUDI-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
pengzhiwei updated HUDI-1659:
-
Description:
The Basic Implement include the follow things:
1、CREATE TABLE FOR HOODIE
2、CTAS
3、INSERT
[
https://issues.apache.org/jira/browse/HUDI-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
pengzhiwei updated HUDI-1659:
-
Summary: Basic Implement Of Spark Sql Support For Hoodie (was: Support DDL
And Insert For Hudi In Spark
[
https://issues.apache.org/jira/browse/HUDI-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1658:
-
Labels: hudi-umbrellas (was: Umbrella)
> [UMBRELLA] Spark Sql Support For Hudi
>
[
https://issues.apache.org/jira/browse/HUDI-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1658:
-
Labels: Umbrella (was: )
Summary: [UMBRELLA] Spark Sql Support For Hudi (was: Spark Sql
Sugamber opened a new issue #2637:
URL: https://github.com/apache/hudi/issues/2637
**_Tips before filing an issue_**
- Have you gone through our
[FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)?
- Join the mailing list to engage in conversations and get faster
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sugamber updated HUDI-1668:
---
Description:
Hi Team,
I'm using bulk insert option to load close to 2 TB data. The process is taking
near
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sugamber updated HUDI-1668:
---
Description:
Hi Team,
I'm using bulk insert option to load close to 2 TB data. The process is taking
near
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sugamber updated HUDI-1668:
---
Priority: Minor (was: Major)
> GlobalSortPartitioner is getting called twice during bulk_insert.
>
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sugamber updated HUDI-1668:
---
Description:
Hi Team,
I'm using bulk insert option to load close to 2 TB data. The process is taking
near
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sugamber updated HUDI-1668:
---
Description:
Hi Team,
I'm using bulk insert option to load close to 2 TB data. The process is taking
near
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sugamber updated HUDI-1668:
---
Description:
Hi Team,
I'm using bulk insert option to load close to 2 TB data. The process is taking
near
[
https://issues.apache.org/jira/browse/HUDI-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sugamber updated HUDI-1668:
---
Attachment: 2nd.png
1st.png
> GlobalSortPartitioner is getting called twice during
Sugamber created HUDI-1668:
--
Summary: GlobalSortPartitioner is getting called twice during
bulk_insert.
Key: HUDI-1668
URL: https://issues.apache.org/jira/browse/HUDI-1668
Project: Apache Hudi
Liulietong commented on pull request #2636:
URL: https://github.com/apache/hudi/pull/2636#issuecomment-791305070
hi @garyli1019 , would you take a look?
This is an automated message from the Apache Git Service.
To respond to
[
https://issues.apache.org/jira/browse/HUDI-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1667:
-
Labels: pull-request-available (was: )
> Fix bug when HoodieMergeOnReadRDD read record from base
Liulietong opened a new pull request #2636:
URL: https://github.com/apache/hudi/pull/2636
…file, Hoodie may set non-null value in field which is null if vectorization
is enabled.
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review
[
https://issues.apache.org/jira/browse/HUDI-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lietong Liu updated HUDI-1667:
--
Fix Version/s: 0.6.0
Description:
When HoodieMergeOnReadRDD read record from base file, will
Lietong Liu created HUDI-1667:
-
Summary: Fix bug when HoodieMergeOnReadRDD read record from base
file, Hoodie may set non-null value in field which is null if vectorization is
enabled.
Key: HUDI-1667
URL:
[
https://issues.apache.org/jira/browse/HUDI-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lietong Liu resolved HUDI-1583.
---
Resolution: Fixed
> Hudi will skip remaining log files if there is logFile with zero size in
>
n3nash commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r58089
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -30,16 +31,19 @@
import
58 matches
Mail list logo
