codecov-io commented on pull request #2634:
URL: https://github.com/apache/hudi/pull/2634#issuecomment-791203944
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2634?src=pr&el=h1) Report
> Merging
[#2634](https://codecov.io/gh/apache/hudi/pull/2634?src=pr&el=desc) (ccf9a8f)
into
[ma
garyli1019 commented on pull request #2634:
URL: https://github.com/apache/hudi/pull/2634#issuecomment-791202125
@xiarixiaoyao your force push already triggered the CI. Do you mean JIRA
contributor access? If so, would you send an email to the dev mailing list with
your JIRA ID? That's how
xiarixiaoyao commented on pull request #2634:
URL: https://github.com/apache/hudi/pull/2634#issuecomment-791188663
Thank you @garyli1019
but I don't have permission to trigger CI, could you help.
BYT, could you give me the contributor permission? thank you
--
satishkotha commented on a change in pull request #2635:
URL: https://github.com/apache/hudi/pull/2635#discussion_r588059204
##
File path:
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/storage/TestHoodieFileWriterFactory.java
##
@@ -64,4 +80,246 @@ public void
satishkotha opened a new pull request #2635:
URL: https://github.com/apache/hudi/pull/2635
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the
[
https://issues.apache.org/jira/browse/HUDI-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang updated HUDI-1636:
---
Fix Version/s: 0.8.0
> Support Builder Pattern To Build Table Properties For HoodieTableConfig
> ---
This is an automated email from the ASF dual-hosted git repository.
vinoyang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new bc883db [HUDI-1636] Support Builder Pattern To
[
https://issues.apache.org/jira/browse/HUDI-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang closed HUDI-1636.
--
Resolution: Done
> Support Builder Pattern To Build Table Properties For HoodieTableConfig
> -
yanghua merged pull request #2596:
URL: https://github.com/apache/hudi/pull/2596
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
yanghua commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r588054717
##
File path:
hudi-examples/src/main/java/org/apache/hudi/examples/java/HoodieJavaWriteClientExample.java
##
@@ -72,8 +72,11 @@ public static void main(Stri
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new f53bca4 [HUDI-1655] Support custom date format
xushiyan merged pull request #2621:
URL: https://github.com/apache/hudi/pull/2621
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
codecov-io edited a comment on pull request #2625:
URL: https://github.com/apache/hudi/pull/2625#issuecomment-789780238
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=h1) Report
> Merging
[#2625](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=desc) (369d44f)
in
codecov-io edited a comment on pull request #2625:
URL: https://github.com/apache/hudi/pull/2625#issuecomment-789780238
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=h1) Report
> Merging
[#2625](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=desc) (369d44f)
in
codecov-io edited a comment on pull request #2625:
URL: https://github.com/apache/hudi/pull/2625#issuecomment-789780238
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=h1) Report
> Merging
[#2625](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=desc) (369d44f)
in
nsivabalan edited a comment on pull request #2625:
URL: https://github.com/apache/hudi/pull/2625#issuecomment-789746642
CC @vinothchandar @garyli1019 @bvaradar
This is an automated message from the Apache Git Service.
To res
nsivabalan removed a comment on pull request #2625:
URL: https://github.com/apache/hudi/pull/2625#issuecomment-789746287
@umehrot2 @zhedoubushishi : Can you folks help me out here. I see we have
added support for spark3 [here](https://github.com/apache/hudi/pull/2208). Did
we test the bund
Nishith Agarwal created HUDI-1666:
-
Summary: Refactor BaseCleanActionExecutor to return
List
Key: HUDI-1666
URL: https://issues.apache.org/jira/browse/HUDI-1666
Project: Apache Hudi
Issue Ty
xiarixiaoyao edited a comment on pull request #2634:
URL: https://github.com/apache/hudi/pull/2634#issuecomment-791119070
cc @garyli1019 , could you take a look
This is an automated message from the Apache Git Service.
To re
xiarixiaoyao edited a comment on pull request #2634:
URL: https://github.com/apache/hudi/pull/2634#issuecomment-791119070
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Gi
xiarixiaoyao commented on pull request #2634:
URL: https://github.com/apache/hudi/pull/2634#issuecomment-791119070
cc @garyli1019
This is an automated message from the Apache Git Service.
To respond to the message, please lo
Nishith Agarwal created HUDI-1665:
-
Summary: Remove autoCommit option from BaseCommitActionExecutor
Key: HUDI-1665
URL: https://issues.apache.org/jira/browse/HUDI-1665
Project: Apache Hudi
Is
[
https://issues.apache.org/jira/browse/HUDI-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishith Agarwal reassigned HUDI-1486:
-
Assignee: Nishith Agarwal
> Remove pending rollback and move to cleaner
> ---
[
https://issues.apache.org/jira/browse/HUDI-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1662:
-
Labels: pull-request-available (was: )
> Failed to query real-time view use hive/spark-sql when
[
https://issues.apache.org/jira/browse/HUDI-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishith Agarwal updated HUDI-1486:
--
Status: Patch Available (was: In Progress)
> Remove pending rollback and move to cleaner
>
[
https://issues.apache.org/jira/browse/HUDI-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishith Agarwal updated HUDI-1486:
--
Status: Open (was: New)
> Remove pending rollback and move to cleaner
> ---
[
https://issues.apache.org/jira/browse/HUDI-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishith Agarwal updated HUDI-1486:
--
Status: In Progress (was: Open)
> Remove pending rollback and move to cleaner
> ---
xiarixiaoyao opened a new pull request #2634:
URL: https://github.com/apache/hudi/pull/2634
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of th
[
https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1655:
-
Description:
Add a config to allow parsing custom date format in
{{DatePartitionPathSelector}}. Currently
[
https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1655:
-
Summary: Support custom date format and fix unsupported exception in
DatePartitionPathSelector (was: Allo
xushiyan commented on pull request #2621:
URL: https://github.com/apache/hudi/pull/2621#issuecomment-791115825
> @xushiyan It would be also good to change the title of the PR to add more
information about fixing the bug?
@yanghua ok done. Pls check. Thanks.
[
https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1655:
-
Description:
Add a config to allow parsing custom date format in
{{DatePartitionPathSelector}}. Currently
yanghua commented on pull request #2621:
URL: https://github.com/apache/hudi/pull/2621#issuecomment-791113338
@xushiyan It would be also good to change the title of the PR to add more
information about fixing the bug?
This i
yanghua commented on a change in pull request #2621:
URL: https://github.com/apache/hudi/pull/2621#discussion_r587994448
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/DatePartitionPathSelector.java
##
@@ -130,20 +140,19 @@ public DatePart
root18039532923 commented on issue #2614:
URL: https://github.com/apache/hudi/issues/2614#issuecomment-791105284
I need the jar of the patch which you opened to test,but I am using
inner-net. @satishkotha
This is an automat
[
https://issues.apache.org/jira/browse/HUDI-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao meng updated HUDI-1662:
---
Description:
step1: prepare raw DataFrame with DateType, and insert it to HudiMorTable
df_raw.withColumn("dat
[
https://issues.apache.org/jira/browse/HUDI-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao meng updated HUDI-1662:
---
Description:
step1: prepare raw DataFrame with DateType, and insert it to HudiMorTable
df_raw.withColumn("dat
[
https://issues.apache.org/jira/browse/HUDI-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen closed HUDI-1664.
Resolution: Duplicate
> Streaming read for Flink MOR table
> --
>
>
Danny Chen created HUDI-1663:
Summary: Streaming read for Flink MOR table
Key: HUDI-1663
URL: https://issues.apache.org/jira/browse/HUDI-1663
Project: Apache Hudi
Issue Type: Sub-task
C
Danny Chen created HUDI-1664:
Summary: Streaming read for Flink MOR table
Key: HUDI-1664
URL: https://issues.apache.org/jira/browse/HUDI-1664
Project: Apache Hudi
Issue Type: Sub-task
C
[
https://issues.apache.org/jira/browse/HUDI-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao meng updated HUDI-1662:
---
Description:
step1: prepare raw DataFrame with DateType, and insert it to HudiMorTable
df_raw.withColumn("dat
tao meng created HUDI-1662:
--
Summary: Failed to query real-time view use hive/spark-sql when
hudi mor table contains dateType
Key: HUDI-1662
URL: https://issues.apache.org/jira/browse/HUDI-1662
Project: Apa
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.
from 89003bc [HUDI-1647] Supports snapshot read for Flink (#2613)
add 7cc75e0 [HUDI-1646] Provide mechanism to read
n3nash merged pull request #2611:
URL: https://github.com/apache/hudi/pull/2611
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
xushiyan commented on a change in pull request #2621:
URL: https://github.com/apache/hudi/pull/2621#discussion_r587949226
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/DatePartitionPathSelector.java
##
@@ -130,20 +140,19 @@ public DatePar
xushiyan commented on a change in pull request #2621:
URL: https://github.com/apache/hudi/pull/2621#discussion_r587949226
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/DatePartitionPathSelector.java
##
@@ -130,20 +140,19 @@ public DatePar
[
https://issues.apache.org/jira/browse/HUDI-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang closed HUDI-1647.
--
Resolution: Implemented
Implemented via master branch: 89003bc7801b035b5be31c76bfbf691bfcf9081a
> Supports snap
[
https://issues.apache.org/jira/browse/HUDI-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang updated HUDI-1647:
---
Fix Version/s: 0.8.0
> Supports snapshot read for Flink
>
>
>
yanghua merged pull request #2613:
URL: https://github.com/apache/hudi/pull/2613
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
This is an automated email from the ASF dual-hosted git repository.
vinoyang pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.
from 899ae70 [HUDI-1587] Add latency and freshness support (#2541)
add 89003bc [HUDI-1647] Supports snapshot read f
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new a2efa69 Travis CI build asf-site
a2efa69 is d
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 2619964 [DOCS] Update 0_4_docker_demo.cn.md (
vinothchandar merged pull request #2629:
URL: https://github.com/apache/hudi/pull/2629
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
bvaradar commented on issue #2620:
URL: https://github.com/apache/hudi/issues/2620#issuecomment-790975178
@nsivabalan is looking into this.
This is an automated message from the Apache Git Service.
To respond to the message,
umehrot2 edited a comment on issue #2592:
URL: https://github.com/apache/hudi/issues/2592#issuecomment-790955939
@codejoyan I think the problem stems because you are using
`org.apache.spark:spark-avro_2.11:2.4.4` in you packages with spark-submit.
This is incompatible with `spark-sql 2.3.0
umehrot2 commented on issue #2592:
URL: https://github.com/apache/hudi/issues/2592#issuecomment-790955939
@codejoyan I think the problem stems because you are using
`org.apache.spark:spark-avro_2.11:2.4.4` in you packages with spark-submit.
This is incompatible with `spark-sql 2.3.0` that
satishkotha commented on issue #2589:
URL: https://github.com/apache/hudi/issues/2589#issuecomment-790942436
yeah, column deletions are not supported today. You can consider making all
columns optional and continue writing null for fields that you want to delete.
@bvaradar Could you
codecov-io edited a comment on pull request #2632:
URL: https://github.com/apache/hudi/pull/2632#issuecomment-790858581
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2632?src=pr&el=h1) Report
> Merging
[#2632](https://codecov.io/gh/apache/hudi/pull/2632?src=pr&el=desc) (52706ea)
in
satishkotha commented on issue #2614:
URL: https://github.com/apache/hudi/issues/2614#issuecomment-790940752
@root18039532923 Did you get a chance to try this patch? We can merge patch
after your testing looks good.
This is
satishkotha commented on a change in pull request #2627:
URL: https://github.com/apache/hudi/pull/2627#discussion_r587802720
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/NonpartitionedKeyGenerator.java
##
@@ -20,20 +20,32 @@
import org.ap
vinothchandar edited a comment on issue #2633:
URL: https://github.com/apache/hudi/issues/2633#issuecomment-790926531
@n3nash so seems to corroborate with udit's finding then.
cc @bvaradar as well, who can comment on the suggested fix.
-
vinothchandar commented on issue #2633:
URL: https://github.com/apache/hudi/issues/2633#issuecomment-790926531
cc @bvaradar as well, who can confirm.
This is an automated message from the Apache Git Service.
To respond to th
n3nash commented on issue #2633:
URL: https://github.com/apache/hudi/issues/2633#issuecomment-790917128
@umehrot2 From what you are describing, it looks like a bug. When we
configure HbaseIndex, we automatically assume
```
public boolean canIndexLogFiles() {
return true;
modi95 commented on pull request #2628:
URL: https://github.com/apache/hudi/pull/2628#issuecomment-790916909
@nbalajee these changes look good to me. Can try doing the following:
- Run schema evolution test suite in the docker setup (step-by-step guide
available in test-suite readme)
umehrot2 commented on issue #2633:
URL: https://github.com/apache/hudi/issues/2633#issuecomment-790891245
@bvaradar can you confirm that the finding is correct since it seems you
worked on that file system view implementation ? Also cc @n3nash @vinothchandar
-
umehrot2 opened a new issue #2633:
URL: https://github.com/apache/hudi/issues/2633
**Describe the problem you faced**
IHAC who is using Hudi's `Spark structured streaming sink` with
`asynchronous compaction` and `Hbase Index` on EMR. The Hudi version being used
is 0.6.0. After a whi
vinothchandar commented on a change in pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#discussion_r587049910
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -30,16 +31,19 @@
import org.ap
codecov-io commented on pull request #2632:
URL: https://github.com/apache/hudi/pull/2632#issuecomment-790858581
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2632?src=pr&el=h1) Report
> Merging
[#2632](https://codecov.io/gh/apache/hudi/pull/2632?src=pr&el=desc) (fd53720)
into
[ma
[
https://issues.apache.org/jira/browse/HUDI-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1661:
-
Labels: pull-request-available (was: )
> Change utility methods that help get extra metadata to i
satishkotha opened a new pull request #2632:
URL: https://github.com/apache/hudi/pull/2632
## What is the purpose of the pull request
Exclude internal rewrite commit such as clustering commits from
getExtraMetadataFromLatest API
## Brief change log
getExtraMetadataFromLatest AP
satish created HUDI-1661:
Summary: Change utility methods that help get extra metadata to
ignore internal rewrite commits
Key: HUDI-1661
URL: https://issues.apache.org/jira/browse/HUDI-1661
Project: Apache Hu
n3nash commented on pull request #2628:
URL: https://github.com/apache/hudi/pull/2628#issuecomment-790821135
@modi95 can you review this ?
This is an automated message from the Apache Git Service.
To respond to the message, p
codecov-io edited a comment on pull request #2611:
URL: https://github.com/apache/hudi/pull/2611#issuecomment-787641189
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2611?src=pr&el=h1) Report
> Merging
[#2611](https://codecov.io/gh/apache/hudi/pull/2611?src=pr&el=desc) (427523d)
in
n3nash opened a new pull request #2631:
URL: https://github.com/apache/hudi/pull/2631
## What is the purpose of the pull request
*This PR fixes a bug to ensure that pending compaction & clustering
operations are always excluded when performing inflight rollbacks*
## Committer
Nishith Agarwal created HUDI-1660:
-
Summary: Exclude pending compaction & clustering from rollback
Key: HUDI-1660
URL: https://issues.apache.org/jira/browse/HUDI-1660
Project: Apache Hudi
Iss
[
https://issues.apache.org/jira/browse/HUDI-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fredrick jose antony cruz updated HUDI-1656:
Description:
spark-submit --jars
/u/users/svcordrdats/order_hudi_poc/hudi-s
[
https://issues.apache.org/jira/browse/HUDI-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
pengzhiwei updated HUDI-1659:
-
Summary: Support DDL And Insert For Hudi In Spark Sql (was: DDL Support
For Hudi In Spark Sql)
> Suppor
rswagatika commented on issue #2564:
URL: https://github.com/apache/hudi/issues/2564#issuecomment-790707124
@bvaradar Hi I was able to get the files but the driver log am trying will
provide you once i have it. Let me know if this is what you meaning for
recursive s3 dataset?
2021-
pengzhiwei created HUDI-1659:
Summary: DDL Support For Hudi In Spark Sql
Key: HUDI-1659
URL: https://issues.apache.org/jira/browse/HUDI-1659
Project: Apache Hudi
Issue Type: Sub-task
Co
pengzhiwei created HUDI-1658:
Summary: Spark Sql Support For Hudi
Key: HUDI-1658
URL: https://issues.apache.org/jira/browse/HUDI-1658
Project: Apache Hudi
Issue Type: New Feature
Compon
guanziyue opened a new issue #2630:
URL: https://github.com/apache/hudi/issues/2630
**Describe the problem you faced**
In the UpsertPartitioner class, the method called averageBytesPerRecord is
used to evaluate the average record size according to previous commits. There
is a fileSi
danny0405 commented on a change in pull request #2613:
URL: https://github.com/apache/hudi/pull/2613#discussion_r587409966
##
File path:
hudi-flink/src/main/resources/META-INF/services/org.apache.flink.table.factories.TableFactory
##
@@ -0,0 +1,17 @@
+# Licensed to the Apache
yanghua commented on a change in pull request #2621:
URL: https://github.com/apache/hudi/pull/2621#discussion_r587389540
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/DatePartitionPathSelector.java
##
@@ -130,20 +140,19 @@ public DatePart
garyli1019 commented on a change in pull request #2613:
URL: https://github.com/apache/hudi/pull/2613#discussion_r587262267
##
File path:
hudi-flink/src/main/resources/META-INF/services/org.apache.flink.table.factories.TableFactory
##
@@ -0,0 +1,17 @@
+# Licensed to the Apache
chaplinthink opened a new pull request #2629:
URL: https://github.com/apache/hudi/pull/2629
Fix docs hive_sync path
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
85 matches
Mail list logo
