[
https://issues.apache.org/jira/browse/HUDI-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang closed HUDI-1693.
--
Resolution: Done
db9cb1c568d4180125dd654e815afa64fa2aeb2a
> Add document about HUDI Flink integration
> ---
This is an automated email from the ASF dual-hosted git repository.
vinoyang pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new db9cb1c [HUDI-1693] Add document about HUDI
yanghua merged pull request #2681:
URL: https://github.com/apache/hudi/pull/2681
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
yanghua commented on a change in pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#discussion_r595738988
##
File path: docs/_docs/1_6_flink_quick_start_guide.md
##
@@ -0,0 +1,169 @@
+---
+title: "Quick-Start Guide"
+permalink: /docs/flink-quick-start-guide.html
nsivabalan commented on a change in pull request #2655:
URL: https://github.com/apache/hudi/pull/2655#discussion_r595725356
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
##
@@ -201,9 +200,12 @@ private[hudi] object Hoo
n3nash commented on a change in pull request #2655:
URL: https://github.com/apache/hudi/pull/2655#discussion_r595703338
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
##
@@ -201,9 +200,12 @@ private[hudi] object HoodieS
codecov-io edited a comment on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-792430670
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=h1) Report
> Merging
[#2645](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=desc) (fe988d1)
in
codecov-io edited a comment on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-792430670
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=h1) Report
> Merging
[#2645](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=desc) (a0d9414)
in
codecov-io edited a comment on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-792430670
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=h1) Report
> Merging
[#2645](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=desc) (cc6e04b)
in
rubenssoto opened a new issue #2688:
URL: https://github.com/apache/hudi/issues/2688
Hello,
I'm trying to sync with hive in EMR 6.2 using metastore
Emr Version: 6.2
Hudi Version: 6.0.0/7.0.0
Spark Session:
spark_session = (
SparkSession.builder.appName(s
danny0405 commented on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-800748973
> Here is the issue for the follow up ->
https://issues.apache.org/jira/browse/HUDI-1698. I'll work with you guys
offline @danny0405 @yanghua @leesf
Thanks for the notion,
rubenssoto commented on issue #2664:
URL: https://github.com/apache/hudi/issues/2664#issuecomment-800748833
Thank you, I will try if necessary I open this issue again, thank you
This is an automated message from the Apache Gi
liujinhui1994 commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-800745638
There does not seem to be the same function as this PR at the moment
@nsivabalan
This PR inherits from here, this one
https://github.com/apache/hudi/pull/1929 wil
codecov-io edited a comment on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-797350759
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2666?src=pr&el=h1) Report
> Merging
[#2666](https://codecov.io/gh/apache/hudi/pull/2666?src=pr&el=desc) (7eeba90)
in
danny0405 commented on a change in pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#discussion_r595658218
##
File path: docs/_docs/1_6_flink_quick_start_guide.md
##
@@ -0,0 +1,169 @@
+---
+title: "Quick-Start Guide"
+permalink: /docs/flink-quick-start-guide.htm
danny0405 commented on a change in pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#discussion_r595657947
##
File path: docs/_docs/1_6_flink_quick_start_guide.md
##
@@ -0,0 +1,169 @@
+---
+title: "Quick-Start Guide"
+permalink: /docs/flink-quick-start-guide.htm
n3nash merged pull request #2374:
URL: https://github.com/apache/hudi/pull/2374
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
n3nash edited a comment on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-800685324
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub a
n3nash commented on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-800685324
Here is the issue for the follow up ->
https://issues.apache.org/jira/browse/HUDI-1698
This is an automated message
codecov-io edited a comment on pull request #2625:
URL: https://github.com/apache/hudi/pull/2625#issuecomment-789780238
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=h1) Report
> Merging
[#2625](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=desc) (0d365b9)
in
codecov-io edited a comment on pull request #2625:
URL: https://github.com/apache/hudi/pull/2625#issuecomment-789780238
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=h1) Report
> Merging
[#2625](https://codecov.io/gh/apache/hudi/pull/2625?src=pr&el=desc) (0d365b9)
in
codecov-io edited a comment on pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#issuecomment-786454326
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=h1) Report
> Merging
[#2607](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=desc) (0194bdc)
in
codecov-io edited a comment on pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#issuecomment-786454326
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=h1) Report
> Merging
[#2607](https://codecov.io/gh/apache/hudi/pull/2607?src=pr&el=desc) (0194bdc)
in
n3nash opened a new pull request #2687:
URL: https://github.com/apache/hudi/pull/2687
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc chang
[
https://issues.apache.org/jira/browse/HUDI-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1700:
-
Labels: pull-request-available (was: )
> Add video link to Hudi Uber meetup
> ---
n3nash closed pull request #2686:
URL: https://github.com/apache/hudi/pull/2686
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
Nishith Agarwal created HUDI-1700:
-
Summary: Add video link to Hudi Uber meetup
Key: HUDI-1700
URL: https://issues.apache.org/jira/browse/HUDI-1700
Project: Apache Hudi
Issue Type: Improvemen
n3nash opened a new pull request #2686:
URL: https://github.com/apache/hudi/pull/2686
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes d
n3nash closed pull request #2685:
URL: https://github.com/apache/hudi/pull/2685
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
n3nash opened a new pull request #2685:
URL: https://github.com/apache/hudi/pull/2685
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes d
[
https://issues.apache.org/jira/browse/HUDI-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302948#comment-17302948
]
Nishith Agarwal commented on HUDI-1699:
---
Quick start is broken
Docker -> Spark 2.
[
https://issues.apache.org/jira/browse/HUDI-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nishith Agarwal updated HUDI-1699:
--
Status: In Progress (was: Open)
> Fix docker demo steps with spark2/spark3
> --
Nishith Agarwal created HUDI-1699:
-
Summary: Fix docker demo steps with spark2/spark3
Key: HUDI-1699
URL: https://issues.apache.org/jira/browse/HUDI-1699
Project: Apache Hudi
Issue Type: Impr
Nishith Agarwal created HUDI-1698:
-
Summary: Multiwriting for Flink / Java
Key: HUDI-1698
URL: https://issues.apache.org/jira/browse/HUDI-1698
Project: Apache Hudi
Issue Type: Improvement
vinothchandar commented on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-800644758
cc @yanghua @danny0405 @leesf to take note for flink/java support follow up.
This is an automated message fr
nbalajee commented on a change in pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#discussion_r595568718
##
File path: hudi-client/hudi-client-common/pom.xml
##
@@ -195,6 +195,11 @@
junit-platform-commons
test
+
Review comment:
n3nash commented on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-800615737
@vinothchandar I've added curator to utilities bundle. In this PR, we don't
support locking for flink and java clients so I have not added to the flink
bundle. If you have another r
nbalajee commented on a change in pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#discussion_r595527836
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieCreateHandle.java
##
@@ -113,13 +121,15 @@ public void write(HoodieReco
nbalajee commented on a change in pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#discussion_r595527683
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieCreateHandle.java
##
@@ -60,6 +65,8 @@
protected long recordsDeleted
nbalajee commented on a change in pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#discussion_r595527355
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##
@@ -143,6 +143,9 @@
public static final Stri
Volodymyr Burenin created HUDI-1697:
---
Summary: A parallel scan needed for FS.
Key: HUDI-1697
URL: https://issues.apache.org/jira/browse/HUDI-1697
Project: Apache Hudi
Issue Type: Improvemen
codejoyan edited a comment on issue #2620:
URL: https://github.com/apache/hudi/issues/2620#issuecomment-800542037
Apologies for the delay @nsivabalan
Below are the answers to the questions you asked:
- What constitutes your record key? - _The record key is random within a
partition (
codejoyan commented on issue #2620:
URL: https://github.com/apache/hudi/issues/2620#issuecomment-800542037
Aplogies for the delay @nsivabalan
Below are the answers to the questions you asked:
- What constitutes your record key? - The record key is random within a
partition (store num
codecov-io edited a comment on pull request #2374:
URL: https://github.com/apache/hudi/pull/2374#issuecomment-750782300
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2374?src=pr&el=h1) Report
> Merging
[#2374](https://codecov.io/gh/apache/hudi/pull/2374?src=pr&el=desc) (0e7fbb3)
in
vinothchandar commented on a change in pull request #2655:
URL: https://github.com/apache/hudi/pull/2655#discussion_r595355114
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
##
@@ -201,9 +200,12 @@ private[hudi] object
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.
from 16864ae [HUDI-1695] Fixed the error messaging (#2679)
add b038623 [HUDI 1615] Fixing null schema in bulk_insert
vinothchandar merged pull request #2653:
URL: https://github.com/apache/hudi/pull/2653
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
peng-xin edited a comment on pull request #2683:
URL: https://github.com/apache/hudi/pull/2683#issuecomment-800367586
> do we really need to fix 0.7.0? we don't typically do that. We can just
fix master branch and get it into the future 0.8.0?
master branch has been fix by another o
peng-xin closed pull request #2684:
URL: https://github.com/apache/hudi/pull/2684
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
peng-xin closed pull request #2683:
URL: https://github.com/apache/hudi/pull/2683
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
peng-xin commented on pull request #2683:
URL: https://github.com/apache/hudi/pull/2683#issuecomment-800367586
> do we really need to fix 0.7.0? we don't typically do that. We can just
fix master branch and get it into the future 0.8.0?
yes,you are right
--
peng-xin commented on pull request #2684:
URL: https://github.com/apache/hudi/pull/2684#issuecomment-800365791
> @peng-xin IMO, you just need to keep one PR, close this one, and remain
#2683 . wdyt?
but the master br has the same problem
peng-xin commented on pull request #2684:
URL: https://github.com/apache/hudi/pull/2684#issuecomment-800363863
> I also see the relocation there, if I am not wrong. So unsure how this is
happening.
but the commons-codec package is not in the includeSet(maven-shade-plugin) .
---
vinothchandar commented on pull request #2683:
URL: https://github.com/apache/hudi/pull/2683#issuecomment-800340732
do we really need to fix 0.7.0? we don't typically do that. We can just fix
master branch and get it into the future 0.8.0?
vinothchandar commented on pull request #2684:
URL: https://github.com/apache/hudi/pull/2684#issuecomment-800339684
I also see the relocation there, if I am not wrong. So unsure how this is
happening.
This is an automated
yanghua commented on pull request #2684:
URL: https://github.com/apache/hudi/pull/2684#issuecomment-800338813
@peng-xin IMO, you just need to keep one PR, close this one, and remain
#2683 . wdyt?
This is an automated message
yanghua commented on a change in pull request #2684:
URL: https://github.com/apache/hudi/pull/2684#discussion_r595255420
##
File path: packaging/hudi-spark-bundle/pom.xml
##
@@ -112,6 +112,7 @@
org.apache.hbase:hbase-protocol
org.apache.hba
yanghua commented on a change in pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#discussion_r595241367
##
File path: docs/_docs/1_6_flink_quick_start_guide.md
##
@@ -0,0 +1,169 @@
+---
+title: "Quick-Start Guide"
+permalink: /docs/flink-quick-start-guide.html
peng-xin closed pull request #2682:
URL: https://github.com/apache/hudi/pull/2682
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
codecov-io edited a comment on pull request #2683:
URL: https://github.com/apache/hudi/pull/2683#issuecomment-800243025
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2683?src=pr&el=h1) Report
> Merging
[#2683](https://codecov.io/gh/apache/hudi/pull/2683?src=pr&el=desc) (f738c7c)
in
codecov-io edited a comment on pull request #2683:
URL: https://github.com/apache/hudi/pull/2683#issuecomment-800243025
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2683?src=pr&el=h1) Report
> Merging
[#2683](https://codecov.io/gh/apache/hudi/pull/2683?src=pr&el=desc) (f738c7c)
in
codecov-io commented on pull request #2683:
URL: https://github.com/apache/hudi/pull/2683#issuecomment-800243025
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2683?src=pr&el=h1) Report
> Merging
[#2683](https://codecov.io/gh/apache/hudi/pull/2683?src=pr&el=desc) (f738c7c)
into
[re
peng-xin opened a new pull request #2684:
URL: https://github.com/apache/hudi/pull/2684
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the pu
peng-xin opened a new pull request #2683:
URL: https://github.com/apache/hudi/pull/2683
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the pu
yanghua commented on a change in pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#discussion_r595095610
##
File path: docs/_docs/1_6_flink_quick_start_guide.md
##
@@ -0,0 +1,169 @@
+---
+title: "Quick-Start Guide"
+permalink: /docs/flink-quick-start-guide.html
peng-xin opened a new pull request #2682:
URL: https://github.com/apache/hudi/pull/2682
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the pu
danny0405 commented on a change in pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#discussion_r595088821
##
File path: docs/_docs/1_6_flink_quick_start_guide.md
##
@@ -0,0 +1,169 @@
+---
+title: "Quick-Start Guide"
+permalink: /docs/flink-quick-start-guide.htm
peng-xin created HUDI-1696:
--
Summary: artifactSet of maven-shade-plugin has not commons-codec
Key: HUDI-1696
URL: https://issues.apache.org/jira/browse/HUDI-1696
Project: Apache Hudi
Issue Type: Bug
yanghua commented on a change in pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#discussion_r595069913
##
File path: docs/_docs/1_6_flink_quick_start_guide.md
##
@@ -0,0 +1,169 @@
+---
+title: "Quick-Start Guide"
+permalink: /docs/flink-quick-start-guide.html
[
https://issues.apache.org/jira/browse/HUDI-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1693:
-
Labels: pull-request-available (was: )
> Add document about HUDI Flink integration
>
danny0405 commented on pull request #2681:
URL: https://github.com/apache/hudi/pull/2681#issuecomment-800041509
I want to collapse these two items but don't know how to, can som
danny0405 opened a new pull request #2681:
URL: https://github.com/apache/hudi/pull/2681
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the p
ztcheck commented on issue #2680:
URL: https://github.com/apache/hudi/issues/2680#issuecomment-800020976
All my environment is in k8s.
This is an automated message from the Apache Git Service.
To respond to the message, pleas
marrycheck opened a new issue #2680:
URL: https://github.com/apache/hudi/issues/2680
I used ```run_sync_tool.sh``` to synchronize the metadata between hudi and
hive, and there were several errors:
1. The hive metastore cannot be recognized.
Error message ```"Required table missing:
74 matches
Mail list logo
