n3nash commented on issue #2637:
URL: https://github.com/apache/hudi/issues/2637#issuecomment-812335639
@Sugamber If your issue is addressed, please close this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
n3nash closed issue #2637:
URL: https://github.com/apache/hudi/issues/2637
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact
n3nash commented on issue #2623:
URL: https://github.com/apache/hudi/issues/2623#issuecomment-812334675
@root18039532923 Not sure if you're asking how to package this but leaving a
comment here if that's what you are referring to.
1. Do a git checkout of the 0.7.0 tag. `git checkout
n3nash commented on pull request #2751:
URL: https://github.com/apache/hudi/pull/2751#issuecomment-812329664
@li36909 If I understand this correctly, you are saying reading a MOR table
`_rt` view can fail if a concurrent write is happening ?
--
This is an automated message from the
codecov-io edited a comment on pull request #2758:
URL: https://github.com/apache/hudi/pull/2758#issuecomment-812325694
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2758?src=pr=h1) Report
> Merging
[#2758](https://codecov.io/gh/apache/hudi/pull/2758?src=pr=desc) (ea0d401)
into
codecov-io commented on pull request #2758:
URL: https://github.com/apache/hudi/pull/2758#issuecomment-812325694
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2758?src=pr=h1) Report
> Merging
[#2758](https://codecov.io/gh/apache/hudi/pull/2758?src=pr=desc) (ea0d401)
into
[
https://issues.apache.org/jira/browse/HUDI-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17313551#comment-17313551
]
Harshit Mittal edited comment on HUDI-1696 at 4/2/21, 4:07 AM:
---
I started
[
https://issues.apache.org/jira/browse/HUDI-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17313551#comment-17313551
]
Harshit Mittal commented on HUDI-1696:
--
I started looking into this and realized that the fix is
hmit opened a new pull request #2758:
URL: https://github.com/apache/hudi/pull/2758
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the pull
[
https://issues.apache.org/jira/browse/HUDI-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang updated HUDI-1737:
---
Fix Version/s: 0.9.0
> Extract common method in HoodieCreateHandle & FlinkCreateHandle
>
[
https://issues.apache.org/jira/browse/HUDI-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang closed HUDI-1737.
--
Resolution: Done
94a5e72f16620da86bd2ca7ef27bb9abc266cc47
> Extract common method in HoodieCreateHandle &
yanghua merged pull request #2745:
URL: https://github.com/apache/hudi/pull/2745
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
This is an automated email from the ASF dual-hosted git repository.
vinoyang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 94a5e72 [HUDI-1737][hudi-client] Code Cleanup:
RocMarshal commented on pull request #2745:
URL: https://github.com/apache/hudi/pull/2745#issuecomment-812296838
@danny0405 Thank you so much.
Now, ping @yanghua
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
codecov-io edited a comment on pull request #2757:
URL: https://github.com/apache/hudi/pull/2757#issuecomment-812247500
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=h1) Report
> Merging
[#2757](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=desc) (2c8fc00)
into
liujinhui1994 edited a comment on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-812290646
Your suggestion is very good, please let me think about it, and then reply
to you
@nsivabalan
--
This is an automated message from the Apache Git Service.
To
liujinhui1994 commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-812290646
Your suggestion is very good, please let me think about it
@nsivabalan
--
This is an automated message from the Apache Git Service.
To respond to the message, please
[
https://issues.apache.org/jira/browse/HUDI-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xurunbai updated HUDI-1752:
---
Status: Closed (was: Patch Available)
> Add HoodieFlinkClient InsertOverwrite
>
[
https://issues.apache.org/jira/browse/HUDI-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xurunbai updated HUDI-1752:
---
Status: Patch Available (was: In Progress)
> Add HoodieFlinkClient InsertOverwrite
>
[
https://issues.apache.org/jira/browse/HUDI-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xurunbai updated HUDI-1752:
---
Status: In Progress (was: Open)
> Add HoodieFlinkClient InsertOverwrite
>
li36909 commented on pull request #2753:
URL: https://github.com/apache/hudi/pull/2753#issuecomment-812274605
cc @nsivabalan could you help to take a look, thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
li36909 commented on pull request #2751:
URL: https://github.com/apache/hudi/pull/2751#issuecomment-812271790
@nsivabalan I run the test at hudi 0.7. yes, you are right, I start a
spark-shell for upserting, and query the same table by spark datasouce api,
then the problem arises. The
root18039532923 commented on issue #2623:
URL: https://github.com/apache/hudi/issues/2623#issuecomment-812271600
how to operate this? @nsivabalan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
bvaradar commented on issue #2588:
URL: https://github.com/apache/hudi/issues/2588#issuecomment-812256475
We use hive-2.3.4 and have more than 100 jobs running
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
bvaradar closed issue #2644:
URL: https://github.com/apache/hudi/issues/2644
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
codecov-io commented on pull request #2757:
URL: https://github.com/apache/hudi/pull/2757#issuecomment-812247500
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=h1) Report
> Merging
[#2757](https://codecov.io/gh/apache/hudi/pull/2757?src=pr=desc) (b9e79e1)
into
danny0405 closed pull request #2757:
URL: https://github.com/apache/hudi/pull/2757
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
bvaradar commented on issue #2633:
URL: https://github.com/apache/hudi/issues/2633#issuecomment-812212286
@umehrot2 : Looking more closely on the code change to fix this. We need to
do more changes.
the base file check needs to change in
bvaradar edited a comment on issue #2633:
URL: https://github.com/apache/hudi/issues/2633#issuecomment-810709098
@umehrot2 @n3nash @nsivabalan : My apologies. Sorry for the delay, I
finally got chance to look into this .
Yes, this will only manifest for case when index can support
satishkotha commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-812096323
@ssdong thanks for detailed update. Yes, this one seems little tricky. We'll
need some more time to investigate. In the meantime, as a workaround, i think
you can disable embedded
This is an automated email from the ASF dual-hosted git repository.
uditme pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 684622c [HUDI-1591] Implement Spark's FileIndex
umehrot2 merged pull request #2651:
URL: https://github.com/apache/hudi/pull/2651
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
nsivabalan edited a comment on pull request #2751:
URL: https://github.com/apache/hudi/pull/2751#issuecomment-812037473
@li36909 : can you clarify what do you mean by concurrent operations.
Ignoring any table services, you mean to say that just a batch of write and rt
snapshot view
nsivabalan commented on pull request #2751:
URL: https://github.com/apache/hudi/pull/2751#issuecomment-812037473
@li36909 : can you clarify what do you mean by concurrent operations. Is it
cleaning/archiving along with a batch of write or do you say two batches of
write going concurrently
nsivabalan edited a comment on pull request #2334:
URL: https://github.com/apache/hudi/pull/2334#issuecomment-812021796
oh, didn't realize default schema compatibility check is false. I assume if
I enable schema compatibility check, double to int evolution is likely to fail.
So, not sure
nsivabalan commented on pull request #2334:
URL: https://github.com/apache/hudi/pull/2334#issuecomment-812021796
oh, didn't realize default schema compatibility check is false. I assume if
I enable schema compatibility check, double to int evolution is likely to fail.
So, not sure what
nsivabalan commented on pull request #2334:
URL: https://github.com/apache/hudi/pull/2334#issuecomment-812019464
just to clarify. some schema evolution just for types are working fine w/
hoodie. for eg: integer to double works fine. Problem is that, double to int is
where the issue is. I
nsivabalan commented on pull request #2106:
URL: https://github.com/apache/hudi/pull/2106#issuecomment-811939606
@Karl-WangSK : we have another PR being reviewed right now for partial
updates support. https://github.com/apache/hudi/pull/2666
Please check it out. We don't need to parse
[
https://issues.apache.org/jira/browse/HUDI-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1757:
-
Labels: pull-request-available (was: )
> Assigns the buckets by record key for Flink writer
>
[
https://issues.apache.org/jira/browse/HUDI-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-1757:
-
Description: Currently we assign the buckets by record partition path
which could cause hotspot if the
danny0405 opened a new pull request #2757:
URL: https://github.com/apache/hudi/pull/2757
Currently we assign the buckets by record partition path which could
cause hotspot if the partition field is datetime type. Changes to assign
buckets by grouping the record whth their key first,
Danny Chen created HUDI-1757:
Summary: Assigns the buckets by record key for Flink writer
Key: HUDI-1757
URL: https://issues.apache.org/jira/browse/HUDI-1757
Project: Apache Hudi
Issue Type:
Danny Chen created HUDI-1755:
Summary: Assigns the buckets by record key for Flink writer
Key: HUDI-1755
URL: https://issues.apache.org/jira/browse/HUDI-1755
Project: Apache Hudi
Issue Type:
Danny Chen created HUDI-1756:
Summary: Assigns the buckets by record key for Flink writer
Key: HUDI-1756
URL: https://issues.apache.org/jira/browse/HUDI-1756
Project: Apache Hudi
Issue Type:
Danny Chen created HUDI-1754:
Summary: Assigns the buckets by record key for Flink writer
Key: HUDI-1754
URL: https://issues.apache.org/jira/browse/HUDI-1754
Project: Apache Hudi
Issue Type:
Danny Chen created HUDI-1753:
Summary: Assigns the buckets by record key for Flink writer
Key: HUDI-1753
URL: https://issues.apache.org/jira/browse/HUDI-1753
Project: Apache Hudi
Issue Type:
nsivabalan commented on pull request #2091:
URL: https://github.com/apache/hudi/pull/2091#issuecomment-811931337
@ivorzhou : if your requirement is to fetch value from previous version of
the record and inject into incoming record, we already have another PR open
nsivabalan commented on a change in pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#discussion_r605601097
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##
@@ -79,6 +80,7 @@
public static final
liujinhui1994 commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-811861142
> @liujinhui1994 : Can you please update the description with an example.
1、old data
id nameage
1 liujinhui 26
2 sam 25
3 madeline
liujinhui1994 removed a comment on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-811860789
> @liujinhui1994 : Can you please update the description with an example.
一、old data
id nameage
1 liujinhui 26
2 sam 25
3
liujinhui1994 commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-811860789
> @liujinhui1994 : Can you please update the description with an example.
一、old data
id nameage
1 liujinhui 26
2 sam 25
3 madeline
liujinhui1994 commented on pull request #2438:
URL: https://github.com/apache/hudi/pull/2438#issuecomment-811856655
> Myself and Nishith discussed on this. Here is our proposal.
> Let's rely on Deltastreamer.Config.checkpoint to pass in any type of
checkpoint.
> We can add another
nsivabalan commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-811856279
@liujinhui1994 : Can you please update the description with an example.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
nsivabalan commented on pull request #2438:
URL: https://github.com/apache/hudi/pull/2438#issuecomment-81184
Myself and Nishith discussed on this. Here is our proposal.
Let's rely on Deltastreamer.Config.checkpoint to pass in any type of
checkpoint.
We can add another config
xurunbai commented on pull request #2755:
URL: https://github.com/apache/hudi/pull/2755#issuecomment-811770811
> @xurunbai Thanks for your contribution. Can you file a jira ticket for
this feature?
OK
--
This is an automated message from the Apache Git Service.
To respond to the
xurunbai closed pull request #2755:
URL: https://github.com/apache/hudi/pull/2755
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
xurunbai created HUDI-1752:
--
Summary: Add HoodieFlinkClient InsertOverwrite
Key: HUDI-1752
URL: https://issues.apache.org/jira/browse/HUDI-1752
Project: Apache Hudi
Issue Type: New Feature
aditiwari01 opened a new issue #2756:
URL: https://github.com/apache/hudi/issues/2756
While creating HoodieRecordPayloads from log files in case of MOR tables,
the payloads are created without any orderingVal (even if specified while
writing data). Due to this the precombine function
yanghua commented on pull request #2755:
URL: https://github.com/apache/hudi/pull/2755#issuecomment-811710440
@xurunbai Thanks for your contribution. Can you file a jira ticket for this
feature?
--
This is an automated message from the Apache Git Service.
To respond to the message,
[
https://issues.apache.org/jira/browse/HUDI-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang closed HUDI-1738.
--
Resolution: Implemented
9804662bc8e17d6936c20326f17ec7c0360dcaf6
> Emit deletes for Flink MOR table streaming
This is an automated email from the ASF dual-hosted git repository.
vinoyang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 9804662 [HUDI-1738] Emit deletes for flink MOR
yanghua merged pull request #2742:
URL: https://github.com/apache/hudi/pull/2742
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
xiarixiaoyao commented on pull request #2722:
URL: https://github.com/apache/hudi/pull/2722#issuecomment-811705289
thanks @garyli1019 . ok， i will try to add unit test
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
yanghua commented on pull request #2747:
URL: https://github.com/apache/hudi/pull/2747#issuecomment-811679455
> @yanghua - I've fixed the build, can you please merge this code?
Thanks, IMO, can you add a unit test for the feature.
--
This is an automated message from the Apache
xurunbai commented on pull request #2755:
URL: https://github.com/apache/hudi/pull/2755#issuecomment-811678698
Add HoodieFlinkClient InsertOverwrite
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
xurunbai opened a new pull request #2755:
URL: https://github.com/apache/hudi/pull/2755
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the
66 matches
Mail list logo
