hj2016 commented on pull request #1978:
URL: https://github.com/apache/hudi/pull/1978#issuecomment-691379071
@n3nash The problem nsivabalan said, I have fixed it a few days ago. I don’t
know if you are talking about the same problem. If not, can I elaborate on it?
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 5e61454 [HUDI-802] AWSDmsTransformer does not
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 5e61454 [HUDI-802] AWSDmsTransformer does not
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 5e61454 [HUDI-802] AWSDmsTransformer does not
bvaradar merged pull request #2084:
URL: https://github.com/apache/hudi/pull/2084
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
nsivabalan commented on pull request #2084:
URL: https://github.com/apache/hudi/pull/2084#issuecomment-691327993
yeah, https://github.com/apache/hudi/pull/1792 fixed the issue for
OverwriteWithLatestAvroPayload and not for AWSDmsAvroPayload. thanks @bvaradar.
bvaradar commented on pull request #2084:
URL: https://github.com/apache/hudi/pull/2084#issuecomment-691324390
@tooptoop4 : The issue was still there. I added a testcase
(testPreCombineWithDelete) which would fail with existing code but passes with
this PR.
abhijeetkushe commented on issue #1737:
URL: https://github.com/apache/hudi/issues/1737#issuecomment-691268965
@bvaradar The hudi version we are using 0.5.2-incubating deployed on EMR.
Good point on the terminology.I will rephrase my question
COW with 'hoodie.cleaner.commits.retained':
bvaradar commented on pull request #2058:
URL: https://github.com/apache/hudi/pull/2058#issuecomment-691209314
Yes @yanghua : The docker containers are for mainly for internal (testing
and demo) consumption but I agree we can document it for engineers to know.
Would you mind helping
bvaradar closed issue #2062:
URL: https://github.com/apache/hudi/issues/2062
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
bvaradar commented on issue #2062:
URL: https://github.com/apache/hudi/issues/2062#issuecomment-691206241
@kpurella : I think you should either try patching the PR I had mentioned
or use 0.6.0
This is an automated message
n3nash commented on pull request #1242:
URL: https://github.com/apache/hudi/pull/1242#issuecomment-691203252
@hddong Extremely sorry, this fell through the crack, please rebase and I
will merge this right after.
This is an
n3nash commented on pull request #1978:
URL: https://github.com/apache/hudi/pull/1978#issuecomment-691202637
@hj2016 Please rebase and fix the tests, we can land after that.
This is an automated message from the Apache Git
n3nash commented on a change in pull request #2012:
URL: https://github.com/apache/hudi/pull/2012#discussion_r487165310
##
File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java
##
@@ -127,12 +128,59 @@ public static GenericRecord bytesToAvro(byte[]
n3nash commented on a change in pull request #2012:
URL: https://github.com/apache/hudi/pull/2012#discussion_r487165310
##
File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java
##
@@ -127,12 +128,59 @@ public static GenericRecord bytesToAvro(byte[]
n3nash commented on pull request #2071:
URL: https://github.com/apache/hudi/pull/2071#issuecomment-691200964
@shenh062326 The PR looks fine to me, high level, what is the reason for
this change ? Is it just to correct timestamp types ?
rajgowtham24 opened a new issue #2086:
URL: https://github.com/apache/hudi/issues/2086
Hi,
I am trying to achieve two identical copy of the Hudi Tables in different
buckets.
For the above scenario, I have copied the contents of the hudi table data
files into another bucket
bvaradar commented on issue #1737:
URL: https://github.com/apache/hudi/issues/1737#issuecomment-691198064
@abhijeetkushe : Just to get the terminology right : Compaction within Hudi
is the process of all the log files belonging to a logical file and creating a
columnar file. This is only
leesf commented on a change in pull request #1929:
URL: https://github.com/apache/hudi/pull/1929#discussion_r487137203
##
File path: hudi-client/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java
##
@@ -90,9 +92,19 @@ protected HoodieWriteHandle(HoodieWriteConfig config,
vinothchandar commented on a change in pull request #2048:
URL: https://github.com/apache/hudi/pull/2048#discussion_r486369440
##
File path:
hudi-client/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -87,44 +88,55 @@ protected
[
https://issues.apache.org/jira/browse/HUDI-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194355#comment-17194355
]
Balaji Varadarajan commented on HUDI-1208:
--
[~shenhong]: Sure, You can take this.
> Ordering
[
https://issues.apache.org/jira/browse/HUDI-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194354#comment-17194354
]
Balaji Varadarajan commented on HUDI-1209:
--
[~shenhong]: Sure. You can take this.
> Properties
[
https://issues.apache.org/jira/browse/HUDI-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194348#comment-17194348
]
Raymond Xu commented on HUDI-1058:
--
No worries [~shenhong]. thanks for the update.
> Make delete marker
leesf commented on a change in pull request #1929:
URL: https://github.com/apache/hudi/pull/1929#discussion_r487128690
##
File path:
hudi-client/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##
@@ -94,6 +95,11 @@
public static final String
leesf commented on a change in pull request #1929:
URL: https://github.com/apache/hudi/pull/1929#discussion_r487128319
##
File path:
hudi-client/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -117,7 +118,17 @@ public boolean commitStats(String
leesf commented on a change in pull request #1929:
URL: https://github.com/apache/hudi/pull/1929#discussion_r487126922
##
File path:
hudi-client/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -117,7 +118,17 @@ public boolean commitStats(String
abhijeetkushe edited a comment on issue #1737:
URL: https://github.com/apache/hudi/issues/1737#issuecomment-690685990
@vinothchandar
I am facing a similar problem.I am doing a POC for Hudi and am using with
the same data for both COW and MOR.I see the compaction happening for both
rajgowtham24 commented on issue #2075:
URL: https://github.com/apache/hudi/issues/2075#issuecomment-691079649
Thanks @bvaradar will check on that
This is an automated message from the Apache Git Service.
To respond to the
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new b67f9f0 Travis CI build asf-site
b67f9f0 is
This is an automated email from the ASF dual-hosted git repository.
pratyakshsharma pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 6d2b0cf [MINOR]Add clinbrain to
pratyakshsharma merged pull request #2078:
URL: https://github.com/apache/hudi/pull/2078
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
pratyakshsharma commented on pull request #2078:
URL: https://github.com/apache/hudi/pull/2078#issuecomment-691050799
LGTM, merging.
This is an automated message from the Apache Git Service.
To respond to the message, please
leesf commented on pull request #1748:
URL: https://github.com/apache/hudi/pull/1748#issuecomment-691043300
> @leesf we no longer use SimpleDateFormat in TimestampBasedKeyGenerator. So
the issues linked with usage of SimpleDateFormat are also no longer there.
Guess we can close this?
leesf closed pull request #1748:
URL: https://github.com/apache/hudi/pull/1748
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
pratyakshsharma commented on pull request #2085:
URL: https://github.com/apache/hudi/pull/2085#issuecomment-691021969
Changes look good to me. Can you see why the build is failing? @shenh062326
This is an automated message
[
https://issues.apache.org/jira/browse/HUDI-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-982:
-
Description: Add commit action implemetation to hudi-flink-client (was:
could be like this
{code:java}
[
https://issues.apache.org/jira/browse/HUDI-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-982:
-
Summary: Add commit action implemetation to hudi-flink-client (was:
Introduce AbstractHoodieTable for
[
https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-981:
-
Summary: Add async compact implemetation to hudi-flink-client (was:
Introduce AbstractHoodieIndex for
[
https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-981:
-
Description: Add async compact implemetation to hudi-flink-client
> Add async compact implemetation to
[
https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-981:
-
Description: (was: At a high level, HoodieIndex should be irrelevant to
engines. So we should abstract
[
https://issues.apache.org/jira/browse/HUDI-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-913:
-
Description:
Add read client implemetation to hudi-flink-client
was:
Introduce
[
https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-912:
-
Summary: Add write client implemetation to hudi-flink-client (was:
Introduce HoodieWriteKey for hudi
[
https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-912:
-
Description: Add write client implemetation to hudi-flink-client (was:
Introduce HoodieWriteKey as Hudi
[
https://issues.apache.org/jira/browse/HUDI-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-913:
-
Summary: Add read client implemetation to hudi-flink-client (was:
Introduce HoodieEngineContext for hudi
[
https://issues.apache.org/jira/browse/HUDI-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-911:
-
Summary: Add tableimplemetation to hudi-flink-client (was: Introduce
HoodieWriteOutput for hudi write
[
https://issues.apache.org/jira/browse/HUDI-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-911:
-
Description: Add tableimplemetation to hudi-flink-client (was: Introduce
HoodieWriteOutput as the unified
[
https://issues.apache.org/jira/browse/HUDI-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-911:
-
Summary: Add table implemetation to hudi-flink-client (was: Add
tableimplemetation to hudi-flink-client)
[
https://issues.apache.org/jira/browse/HUDI-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-911:
-
Description: Add table implemetation to hudi-flink-client (was: Add
tableimplemetation to
[
https://issues.apache.org/jira/browse/HUDI-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-910:
-
Summary: Add index implemetation to hudi-flink-client (was: Introduce
HoodieWriteInput for hudi write
[
https://issues.apache.org/jira/browse/HUDI-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-910:
-
Description: Add index implemetation to hudi-flink-client (was: Introduce
HoodieWriteInput as the unified
[
https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-909:
-
Summary: Introduce hudi-flink-client module to support flink engine (was:
Introduce hudi-client-flink
[
https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-909:
-
Description: Introduce hudi-flink-client module to support flink engine
based on new abstraction (was:
shenh062326 opened a new pull request #2085:
URL: https://github.com/apache/hudi/pull/2085
## What is the purpose of the pull request
* Prevent print error message when user has not specify "--props" when
running deltastreamer.
## Brief change log
*(for example:)*
[
https://issues.apache.org/jira/browse/HUDI-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1209:
-
Labels: pull-request-available (was: )
> Properties File must be optional when running
[
https://issues.apache.org/jira/browse/HUDI-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratyaksh Sharma closed HUDI-1156.
--
> Remove unused dependencies from HoodieDeltaStreamerWrapper Class
>
[
https://issues.apache.org/jira/browse/HUDI-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratyaksh Sharma updated HUDI-1156:
---
Status: Open (was: New)
> Remove unused dependencies from HoodieDeltaStreamerWrapper Class
>
[
https://issues.apache.org/jira/browse/HUDI-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratyaksh Sharma resolved HUDI-1156.
Resolution: Fixed
Fixed
> Remove unused dependencies from HoodieDeltaStreamerWrapper Class
[
https://issues.apache.org/jira/browse/HUDI-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194109#comment-17194109
]
Pratyaksh Sharma commented on HUDI-1029:
We don't use SimpleDateFormat in
pratyakshsharma commented on pull request #1748:
URL: https://github.com/apache/hudi/pull/1748#issuecomment-690966794
@leesf we no longer use SimpleDateFormat in TimestampBasedKeyGenerator. So
the issues linked with usage of SimpleDateFormat are also no longer there.
Guess we can close
[
https://issues.apache.org/jira/browse/HUDI-735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194105#comment-17194105
]
Pratyaksh Sharma commented on HUDI-735:
---
Anything else needs to be done here? As per the description
[
https://issues.apache.org/jira/browse/HUDI-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194075#comment-17194075
]
shenh062326 commented on HUDI-1208:
---
I can take this issue if you have not start it.
> Ordering Field
[
https://issues.apache.org/jira/browse/HUDI-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194076#comment-17194076
]
shenh062326 commented on HUDI-1209:
---
I can take this issue if you have not start it.
> Properties File
[
https://issues.apache.org/jira/browse/HUDI-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shenh062326 reassigned HUDI-1208:
-
Assignee: shenh062326
> Ordering Field should be optional when precombine is turned off
>
[
https://issues.apache.org/jira/browse/HUDI-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shenh062326 reassigned HUDI-1209:
-
Assignee: shenh062326
> Properties File must be optional when running deltastreamer
>
shenh062326 commented on pull request #2071:
URL: https://github.com/apache/hudi/pull/2071#issuecomment-690928998
@n3nash can you take a look at this MR.
This is an automated message from the Apache Git Service.
To respond
tooptoop4 commented on pull request #2084:
URL: https://github.com/apache/hudi/pull/2084#issuecomment-690925786
I thought https://github.com/apache/hudi/pull/1792 fixed it?
This is an automated message from the Apache Git
yanghua commented on pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#issuecomment-690922454
@leesf Thanks for your awesome work. Can you squash these commits for the
subsequent review?
This is an automated
67 matches
Mail list logo
