n3nash merged pull request #2030:
URL: https://github.com/apache/hudi/pull/2030
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new fec7cd3 [HUDI-1130] hudi-test-suite support for
n3nash merged pull request #2039:
URL: https://github.com/apache/hudi/pull/2039
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
n3nash commented on pull request #2045:
URL: https://github.com/apache/hudi/pull/2045#issuecomment-689318428
@nbalajee can you please rebase ?
This is an automated message from the Apache Git Service.
To respond to the messag
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 53d1e55 Test Suite should work with Docker + Un
n3nash commented on pull request #2039:
URL: https://github.com/apache/hudi/pull/2039#issuecomment-689317926
@modi95 This LGTM, tried it manually and it works, thanks for taking this
over the finish line.
This is an automate
bvaradar commented on pull request #2058:
URL: https://github.com/apache/hudi/pull/2058#issuecomment-689300968
@yanghua :
```I just want to speed up the local build progress so that I can verify new
changes frequently.```
Can you kindly clarify what you mean by changes here ?
n3nash commented on issue #2066:
URL: https://github.com/apache/hudi/issues/2066#issuecomment-689299100
@KarthickAN Making hoodie_record_key virtual is actively being worked on.
There will be an initial implementation in the next few weeks and you might be
able to try it out as an WIP feat
[
https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192611#comment-17192611
]
cdmikechen commented on HUDI-83:
[~uditme]
Yes, in hive3 it is supported, and we can just re
[
https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192604#comment-17192604
]
cdmikechen commented on HUDI-83:
[~shivnarayan] I will open a PR recently.
I have completed
This is an automated email from the ASF dual-hosted git repository.
uditme pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 2fee087 [HUDI-1181] Fix decimal type display issu
umehrot2 merged pull request #1953:
URL: https://github.com/apache/hudi/pull/1953
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
sathyaprakashg commented on a change in pull request #2012:
URL: https://github.com/apache/hudi/pull/2012#discussion_r485249027
##
File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java
##
@@ -127,12 +128,59 @@ public static GenericRecord bytesToAvro(byt
bvaradar commented on issue #2020:
URL: https://github.com/apache/hudi/issues/2020#issuecomment-689173851
@zherenyu831 @dm-tran : Good catch about incremental timeline syncing. This
is an experimental feature still and is disabled by default. There could be a
bug here. I will investigate
[
https://issues.apache.org/jira/browse/HUDI-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Balaji Varadarajan updated HUDI-1275:
-
Status: Open (was: New)
> Incremental TImeline Syncing causes compaction to fail with Fil
Balaji Varadarajan created HUDI-1275:
Summary: Incremental TImeline Syncing causes compaction to fail
with FileNotFound exception
Key: HUDI-1275
URL: https://issues.apache.org/jira/browse/HUDI-1275
[
https://issues.apache.org/jira/browse/HUDI-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Balaji Varadarajan reassigned HUDI-1275:
Assignee: Balaji Varadarajan
> Incremental TImeline Syncing causes compaction to fa
[
https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192515#comment-17192515
]
sivabalan narayanan commented on HUDI-83:
-
[~chenxiang]: looks like there is some in
bvaradar commented on issue #2076:
URL: https://github.com/apache/hudi/issues/2076#issuecomment-689170277
@Yogashri12 : It does not make sense to have different types deduced for the
same column. If you want such mismatch partition-types to be inserted, you can
simply cast the partition co
pratyakshsharma commented on a change in pull request #1984:
URL: https://github.com/apache/hudi/pull/1984#discussion_r485182381
##
File path: hudi-spark/src/main/java/org/apache/hudi/keygen/KeyGenerator.java
##
@@ -41,7 +41,7 @@
private static final String STRUCT_NAME = "ho
[
https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratyaksh Sharma reassigned HUDI-1200:
--
Assignee: Pratyaksh Sharma (was: liujinhui)
> CustomKeyGenerator does not work,java.la
pratyakshsharma commented on a change in pull request #1984:
URL: https://github.com/apache/hudi/pull/1984#discussion_r485151075
##
File path: hudi-spark/src/main/java/org/apache/hudi/keygen/KeyGenerator.java
##
@@ -41,7 +41,7 @@
private static final String STRUCT_NAME = "ho
pratyakshsharma commented on a change in pull request #1984:
URL: https://github.com/apache/hudi/pull/1984#discussion_r485151075
##
File path: hudi-spark/src/main/java/org/apache/hudi/keygen/KeyGenerator.java
##
@@ -41,7 +41,7 @@
private static final String STRUCT_NAME = "ho
bradleyhurley commented on issue #2068:
URL: https://github.com/apache/hudi/issues/2068#issuecomment-689064559
I made some tweaks and was able to get the job to complete.
- Executor Cores = 1
- Executors = 300
- Driver Memory = 4G
- Executor Memory = 6G
- spark.kryoseriali
pratyakshsharma commented on pull request #1984:
URL: https://github.com/apache/hudi/pull/1984#issuecomment-689053835
> @pratyakshsharma I would like to get this into 0.6.1 if possible. please
prioritize accordingly
Checking this.
--
nsivabalan commented on pull request #1978:
URL: https://github.com/apache/hudi/pull/1978#issuecomment-689043555
@hj2016 : can you fix the build failure.
This is an automated message from the Apache Git Service.
To respond to
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r485058261
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/SparkWorkloadProfile.java
##
@@ -22,49 +22,22 @@
import org.apache.hudi
bvaradar commented on issue #2072:
URL: https://github.com/apache/hudi/issues/2072#issuecomment-688979127
Try running refresh CLI command and then call show rollbacks ?
This is an automated message from the Apache Git Service
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r485027583
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/HoodieSparkMergeHandle.java
##
@@ -71,34 +77,25 @@
protected boolean use
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r485026581
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/HoodieSparkMergeHandle.java
##
@@ -54,9 +60,9 @@
import java.util.Set;
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r485016294
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/embedded/SparkEmbeddedTimelineService.java
##
@@ -0,0 +1,51 @@
+/*
+ *
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r485016294
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/embedded/SparkEmbeddedTimelineService.java
##
@@ -0,0 +1,51 @@
+/*
+ *
n3nash commented on a change in pull request #2012:
URL: https://github.com/apache/hudi/pull/2012#discussion_r485009679
##
File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java
##
@@ -127,12 +128,59 @@ public static GenericRecord bytesToAvro(byte[] byte
n3nash commented on a change in pull request #2012:
URL: https://github.com/apache/hudi/pull/2012#discussion_r485009679
##
File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java
##
@@ -127,12 +128,59 @@ public static GenericRecord bytesToAvro(byte[] byte
n3nash commented on pull request #2012:
URL: https://github.com/apache/hudi/pull/2012#issuecomment-688954187
@sathyaprakashg Thanks for looking into this. I see that the
`org.apache.spark.sql.avro.SchemaConverters` uses the `fixed` name so it's
difficult to workaround it. Your approach sou
wangxianghu commented on pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#issuecomment-688918271
> One more pass.
>
> @wangxianghu do the tests pass locally? 50 min is the travis limit, if its
consistently exceeding that limit, we need to understand why and fix it. I
ashishmgofficial commented on issue #2072:
URL: https://github.com/apache/hudi/issues/2072#issuecomment-688903435
@bvaradar Im trying to do rollbacks and Savepoints through Hudi CLI in
ver.0.6.0 . Im able to successfully create savepoints and rollback to the
savepoint. But after rollback,
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484940203
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/bootstrap/SparkBootstrapCommitActionExecutor.java
##
@@ -77,34 +8
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484933755
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/SparkCreateHandleFactory.java
##
@@ -0,0 +1,46 @@
+/*
+ * Licensed to the A
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484933013
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/HoodieSparkWriteClient.java
##
@@ -0,0 +1,360 @@
+/*
+ * Licensed to th
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484931317
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/HoodieSparkWriteClient.java
##
@@ -0,0 +1,360 @@
+/*
+ * Licensed to th
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484931707
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##
@@ -716,32 +674,97 @@ private void r
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484931161
##
File path:
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/testutils/HoodieClientTestUtils.java
##
@@ -81,7 +82,9 @@
*/
public sta
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484928117
##
File path:
hudi-spark/src/main/java/org/apache/hudi/bootstrap/SparkParquetBootstrapDataProvider.java
##
@@ -43,18 +43,18 @@
/**
* Spark Data frame
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484925689
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseMergeHelper.java
##
@@ -161,11 +108,11 @@ private sta
hj2016 commented on a change in pull request #1978:
URL: https://github.com/apache/hudi/pull/1978#discussion_r484922986
##
File path:
hudi-client/src/test/java/org/apache/hudi/index/hbase/TestHBaseIndex.java
##
@@ -156,6 +160,53 @@ public void testSimpleTagLocationAndUpdate()
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484921994
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/hbase/BaseHoodieHBaseIndex.java
##
@@ -0,0 +1,295 @@
+/*
+ * Licensed t
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484921612
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bloom/BaseHoodieBloomIndex.java
##
@@ -0,0 +1,71 @@
+/*
+ * Licensed to
rajgowtham24 commented on issue #2075:
URL: https://github.com/apache/hudi/issues/2075#issuecomment-688806064
Hi @tooptoop4 ,
While reading the csv file i have used inferschema option as mentioned below
input_df =
spark.read.format("csv").option("header","true").option("infers
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484832824
##
File path: hudi-client/pom.xml
##
@@ -68,6 +107,12 @@
+
+
+ org.scala-lang
Review comment:
> should we limit scala to j
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484828823
##
File path: hudi-spark/src/main/scala/org/apache/hudi/IncrementalRelation.scala
##
@@ -64,8 +64,7 @@ class IncrementalRelation(val sqlContext: SQLConte
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484828652
##
File path: style/checkstyle.xml
##
@@ -62,7 +62,7 @@
-
+
Review comment:
> let's dis
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484823465
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/rollback/RollbackUtils.java
##
@@ -0,0 +1,134 @@
+/*
+ * License
nsivabalan commented on a change in pull request #1978:
URL: https://github.com/apache/hudi/pull/1978#discussion_r484820440
##
File path:
hudi-client/src/test/java/org/apache/hudi/index/hbase/TestHBaseIndex.java
##
@@ -156,6 +160,53 @@ public void testSimpleTagLocationAndUpdat
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484816690
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/KeyGeneratorInterface.java
##
@@ -34,8 +33,4 @@
List getRecordKey
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484815402
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/HoodieIndex.java
##
@@ -21,94 +21,52 @@
import org.apache.hudi.ApiMatu
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r484815015
##
File path: hudi-client/hudi-client-common/pom.xml
##
@@ -0,0 +1,44 @@
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.org/2001/XMLS
liujinhui1994 commented on pull request #1968:
URL: https://github.com/apache/hudi/pull/1968#issuecomment-688749502
Ok i will deal with this soon
This is an automated message from the Apache Git Service.
To respond to the mes
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192074#comment-17192074
]
wangxianghu commented on HUDI-1269:
---
[~liujinhui] sure, feel free to take it
> Make wh
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192072#comment-17192072
]
liujinhui commented on HUDI-1269:
-
I am interested in hive related issues, may i take this
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu reassigned HUDI-1269:
-
Assignee: liujinhui (was: wangxianghu)
> Make whether the failure of sync hudi data to hive affe
[
https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujinhui closed HUDI-1193.
---
> Upgrade http dependent version
> --
>
> Key: HUDI-1193
>
[
https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192063#comment-17192063
]
liujinhui commented on HUDI-1200:
-
[~vinoth] Yes, it has been resolved, the production env
[
https://issues.apache.org/jira/browse/HUDI-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujinhui reassigned HUDI-1274:
---
Assignee: liujinhui
> Hive synchronization supports hourly partition
> --
[
https://issues.apache.org/jira/browse/HUDI-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujinhui updated HUDI-1274:
Status: Open (was: New)
> Hive synchronization supports hourly partition
>
garyli1019 commented on pull request #1938:
URL: https://github.com/apache/hudi/pull/1938#issuecomment-688685118
Ready for review. cc: @vinothchandar @bhasudha
This is an automated message from the Apache Git Service.
To res
garyli1019 commented on a change in pull request #1938:
URL: https://github.com/apache/hudi/pull/1938#discussion_r484701932
##
File path:
hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieInputFormatUtils.java
##
@@ -443,4 +444,45 @@ private static HoodieBaseFile
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 51b16bd [MINOR] fix typo
new e3cf34d Merge
garyli1019 merged pull request #2077:
URL: https://github.com/apache/hudi/pull/2077
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
garyli1019 commented on pull request #2077:
URL: https://github.com/apache/hudi/pull/2077#issuecomment-688661449
thanks for opening this PR, LGTM. merging
This is an automated message from the Apache Git Service.
To respond t
70 matches
Mail list logo
