[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1592: [Hudi-822] decouple Hudi related logics from HoodieInputFormat

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1592: URL: https://github.com/apache/incubator-hudi/pull/1592#issuecomment-632985999 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1592?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-commenter commented on pull request #1592: [Hudi-822] decouple Hudi related logics from HoodieInputFormat

2020-05-22 Thread GitBox
codecov-commenter commented on pull request #1592: URL: https://github.com/apache/incubator-hudi/pull/1592#issuecomment-632985999 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1592?src=pr=h1) Report > Merging

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #286

2020-05-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.36 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[GitHub] [incubator-hudi] garyli1019 commented on pull request #1592: [Hudi-822] decouple Hudi related logics from HoodieInputFormat

2020-05-22 Thread GitBox
garyli1019 commented on pull request #1592: URL: https://github.com/apache/incubator-hudi/pull/1592#issuecomment-632977748 Folks, put these two commits together is too difficult to review. Let's do one step at a time. 1. This PR is decoupling Hudi related logics from

[jira] [Updated] (HUDI-920) Incremental view on MOR table using Spark Datasource

2020-05-22 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-920: Fix Version/s: 0.6.0 > Incremental view on MOR table using Spark Datasource >

[jira] [Updated] (HUDI-920) Incremental view on MOR table using Spark Datasource

2020-05-22 Thread Yanjia Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-920: Status: Open (was: New) > Incremental view on MOR table using Spark Datasource >

[jira] [Created] (HUDI-920) Incremental view on MOR table using Spark Datasource

2020-05-22 Thread Yanjia Gary Li (Jira)
Yanjia Gary Li created HUDI-920: --- Summary: Incremental view on MOR table using Spark Datasource Key: HUDI-920 URL: https://issues.apache.org/jira/browse/HUDI-920 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] leesf edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-22 Thread GitBox
leesf edited a comment on issue #661: URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632942498 Hudi has been integrated into [Data Lake Analytics](https://www.alibabacloud.com/help/product/70174.htm) at Aliyun to provide a datalake solution for users on

[GitHub] [incubator-hudi] leesf removed a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-22 Thread GitBox
leesf removed a comment on issue #661: URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-526755266 Not using it in prod yet, but very early stages of investigating its usage. This is an automated message

[GitHub] [incubator-hudi] leesf edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-22 Thread GitBox
leesf edited a comment on issue #661: URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632942498 Hudi has been integrated into [AliCloud Data Lake Analytics](https://www.alibabacloud.com/help/product/70174.htm) at Aliyun to provide a datalake solution for users.

[GitHub] [incubator-hudi] leesf commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-22 Thread GitBox
leesf commented on issue #661: URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632942498 Hudi has been integrated into [AliCloud Data Lake Analytics](https://www.alibabacloud.com/help/product/70174.htm) at Aliyun to provide a solution for users to query hudi tables

svn commit: r39731 - /dev/incubator/hudi/KEYS

2020-05-22 Thread vbalaji
Author: vbalaji Date: Fri May 22 20:19:45 2020 New Revision: 39731 Log: Adding nsivabalan KEY Modified: dev/incubator/hudi/KEYS Modified: dev/incubator/hudi/KEYS == --- dev/incubator/hudi/KEYS (original) +++

svn commit: r39730 - /release/incubator/hudi/KEYS

2020-05-22 Thread vbalaji
Author: vbalaji Date: Fri May 22 20:18:41 2020 New Revision: 39730 Log: Adding nsivabalan KEY Modified: release/incubator/hudi/KEYS Modified: release/incubator/hudi/KEYS == --- release/incubator/hudi/KEYS (original)

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1650: [HUDI-541]: replaced dataFile/df with baseFile/bf throughout code base

2020-05-22 Thread GitBox
bvaradar commented on a change in pull request #1650: URL: https://github.com/apache/incubator-hudi/pull/1650#discussion_r429412110 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/RocksDBSchemaHelper.java ## @@ -78,12 +78,12 @@ public String

[GitHub] [incubator-hudi] pratyakshsharma commented on pull request #1650: [HUDI-541]: replaced dataFile/df with baseFile/bf throughout code base

2020-05-22 Thread GitBox
pratyakshsharma commented on pull request #1650: URL: https://github.com/apache/incubator-hudi/pull/1650#issuecomment-632859031 Here also the error seems to be similar to the one I faced in https://github.com/apache/incubator-hudi/pull/1558#issuecomment-632858646 @vinothchandar

[GitHub] [incubator-hudi] pratyakshsharma commented on pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
pratyakshsharma commented on pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#issuecomment-632858646 > Do you know what the error is There is some error while forking as below -> [ERROR] Please refer to dump files (if any exist) [date].dump,

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1650: [HUDI-541]: replaced dataFile/df with baseFile/bf throughout code base

2020-05-22 Thread GitBox
vinothchandar commented on pull request #1650: URL: https://github.com/apache/incubator-hudi/pull/1650#issuecomment-632852432 @bvaradar you can just look at my comments alone This is an automated message from the

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1650: [HUDI-541]: replaced dataFile/df with baseFile/bf throughout code base

2020-05-22 Thread GitBox
vinothchandar commented on a change in pull request #1650: URL: https://github.com/apache/incubator-hudi/pull/1650#discussion_r429399564 ## File path: hudi-client/src/main/java/org/apache/hudi/table/action/rollback/MergeOnReadRollbackActionExecutor.java ## @@ -124,7 +124,7 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1616: [HUDI-786] Fixing read beyond inline length in InlineFS

2020-05-22 Thread GitBox
bvaradar commented on a change in pull request #1616: URL: https://github.com/apache/incubator-hudi/pull/1616#discussion_r429392893 ## File path: hudi-common/src/main/java/org/apache/hudi/common/fs/inline/InLineFsDataInputStream.java ## @@ -56,24 +56,29 @@ public long

[GitHub] [incubator-hudi] afilipchik commented on pull request #1514: [HUDI-774] Addressing incorrect Spark to Avro schema generation

2020-05-22 Thread GitBox
afilipchik commented on pull request #1514: URL: https://github.com/apache/incubator-hudi/pull/1514#issuecomment-632839321 @umehrot2 yep, it is attempt to fix schema generated by spark-avro. Moving generation in house makes sense, but, if I recall correctly, the issue is not coming from

[GitHub] [incubator-hudi] garyli1019 commented on pull request #1574: [HUDI-701]Add unit test for HDFSParquetImportCommand

2020-05-22 Thread GitBox
garyli1019 commented on pull request #1574: URL: https://github.com/apache/incubator-hudi/pull/1574#issuecomment-632830706 Thanks @hddong . I am using Spark installed by brew and `mkdir /tmp/spark-events/` fix the issue. IMO if docker is not possible then we may consider using a

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1647: [HUDI-867]: fixed IllegalArgumentException from graphite metrics in deltaStreamer continuous mode

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1647: URL: https://github.com/apache/incubator-hudi/pull/1647#discussion_r429381950 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -416,10 +425,12 @@

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1652: [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug

2020-05-22 Thread GitBox
garyli1019 commented on a change in pull request #1652: URL: https://github.com/apache/incubator-hudi/pull/1652#discussion_r429371998 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java ## @@ -207,6 +208,11 @@ public

[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1648: [HUDI-916]: added support for multiple input formats in TimestampBasedKeyGenerator

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1648: URL: https://github.com/apache/incubator-hudi/pull/1648#issuecomment-631889483 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1648?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1648: [HUDI-916]: added support for multiple input formats in TimestampBasedKeyGenerator

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1648: URL: https://github.com/apache/incubator-hudi/pull/1648#issuecomment-631889483 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1648?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] vinothchandar commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-22 Thread GitBox
vinothchandar commented on issue #661: URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632815250 @maduxi do you mind sharing the company name or can we add this to the site? @sungjuly same question. Can we add this to the site? Please let me know

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
vinothchandar commented on pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#issuecomment-632813623 you can hop onto travis and click restart.. CI has been pretty stable for a while now.. Do you know what the error is

[GitHub] [incubator-hudi] xushiyan edited a comment on pull request #1603: [HUDI-836] Add configs for Datadog metrics reporter

2020-05-22 Thread GitBox
xushiyan edited a comment on pull request #1603: URL: https://github.com/apache/incubator-hudi/pull/1603#issuecomment-629712980 @yanghua This is ready for review now. But not sure if the merging is blocked by generating 0.5.3 docs as this is for 0.6.0 docs.

[jira] [Resolved] (HUDI-836) Implement datadog metrics reporter

2020-05-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-836. - Resolution: Implemented > Implement datadog metrics reporter > -- > >

[GitHub] [incubator-hudi] pratyakshsharma commented on pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
pratyakshsharma commented on pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#issuecomment-632793624 Wondering why are the tests crashing today in between. This happened twice with me today. Is there any way to re-trigger travis build apart from re-pushing the

[GitHub] [incubator-hudi] xushiyan commented on pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-22 Thread GitBox
xushiyan commented on pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#issuecomment-632789214 > @xushiyan may be we need to doc this or write a small post? Yes @vinothchandar will do the post soon. Config docs update is in #1603 . As for http-client, I

[GitHub] [incubator-hudi] pratyakshsharma commented on pull request #1433: [HUDI-728]: Implement custom key generator

2020-05-22 Thread GitBox
pratyakshsharma commented on pull request #1433: URL: https://github.com/apache/incubator-hudi/pull/1433#issuecomment-632778203 @nsivabalan I squashed the commits and force pushed after unstaging the 2 parquet files, but they are still showing.

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-22 Thread GitBox
vinothchandar commented on pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#issuecomment-632774712 @xushiyan may be we need to doc this or write a small post? This is an automated message from

[GitHub] [incubator-hudi] vinothchandar merged pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-22 Thread GitBox
vinothchandar merged pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[incubator-hudi] branch master updated: [HUDI-836] Implement datadog metrics reporter (#1572)

2020-05-22 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new f34de3f [HUDI-836] Implement datadog

[GitHub] [incubator-hudi] vinothchandar commented on pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-22 Thread GitBox
vinothchandar commented on pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#issuecomment-632774153 Sorry folks.. Got delayed .. This looks fine at a high level.. I was mulling if using http-client directly will cause any issues for us.. but seems ok..

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1647: [HUDI-867]: fixed IllegalArgumentException from graphite metrics in deltaStreamer continuous mode

2020-05-22 Thread GitBox
leesf commented on a change in pull request #1647: URL: https://github.com/apache/incubator-hudi/pull/1647#discussion_r429313527 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -416,10 +425,12 @@ public

[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1433: [HUDI-728]: Implement custom key generator

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1433: URL: https://github.com/apache/incubator-hudi/pull/1433#issuecomment-631535136 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1433?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1433: [HUDI-728]: Implement custom key generator

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1433: URL: https://github.com/apache/incubator-hudi/pull/1433#issuecomment-631535136 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1433?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#issuecomment-630856735 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1558?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#issuecomment-630856735 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1558?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
hddong commented on a change in pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#discussion_r429251126 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java ## @@ -263,13 +265,26 @@ private static int

[GitHub] [incubator-hudi] nsivabalan commented on pull request #1648: [HUDI-916]: added support for multiple input formats in TimestampBasedKeyGenerator

2020-05-22 Thread GitBox
nsivabalan commented on pull request #1648: URL: https://github.com/apache/incubator-hudi/pull/1648#issuecomment-632683547 Also, for book-keeping purposes, can you fix the description of this patch. I guess you missed to copy from the original.

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1648: [HUDI-916]: added support for multiple input formats in TimestampBasedKeyGenerator

2020-05-22 Thread GitBox
nsivabalan commented on a change in pull request #1648: URL: https://github.com/apache/incubator-hudi/pull/1648#discussion_r429230492 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java ## @@ -53,44 +56,74 @@

[GitHub] [incubator-hudi] codecov-commenter edited a comment on pull request #1652: [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug

2020-05-22 Thread GitBox
codecov-commenter edited a comment on pull request #1652: URL: https://github.com/apache/incubator-hudi/pull/1652#issuecomment-632676442 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1652?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-commenter commented on pull request #1652: [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug

2020-05-22 Thread GitBox
codecov-commenter commented on pull request #1652: URL: https://github.com/apache/incubator-hudi/pull/1652#issuecomment-632676442 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1652?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] nsivabalan commented on pull request #1433: [HUDI-728]: Implement custom key generator

2020-05-22 Thread GitBox
nsivabalan commented on pull request #1433: URL: https://github.com/apache/incubator-hudi/pull/1433#issuecomment-632675414 @pratyakshsharma : can you fix the build issue. This is an automated message from the Apache Git

[GitHub] [incubator-hudi] sassai commented on issue #1646: [SUPPORT]: Unable to query Hive table through Spark SQL

2020-05-22 Thread GitBox
sassai commented on issue #1646: URL: https://github.com/apache/incubator-hudi/issues/1646#issuecomment-632666310 Hi @bvaradar, thanks for the reply. After some digging I found a solution. The problem was that the spark did not load the jars specified in `HIVE_AUX_JARS_PATH`

[GitHub] [incubator-hudi] maduxi edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-22 Thread GitBox
maduxi edited a comment on issue #661: URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632323358 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#discussion_r429177537 ## File path: hudi-cli/src/main/scala/org/apache/hudi/cli/DedupeSparkJob.scala ## @@ -98,34 +97,92 @@ class DedupeSparkJob(basePath:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#discussion_r429176562 ## File path: hudi-cli/src/main/scala/org/apache/hudi/cli/DeDupeType.scala ## @@ -0,0 +1,28 @@ +/* + * Licensed to the Apache Software

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#discussion_r429174118 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/RepairsCommand.java ## @@ -77,7 +77,9 @@ public String deduplicate(

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1558: [HUDI-796]: added deduping logic for upserts case

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1558: URL: https://github.com/apache/incubator-hudi/pull/1558#discussion_r429171990 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java ## @@ -263,13 +265,26 @@ private static int

[GitHub] [incubator-hudi] pratyakshsharma commented on pull request #1648: [HUDI-916]: added support for multiple input formats in TimestampBasedKeyGenerator

2020-05-22 Thread GitBox
pratyakshsharma commented on pull request #1648: URL: https://github.com/apache/incubator-hudi/pull/1648#issuecomment-632611762 > @pratyakshsharma : was this patch already reviewed as part of #1597? or do I need to review it from scratch The changes in

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1647: [HUDI-867]: fixed IllegalArgumentException from graphite metrics in deltaStreamer continuous mode

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1647: URL: https://github.com/apache/incubator-hudi/pull/1647#discussion_r429158430 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -416,10 +425,12 @@

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1647: [HUDI-867]: fixed IllegalArgumentException from graphite metrics in deltaStreamer continuous mode

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1647: URL: https://github.com/apache/incubator-hudi/pull/1647#discussion_r429158430 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -416,10 +425,12 @@

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1647: [HUDI-867]: fixed IllegalArgumentException from graphite metrics in deltaStreamer continuous mode

2020-05-22 Thread GitBox
pratyakshsharma commented on a change in pull request #1647: URL: https://github.com/apache/incubator-hudi/pull/1647#discussion_r429158430 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -416,10 +425,12 @@

[jira] [Updated] (HUDI-473) IllegalArgumentException in QuickstartUtils

2020-05-22 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-473: --- Status: In Progress (was: Open) > IllegalArgumentException in QuickstartUtils >

[jira] [Commented] (HUDI-473) IllegalArgumentException in QuickstartUtils

2020-05-22 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113893#comment-17113893 ] Bhavani Sudha commented on HUDI-473: [~zhangpu-paul] I believe you can reproduce this exception when

[jira] [Updated] (HUDI-115) Enhance OverwriteWithLatestAvroPayload to also respect ordering value of record in storage

2020-05-22 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-115: --- Status: Open (was: New) > Enhance OverwriteWithLatestAvroPayload to also respect ordering value of >

[jira] [Updated] (HUDI-115) Enhance OverwriteWithLatestAvroPayload to also respect ordering value of record in storage

2020-05-22 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-115: --- Labels: bug-bash-0.6.0 (was: ) > Enhance OverwriteWithLatestAvroPayload to also respect ordering

[jira] [Assigned] (HUDI-473) IllegalArgumentException in QuickstartUtils

2020-05-22 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reassigned HUDI-473: -- Assignee: Bhavani Sudha (was: Bhavani Sudha Saktheeswaran) > IllegalArgumentException in

[jira] [Closed] (HUDI-790) Improve OverwriteWithLatestAvroPayload to consider value on disk as well before overwriting.

2020-05-22 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-790. -- Resolution: Duplicate > Improve OverwriteWithLatestAvroPayload to consider value on disk as well >

[jira] [Updated] (HUDI-790) Improve OverwriteWithLatestAvroPayload to consider value on disk as well before overwriting.

2020-05-22 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-790: --- Status: Open (was: New) > Improve OverwriteWithLatestAvroPayload to consider value on disk as well >

[GitHub] [incubator-hudi] bhasudha commented on issue #1653: [SUPPORT]: Hudi Deltastreamer OffsetoutofRange Exception reading from Kafka topic (12 partitions)

2020-05-22 Thread GitBox
bhasudha commented on issue #1653: URL: https://github.com/apache/incubator-hudi/issues/1653#issuecomment-632516157 @prashanthpdesai sorry I assumed you were referring to your own check pointing. Your understanding is right. Checkpoints are written to hoodie commit metadata after each