[GitHub] [hudi] selvarajperiyasamy commented on issue #1679: How to disable Hive JDBC and enable metastore

2020-05-30 Thread GitBox
selvarajperiyasamy commented on issue #1679: URL: https://github.com/apache/hudi/issues/1679#issuecomment-636416771 I have already used below setting and error is still the same as mentioned in the ticket. option(HIVE_SYNC_ENABLED_OPT_KEY,true).

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #294

2020-05-30 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.41 KB...] settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.4/conf/logging: simplelogger.properties

[GitHub] [hudi] bvaradar merged pull request #1691: [MINOR] Fixing binary file checks and disclaimer file checks

2020-05-30 Thread GitBox
bvaradar merged pull request #1691: URL: https://github.com/apache/hudi/pull/1691 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[hudi] branch master updated: Fixing binary file checks and disclaimer file checks (#1691)

2020-05-30 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 1a9fef4 Fixing binary file checks and

[GitHub] [hudi] nsivabalan opened a new pull request #1691: [MINOR] Fixing binary file checks and disclaimer file checks

2020-05-30 Thread GitBox
nsivabalan opened a new pull request #1691: URL: https://github.com/apache/hudi/pull/1691 Fixes release validation script for 1: ignoring application/json files 2: checking for presence of DISCLAIMER file ## Verify this pull request This pull request is a trivial rework /

[jira] [Updated] (HUDI-908) Consistent test data generation with data type coverage

2020-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-908: Labels: bug-bash-0.6.0 pull-request-available (was: bug-bash-0.6.0) > Consistent test data

[GitHub] [hudi] shenh062326 opened a new pull request #1690: [HUDI-908] Add decimals to HoodieTestDataGenerator

2020-05-30 Thread GitBox
shenh062326 opened a new pull request #1690: URL: https://github.com/apache/hudi/pull/1690 ## What is the purpose of the pull request * For HUDI-908, first add decimals to HoodieTestDataGenerator. ## Brief change log *(for example:)* - *Modify

svn commit: r39863 - /release/hudi/KEYS

2020-05-30 Thread vbalaji
Author: vbalaji Date: Sun May 31 02:45:25 2020 New Revision: 39863 Log: Fixing KEYS file Modified: release/hudi/KEYS Modified: release/hudi/KEYS == --- release/hudi/KEYS (original) +++ release/hudi/KEYS Sun May 31

svn commit: r39862 - /dev/hudi/KEYS

2020-05-30 Thread sivabalan
Author: sivabalan Date: Sun May 31 01:20:20 2020 New Revision: 39862 Log: Fixing Sivabalan KEYS Modified: dev/hudi/KEYS Modified: dev/hudi/KEYS == --- dev/hudi/KEYS (original) +++ dev/hudi/KEYS Sun May 31 01:20:20

svn commit: r39861 - /dev/hudi/KEYS

2020-05-30 Thread sivabalan
Author: sivabalan Date: Sun May 31 01:17:03 2020 New Revision: 39861 Log: Fixing Sivabalan KEYS Modified: dev/hudi/KEYS Modified: dev/hudi/KEYS == --- dev/hudi/KEYS (original) +++ dev/hudi/KEYS Sun May 31 01:17:03

[GitHub] [hudi] xushiyan edited a comment on pull request #1619: [HUDI-896] Parallelize CI tests by modules

2020-05-30 Thread GitBox
xushiyan edited a comment on pull request #1619: URL: https://github.com/apache/hudi/pull/1619#issuecomment-636405172 Hi all, thank you for the feedbacks. Seems like it is favorable that the we avoid code coverage report to be override across running tasks. @ramachandranms would you agree

[GitHub] [hudi] xushiyan commented on pull request #1619: [HUDI-896] Parallelize CI tests by modules

2020-05-30 Thread GitBox
xushiyan commented on pull request #1619: URL: https://github.com/apache/hudi/pull/1619#issuecomment-636405172 Hi all, thank you for the feedbacks. Seems like it is favorable that the we avoid code coverage report to be override across running tasks. @ramachandranms would you agree with

svn commit: r39859 - in /dev/hudi/hudi-0.5.3-rc1: ./ hudi-0.5.3-rc1.src.tgz hudi-0.5.3-rc1.src.tgz.asc hudi-0.5.3-rc1.src.tgz.sha512

2020-05-30 Thread sivabalan
Author: sivabalan Date: Sat May 30 23:38:15 2020 New Revision: 39859 Log: Staging source releases for release-0.5.3-rc1 Added: dev/hudi/hudi-0.5.3-rc1/ dev/hudi/hudi-0.5.3-rc1/hudi-0.5.3-rc1.src.tgz (with props) dev/hudi/hudi-0.5.3-rc1/hudi-0.5.3-rc1.src.tgz.asc

[hudi] annotated tag release-0.5.3-rc1 updated (7c1da98 -> 33a18c8)

2020-05-30 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to annotated tag release-0.5.3-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.5.3-rc1 was modified! *** from 7c1da98 (commit) to 33a18c8 (tag)

[hudi] annotated tag release-0.5.3-rc1 updated (82a7be0 -> 3827f1f)

2020-05-30 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to annotated tag release-0.5.3-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.5.3-rc1 was modified! *** from 82a7be0 (commit) to 3827f1f (tag)

[hudi] 01/01: Bumping release candidate number 1

2020-05-30 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2acab1736aba279f5b8171ad2324419d74a434ed Author: Sivabalan Narayanan AuthorDate: Sat May 30 18:22:58 2020 -0400

[hudi] branch release-0.5.3 updated (351ec08 -> 2acab17)

2020-05-30 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git. omit 351ec08 Bumping release candidate number 1 new 2acab17 Bumping release candidate number 1 This

[GitHub] [hudi] vinothchandar commented on pull request #1665: [HUDI-910]Introduce HoodieWriteInput for hudi write client

2020-05-30 Thread GitBox
vinothchandar commented on pull request #1665: URL: https://github.com/apache/hudi/pull/1665#issuecomment-636382401 This pr itself is fine. But given we are adding a new module and this is a critical thing to get right, trying to understand more upfront

[GitHub] [hudi] vinothchandar commented on pull request #1665: [HUDI-910]Introduce HoodieWriteInput for hudi write client

2020-05-30 Thread GitBox
vinothchandar commented on pull request #1665: URL: https://github.com/apache/hudi/pull/1665#issuecomment-636382237 @wangxianghu @leesf sorry for that delays. I was trying to understand the relation to this work https://issues.apache.org/jira/browse/HUDI-538 cc @yanghua This is not

[GitHub] [hudi] vinothchandar commented on issue #1679: How to disable Hive JDBC and enable metastore

2020-05-30 Thread GitBox
vinothchandar commented on issue #1679: URL: https://github.com/apache/hudi/issues/1679#issuecomment-636380163 cc @n3nash as well who made similar changes This is an automated message from the Apache Git Service. To respond

[hudi] annotated tag release-0.5.3-rc1 updated (82a7be0 -> 3827f1f)

2020-05-30 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to annotated tag release-0.5.3-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.5.3-rc1 was modified! *** from 82a7be0 (commit) to 3827f1f (tag)

[GitHub] [hudi] vinothchandar commented on pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
vinothchandar commented on pull request #1592: URL: https://github.com/apache/hudi/pull/1592#issuecomment-636378353 Thanks for jumping in @leesf .. will pull the code down today and review, with plan to land early next week

[hudi] annotated tag 0.5.3-rc1 updated (351ec08 -> 024cf28)

2020-05-30 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to annotated tag 0.5.3-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag 0.5.3-rc1 was modified! *** from 351ec08 (commit) to 024cf28 (tag) tagging

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
codecov-commenter edited a comment on pull request #1592: URL: https://github.com/apache/hudi/pull/1592#issuecomment-632985999 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1592?src=pr=h1) Report > Merging [#1592](https://codecov.io/gh/apache/hudi/pull/1592?src=pr=desc) into

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
codecov-commenter edited a comment on pull request #1592: URL: https://github.com/apache/hudi/pull/1592#issuecomment-632985999 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1592?src=pr=h1) Report > Merging [#1592](https://codecov.io/gh/apache/hudi/pull/1592?src=pr=desc) into

[GitHub] [hudi] garyli1019 commented on pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
garyli1019 commented on pull request #1592: URL: https://github.com/apache/hudi/pull/1592#issuecomment-636371462 @leesf Thanks for reviewing! Comments addressed This is an automated message from the Apache Git Service. To

[GitHub] [hudi] garyli1019 commented on a change in pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
garyli1019 commented on a change in pull request #1592: URL: https://github.com/apache/hudi/pull/1592#discussion_r432879074 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeRecordReaderUtils.java ## @@ -0,0 +1,41 @@ +/* + * Licensed to the

[GitHub] [hudi] wangxianghu edited a comment on pull request #1665: [HUDI-910]Introduce HoodieWriteInput for hudi write client

2020-05-30 Thread GitBox
wangxianghu edited a comment on pull request #1665: URL: https://github.com/apache/hudi/pull/1665#issuecomment-633776310 > > > Is there an umbrella task to understand how all the follow up work will be.. on this..For e.g I am wondering what the eventual methods on

[hudi] branch asf-site updated: Travis CI build asf-site

2020-05-30 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 9eb6e6d Travis CI build asf-site 9eb6e6d is

[hudi] branch asf-site updated: [HUDI-836] [BLOG] Monitor Hudi metrics with Datadog (#1672)

2020-05-30 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new ae31d77 [HUDI-836] [BLOG] Monitor Hudi

[GitHub] [hudi] vinothchandar merged pull request #1672: [HUDI-836] [BLOG] Monitor Hudi metrics with Datadog

2020-05-30 Thread GitBox
vinothchandar merged pull request #1672: URL: https://github.com/apache/hudi/pull/1672 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Description: Document the use of metrics system in Hudi, include all supported metrics reporter. See the

[GitHub] [hudi] xushiyan commented on a change in pull request #1672: [HUDI-836] [BLOG] Monitor Hudi metrics with Datadog

2020-05-30 Thread GitBox
xushiyan commented on a change in pull request #1672: URL: https://github.com/apache/hudi/pull/1672#discussion_r432872823 ## File path: docs/_posts/2020-05-28-monitoring-hudi-metrics-with-datadog.md ## @@ -0,0 +1,61 @@ +--- +title: "Monitor Hudi metrics with Datadog" +excerpt:

[GitHub] [hudi] xushiyan commented on pull request #1672: [HUDI-836] [BLOG] Monitor Hudi metrics with Datadog

2020-05-30 Thread GitBox
xushiyan commented on pull request #1672: URL: https://github.com/apache/hudi/pull/1672#issuecomment-636361909 > @xushiyan +1 to add a blog first.. but let’s add a ticket to document this in the 0.6.0 timeline? Sure. Created https://jira.apache.org/jira/browse/HUDI-983

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Labels: documentation newbie (was: newbie) > Add Metrics section to asf-site >

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Priority: Minor (was: Major) > Add Metrics section to asf-site > --- > >

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Labels: newbie (was: ) > Add Metrics section to asf-site > --- > >

[jira] [Created] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-983: --- Summary: Add Metrics section to asf-site Key: HUDI-983 URL: https://issues.apache.org/jira/browse/HUDI-983 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] vinothchandar commented on issue #1676: [SUPPORT] Updating all the records per key rather than the one with higher timestamp

2020-05-30 Thread GitBox
vinothchandar commented on issue #1676: URL: https://github.com/apache/hudi/issues/1676#issuecomment-636343512 @abhibhat98 trying to understand your user case bit more.. do you want to retain all the versions forever? If so probably better to have a separate table that has an append

[GitHub] [hudi] vinothchandar edited a comment on issue #1676: [SUPPORT] Updating all the records per key rather than the one with higher timestamp

2020-05-30 Thread GitBox
vinothchandar edited a comment on issue #1676: URL: https://github.com/apache/hudi/issues/1676#issuecomment-636343512 @abhibhat98 trying to understand your use case bit more.. do you want to retain all the versions forever? If so probably better to have a separate table that has an append

[GitHub] [hudi] vinothchandar commented on a change in pull request #1672: [HUDI-836] [BLOG] Monitor Hudi metrics with Datadog

2020-05-30 Thread GitBox
vinothchandar commented on a change in pull request #1672: URL: https://github.com/apache/hudi/pull/1672#discussion_r432851638 ## File path: docs/_posts/2020-05-28-monitoring-hudi-metrics-with-datadog.md ## @@ -0,0 +1,61 @@ +--- +title: "Monitor Hudi metrics with Datadog"

[GitHub] [hudi] vinothchandar commented on pull request #1672: [HUDI-836] [BLOG] Monitor Hudi metrics with Datadog

2020-05-30 Thread GitBox
vinothchandar commented on pull request #1672: URL: https://github.com/apache/hudi/pull/1672#issuecomment-636341512 @xushiyan +1 to add a blog first.. but let’s add a ticket to document this in the 0.6.0 timeline?

[hudi] branch release-0.5.3 updated: Bumping release candidate number 1

2020-05-30 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.5.3 by this push: new 351ec08 Bumping release

[jira] [Updated] (HUDI-981) Introduce AbstractHoodieIndex for hudi write client

2020-05-30 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-981: - Description: At a high level, HoodieIndex should be irrelevant to engines. So we should abstract it.

[jira] [Closed] (HUDI-980) Some remnants after running TestHiveSyncTool is created in local source dir

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-980. -- > Some remnants after running TestHiveSyncTool is created in local source dir >

[jira] [Updated] (HUDI-980) Some remnants after running TestHiveSyncTool is created in local source dir

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-980: --- Fix Version/s: 0.6.0 > Some remnants after running TestHiveSyncTool is created in local source dir >

[jira] [Resolved] (HUDI-786) InlineFileSystem.read API should ensure content beyond inline length gets an EOF

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-786. Resolution: Fixed Fixed via master: 5a0d3f1cf963e0061364d915ac86a465dd079bac > InlineFileSystem.read API should

[jira] [Closed] (HUDI-973) RemoteHoodieTableFileSystemView supports non-partitioned table queries

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-973. -- > RemoteHoodieTableFileSystemView supports non-partitioned table queries >

[jira] [Resolved] (HUDI-476) Add a hudi-examples module

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-476. Resolution: Fixed Fixed via master: bde7a7043e100242fec8fc0111e489a269a1d997 > Add a hudi-examples module >

[jira] [Closed] (HUDI-476) Add a hudi-examples module

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-476. -- > Add a hudi-examples module > -- > > Key: HUDI-476 > URL:

[jira] [Closed] (HUDI-936) Fix fetching orderingval logic in HoodieSparkSqlWriter.write(...) to remove unnecessary casting to String

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-936. -- > Fix fetching orderingval logic in HoodieSparkSqlWriter.write(...) to remove > unnecessary casting to String >

[jira] [Resolved] (HUDI-936) Fix fetching orderingval logic in HoodieSparkSqlWriter.write(...) to remove unnecessary casting to String

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-936. Resolution: Fixed Fixed via master: 9697fbf71ead328cae6d56e9f99872e871342887 > Fix fetching orderingval logic in

[jira] [Resolved] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-690. Resolution: Fixed Fixed via master: 6c450957ced051de6231ad047bce22752210b786 > filtercompletedInstants in

[jira] [Closed] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-690. -- > filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR > tables >

[GitHub] [hudi] bvaradar commented on pull request #1678: [WIP] [HUDI-242] Metadata Bootstrap changes

2020-05-30 Thread GitBox
bvaradar commented on pull request #1678: URL: https://github.com/apache/hudi/pull/1678#issuecomment-636315006 @umehrot2 @vinothchandar : Unit tests should be passing now. I will add notes to explain high level changes and also annotate part of code myself to describe the reason behind

[jira] [Comment Edited] (HUDI-826) Spark to avro schema in 0.6 incompatible with 0.5 for fixed types

2020-05-30 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120172#comment-17120172 ] Yajun Luo edited comment on HUDI-826 at 5/30/20, 9:41 AM: -- [~afilipchik] I saw

[jira] [Comment Edited] (HUDI-826) Spark to avro schema in 0.6 incompatible with 0.5 for fixed types

2020-05-30 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120172#comment-17120172 ] Yajun Luo edited comment on HUDI-826 at 5/30/20, 9:39 AM: -- [~afilipchik] I saw

[jira] [Comment Edited] (HUDI-826) Spark to avro schema in 0.6 incompatible with 0.5 for fixed types

2020-05-30 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120172#comment-17120172 ] Yajun Luo edited comment on HUDI-826 at 5/30/20, 9:38 AM: -- [~afilipchik] I saw

[jira] [Commented] (HUDI-826) Spark to avro schema in 0.6 incompatible with 0.5 for fixed types

2020-05-30 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120172#comment-17120172 ] Yajun Luo commented on HUDI-826: [~afilipchik] I see that databricks spark-avro has been replaced by native

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1686: [HUDI-709]Add unit test for UtilsCommand

2020-05-30 Thread GitBox
codecov-commenter edited a comment on pull request #1686: URL: https://github.com/apache/hudi/pull/1686#issuecomment-636298521 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1686?src=pr=h1) Report > Merging [#1686](https://codecov.io/gh/apache/hudi/pull/1686?src=pr=desc) into

[GitHub] [hudi] codecov-commenter commented on pull request #1686: [HUDI-709]Add unit test for UtilsCommand

2020-05-30 Thread GitBox
codecov-commenter commented on pull request #1686: URL: https://github.com/apache/hudi/pull/1686#issuecomment-636298521 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1686?src=pr=h1) Report > Merging [#1686](https://codecov.io/gh/apache/hudi/pull/1686?src=pr=desc) into

[GitHub] [hudi] leesf commented on a change in pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
leesf commented on a change in pull request #1592: URL: https://github.com/apache/hudi/pull/1592#discussion_r432820783 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeRecordReaderUtils.java ## @@ -0,0 +1,41 @@ +/* + * Licensed to the

[GitHub] [hudi] leesf commented on a change in pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
leesf commented on a change in pull request #1592: URL: https://github.com/apache/hudi/pull/1592#discussion_r432820528 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieParquetRealtimeInputFormat.java ## @@ -199,9 +110,9 @@ private static

[GitHub] [hudi] leesf commented on a change in pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
leesf commented on a change in pull request #1592: URL: https://github.com/apache/hudi/pull/1592#discussion_r432819904 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieParquetInputFormat.java ## @@ -158,157 +122,22 @@ protected HoodieDefaultTimeline

[jira] [Updated] (HUDI-822) Decouple hoodie related methods with Hoodie Input Formats

2020-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-822: Labels: pull-request-available (was: ) > Decouple hoodie related methods with Hoodie Input Formats

[GitHub] [hudi] leesf commented on a change in pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-05-30 Thread GitBox
leesf commented on a change in pull request #1592: URL: https://github.com/apache/hudi/pull/1592#discussion_r432819904 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieParquetInputFormat.java ## @@ -158,157 +122,22 @@ protected HoodieDefaultTimeline