[GitHub] [incubator-hudi] AakashPradeep commented on a change in pull request #1580: [HUDI-852] adding check for table name for Append Save mode

AakashPradeep commented on a change in pull request #1580: URL: https://github.com/apache/incubator-hudi/pull/1580#discussion_r419837606 ## File path: hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala ## @@ -83,6 +83,13 @@ private[hudi] object

[GitHub] [incubator-hudi] afilipchik commented on a change in pull request #1516: [HUDI-784] Adressing issue with log reader on GCS

afilipchik commented on a change in pull request #1516: URL: https://github.com/apache/incubator-hudi/pull/1516#discussion_r419850319 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFileReader.java ## @@ -79,6 +79,11 @@

[GitHub] [incubator-hudi] afilipchik commented on pull request #1584: fix schema provider issue

afilipchik commented on pull request #1584: URL: https://github.com/apache/incubator-hudi/pull/1584#issuecomment-623841301 Probably outside of the scope of this PR, but, would it be a good idea to split schema provider into 2 separate source and target ones? I contributed null target

[jira] [Updated] (HUDI-69) Support realtime view in Spark datasource #136

[ https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-69: --- Status: Closed (was: Patch Available) > Support realtime view in Spark datasource #136 >

[GitHub] [incubator-hudi] afilipchik commented on a change in pull request #1565: [HUDI-73]: implemented vanilla AvroKafkaSource

afilipchik commented on a change in pull request #1565: URL: https://github.com/apache/incubator-hudi/pull/1565#discussion_r419848101 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/serde/AbstractHoodieKafkaAvroDeserializer.java ## @@ -0,0 +1,97 @@ +/* +

[jira] [Reopened] (HUDI-69) Support realtime view in Spark datasource #136

[ https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li reopened HUDI-69: > Support realtime view in Spark datasource #136 > -- > >

[jira] [Issue Comment Deleted] (HUDI-69) Support realtime view in Spark datasource #136

[ https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-69: --- Comment: was deleted (was: Can anyone reopen this ticket? I accidentally closed this :)) > Support

[jira] [Commented] (HUDI-69) Support realtime view in Spark datasource #136

[ https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099507#comment-17099507 ] Yanjia Gary Li commented on HUDI-69: Can anyone reopen this ticket? I accidentally closed this :) >

[GitHub] [incubator-hudi] afilipchik commented on a change in pull request #1565: [HUDI-73]: implemented vanilla AvroKafkaSource

afilipchik commented on a change in pull request #1565: URL: https://github.com/apache/incubator-hudi/pull/1565#discussion_r419848101 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/serde/AbstractHoodieKafkaAvroDeserializer.java ## @@ -0,0 +1,97 @@ +/* +

[jira] [Updated] (HUDI-822) Decouple hoodie related methods with Hoodie Input Formats

[ https://issues.apache.org/jira/browse/HUDI-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-822: Status: In Progress (was: Open) > Decouple hoodie related methods with Hoodie Input Formats >

[jira] [Updated] (HUDI-69) Support realtime view in Spark datasource #136

[ https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-69: --- Description: [https://github.com/uber/hudi/issues/136] RFC: 

[jira] [Updated] (HUDI-69) Support realtime view in Spark datasource #136

[ https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-69: --- Status: Patch Available (was: In Progress) > Support realtime view in Spark datasource #136 >

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #268

See Changes: -- [...truncated 2.34 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[GitHub] [incubator-hudi] afilipchik commented on a change in pull request #1562: [HUDI-837]: implemented custom deserializer for AvroKafkaSource

afilipchik commented on a change in pull request #1562: URL: https://github.com/apache/incubator-hudi/pull/1562#discussion_r419843893 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/serde/HoodieAvroKafkaDeserializer.java ## @@ -0,0 +1,78 @@ +/* +

[GitHub] [incubator-hudi] AakashPradeep commented on a change in pull request #1580: [HUDI-852] adding check for table name for Append Save mode

AakashPradeep commented on a change in pull request #1580: URL: https://github.com/apache/incubator-hudi/pull/1580#discussion_r419837606 ## File path: hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala ## @@ -83,6 +83,13 @@ private[hudi] object

[jira] [Updated] (HUDI-862) Migrate HUDI site blogs from Confluence to Jeykll

[ https://issues.apache.org/jira/browse/HUDI-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-862: Status: Open (was: New) > Migrate HUDI site blogs from Confluence to Jeykll >

[jira] [Updated] (HUDI-862) Migrate HUDI site blogs from Confluence to Jeykll

[ https://issues.apache.org/jira/browse/HUDI-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-862: Status: In Progress (was: Open) > Migrate HUDI site blogs from Confluence to Jeykll >

[GitHub] [incubator-hudi] prashantwason commented on pull request #1594: [HUDI-862] Migrate HUDI site blogs from Confluence to Jeykll.

prashantwason commented on pull request #1594: URL: https://github.com/apache/incubator-hudi/pull/1594#issuecomment-623785503  Screenshot showing a blog post page.

[GitHub] [incubator-hudi] prashantwason commented on pull request #1594: [HUDI-862] Migrate HUDI site blogs from Confluence to Jeykll.

prashantwason commented on pull request #1594: URL: https://github.com/apache/incubator-hudi/pull/1594#issuecomment-623785400  The main page showing the new blog section and

[GitHub] [incubator-hudi] prashantwason opened a new pull request #1594: [HUDI-862] Migrate HUDI site blogs from Confluence to Jeykll.

prashantwason opened a new pull request #1594: URL: https://github.com/apache/incubator-hudi/pull/1594 ## What is the purpose of the pull request ## Brief change log 1. Added a data file which saves author information (authors.yml) 2. Theme changes: - Author

[jira] [Updated] (HUDI-862) Migrate HUDI site blogs from Confluence to Jeykll

[ https://issues.apache.org/jira/browse/HUDI-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-862: Labels: pull-request-available (was: ) > Migrate HUDI site blogs from Confluence to Jeykll >

[jira] [Updated] (HUDI-862) Migrate HUDI site blogs from Confluence to Jeykll

[ https://issues.apache.org/jira/browse/HUDI-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-862: Description: # Move the blogs from Confluence 

[jira] [Created] (HUDI-862) Migrate HUDI site blogs from Confluence to Jeykll

Prashant Wason created HUDI-862: --- Summary: Migrate HUDI site blogs from Confluence to Jeykll Key: HUDI-862 URL: https://issues.apache.org/jira/browse/HUDI-862 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-839) Implement rollbacks using marker files instead of relying on commit metadata

[ https://issues.apache.org/jira/browse/HUDI-839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-839: Labels: pull-request-available (was: ) > Implement rollbacks using marker files instead of relying

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #1593: [WIP] [HUDI-839] Introducing rollback strategy using marker files

vinothchandar opened a new pull request #1593: URL: https://github.com/apache/incubator-hudi/pull/1593 - Initial commit ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[GitHub] [incubator-hudi] garyli1019 opened a new pull request #1592: WIP[Hudi 69] Spark Datasource for MOR table

garyli1019 opened a new pull request #1592: URL: https://github.com/apache/incubator-hudi/pull/1592 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1591: Skip Null Value on Upsert

pratyakshsharma commented on issue #1591: URL: https://github.com/apache/incubator-hudi/issues/1591#issuecomment-623693070 Hi @AnkitMishra3220 IIUC you want the records to be updated but want to retain the value of the field which has updated value as null. Unfortunately there is no such

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1580: [HUDI-852] adding check for table name for Append Save mode

vinothchandar commented on a change in pull request #1580: URL: https://github.com/apache/incubator-hudi/pull/1580#discussion_r419654885 ## File path: hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala ## @@ -83,6 +83,13 @@ private[hudi] object

[GitHub] [incubator-hudi] bhasudha commented on pull request #1578: [HUDI-305] Add Hudi changes for Presto MOR query support

bhasudha commented on pull request #1578: URL: https://github.com/apache/incubator-hudi/pull/1578#issuecomment-623628994 LGTM. merging this. This is an automated message from the Apache Git Service. To respond to the

[incubator-hudi] branch master updated: Add changes for presto mor queries (#1578)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e21441a Add changes for presto

[jira] [Reopened] (HUDI-852) Add validation to check Table name when Append Mode is used in DataSource writer

[ https://issues.apache.org/jira/browse/HUDI-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aakash Pradeep reopened HUDI-852: - > Add validation to check Table name when Append Mode is used in DataSource > writer >

[jira] [Updated] (HUDI-305) Presto MOR "_rt" queries only reads base parquet file

[ https://issues.apache.org/jira/browse/HUDI-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-305: Labels: pull-request-available (was: ) > Presto MOR "_rt" queries only reads base parquet file >

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1578: [HUDI-305] Add Hudi changes for Presto MOR query support

bschell commented on a change in pull request #1578: URL: https://github.com/apache/incubator-hudi/pull/1578#discussion_r419591469 ## File path: packaging/hudi-presto-bundle/pom.xml ## @@ -128,5 +133,18 @@ hudi-hadoop-mr-bundle ${project.version} + + +

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1578: [HUDI-305] Add Hudi changes for Presto MOR query support

bschell commented on a change in pull request #1578: URL: https://github.com/apache/incubator-hudi/pull/1578#discussion_r419591469 ## File path: packaging/hudi-presto-bundle/pom.xml ## @@ -128,5 +133,18 @@ hudi-hadoop-mr-bundle ${project.version} + + +

[jira] [Updated] (HUDI-852) Add validation to check Table name when Append Mode is used in DataSource writer

[ https://issues.apache.org/jira/browse/HUDI-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aakash Pradeep updated HUDI-852: Status: Closed (was: Patch Available) > Add validation to check Table name when Append Mode is used

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1590: [HUDI-812] Migrate hudi common tests to JUnit 5

xushiyan commented on a change in pull request #1590: URL: https://github.com/apache/incubator-hudi/pull/1590#discussion_r419542895 ## File path: hudi-common/src/test/java/org/apache/hudi/common/fs/TestFSUtils.java ## @@ -18,25 +18,25 @@ package org.apache.hudi.common.fs;

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1590: [HUDI-812] Migrate hudi common tests to JUnit 5

xushiyan commented on a change in pull request #1590: URL: https://github.com/apache/incubator-hudi/pull/1590#discussion_r419227760 ## File path: hudi-common/src/test/java/org/apache/hudi/common/fs/TestFSUtils.java ## @@ -18,25 +18,25 @@ package org.apache.hudi.common.fs;

[GitHub] [incubator-hudi] AnkitMishra3220 opened a new issue #1591: Skip Null Value on Upsert

AnkitMishra3220 opened a new issue #1591: URL: https://github.com/apache/incubator-hudi/issues/1591 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? Yes - Join the mailing list to engage in

[GitHub] [incubator-hudi] hddong removed a comment on pull request #1554: [HUDI-704]Add test for RepairsCommand

hddong removed a comment on pull request #1554: URL: https://github.com/apache/incubator-hudi/pull/1554#issuecomment-623485400 @yanghua : Thanks for your review and comments, had address them. This is an automated message

[GitHub] [incubator-hudi] hddong commented on pull request #1554: [HUDI-704]Add test for RepairsCommand

hddong commented on pull request #1554: URL: https://github.com/apache/incubator-hudi/pull/1554#issuecomment-623485387 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] harshi2506 commented on issue #1552: Time taken for upserting hudi table is increasing with increase in number of partitions

harshi2506 commented on issue #1552: URL: https://github.com/apache/incubator-hudi/issues/1552#issuecomment-623389443 > fighting > BUG status > bugstatus way > upsert long time first timefixed upgrate version (0.5.0 to master) >

[incubator-hudi] branch master updated: [HUDI-852] adding check for table name for Append Save mode (#1580)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 5e0f5e5 [HUDI-852] adding check

[GitHub] [incubator-hudi] bhasudha commented on pull request #1580: [HUDI-852] adding check for table name for Append Save mode

bhasudha commented on pull request #1580: URL: https://github.com/apache/incubator-hudi/pull/1580#issuecomment-623275628 LGtM. Merging. This is an automated message from the Apache Git Service. To respond to the message,