[GitHub] [hudi] hudi-bot edited a comment on pull request #3477: Add apache license to spark_command.txt.template

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3477: URL: https://github.com/apache/hudi/pull/3477#issuecomment-899003665 ## CI report: * de8f523cf3ee764fb22d19d9cdb0bc6d4324265c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot commented on pull request #3477: Add apache license to spark_command.txt.template

2021-08-14 Thread GitBox
hudi-bot commented on pull request #3477: URL: https://github.com/apache/hudi/pull/3477#issuecomment-899003665 ## CI report: * de8f523cf3ee764fb22d19d9cdb0bc6d4324265c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] umehrot2 opened a new pull request #3477: Add apache license to spark_command.txt.template

2021-08-14 Thread GitBox
umehrot2 opened a new pull request #3477: URL: https://github.com/apache/hudi/pull/3477 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpos

svn commit: r49506 - in /dev/hudi/hudi-0.9.0-rc1: ./ hudi-0.9.0-rc1.src.tgz hudi-0.9.0-rc1.src.tgz.asc hudi-0.9.0-rc1.src.tgz.sha512

2021-08-14 Thread uditme
Author: uditme Date: Sun Aug 15 05:55:45 2021 New Revision: 49506 Log: Apache Hudi, version 0.9.0, release candidate 1 Added: dev/hudi/hudi-0.9.0-rc1/ dev/hudi/hudi-0.9.0-rc1/hudi-0.9.0-rc1.src.tgz (with props) dev/hudi/hudi-0.9.0-rc1/hudi-0.9.0-rc1.src.tgz.asc dev/hudi/hudi-0.9

[jira] [Commented] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399304#comment-17399304 ] ASF GitHub Bot commented on HUDI-1822: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3475: [HUDI-1822][RFC-27][WIP] range index support with metadata table

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3475: URL: https://github.com/apache/hudi/pull/3475#issuecomment-898962060 ## CI report: * e41d68d93250ce90b76440ffb9bb1e4019852bae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] umehrot2 commented on issue #3321: [SUPPORT] Setting _hoodie_is_deleted column is not deleting records when using Spark DataSource.

2021-08-14 Thread GitBox
umehrot2 commented on issue #3321: URL: https://github.com/apache/hudi/issues/3321#issuecomment-898996544 @nmukerje you have to make sure that the newly added field `_hoodie_is_deleted` is marked as `nullable` in the Spark schema. I think in your example its becoming `nullable=false` with

[jira] [Commented] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399301#comment-17399301 ] ASF GitHub Bot commented on HUDI-1822: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3475: [HUDI-1822][RFC-27][WIP] range index support with metadata table

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3475: URL: https://github.com/apache/hudi/pull/3475#issuecomment-898962060 ## CI report: * e685a5227e042bae771da874627278f5cc549b06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399300#comment-17399300 ] ASF GitHub Bot commented on HUDI-1822: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3475: [HUDI-1822][RFC-27][WIP] range index support with metadata table

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3475: URL: https://github.com/apache/hudi/pull/3475#issuecomment-898962060 ## CI report: * e685a5227e042bae771da874627278f5cc549b06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[hudi] annotated tag release-0.9.0-rc1 updated (8d82d19 -> da866ba)

2021-08-14 Thread uditme
This is an automated email from the ASF dual-hosted git repository. uditme pushed a change to annotated tag release-0.9.0-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.9.0-rc1 was modified! *** from 8d82d19 (commit) to da866ba (tag) tagg

[GitHub] [hudi] hudi-bot edited a comment on pull request #3476: [MINOR] Fix SelectPackages in HoodieSparkFunctionalTestSuite

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3476: URL: https://github.com/apache/hudi/pull/3476#issuecomment-898971258 ## CI report: * 56542b89026ebdb09ba62fa9a7df6d6353f08639 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Updated] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2279: Status: In Progress (was: Open) > Support column name matching for insert * and update set * in me

[jira] [Resolved] (HUDI-2279) Support column name matching for insert * and update set * in merge into when sourceTable's columns contains all targetTable's columns

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2279. - Resolution: Fixed > Support column name matching for insert * and update set * in merge into > w

[jira] [Updated] (HUDI-1363) Provide Option to drop columns after they are used to generate partition or record keys

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1363: Status: Closed (was: Patch Available) > Provide Option to drop columns after they are used to gener

[jira] [Updated] (HUDI-2151) Make performant out-of-box configs

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2151: Status: In Progress (was: Open) > Make performant out-of-box configs >

[jira] [Resolved] (HUDI-2119) Syncing of rollbacks to metadata table does not work in all cases

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2119. - Resolution: Fixed > Syncing of rollbacks to metadata table does not work in all cases > --

[jira] [Resolved] (HUDI-2307) When using delete_partition with ds should not rely on the primary key

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2307. - Assignee: liujinhui Resolution: Fixed > When using delete_partition with ds should not rely

[jira] [Updated] (HUDI-2307) When using delete_partition with ds should not rely on the primary key

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2307: Status: In Progress (was: Open) > When using delete_partition with ds should not rely on the primar

[jira] [Updated] (HUDI-2305) Fix marker-based rollback in 0.9.0

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2305: Status: In Progress (was: Open) > Fix marker-based rollback in 0.9.0 >

[jira] [Resolved] (HUDI-2305) Fix marker-based rollback in 0.9.0

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2305. - Resolution: Fixed > Fix marker-based rollback in 0.9.0 > -- > >

[jira] [Updated] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1897: Fix Version/s: 0.9.0 > Implement DeltaStreamer Source for AWS S3 > -

[jira] [Updated] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1897: Status: Closed (was: Patch Available) > Implement DeltaStreamer Source for AWS S3 > ---

[jira] [Resolved] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2268. - Resolution: Fixed > Upgrade hoodie table to 0.9.0 > - > >

[jira] [Updated] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2268: Status: In Progress (was: Open) > Upgrade hoodie table to 0.9.0 > - > >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3476: [MINOR] Fix SelectPackages in HoodieSparkFunctionalTestSuite

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3476: URL: https://github.com/apache/hudi/pull/3476#issuecomment-898971258 ## CI report: * 56542b89026ebdb09ba62fa9a7df6d6353f08639 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] xushiyan commented on pull request #3476: [MINOR] Fix SelectPackages in HoodieSparkFunctionalTestSuite

2021-08-14 Thread GitBox
xushiyan commented on pull request #3476: URL: https://github.com/apache/hudi/pull/3476#issuecomment-898985151 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[hudi] branch release-0.9.0 created (now 8d82d19)

2021-08-14 Thread uditme
This is an automated email from the ASF dual-hosted git repository. uditme pushed a change to branch release-0.9.0 in repository https://gitbox.apache.org/repos/asf/hudi.git. at 8d82d19 Create release branch for version 0.9.0. This branch includes the following new commits: new 8d8

[hudi] 01/01: Create release branch for version 0.9.0.

2021-08-14 Thread uditme
This is an automated email from the ASF dual-hosted git repository. uditme pushed a commit to branch release-0.9.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8d82d19ee4da8910c7101b24ab976ac7cf54e732 Author: Udit Mehrotra AuthorDate: Sat Aug 14 18:52:18 2021 -0700 Crea

[hudi] branch master updated: Moving to 0.10.0-SNAPSHOT on master branch.

2021-08-14 Thread uditme
This is an automated email from the ASF dual-hosted git repository. uditme pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3e30119 Moving to 0.10.0-SNAPSHOT on master branc

[GitHub] [hudi] nmukerje edited a comment on issue #3454: [SUPPORT] Is Hive v3 supported?

2021-08-14 Thread GitBox
nmukerje edited a comment on issue #3454: URL: https://github.com/apache/hudi/issues/3454#issuecomment-898979390 Yes, @tooptoop4 e.g. Amazon EMR 6.x is on Hive 3 and supports Hudi 0.7.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] nmukerje commented on issue #3454: [SUPPORT] Is Hive v3 supported?

2021-08-14 Thread GitBox
nmukerje commented on issue #3454: URL: https://github.com/apache/hudi/issues/3454#issuecomment-898979390 Yes, @tooptoop4 tooptoop4EMR 6.x is on Hive 3 and supports Hudi 0.7.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] nmukerje edited a comment on issue #3321: [SUPPORT] Setting _hoodie_is_deleted column is not deleting records when using Spark DataSource.

2021-08-14 Thread GitBox
nmukerje edited a comment on issue #3321: URL: https://github.com/apache/hudi/issues/3321#issuecomment-898979181 @nsivabalan @codope Worked fine after I cast _hoodie_is_deleted to boolean in the upsert operation. ``` from pyspark.sql.types import * df1=df1.withColumn("_hoodie_

[GitHub] [hudi] nmukerje edited a comment on issue #3321: [SUPPORT] Setting _hoodie_is_deleted column is not deleting records when using Spark DataSource.

2021-08-14 Thread GitBox
nmukerje edited a comment on issue #3321: URL: https://github.com/apache/hudi/issues/3321#issuecomment-898979181 @nsivabalan @codope Worked fine after I cast _hoodie_is_deleted to boolean in the upsert operation. ``` df1=df1.withColumn("_hoodie_is_deleted",df1["_hoodie_is_deleted

[GitHub] [hudi] nmukerje edited a comment on issue #3321: [SUPPORT] Setting _hoodie_is_deleted column is not deleting records when using Spark DataSource.

2021-08-14 Thread GitBox
nmukerje edited a comment on issue #3321: URL: https://github.com/apache/hudi/issues/3321#issuecomment-898979181 @nsivabalan @codope Worked fine after I cast _hoodie_is_deleted to boolean. ``` df1=df1.withColumn("_hoodie_is_deleted",df1["_hoodie_is_deleted"].cast(BooleanType()))

[GitHub] [hudi] nmukerje commented on issue #3321: [SUPPORT] Setting _hoodie_is_deleted column is not deleting records when using Spark DataSource.

2021-08-14 Thread GitBox
nmukerje commented on issue #3321: URL: https://github.com/apache/hudi/issues/3321#issuecomment-898979181 @nsivabalan @codope Worked fine after I cast _hoodie_is_deleted to boolean. ``` df1=df1.withColumn("_hoodie_is_deleted",df1["_hoodie_is_deleted"].cast(BooleanType())) ```

[GitHub] [hudi] hudi-bot edited a comment on pull request #3476: [MINOR] Fix SelectPackages in HoodieSparkFunctionalTestSuite

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3476: URL: https://github.com/apache/hudi/pull/3476#issuecomment-898971258 ## CI report: * 56542b89026ebdb09ba62fa9a7df6d6353f08639 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399285#comment-17399285 ] ASF GitHub Bot commented on HUDI-2268: -- nsivabalan merged pull request #3470: URL: ht

[hudi] branch master updated (18e6b79 -> 23dca6c)

2021-08-14 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 18e6b79 [MINOR] Adding back all old default val members to DataSourceOptions (#3474) add 23dca6c [HUDI-2268]

[GitHub] [hudi] nsivabalan merged pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
nsivabalan merged pull request #3470: URL: https://github.com/apache/hudi/pull/3470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [hudi] hudi-bot edited a comment on pull request #3476: [MINOR] Fix SelectPackages in HoodieSparkFunctionalTestSuite

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3476: URL: https://github.com/apache/hudi/pull/3476#issuecomment-898971258 ## CI report: * 56542b89026ebdb09ba62fa9a7df6d6353f08639 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot commented on pull request #3476: [MINOR] Fix SelectPackages in HoodieSparkFunctionalTestSuite

2021-08-14 Thread GitBox
hudi-bot commented on pull request #3476: URL: https://github.com/apache/hudi/pull/3476#issuecomment-898971258 ## CI report: * 56542b89026ebdb09ba62fa9a7df6d6353f08639 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] xushiyan opened a new pull request #3476: [MINOR] Fix SelectPackages in HoodieSparkFunctionalTestSuite

2021-08-14 Thread GitBox
xushiyan opened a new pull request #3476: URL: https://github.com/apache/hudi/pull/3476 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpos

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399284#comment-17399284 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * 777aa8295572618a5b191deebe4baf62ed3b52e9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399282#comment-17399282 ] ASF GitHub Bot commented on HUDI-2080: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [HUDI-2080] Move to ubuntu-18.04 for Azure CI

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-895612316 ## CI report: * 9053eae7f3f643dad44c202112cb2c0b62b70f31 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Reopened] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-08-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-1939: -- reopening this due to not complete for modules other than hivesync. and updated version to 0.10.0 cc [~udi

[jira] [Updated] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-08-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1939: - Fix Version/s: (was: 0.9.0) 0.10.0 > Replace joda-time api to new jdk8 time api > -

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399277#comment-17399277 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * 2c9c5d3123dc437e0e012f14f33cd21eef536b64 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Commented] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399274#comment-17399274 ] ASF GitHub Bot commented on HUDI-1822: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3475: [HUDI-1822][RFC-27][WIP] range index support with metadata table

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3475: URL: https://github.com/apache/hudi/pull/3475#issuecomment-898962060 ## CI report: * e685a5227e042bae771da874627278f5cc549b06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399271#comment-17399271 ] ASF GitHub Bot commented on HUDI-2080: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [HUDI-2080] Move to ubuntu-18.04 for Azure CI

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-895612316 ## CI report: * 780c75a10e5a646d14abb2e8207179202bedfce7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399269#comment-17399269 ] ASF GitHub Bot commented on HUDI-2080: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [HUDI-2080] Move to ubuntu-18.04 for Azure CI

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-895612316 ## CI report: * 780c75a10e5a646d14abb2e8207179202bedfce7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399264#comment-17399264 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * 2c9c5d3123dc437e0e012f14f33cd21eef536b64 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[hudi] branch master updated (5cc96e8 -> 18e6b79)

2021-08-14 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 5cc96e8 [HUDI-1897] Deltastreamer source for AWS S3 (#3433) add 18e6b79 [MINOR] Adding back all old default val

[GitHub] [hudi] vinothchandar merged pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
vinothchandar merged pull request #3474: URL: https://github.com/apache/hudi/pull/3474 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[jira] [Commented] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399263#comment-17399263 ] ASF GitHub Bot commented on HUDI-1822: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3475: [HUDI-1822][RFC-27][WIP] range index support with metadata table

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3475: URL: https://github.com/apache/hudi/pull/3475#issuecomment-898962060 ## CI report: * e685a5227e042bae771da874627278f5cc549b06 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399261#comment-17399261 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[jira] [Commented] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399262#comment-17399262 ] ASF GitHub Bot commented on HUDI-1822: -- hudi-bot commented on pull request #3475: URL

[GitHub] [hudi] hudi-bot commented on pull request #3475: [HUDI-1822][RFC-27][WIP] range index support with metadata table

2021-08-14 Thread GitBox
hudi-bot commented on pull request #3475: URL: https://github.com/apache/hudi/pull/3475#issuecomment-898962060 ## CI report: * e685a5227e042bae771da874627278f5cc549b06 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * bd0a74b3af15af01b2b4fa0475a90e132f8eb1e4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Updated] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1822: - Labels: pull-request-available (was: ) > [Umbrella] Range index support > ---

[jira] [Commented] (HUDI-1822) [Umbrella] Range index support

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399260#comment-17399260 ] ASF GitHub Bot commented on HUDI-1822: -- satishkotha opened a new pull request #3475:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898956370 ## CI report: * 9aa0a3ebf47c9b7debab1366f021924c358dbfde Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] satishkotha opened a new pull request #3475: [HUDI-1822][RFC-27][WIP] range index support with metadata table

2021-08-14 Thread GitBox
satishkotha opened a new pull request #3475: URL: https://github.com/apache/hudi/pull/3475 ## What is the purpose of the pull request Add range index support with metadata table ## Brief change log * This is a WIP PR primarily used for data collection. * Lot of fundam

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399259#comment-17399259 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * bd0a74b3af15af01b2b4fa0475a90e132f8eb1e4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399258#comment-17399258 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898956370 ## CI report: * 9aa0a3ebf47c9b7debab1366f021924c358dbfde Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * bd0a74b3af15af01b2b4fa0475a90e132f8eb1e4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898956370 ## CI report: * 9aa0a3ebf47c9b7debab1366f021924c358dbfde Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] vinothchandar commented on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
vinothchandar commented on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898959191 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [hudi] hudi-bot edited a comment on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898956370 ## CI report: * 9aa0a3ebf47c9b7debab1366f021924c358dbfde Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot edited a comment on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898956370 ## CI report: * 9aa0a3ebf47c9b7debab1366f021924c358dbfde Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898956370 ## CI report: * 9aa0a3ebf47c9b7debab1366f021924c358dbfde Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot commented on pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
hudi-bot commented on pull request #3474: URL: https://github.com/apache/hudi/pull/3474#issuecomment-898956370 ## CI report: * 9aa0a3ebf47c9b7debab1366f021924c358dbfde UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] vinothchandar opened a new pull request #3474: [MINOR] Adding back all old default val members to DataSourceOptions

2021-08-14 Thread GitBox
vinothchandar opened a new pull request #3474: URL: https://github.com/apache/hudi/pull/3474 - Added @Deprecated - Added @deprecated javadoc to keys and defaults suggested how to migrate - Moved all deprecated members to bottom to improve readability ## *Tips* - *Thank you

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399250#comment-17399250 ] ASF GitHub Bot commented on HUDI-2268: -- nsivabalan commented on pull request #3470: U

[GitHub] [hudi] nsivabalan commented on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
nsivabalan commented on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898953599 LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399233#comment-17399233 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * bd0a74b3af15af01b2b4fa0475a90e132f8eb1e4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399213#comment-17399213 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * 99fd2ff7aa0818d7591a0a4bdb59e405758d64f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399212#comment-17399212 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * 99fd2ff7aa0818d7591a0a4bdb59e405758d64f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399211#comment-17399211 ] ASF GitHub Bot commented on HUDI-2268: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
yihua commented on a change in pull request #3470: URL: https://github.com/apache/hudi/pull/3470#discussion_r688960995 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/MarkerUtils.java ## @@ -216,4 +216,4 @@ public static void deleteMarkerTypeFile(FileSystem

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399208#comment-17399208 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * 99fd2ff7aa0818d7591a0a4bdb59e405758d64f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399207#comment-17399207 ] ASF GitHub Bot commented on HUDI-2268: -- hudi-bot edited a comment on pull request #34

[GitHub] [hudi] hudi-bot edited a comment on pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
hudi-bot edited a comment on pull request #3470: URL: https://github.com/apache/hudi/pull/3470#issuecomment-898348968 ## CI report: * 775dbc13d18f0b76736b6d3993c42c6efa4b2e1c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399198#comment-17399198 ] ASF GitHub Bot commented on HUDI-2268: -- nsivabalan commented on a change in pull requ

[GitHub] [hudi] nsivabalan commented on a change in pull request #3470: [HUDI-2268] Add upgrade and downgrade to and from 0.9.0

2021-08-14 Thread GitBox
nsivabalan commented on a change in pull request #3470: URL: https://github.com/apache/hudi/pull/3470#discussion_r688940468 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/BaseOneToTwoUpgradeHandler.java ## @@ -0,0 +1,43 @@ +/* + * Lice

  1   2   >