[jira] [Commented] (HUDI-1387) [UMBRELLA] Support Apache Calcite for writing/querying Hudi datasets

2020-11-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231039#comment-17231039 ] Raymond Xu commented on HUDI-1387: -- [~vinoth] ok sounds good. > [UMBRELLA] Support Apache Calcite for

[jira] [Commented] (HUDI-1390) [UMBRELLA] Support schema inference for unstructured data

2020-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232147#comment-17232147 ] Raymond Xu commented on HUDI-1390: -- [~309637554] glad to hear that! we labelled a series of issues with

[jira] [Commented] (HUDI-1390) [UMBRELLA] Support schema inference for unstructured data

2020-11-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232904#comment-17232904 ] Raymond Xu commented on HUDI-1390: -- yes sounds good. > [UMBRELLA] Support schema inference for

[jira] [Updated] (HUDI-1237) [UMBRELLA] Checkstyle, formatting, warnings, spotless

2020-11-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1237: - Labels: gsoc2021 mentor (was: gsoc2021) > [UMBRELLA] Checkstyle, formatting, warnings, spotless >

[jira] [Updated] (HUDI-1237) [UMBRELLA] Checkstyle, formatting, warnings, spotless

2020-11-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1237: - Labels: gsoc2021 (was: ) > [UMBRELLA] Checkstyle, formatting, warnings, spotless >

[jira] [Commented] (HUDI-1390) [UMBRELLA] Support schema inference for unstructured data

2020-11-15 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232381#comment-17232381 ] Raymond Xu commented on HUDI-1390: -- yes [~309637554] that is the intended use case. It'll be great to be

[jira] [Updated] (HUDI-304) Bring back spotless plugin

2021-01-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-304: Labels: pull-request-available (was: bug-bash-0.6.0 help-wanted pull-request-available) > Bring back

[jira] [Assigned] (HUDI-304) Bring back spotless plugin

2021-01-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-304: --- Assignee: Raymond Xu (was: leesf) > Bring back spotless plugin > --- > >

[jira] [Updated] (HUDI-304) Bring back spotless plugin

2021-01-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-304: Status: In Progress (was: Open) > Bring back spotless plugin > --- > >

[jira] [Commented] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-01-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266551#comment-17266551 ] Raymond Xu commented on HUDI-393: - [~wangxianghu] I've started trying out some Azure configs. Please feel

[jira] [Assigned] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-01-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-393: --- Assignee: Raymond Xu > Integrate with Azure Pipeline run the end to end tests >

[jira] [Commented] (HUDI-304) Bring back spotless plugin

2021-01-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266549#comment-17266549 ] Raymond Xu commented on HUDI-304: - [~vinoth] Thanks, I've checked out flink's changes and made a PR to show

[jira] [Commented] (HUDI-1505) Allow pluggable option to write error records to side table, queue

2021-02-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277639#comment-17277639 ] Raymond Xu commented on HUDI-1505: -- [~vinoth] sorry I'm not actively on that feature. > Allow pluggable

[jira] [Created] (HUDI-1985) Website re-design implementation

2021-06-07 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1985: Summary: Website re-design implementation Key: HUDI-1985 URL: https://issues.apache.org/jira/browse/HUDI-1985 Project: Apache Hudi Issue Type: Improvement

[jira] [Assigned] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-06-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1932: Assignee: nate radtke > Hive Sync should not always update last_commit_time_sync >

[jira] [Updated] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-06-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1932: - Status: In Progress (was: Open) > Hive Sync should not always update last_commit_time_sync >

[jira] [Commented] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-06-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362366#comment-17362366 ] Raymond Xu commented on HUDI-1939: -- Some previous related discussion 

[jira] [Commented] (HUDI-1175) Investigate CI test flakiness (hangs)

2021-06-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362593#comment-17362593 ] Raymond Xu commented on HUDI-1175: -- [~shivnarayan] looks like there is one PR for this. can resolve and

[jira] [Assigned] (HUDI-1175) Investigate CI test flakiness (hangs)

2021-06-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1175: Assignee: sivabalan narayanan > Investigate CI test flakiness (hangs) >

[jira] [Updated] (HUDI-1175) Investigate CI test flakiness (hangs)

2021-06-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1175: - Status: Open (was: New) > Investigate CI test flakiness (hangs) > -

[jira] [Resolved] (HUDI-1175) Investigate CI test flakiness (hangs)

2021-06-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1175. -- Fix Version/s: 0.9.0 Resolution: Fixed > Investigate CI test flakiness (hangs) >

[jira] [Commented] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2021-06-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365844#comment-17365844 ] Raymond Xu commented on HUDI-1248: -- Starting from [this

[jira] [Comment Edited] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2021-06-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365844#comment-17365844 ] Raymond Xu edited comment on HUDI-1248 at 6/21/21, 5:59 AM: -Starting from

[jira] [Comment Edited] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2021-06-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365844#comment-17365844 ] Raymond Xu edited comment on HUDI-1248 at 6/21/21, 6:00 AM: -Starting from

[jira] [Resolved] (HUDI-1950) Azure CI unit tests fail with connection refused

2021-06-15 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1950. -- Fix Version/s: 0.9.0 Resolution: Fixed > Azure CI unit tests fail with connection refused >

[jira] [Commented] (HUDI-1723) DFSPathSelector skips files with the same modify date when read up to source limit

2021-05-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17339865#comment-17339865 ] Raymond Xu commented on HUDI-1723: -- As suggested by [~vinoth] last time, a new implementation of

[jira] [Created] (HUDI-1897) Implement DeltaStreamer Source for AWS S3

2021-05-12 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1897: Summary: Implement DeltaStreamer Source for AWS S3 Key: HUDI-1897 URL: https://issues.apache.org/jira/browse/HUDI-1897 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-1898) Implement DeltaStreamer Source for GCS

2021-05-12 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1898: Summary: Implement DeltaStreamer Source for GCS Key: HUDI-1898 URL: https://issues.apache.org/jira/browse/HUDI-1898 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-1896) Implement DeltaStreamer Source for cloud object stores

2021-05-12 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1896: Summary: Implement DeltaStreamer Source for cloud object stores Key: HUDI-1896 URL: https://issues.apache.org/jira/browse/HUDI-1896 Project: Apache Hudi Issue Type:

[jira] [Commented] (HUDI-1723) DFSPathSelector skips files with the same modify date when read up to source limit

2021-05-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343278#comment-17343278 ] Raymond Xu commented on HUDI-1723: -- Done https://issues.apache.org/jira/browse/HUDI-1896 >

[jira] [Updated] (HUDI-1896) [UMBRELLA] Implement DeltaStreamer Source for cloud object stores

2021-05-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1896: - Description: As discussed in HUDI-1723, we need a better implementation for Cloud object storage like

[jira] [Updated] (HUDI-1896) [UMBRELLA] Implement DeltaStreamer Source for cloud object stores

2021-05-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1896: - Summary: [UMBRELLA] Implement DeltaStreamer Source for cloud object stores (was: Implement DeltaStreamer

[jira] [Created] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-05-25 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1932: Summary: Hive Sync should not always update last_commit_time_sync Key: HUDI-1932 URL: https://issues.apache.org/jira/browse/HUDI-1932 Project: Apache Hudi Issue

[jira] [Created] (HUDI-1950) Azure CI unit tests fail with connection refused

2021-05-31 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1950: Summary: Azure CI unit tests fail with connection refused Key: HUDI-1950 URL: https://issues.apache.org/jira/browse/HUDI-1950 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-1950) Azure CI unit tests fail with connection refused

2021-06-06 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1950: - Status: In Progress (was: Open) > Azure CI unit tests fail with connection refused >

[jira] [Assigned] (HUDI-1950) Azure CI unit tests fail with connection refused

2021-06-06 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1950: Assignee: Raymond Xu > Azure CI unit tests fail with connection refused >

[jira] [Updated] (HUDI-997) Debug possible memory leaks when running tests in hudi-client

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-997: Parent: HUDI-1248 Issue Type: Sub-task (was: Task) > Debug possible memory leaks when running tests

[jira] [Commented] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370131#comment-17370131 ] Raymond Xu commented on HUDI-1989: -- Consolidated failed cases *

[jira] [Created] (HUDI-2075) Flaky test: TestRowDataToHoodieFunction

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2075: Summary: Flaky test: TestRowDataToHoodieFunction Key: HUDI-2075 URL: https://issues.apache.org/jira/browse/HUDI-2075 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-1985) Website re-design implementation

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1985: - Description: To provide better navigation and organization of Hudi website's info, we have done a

[jira] [Resolved] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1055. -- Resolution: Fixed > Ensure hardcoded storage type ".parquet" is removed from tests >

[jira] [Updated] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1055: - Status: In Progress (was: Open) > Ensure hardcoded storage type ".parquet" is removed from tests >

[jira] [Closed] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1055. > Ensure hardcoded storage type ".parquet" is removed from tests >

[jira] [Commented] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370132#comment-17370132 ] Raymond Xu commented on HUDI-2077: -- [~codope] assigning to you since you made a PR to increase the

[jira] [Assigned] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2077: Assignee: Sagar Sumit > Flaky test: TestHoodieDeltaStreamer > ---

[jira] [Created] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2080: Summary: Migrate to ubuntu 20.04 for Azure pipeline builds Key: HUDI-2080 URL: https://issues.apache.org/jira/browse/HUDI-2080 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Parent: HUDI-1248 Issue Type: Sub-task (was: Bug) > Fix the memory leak for hudi-client unit

[jira] [Updated] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1989: - Parent: HUDI-1248 Issue Type: Sub-task (was: Bug) > Flaky test : TestHoodieMergeOnReadTable >

[jira] [Created] (HUDI-2078) Flaky test: TestCleaner

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2078: Summary: Flaky test: TestCleaner Key: HUDI-2078 URL: https://issues.apache.org/jira/browse/HUDI-2078 Project: Apache Hudi Issue Type: Sub-task Components:

[jira] [Updated] (HUDI-1033) Remove redundant CLI tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1033: - Parent: HUDI-1248 Issue Type: Sub-task (was: Task) > Remove redundant CLI tests >

[jira] [Assigned] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1939: Assignee: Xuedong Luan > Replace joda-time api to new jdk8 time api >

[jira] [Updated] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1939: - Status: In Progress (was: Open) > Replace joda-time api to new jdk8 time api >

[jira] [Updated] (HUDI-1939) Replace joda-time api to new jdk8 time api

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1939: - Fix Version/s: 0.9.0 > Replace joda-time api to new jdk8 time api >

[jira] [Created] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2077: Summary: Flaky test: TestHoodieDeltaStreamer Key: HUDI-2077 URL: https://issues.apache.org/jira/browse/HUDI-2077 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2076) Flaky test: TestHoodieMultiTableDeltaStreamer

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2076: Summary: Flaky test: TestHoodieMultiTableDeltaStreamer Key: HUDI-2076 URL: https://issues.apache.org/jira/browse/HUDI-2076 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2079) Move CLI integ tests to functional

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2079: Summary: Move CLI integ tests to functional Key: HUDI-2079 URL: https://issues.apache.org/jira/browse/HUDI-2079 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Description: hudi-client unit test has a memory leak, which could be some resources are not properly

[jira] [Closed] (HUDI-997) Debug possible memory leaks when running tests in hudi-client

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-997. --- Assignee: (was: lamber-ken) Resolution: Duplicate Duplicate. Referencing this from HUDI-1010 >

[jira] [Updated] (HUDI-1251) [UMBRELLA] Migrate CI to azure

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1251: - Status: In Progress (was: Open) > [UMBRELLA] Migrate CI to azure > --- > >

[jira] [Assigned] (HUDI-2081) Move TestHiveSyncTool to functional

2021-06-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2081: Assignee: Raymond Xu > Move TestHiveSyncTool to functional > --- >

[jira] [Created] (HUDI-2081) Move TestHiveSyncTool to functional

2021-06-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2081: Summary: Move TestHiveSyncTool to functional Key: HUDI-2081 URL: https://issues.apache.org/jira/browse/HUDI-2081 Project: Apache Hudi Issue Type: Sub-task

[jira] [Comment Edited] (HUDI-1211) Test failures w/ some index tests (TestHoodieIndex)

2021-06-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370315#comment-17370315 ] Raymond Xu edited comment on HUDI-1211 at 6/27/21, 7:40 PM: [~shivnarayan] is

[jira] [Commented] (HUDI-1211) Test failures w/ some index tests (TestHoodieIndex)

2021-06-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370315#comment-17370315 ] Raymond Xu commented on HUDI-1211: -- [~shivnarayan] is this still an issue? I couldn't repro this in my

[jira] [Updated] (HUDI-2081) Move TestHiveSyncTool to functional

2021-06-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2081: - Status: In Progress (was: Open) > Move TestHiveSyncTool to functional >

[jira] [Resolved] (HUDI-1810) Azure CI integration test failed for CLI tests

2021-04-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1810. -- Resolution: Fixed > Azure CI integration test failed for CLI tests >

[jira] [Resolved] (HUDI-1620) TestPushGateWayReporter failed when run separately

2021-04-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1620. -- Resolution: Fixed > TestPushGateWayReporter failed when run separately >

[jira] [Resolved] (HUDI-1811) Azure CI connection refused error when init HoodieRealtimeRecordReader

2021-04-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1811. -- Resolution: Fixed > Azure CI connection refused error when init HoodieRealtimeRecordReader >

[jira] [Updated] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-04-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-393: Parent: HUDI-1251 Issue Type: Sub-task (was: New Feature) > Integrate with Azure Pipeline run the

[jira] [Updated] (HUDI-1620) TestPushGateWayReporter failed when run separately

2021-04-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1620: - Fix Version/s: (was: 0.8.0) 0.9.0 > TestPushGateWayReporter failed when run

[jira] [Reopened] (HUDI-1620) TestPushGateWayReporter failed when run separately

2021-04-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-1620: -- > TestPushGateWayReporter failed when run separately > -- >

[jira] [Updated] (HUDI-1810) Azure CI integration test failed for CLI tests

2021-04-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1810: - Status: In Progress (was: Open) > Azure CI integration test failed for CLI tests >

[jira] [Updated] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-04-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-393: Fix Version/s: 0.9.0 > Integrate with Azure Pipeline run the end to end tests >

[jira] [Updated] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-04-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-393: Parent: (was: HUDI-289) Issue Type: New Feature (was: Sub-task) > Integrate with Azure Pipeline

[jira] [Updated] (HUDI-1811) Azure CI connection refused error when init HoodieRealtimeRecordReader

2021-04-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1811: - Status: In Progress (was: Open) > Azure CI connection refused error when init HoodieRealtimeRecordReader

[jira] [Assigned] (HUDI-1587) Add latency and freshness metrics for commits

2021-02-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1587: Assignee: Raymond Xu > Add latency and freshness metrics for commits >

[jira] [Updated] (HUDI-1587) Add latency and freshness metrics for commits

2021-02-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1587: - Fix Version/s: 0.8.0 > Add latency and freshness metrics for commits >

[jira] [Created] (HUDI-1587) Add latency and freshness metrics for commits

2021-02-05 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1587: Summary: Add latency and freshness metrics for commits Key: HUDI-1587 URL: https://issues.apache.org/jira/browse/HUDI-1587 Project: Apache Hudi Issue Type: New

[jira] [Updated] (HUDI-1587) Add latency and freshness metrics for commits

2021-02-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1587: - Status: In Progress (was: Open) > Add latency and freshness metrics for commits >

[jira] [Created] (HUDI-1588) Support multiple ordering fields via payload class config

2021-02-05 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1588: Summary: Support multiple ordering fields via payload class config Key: HUDI-1588 URL: https://issues.apache.org/jira/browse/HUDI-1588 Project: Apache Hudi Issue

[jira] [Commented] (HUDI-1723) DFSPathSelector skips files with the same modify date when read up to source limit

2021-04-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314571#comment-17314571 ] Raymond Xu commented on HUDI-1723: -- [~shivnarayan] sure. I've actually encountered this issue in

[jira] [Commented] (HUDI-1723) DFSPathSelector skips files with the same modify date when read up to source limit

2021-03-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309282#comment-17309282 ] Raymond Xu commented on HUDI-1723: -- [~vinoth] Related to this, I'm thinking maybe it's time to create

[jira] [Created] (HUDI-1723) DFSPathSelector skips files with the same modify date when read up to source limit

2021-03-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1723: Summary: DFSPathSelector skips files with the same modify date when read up to source limit Key: HUDI-1723 URL: https://issues.apache.org/jira/browse/HUDI-1723 Project:

[jira] [Commented] (HUDI-1723) DFSPathSelector skips files with the same modify date when read up to source limit

2021-03-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309273#comment-17309273 ] Raymond Xu commented on HUDI-1723: -- [~vinoth], as we discussed, a quick fix is to ignore source limit and

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-03-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294253#comment-17294253 ] Raymond Xu commented on HUDI-648: - [~liujinhui] ok great! > Implement error log/table for

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-03-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294249#comment-17294249 ] Raymond Xu commented on HUDI-648: - [~liujinhui] thanks for taking this up. Just a note on the

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-03-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294255#comment-17294255 ] Raymond Xu commented on HUDI-648: - [~liujinhui] ok cool! we can discuss further over the pr. thanks! >

[jira] [Issue Comment Deleted] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-03-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-648: Comment: was deleted (was: [~liujinhui] ok great!) > Implement error log/table for

[jira] [Updated] (HUDI-1655) Support custom date format and fix unsupported exception in DatePartitionPathSelector

2021-03-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1655: - Description: Add a config to allow parsing custom date format in  {{DatePartitionPathSelector}}.

[jira] [Updated] (HUDI-1655) Support custom date format and fix unsupported exception in DatePartitionPathSelector

2021-03-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1655: - Summary: Support custom date format and fix unsupported exception in DatePartitionPathSelector (was:

[jira] [Updated] (HUDI-1655) Allow custom date format in DatePartitionPathSelector

2021-03-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1655: - Description: Add a config to allow parsing custom date format in  {{DatePartitionPathSelector}}.

[jira] [Commented] (HUDI-1654) Persist written records' latency as histogram in commit metadata

2021-03-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294950#comment-17294950 ] Raymond Xu commented on HUDI-1654: -- Some previous implementation notes from PR for HUDI-1587 * consider

[jira] [Created] (HUDI-1655) Allow custom date format in DatePartitionPathSelector

2021-03-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1655: Summary: Allow custom date format in DatePartitionPathSelector Key: HUDI-1655 URL: https://issues.apache.org/jira/browse/HUDI-1655 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-1655) Allow custom date format in DatePartitionPathSelector

2021-03-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1655: - Status: In Progress (was: Open) > Allow custom date format in DatePartitionPathSelector >

[jira] [Created] (HUDI-1654) Persist written records' latency as histogram in commit metadata

2021-03-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1654: Summary: Persist written records' latency as histogram in commit metadata Key: HUDI-1654 URL: https://issues.apache.org/jira/browse/HUDI-1654 Project: Apache Hudi

[jira] [Closed] (HUDI-1655) Support custom date format and fix unsupported exception in DatePartitionPathSelector

2021-03-07 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1655. > Support custom date format and fix unsupported exception in > DatePartitionPathSelector >

[jira] [Resolved] (HUDI-1655) Support custom date format and fix unsupported exception in DatePartitionPathSelector

2021-03-07 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1655. -- Resolution: Fixed > Support custom date format and fix unsupported exception in >

[jira] [Created] (HUDI-1811) Azure CI connection refused error when init HoodieRealtimeRecordReader

2021-04-18 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1811: Summary: Azure CI connection refused error when init HoodieRealtimeRecordReader Key: HUDI-1811 URL: https://issues.apache.org/jira/browse/HUDI-1811 Project: Apache Hudi

[jira] [Updated] (HUDI-1810) Azure CI integration test failed for CLI tests

2021-04-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1810: - Fix Version/s: 0.9.0 > Azure CI integration test failed for CLI tests >

[jira] [Updated] (HUDI-1810) Azure CI integration test failed for CLI tests

2021-04-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1810: - Description: CLI job failure

[jira] [Created] (HUDI-1810) Azure CI integration test failed for CLI tests

2021-04-18 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1810: Summary: Azure CI integration test failed for CLI tests Key: HUDI-1810 URL: https://issues.apache.org/jira/browse/HUDI-1810 Project: Apache Hudi Issue Type: Bug

<    1   2   3   4   5   6   7   8   9   10   >