[jira] [Assigned] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-690: --- Assignee: Raymond Xu > filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR

[jira] [Updated] (HUDI-896) CI tests improvements

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-896: Status: Open (was: New) > CI tests improvements > - > > Key: HUDI-896 >

[jira] [Created] (HUDI-896) CI tests improvements

2020-05-13 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-896: --- Summary: CI tests improvements Key: HUDI-896 URL: https://issues.apache.org/jira/browse/HUDI-896 Project: Apache Hudi (incubating) Issue Type: New Feature

[jira] [Assigned] (HUDI-767) Support transformation when export to Hudi

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-767: --- Assignee: (was: Raymond Xu) > Support transformation when export to Hudi >

[jira] [Updated] (HUDI-896) CI tests improvements

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-896: Status: In Progress (was: Open) > CI tests improvements > - > > Key:

[jira] [Updated] (HUDI-767) Support transformation when export to Hudi

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-767: Status: New (was: Open) > Support transformation when export to Hudi >

[jira] [Updated] (HUDI-767) Support transformation when export to Hudi

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-767: Fix Version/s: (was: 0.6.0) 0.6.1 > Support transformation when export to Hudi >

[jira] [Updated] (HUDI-767) Support transformation when export to Hudi

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-767: Labels: (was: bug-bash-0.6.0) > Support transformation when export to Hudi >

[jira] [Commented] (HUDI-896) CI tests improvements

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106884#comment-17106884 ] Raymond Xu commented on HUDI-896: - https://github.com/apache/incubator-hudi/pull/1619

[jira] [Commented] (HUDI-774) Spark to Avro converter incorrectly generates optional fields

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106849#comment-17106849 ] Raymond Xu commented on HUDI-774: - I think this is a very important fix..+1 For any custom schema

[jira] [Commented] (HUDI-767) Support transformation when export to Hudi

2020-05-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106877#comment-17106877 ] Raymond Xu commented on HUDI-767: - [~vinoth] I'm trying to clear up my queue a bit, hence deferring this to

[jira] [Updated] (HUDI-902) Avoid exception for getting SchemaProvider when no new input data

2020-05-15 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-902: Status: In Progress (was: Open) > Avoid exception for getting SchemaProvider when no new input data >

[jira] [Created] (HUDI-902) Avoid exception for getting SchemaProvider when no new input data

2020-05-15 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-902: --- Summary: Avoid exception for getting SchemaProvider when no new input data Key: HUDI-902 URL: https://issues.apache.org/jira/browse/HUDI-902 Project: Apache Hudi (incubating)

[jira] [Resolved] (HUDI-902) Avoid exception for getting SchemaProvider when no new input data

2020-05-15 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-902. - Resolution: Done > Avoid exception for getting SchemaProvider when no new input data >

[jira] [Resolved] (HUDI-344) Hudi Dataset Snapshot Exporter

2020-03-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-344. - Resolution: Implemented The main features were implemented. Some future improvements or fix are linked in

[jira] [Updated] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-711: Status: Open (was: New) > Exporter copy method gets passed wrong file list >

[jira] [Updated] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-711: Status: In Progress (was: Open) > Exporter copy method gets passed wrong file list >

[jira] [Assigned] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-711: --- Assignee: Raymond Xu > Exporter copy method gets passed wrong file list >

[jira] [Updated] (HUDI-711) Exporter copy method gets passed wrong file list

2020-03-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-711: Status: Patch Available (was: In Progress) > Exporter copy method gets passed wrong file list >

[jira] [Assigned] (HUDI-731) Implement a chained transformer for deltastreamer that can chain other transformer implementations

2020-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-731: --- Assignee: Raymond Xu > Implement a chained transformer for deltastreamer that can chain other >

[jira] [Updated] (HUDI-731) Implement a chained transformer for deltastreamer that can chain other transformer implementations

2020-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-731: Status: In Progress (was: Open) > Implement a chained transformer for deltastreamer that can chain other >

[jira] [Updated] (HUDI-731) Implement a chained transformer for deltastreamer that can chain other transformer implementations

2020-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-731: Status: Open (was: New) > Implement a chained transformer for deltastreamer that can chain other >

[jira] [Assigned] (HUDI-811) Restructure test packages

2020-05-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-811: --- Assignee: Raymond Xu > Restructure test packages > - > > Key:

[jira] [Updated] (HUDI-811) Restructure test packages

2020-05-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-811: Status: Open (was: New) > Restructure test packages > - > > Key:

[jira] [Updated] (HUDI-811) Restructure test packages

2020-05-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-811: Status: In Progress (was: Open) > Restructure test packages > - > >

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2020-05-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111496#comment-17111496 ] Raymond Xu commented on HUDI-648: - I'm thinking of making `.hoodie/errors/`a dir to save all error'ed

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2020-05-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112712#comment-17112712 ] Raymond Xu commented on HUDI-648: - I guess RFC may not be necessary. Had a look into HoodieWriteClient and

[jira] [Commented] (HUDI-1058) Make delete marker configurable

2020-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194348#comment-17194348 ] Raymond Xu commented on HUDI-1058: -- No worries [~shenhong]. thanks for the update. > Make delete marker

[jira] [Commented] (HUDI-1058) Make delete marker configurable

2020-09-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192931#comment-17192931 ] Raymond Xu commented on HUDI-1058: -- [~shenhong] any news on this ticket? :) > Make delete marker

[jira] [Resolved] (HUDI-995) Organize test utils methods and classes

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-995. - Fix Version/s: 0.6.1 Resolution: Done > Organize test utils methods and classes >

[jira] [Closed] (HUDI-995) Organize test utils methods and classes

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-995. --- > Organize test utils methods and classes > --- > > Key:

[jira] [Resolved] (HUDI-779) [Umbrella] Unit tests improvements

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-779. - Assignee: Raymond Xu Resolution: Done > [Umbrella] Unit tests improvements >

[jira] [Closed] (HUDI-779) [Umbrella] Unit tests improvements

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-779. --- > [Umbrella] Unit tests improvements > -- > > Key: HUDI-779 >

[jira] [Updated] (HUDI-779) [Umbrella] Unit tests improvements

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-779: Status: Open (was: New) > [Umbrella] Unit tests improvements > -- > >

[jira] [Resolved] (HUDI-781) Re-design test utilities

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-781. - Resolution: Implemented > Re-design test utilities > > > Key:

[jira] [Closed] (HUDI-781) Re-design test utilities

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-781. --- > Re-design test utilities > > > Key: HUDI-781 > URL:

[jira] [Updated] (HUDI-995) Organize test utils methods and classes

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-995: Fix Version/s: (was: 0.6.1) > Organize test utils methods and classes >

[jira] [Updated] (HUDI-781) Re-design test utilities

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-781: Fix Version/s: 0.6.1 > Re-design test utilities > > > Key: HUDI-781

[jira] [Closed] (HUDI-896) Parallelize CI testing to reduce CI wait time

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-896. --- > Parallelize CI testing to reduce CI wait time > - > >

[jira] [Resolved] (HUDI-996) Use shared spark session provider

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-996. - Resolution: Done Closing this as the functional test utilities are implemented. The future work is to

[jira] [Closed] (HUDI-996) Use shared spark session provider

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-996. --- Assignee: Raymond Xu > Use shared spark session provider > -- > >

[jira] [Closed] (HUDI-994) Identify functional tests that are convertible to unit tests with mocks

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-994. --- > Identify functional tests that are convertible to unit tests with mocks >

[jira] [Resolved] (HUDI-994) Identify functional tests that are convertible to unit tests with mocks

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-994. - Resolution: Done > Identify functional tests that are convertible to unit tests with mocks >

[jira] [Updated] (HUDI-994) Identify functional tests that are convertible to unit tests with mocks

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-994: Status: Open (was: New) > Identify functional tests that are convertible to unit tests with mocks >

[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Parent: (was: HUDI-781) Issue Type: Bug (was: Sub-task) > Fix the memory leak for

[jira] [Assigned] (HUDI-994) Identify functional tests that are convertible to unit tests with mocks

2020-10-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-994: --- Assignee: Raymond Xu (was: Prashant Wason) > Identify functional tests that are convertible to unit

[jira] [Created] (HUDI-1306) Write documentation/blog about SchemaProvider and subclasses

2020-09-29 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1306: Summary: Write documentation/blog about SchemaProvider and subclasses Key: HUDI-1306 URL: https://issues.apache.org/jira/browse/HUDI-1306 Project: Apache Hudi

[jira] [Commented] (HUDI-995) Organize test utils methods and classes

2020-09-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197937#comment-17197937 ] Raymond Xu commented on HUDI-995: - Working on the 3rd point in the description. After that, we may close

[jira] [Updated] (HUDI-995) Organize test utils methods and classes

2020-09-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-995: Description: * Move test utils classes to hudi-common where appropriate, e.g. TestRawTripPayload,

[jira] [Commented] (HUDI-867) Graphite metrics are throwing IllegalArgumentException on continuous mode

2020-09-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198009#comment-17198009 ] Raymond Xu commented on HUDI-867: - [~Pratyaksh] this can be resolved and closed right? > Graphite metrics

[jira] [Updated] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-690: Status: Open (was: New) > filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR >

[jira] [Updated] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-690: Status: In Progress (was: Open) > filtercompletedInstants in HudiSnapshotCopier not working as expected for

[jira] [Updated] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-690: Fix Version/s: 0.6.0 > filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR >

[jira] [Commented] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116251#comment-17116251 ] Raymond Xu commented on HUDI-690: - It is the `getCommitsTimeline()` that does not include compaction

[jira] [Comment Edited] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116251#comment-17116251 ] Raymond Xu edited comment on HUDI-690 at 5/25/20, 8:39 PM: --- It is the

[jira] [Comment Edited] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-05-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116251#comment-17116251 ] Raymond Xu edited comment on HUDI-690 at 5/25/20, 8:41 PM: --- It is the

[jira] [Created] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-983: --- Summary: Add Metrics section to asf-site Key: HUDI-983 URL: https://issues.apache.org/jira/browse/HUDI-983 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Description: Document the use of metrics system in Hudi, include all supported metrics reporter. See the

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Labels: documentation newbie (was: newbie) > Add Metrics section to asf-site >

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Priority: Minor (was: Major) > Add Metrics section to asf-site > --- > >

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-05-30 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Labels: newbie (was: ) > Add Metrics section to asf-site > --- > >

[jira] [Commented] (HUDI-811) Restructure test packages

2020-06-01 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17122332#comment-17122332 ] Raymond Xu commented on HUDI-811: - Done via master branch: 742c2040995167871db976fc0eb280347401ffc4 >

[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2020-05-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117389#comment-17117389 ] Raymond Xu commented on HUDI-648: - [~vinoth] yes, a small RFC makes sense...I'll get onto it tomorrow. >

[jira] [Commented] (HUDI-867) Graphite metrics are throwing IllegalArgumentException on continuous mode

2020-05-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111785#comment-17111785 ] Raymond Xu commented on HUDI-867: - [~Pratyaksh] I have not started looking into the details. If you're

[jira] [Comment Edited] (HUDI-767) Support transformation when export to Hudi

2020-05-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111789#comment-17111789 ] Raymond Xu edited comment on HUDI-767 at 5/20/20, 5:24 AM: --- [~shivnarayan] Can we

[jira] [Commented] (HUDI-767) Support transformation when export to Hudi

2020-05-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111789#comment-17111789 ] Raymond Xu commented on HUDI-767: - @shivnarayan Can we remove this from bug bash 0.6.0 ? as we're targeting

[jira] [Resolved] (HUDI-836) Implement datadog metrics reporter

2020-05-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-836. - Resolution: Implemented > Implement datadog metrics reporter > -- > >

[jira] [Commented] (HUDI-995) Organize test utils methods and classes

2020-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199155#comment-17199155 ] Raymond Xu commented on HUDI-995: - [~yanghua] I hoped so but no, there are still 8 deprecated APIs in

[jira] [Assigned] (HUDI-767) Support transformation when export to Hudi

2020-07-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-767: --- Assignee: (was: Raymond Xu) > Support transformation when export to Hudi >

[jira] [Resolved] (HUDI-896) Parallelize CI testing to reduce CI wait time

2020-07-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-896. - Resolution: Done > Parallelize CI testing to reduce CI wait time >

[jira] [Updated] (HUDI-896) Parallelize CI testing to reduce CI wait time

2020-07-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-896: Status: In Progress (was: Open) > Parallelize CI testing to reduce CI wait time >

[jira] [Assigned] (HUDI-781) Re-design test utilities

2020-07-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-781: --- Assignee: Raymond Xu > Re-design test utilities > > > Key:

[jira] [Updated] (HUDI-781) Re-design test utilities

2020-07-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-781: Status: In Progress (was: Open) > Re-design test utilities > > >

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-07-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Status: In Progress (was: Open) > Add Metrics section to asf-site > --- > >

[jira] [Updated] (HUDI-983) Add Metrics section to asf-site

2020-07-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-983: Status: Open (was: New) > Add Metrics section to asf-site > --- > >

[jira] [Resolved] (HUDI-983) Add Metrics section to asf-site

2020-07-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-983. - Resolution: Done > Add Metrics section to asf-site > --- > >

[jira] [Created] (HUDI-1069) Remove duplicate assertNoWriteErrors()

2020-07-06 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1069: Summary: Remove duplicate assertNoWriteErrors() Key: HUDI-1069 URL: https://issues.apache.org/jira/browse/HUDI-1069 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-1071) Upgrade dropwizard metrics to make use of SettableGauge

2020-07-06 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1071: Summary: Upgrade dropwizard metrics to make use of SettableGauge Key: HUDI-1071 URL: https://issues.apache.org/jira/browse/HUDI-1071 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-1024) Document S3 related guide and tips

2020-06-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1024: - Fix Version/s: 0.6.0 > Document S3 related guide and tips > -- > >

[jira] [Updated] (HUDI-996) Use shared spark session provider

2020-06-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-996: Status: Open (was: New) > Use shared spark session provider > -- > >

[jira] [Updated] (HUDI-996) Use shared spark session provider

2020-06-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-996: Status: In Progress (was: Open) > Use shared spark session provider > -- >

[jira] [Assigned] (HUDI-996) Use shared spark session provider

2020-06-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-996: --- Assignee: Raymond Xu > Use shared spark session provider > -- > >

[jira] [Commented] (HUDI-983) Add Metrics section to asf-site

2020-06-25 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145998#comment-17145998 ] Raymond Xu commented on HUDI-983: - [~shenhong] IMO the latter is part of a complete reference page so

[jira] [Commented] (HUDI-1058) Make delete marker configurable

2020-06-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148035#comment-17148035 ] Raymond Xu commented on HUDI-1058: -- [~shenhong] Please go ahead. Thanks! cc [~shivnarayan] > Make

[jira] [Commented] (HUDI-983) Add Metrics section to asf-site

2020-06-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148082#comment-17148082 ] Raymond Xu commented on HUDI-983: - [~shenhong] Thank you for the PR. Are you referring to adding screenshot

[jira] [Created] (HUDI-1034) Document info about test structure and guide

2020-06-20 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1034: Summary: Document info about test structure and guide Key: HUDI-1034 URL: https://issues.apache.org/jira/browse/HUDI-1034 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-1058) Make delete marker configurable

2020-06-28 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1058: Summary: Make delete marker configurable Key: HUDI-1058 URL: https://issues.apache.org/jira/browse/HUDI-1058 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2020-06-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Parent: HUDI-781 Issue Type: Sub-task (was: Bug) > Fix the memory leak for hudi-client unit

[jira] [Commented] (HUDI-996) Use shared spark session provider

2020-06-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128497#comment-17128497 ] Raymond Xu commented on HUDI-996: - Notes by [~garyli1019] hudi-client unit tests are the most

[jira] [Closed] (HUDI-1011) Refactor hudi-client unit tests structure

2020-06-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1011. > Refactor hudi-client unit tests structure > - > >

[jira] [Resolved] (HUDI-1011) Refactor hudi-client unit tests structure

2020-06-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1011. -- Resolution: Duplicate > Refactor hudi-client unit tests structure >

[jira] [Commented] (HUDI-896) Parallelize CI testing to reduce CI wait time

2020-06-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129562#comment-17129562 ] Raymond Xu commented on HUDI-896: - [~vinoth] There is a problem with the current codecov report generation.

[jira] [Commented] (HUDI-781) Re-design test utilities

2020-06-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129642#comment-17129642 ] Raymond Xu commented on HUDI-781: - [~vinoth] Make sense. I've paused #1 as it's targeting from a different

[jira] [Commented] (HUDI-983) Add Metrics section to asf-site

2020-06-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125171#comment-17125171 ] Raymond Xu commented on HUDI-983: - [~shenhong] Sure. Thanks for taking the initiative! > Add Metrics

[jira] [Updated] (HUDI-1023) Add validation error messages in delta sync

2020-06-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1023: - Status: In Progress (was: Open) > Add validation error messages in delta sync >

[jira] [Created] (HUDI-1023) Add validation error messages in delta sync

2020-06-12 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1023: Summary: Add validation error messages in delta sync Key: HUDI-1023 URL: https://issues.apache.org/jira/browse/HUDI-1023 Project: Apache Hudi Issue Type:

[jira] [Assigned] (HUDI-1023) Add validation error messages in delta sync

2020-06-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1023: Assignee: Raymond Xu > Add validation error messages in delta sync >

[jira] [Updated] (HUDI-1023) Add validation error messages in delta sync

2020-06-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1023: - Status: Open (was: New) > Add validation error messages in delta sync >

[jira] [Updated] (HUDI-1023) Add validation error messages in delta sync

2020-06-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1023: - Priority: Minor (was: Major) > Add validation error messages in delta sync >

[jira] [Created] (HUDI-1024) Document S3 related guide and tips

2020-06-12 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-1024: Summary: Document S3 related guide and tips Key: HUDI-1024 URL: https://issues.apache.org/jira/browse/HUDI-1024 Project: Apache Hudi Issue Type: Improvement

<    1   2   3   4   5   6   7   8   9   10   >