[GitHub] [incubator-hudi] vingov commented on issue #1526: [HUDI-1526] Add pyspark example in quickstart

vingov commented on issue #1526: [HUDI-1526] Add pyspark example in quickstart URL: https://github.com/apache/incubator-hudi/pull/1526#issuecomment-616051296 Thanks for the contribution @EdwinGuo! This is a good start, I am working on a similar task to add documentation and python package f

[jira] [Updated] (HUDI-810) Migrate HoodieClientTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-810: Description: Once HoodieClientTestHarness migrated, the whole hudi-cli package can be migrated all together.

[jira] [Updated] (HUDI-814) Migrate hudi-client tests to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-814: Summary: Migrate hudi-client tests to JUnit 5 (was: Migrate hudi-client hudi-cli tests to JUnit 5) > Migrat

[jira] [Updated] (HUDI-814) Migrate hudi-client hudi-cli tests to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-814: Status: Open (was: New) > Migrate hudi-client hudi-cli tests to JUnit 5 > --

[jira] [Updated] (HUDI-814) Migrate hudi-client hudi-cli tests to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-814: Summary: Migrate hudi-client hudi-cli tests to JUnit 5 (was: Migrate hudi-client tests to JUnit 5) > Migrat

[jira] [Updated] (HUDI-814) Migrate hudi-client hudi-cli tests to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-814: Status: In Progress (was: Open) > Migrate hudi-client hudi-cli tests to JUnit 5 > --

[jira] [Updated] (HUDI-813) Migrate hudi-utilities tests to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-813: Summary: Migrate hudi-utilities tests to JUnit 5 (was: Migrate hudi-cli tests to JUnit 5) > Migrate hudi-ut

[jira] [Updated] (HUDI-810) Migrate HoodieClientTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-810: Status: Open (was: New) > Migrate HoodieClientTestHarness to JUnit 5 > -

[jira] [Updated] (HUDI-810) Migrate HoodieClientTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-810: Status: In Progress (was: Open) > Migrate HoodieClientTestHarness to JUnit 5 > -

[jira] [Created] (HUDI-814) Migrate hudi-client tests to JUnit 5

Raymond Xu created HUDI-814: --- Summary: Migrate hudi-client tests to JUnit 5 Key: HUDI-814 URL: https://issues.apache.org/jira/browse/HUDI-814 Project: Apache Hudi (incubating) Issue Type: Test

[jira] [Created] (HUDI-812) Migrate hudi-common tests to JUnit 5

Raymond Xu created HUDI-812: --- Summary: Migrate hudi-common tests to JUnit 5 Key: HUDI-812 URL: https://issues.apache.org/jira/browse/HUDI-812 Project: Apache Hudi (incubating) Issue Type: Test

[jira] [Created] (HUDI-813) Migrate hudi-cli tests to JUnit 5

Raymond Xu created HUDI-813: --- Summary: Migrate hudi-cli tests to JUnit 5 Key: HUDI-813 URL: https://issues.apache.org/jira/browse/HUDI-813 Project: Apache Hudi (incubating) Issue Type: Test

[jira] [Updated] (HUDI-811) Restructure test packages

[ https://issues.apache.org/jira/browse/HUDI-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-811: Fix Version/s: 0.6.0 > Restructure test packages > - > > Key: HUDI-81

[jira] [Updated] (HUDI-781) Re-design test utilities

[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-781: Issue Type: Test (was: Improvement) > Re-design test utilities > > >

[jira] [Updated] (HUDI-810) Migrate HoodieClientTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-810: Fix Version/s: 0.6.0 > Migrate HoodieClientTestHarness to JUnit 5 > -

[jira] [Updated] (HUDI-809) Migrate HoodieCommonTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-809: Fix Version/s: 0.6.0 > Migrate HoodieCommonTestHarness to JUnit 5 > -

[jira] [Updated] (HUDI-779) [Umbrella] Unit tests improvements

[ https://issues.apache.org/jira/browse/HUDI-779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-779: Issue Type: Test (was: Improvement) > [Umbrella] Unit tests improvements > -

[jira] [Updated] (HUDI-780) Make JUnit 5 co-exist in the project

[ https://issues.apache.org/jira/browse/HUDI-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-780: Issue Type: Test (was: Improvement) > Make JUnit 5 co-exist in the project > ---

[jira] [Updated] (HUDI-810) Migrate HoodieClientTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-810: Summary: Migrate HoodieClientTestHarness to JUnit 5 (was: Migrate ClientTestHarness to JUnit 5) > Migrate H

[jira] [Closed] (HUDI-780) Make JUnit 5 co-exist in the project

[ https://issues.apache.org/jira/browse/HUDI-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-780. --- > Make JUnit 5 co-exist in the project > > > Key: HUDI-780 >

[jira] [Updated] (HUDI-809) Migrate HoodieCommonTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-809: Status: Open (was: New) > Migrate HoodieCommonTestHarness to JUnit 5 > -

[jira] [Commented] (HUDI-781) Re-design test utilities

[ https://issues.apache.org/jira/browse/HUDI-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086739#comment-17086739 ] Raymond Xu commented on HUDI-781: - [~vinoth][~yanghua]Thank you for the feedbacks. Created

[jira] [Created] (HUDI-811) Restructure test packages

Raymond Xu created HUDI-811: --- Summary: Restructure test packages Key: HUDI-811 URL: https://issues.apache.org/jira/browse/HUDI-811 Project: Apache Hudi (incubating) Issue Type: Test Compo

[jira] [Created] (HUDI-810) Migrate ClientTestHarness to JUnit 5

Raymond Xu created HUDI-810: --- Summary: Migrate ClientTestHarness to JUnit 5 Key: HUDI-810 URL: https://issues.apache.org/jira/browse/HUDI-810 Project: Apache Hudi (incubating) Issue Type: Test

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1530: [HUDI-809] Migrate CommonTestHarness to JUnit 5

codecov-io edited a comment on issue #1530: [HUDI-809] Migrate CommonTestHarness to JUnit 5 URL: https://github.com/apache/incubator-hudi/pull/1530#issuecomment-616025885 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1530?src=pr&el=h1) Report > Merging [#1530](https://c

[GitHub] [incubator-hudi] codecov-io commented on issue #1530: [HUDI-809] Migrate CommonTestHarness to JUnit 5

codecov-io commented on issue #1530: [HUDI-809] Migrate CommonTestHarness to JUnit 5 URL: https://github.com/apache/incubator-hudi/pull/1530#issuecomment-616025885 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1530?src=pr&el=h1) Report > Merging [#1530](https://codecov.

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #252

See Changes: -- [...truncated 2.37 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1529: [HUDI-800] fix Metrics getReporter().close() throws NPE when MetricsR…

leesf commented on a change in pull request #1529: [HUDI-800] fix Metrics getReporter().close() throws NPE when MetricsR… URL: https://github.com/apache/incubator-hudi/pull/1529#discussion_r410796460 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/Metrics.java #

[jira] [Updated] (HUDI-809) Migrate HoodieCommonTestHarness to JUnit 5

[ https://issues.apache.org/jira/browse/HUDI-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-809: Labels: pull-request-available (was: ) > Migrate HoodieCommonTestHarness to JUnit 5 > --

[GitHub] [incubator-hudi] xushiyan opened a new pull request #1530: [HUDI-809] Migrate HoodieCommonTestHarness to JUnit 5

xushiyan opened a new pull request #1530: [HUDI-809] Migrate HoodieCommonTestHarness to JUnit 5 URL: https://github.com/apache/incubator-hudi/pull/1530 * Create an interim test class `org.apache.hudi.common.testutils.HoodieCommonTestHarness` to migrate subclasses of `org.apache.hudi.commo

[jira] [Created] (HUDI-809) Migrate HoodieCommonTestHarness to JUnit 5

Raymond Xu created HUDI-809: --- Summary: Migrate HoodieCommonTestHarness to JUnit 5 Key: HUDI-809 URL: https://issues.apache.org/jira/browse/HUDI-809 Project: Apache Hudi (incubating) Issue Type: Tes

[GitHub] [incubator-hudi] lamber-ken commented on issue #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file

lamber-ken commented on issue #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1512#issuecomment-615908872 Hi @vinothchandar, apologies for the delay. > different partitions use different formats

[jira] [Commented] (HUDI-305) Presto MOR "_rt" queries only reads base parquet file

[ https://issues.apache.org/jira/browse/HUDI-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086506#comment-17086506 ] liwei commented on HUDI-305: great work > Presto MOR "_rt" queries only reads base parquet fil

[jira] [Updated] (HUDI-800) Metrics getReporter().close() throws NPE when MetricsReporter is InMemoryMetricsReporter

[ https://issues.apache.org/jira/browse/HUDI-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-800: Labels: pull-request-available (was: ) > Metrics getReporter().close() throws NPE when MetricsReport

[GitHub] [incubator-hudi] lw309637554 opened a new pull request #1529: [HUDI-800] fix Metrics getReporter().close() throws NPE when MetricsR…

lw309637554 opened a new pull request #1529: [HUDI-800] fix Metrics getReporter().close() throws NPE when MetricsR… URL: https://github.com/apache/incubator-hudi/pull/1529 …eporter is InMemoryMetricsReporter. ## *Tips* - *Thank you very much for contributing to Apache Hudi.* -

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file

codecov-io edited a comment on issue #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1512#issuecomment-615885170 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1512?src=pr&el=h1) Report

[GitHub] [incubator-hudi] codecov-io commented on issue #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file

codecov-io commented on issue #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1512#issuecomment-615885170 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1512?src=pr&el=h1) Report > Mer

[GitHub] [incubator-hudi] nsivabalan commented on issue #1482: [SUPPORT] Deletion of records through deltaStreamer _hoodie_is_deleted flag does not work as expected

nsivabalan commented on issue #1482: [SUPPORT] Deletion of records through deltaStreamer _hoodie_is_deleted flag does not work as expected URL: https://github.com/apache/incubator-hudi/issues/1482#issuecomment-615844051 @venkee14 : did the above changes work? -

[GitHub] [incubator-hudi] jenu9417 opened a new issue #1528: [SUPPORT] Issue while writing to HDFS via hudi. Only `/.hoodie` folder is written.

jenu9417 opened a new issue #1528: [SUPPORT] Issue while writing to HDFS via hudi. Only `/.hoodie` folder is written. URL: https://github.com/apache/incubator-hudi/issues/1528 Hi, all. We are doing a POC experimenting with syncing our data in micro-batches from Kafka to HDFS. We are cur