[jira] [Updated] (HUDI-1339) delete useless import in hudi-spark module

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1339: - Fix Version/s: 0.7.0 > delete useless import in hudi-spark module > --

[jira] [Closed] (HUDI-1339) delete useless import in hudi-spark module

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1339. Resolution: Fixed > delete useless import in hudi-spark module > ---

[jira] [Assigned] (HUDI-1301) use spark INCREMENTAL mode query hudi dataset support schema version

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-1301: Assignee: liwei (was: Vinoth Chandar) > use spark INCREMENTAL mode query hudi dataset sup

[jira] [Updated] (HUDI-1339) delete useless import in hudi-spark module

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1339: - Status: In Progress (was: Open) > delete useless import in hudi-spark module > --

[jira] [Updated] (HUDI-1339) delete useless import in hudi-spark module

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1339: - Status: Open (was: New) > delete useless import in hudi-spark module > --

[jira] [Updated] (HUDI-791) Replace null by Option in Delta Streamer

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-791: Fix Version/s: 0.7.0 > Replace null by Option in Delta Streamer > ---

[jira] [Updated] (HUDI-1184) Support updatePartitionPath for HBaseIndex

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1184: - Status: Open (was: New) > Support updatePartitionPath for HBaseIndex > --

[jira] [Updated] (HUDI-1184) Support updatePartitionPath for HBaseIndex

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1184: - Fix Version/s: 0.7.0 > Support updatePartitionPath for HBaseIndex > --

[jira] [Updated] (HUDI-1184) Support updatePartitionPath for HBaseIndex

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1184: - Status: In Progress (was: Open) > Support updatePartitionPath for HBaseIndex > --

[GitHub] [hudi] vinothchandar opened a new pull request #2469: [MINOR] Make a separate travis CI job for hudi-utilities

2021-01-20 Thread GitBox
vinothchandar opened a new pull request #2469: URL: https://github.com/apache/hudi/pull/2469 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of t

[GitHub] [hudi] vinothchandar commented on pull request #2469: [MINOR] Make a separate travis CI job for hudi-utilities

2021-01-20 Thread GitBox
vinothchandar commented on pull request #2469: URL: https://github.com/apache/hudi/pull/2469#issuecomment-764395733 termporary bandaid to help with the 50 min time exceeded errors. Passed once here. https://travis-ci.com/github/vinothchandar/hudi/builds/213879462 (been using my f

[GitHub] [hudi] vinothchandar commented on pull request #2469: [MINOR] Make a separate travis CI job for hudi-utilities

2021-01-20 Thread GitBox
vinothchandar commented on pull request #2469: URL: https://github.com/apache/hudi/pull/2469#issuecomment-764395841 Landing to hand master branch a glass of cool water. This is an automated message from the Apache Git Servic

[hudi] branch master updated: [MINOR] Make a separate travis CI job for hudi-utilities (#2469)

2021-01-20 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 81ccb0c [MINOR] Make a separate travis CI job for

[GitHub] [hudi] vinothchandar merged pull request #2469: [MINOR] Make a separate travis CI job for hudi-utilities

2021-01-20 Thread GitBox
vinothchandar merged pull request #2469: URL: https://github.com/apache/hudi/pull/2469 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Closed] (HUDI-1184) Support updatePartitionPath for HBaseIndex

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1184. Resolution: Fixed > Support updatePartitionPath for HBaseIndex > ---

[jira] [Updated] (HUDI-1302) Add support for timestamp field in HiveSync

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1302: - Fix Version/s: 0.7.0 > Add support for timestamp field in HiveSync > -

[jira] [Updated] (HUDI-1298) Add better error messages when IOException occurs during log file reading

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1298: - Status: Closed (was: Patch Available) > Add better error messages when IOException occurs during

[jira] [Updated] (HUDI-1302) Add support for timestamp field in HiveSync

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1302: - Status: Closed (was: Patch Available) > Add support for timestamp field in HiveSync > ---

[jira] [Updated] (HUDI-1298) Add better error messages when IOException occurs during log file reading

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1298: - Fix Version/s: 0.7.0 > Add better error messages when IOException occurs during log file reading >

[jira] [Resolved] (HUDI-1344) Support for IBM Cloud Object Storage

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-1344. -- Resolution: Fixed > Support for IBM Cloud Object Storage >

[jira] [Closed] (HUDI-1344) Support for IBM Cloud Object Storage

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1344. > Support for IBM Cloud Object Storage > > > Key: H

[jira] [Updated] (HUDI-1344) Support for IBM Cloud Object Storage

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1344: - Status: Open (was: New) > Support for IBM Cloud Object Storage >

[jira] [Updated] (HUDI-1344) Support for IBM Cloud Object Storage

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1344: - Fix Version/s: 0.7.0 > Support for IBM Cloud Object Storage >

[jira] [Updated] (HUDI-284) Need Tests for Hudi handling of schema evolution

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-284: Fix Version/s: 0.7.0 > Need Tests for Hudi handling of schema evolution > --

[jira] [Updated] (HUDI-1330) handle prefix filtering at directory level

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1330: - Fix Version/s: 0.7.0 > handle prefix filtering at directory level > --

[jira] [Closed] (HUDI-1330) handle prefix filtering at directory level

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1330. Resolution: Fixed > handle prefix filtering at directory level > ---

[jira] [Resolved] (HUDI-1345) undo Hbase and htrace relocation in hudi-utilities bundle as well

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-1345. -- Resolution: Fixed > undo Hbase and htrace relocation in hudi-utilities bundle as well >

[jira] [Updated] (HUDI-1330) handle prefix filtering at directory level

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1330: - Status: Open (was: New) > handle prefix filtering at directory level > --

[jira] [Updated] (HUDI-284) Need Tests for Hudi handling of schema evolution

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-284: Status: Closed (was: Patch Available) > Need Tests for Hudi handling of schema evolution >

[jira] [Updated] (HUDI-1345) undo Hbase and htrace relocation in hudi-utilities bundle as well

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1345: - Status: Open (was: New) > undo Hbase and htrace relocation in hudi-utilities bundle as well > ---

[jira] [Updated] (HUDI-1326) Publishing metrics from hudi-test-suite after each job

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1326: - Fix Version/s: 0.7.0 > Publishing metrics from hudi-test-suite after each job > --

[jira] [Reopened] (HUDI-1326) Publishing metrics from hudi-test-suite after each job

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reopened HUDI-1326: -- > Publishing metrics from hudi-test-suite after each job > -

[jira] [Closed] (HUDI-1209) Properties File must be optional when running deltastreamer

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1209. Resolution: Fixed > Properties File must be optional when running deltastreamer > --

[jira] [Updated] (HUDI-1351) Improvements required to hudi-test-suite for scalable and repeated testing

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1351: - Fix Version/s: 0.7.0 > Improvements required to hudi-test-suite for scalable and repeated testing

[jira] [Updated] (HUDI-1351) Improvements required to hudi-test-suite for scalable and repeated testing

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1351: - Status: Patch Available (was: In Progress) > Improvements required to hudi-test-suite for scalabl

[jira] [Closed] (HUDI-1326) Publishing metrics from hudi-test-suite after each job

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1326. Resolution: Fixed > Publishing metrics from hudi-test-suite after each job > ---

[jira] [Updated] (HUDI-1351) Improvements required to hudi-test-suite for scalable and repeated testing

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1351: - Status: Closed (was: Patch Available) > Improvements required to hudi-test-suite for scalable and

[jira] [Closed] (HUDI-1338) Adding Delete support to test suite framework

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1338. Resolution: Fixed > Adding Delete support to test suite framework >

[jira] [Updated] (HUDI-1338) Adding Delete support to test suite framework

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1338: - Status: Open (was: New) > Adding Delete support to test suite framework > ---

[jira] [Updated] (HUDI-892) RealtimeParquetInputFormat should skip adding projection columns if there are no log files

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-892: Fix Version/s: 0.7.0 > RealtimeParquetInputFormat should skip adding projection columns if there are

[jira] [Updated] (HUDI-912) Refactor and relocate KeyGenerator to support more engines

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-912: Fix Version/s: 0.7.0 > Refactor and relocate KeyGenerator to support more engines > -

[jira] [Updated] (HUDI-1338) Adding Delete support to test suite framework

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1338: - Fix Version/s: 0.7.0 > Adding Delete support to test suite framework > ---

[jira] [Closed] (HUDI-1358) Memory Leak in HoodieLogFormatWriter

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1358. Resolution: Fixed > Memory Leak in HoodieLogFormatWriter > > >

[jira] [Updated] (HUDI-1358) Memory Leak in HoodieLogFormatWriter

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1358: - Fix Version/s: 0.7.0 > Memory Leak in HoodieLogFormatWriter >

[jira] [Updated] (HUDI-1364) Introduce HoodieJavaEngineContext to hudi-java-client

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1364: - Fix Version/s: 0.7.0 > Introduce HoodieJavaEngineContext to hudi-java-client > ---

[jira] [Updated] (HUDI-1393) Add compaction action in archive command

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1393: - Fix Version/s: 0.7.0 > Add compaction action in archive command >

[jira] [Resolved] (HUDI-1396) Bootstrap job via Hudi datasource hangs at the end of the spark-submit job

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-1396. -- Resolution: Fixed > Bootstrap job via Hudi datasource hangs at the end of the spark-submit job >

[jira] [Updated] (HUDI-1396) Bootstrap job via Hudi datasource hangs at the end of the spark-submit job

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1396: - Fix Version/s: 0.7.0 > Bootstrap job via Hudi datasource hangs at the end of the spark-submit job

[jira] [Updated] (HUDI-1396) Bootstrap job via Hudi datasource hangs at the end of the spark-submit job

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1396: - Status: Open (was: New) > Bootstrap job via Hudi datasource hangs at the end of the spark-submit

[jira] [Updated] (HUDI-1373) Add Support for OpenJ9 JVM

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1373: - Status: Open (was: New) > Add Support for OpenJ9 JVM > -- > >

[jira] [Updated] (HUDI-1373) Add Support for OpenJ9 JVM

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1373: - Fix Version/s: 0.7.0 > Add Support for OpenJ9 JVM > -- > >

[jira] [Closed] (HUDI-1373) Add Support for OpenJ9 JVM

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1373. > Add Support for OpenJ9 JVM > -- > > Key: HUDI-1373 >

[jira] [Updated] (HUDI-1196) Record being placed in incorrect partition during upsert on COW/MOR global indexed tables

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1196: - Fix Version/s: 0.7.0 > Record being placed in incorrect partition during upsert on COW/MOR global

[jira] [Resolved] (HUDI-1373) Add Support for OpenJ9 JVM

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-1373. -- Resolution: Fixed > Add Support for OpenJ9 JVM > -- > >

[jira] [Closed] (HUDI-1196) Record being placed in incorrect partition during upsert on COW/MOR global indexed tables

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1196. Resolution: Fixed > Record being placed in incorrect partition during upsert on COW/MOR global > in

[jira] [Updated] (HUDI-1357) Add a check to ensure there is no data loss when writing to HUDI dataset

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1357: - Fix Version/s: 0.7.0 > Add a check to ensure there is no data loss when writing to HUDI dataset >

[jira] [Closed] (HUDI-1357) Add a check to ensure there is no data loss when writing to HUDI dataset

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1357. Resolution: Fixed > Add a check to ensure there is no data loss when writing to HUDI dataset > -

[jira] [Updated] (HUDI-1412) Make HoodieWriteConfig support setting different default value according to engine type

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1412: - Fix Version/s: (was: 0.6.1) 0.7.0 > Make HoodieWriteConfig support setting

[jira] [Updated] (HUDI-1349) spark sql support overwrite use replace action with dynamic partitioning

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1349: - Fix Version/s: 0.7.0 > spark sql support overwrite use replace action with dynamic partitioning >

[jira] [Closed] (HUDI-1428) Clean old fileslice is invalid

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1428. Resolution: Fixed > Clean old fileslice is invalid > > >

[jira] [Updated] (HUDI-1428) Clean old fileslice is invalid

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1428: - Status: Open (was: New) > Clean old fileslice is invalid > > >

[GitHub] [hudi] Trevor-zhang commented on a change in pull request #2449: [HUDI-1528] hudi-sync-tools supports synchronization to remote hive

2021-01-20 Thread GitBox
Trevor-zhang commented on a change in pull request #2449: URL: https://github.com/apache/hudi/pull/2449#discussion_r561621697 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/DataSourceUtils.java ## @@ -284,6 +284,9 @@ public static HiveSyncC

[jira] [Updated] (HUDI-1435) Marker File Reconciliation failing for Non-Partitioned datasets when duplicate marker files present

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1435: - Status: Closed (was: Patch Available) > Marker File Reconciliation failing for Non-Partitioned da

[jira] [Updated] (HUDI-1448) hudi dla sync skip rt create

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1448: - Fix Version/s: 0.7.0 > hudi dla sync skip rt create > - > >

[jira] [Closed] (HUDI-1376) Drop Hudi metadata columns before Spark datasource writing

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1376. Resolution: Fixed > Drop Hudi metadata columns before Spark datasource writing > --

[jira] [Updated] (HUDI-1448) hudi dla sync skip rt create

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1448: - Status: Open (was: New) > hudi dla sync skip rt create > - > >

[jira] [Updated] (HUDI-1376) Drop Hudi metadata columns before Spark datasource writing

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1376: - Fix Version/s: 0.7.0 > Drop Hudi metadata columns before Spark datasource writing > -

[jira] [Updated] (HUDI-1376) Drop Hudi metadata columns before Spark datasource writing

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1376: - Status: Open (was: New) > Drop Hudi metadata columns before Spark datasource writing > -

[jira] [Closed] (HUDI-1448) hudi dla sync skip rt create

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1448. Resolution: Fixed > hudi dla sync skip rt create > - > >

[jira] [Updated] (HUDI-1406) Add new DFS path sector implementation for listing date based partitions

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1406: - Status: Open (was: New) > Add new DFS path sector implementation for listing date based partition

[jira] [Closed] (HUDI-1406) Add new DFS path sector implementation for listing date based partitions

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1406. Resolution: Fixed > Add new DFS path sector implementation for listing date based partitions > -

[jira] [Updated] (HUDI-1437) some description in spark ui is not reality, Not good for performance tracking

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1437: - Fix Version/s: 0.7.0 > some description in spark ui is not reality, Not good for performance > t

[jira] [Updated] (HUDI-1437) some description in spark ui is not reality, Not good for performance tracking

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1437: - Status: Open (was: New) > some description in spark ui is not reality, Not good for performance

[jira] [Closed] (HUDI-1437) some description in spark ui is not reality, Not good for performance tracking

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1437. Resolution: Fixed > some description in spark ui is not reality, Not good for performance > tracki

[jira] [Updated] (HUDI-1470) Hudi-test-suite - DFSHoodieDatasetInputReader.java - Use the latest writer schema, when reading the parquet files.

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1470: - Status: Open (was: New) > Hudi-test-suite - DFSHoodieDatasetInputReader.java - Use the latest wr

[jira] [Closed] (HUDI-1470) Hudi-test-suite - DFSHoodieDatasetInputReader.java - Use the latest writer schema, when reading the parquet files.

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1470. Fix Version/s: 0.7.0 Resolution: Fixed > Hudi-test-suite - DFSHoodieDatasetInputReader.java -

[jira] [Updated] (HUDI-1419) Introduce base implementation of hudi-java-client

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1419: - Fix Version/s: 0.7.0 > Introduce base implementation of hudi-java-client > ---

[jira] [Closed] (HUDI-1419) Introduce base implementation of hudi-java-client

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1419. > Introduce base implementation of hudi-java-client > -

[jira] [Updated] (HUDI-1075) Implement a simple merge clustering strategy

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1075: - Fix Version/s: 0.7.0 > Implement a simple merge clustering strategy > ---

[jira] [Updated] (HUDI-1489) Not able to read after updating bootstrap table with written table

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1489: - Status: Open (was: New) > Not able to read after updating bootstrap table with written table > --

[jira] [Closed] (HUDI-1489) Not able to read after updating bootstrap table with written table

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1489. Resolution: Fixed > Not able to read after updating bootstrap table with written table > ---

[jira] [Updated] (HUDI-1489) Not able to read after updating bootstrap table with written table

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1489: - Fix Version/s: 0.7.0 > Not able to read after updating bootstrap table with written table > --

[jira] [Closed] (HUDI-1487) after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1487. Resolution: Fixed > after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random > ---

[jira] [Updated] (HUDI-1331) Improving Hudi test suite framework to support proper validation and long running tests

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1331: - Fix Version/s: 0.7.0 > Improving Hudi test suite framework to support proper validation and long

[jira] [Updated] (HUDI-1331) Improving Hudi test suite framework to support proper validation and long running tests

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1331: - Status: Open (was: New) > Improving Hudi test suite framework to support proper validation and lo

[jira] [Closed] (HUDI-1331) Improving Hudi test suite framework to support proper validation and long running tests

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1331. Resolution: Fixed > Improving Hudi test suite framework to support proper validation and long > run

[jira] [Updated] (HUDI-1398) Align insert file size for reducing IO

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1398: - Fix Version/s: 0.7.0 > Align insert file size for reducing IO > --

[jira] [Closed] (HUDI-1398) Align insert file size for reducing IO

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1398. Resolution: Fixed > Align insert file size for reducing IO > --

[jira] [Updated] (HUDI-1398) Align insert file size for reducing IO

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1398: - Status: Open (was: New) > Align insert file size for reducing IO > --

[jira] [Updated] (HUDI-1147) Generate valid timestamp and partition for data generator

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1147: - Status: Open (was: New) > Generate valid timestamp and partition for data generator > ---

[jira] [Updated] (HUDI-1493) Schema evolution does not allow INT to LONG

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1493: - Fix Version/s: 0.7.0 > Schema evolution does not allow INT to LONG > -

[jira] [Updated] (HUDI-1147) Generate valid timestamp and partition for data generator

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1147: - Fix Version/s: 0.7.0 > Generate valid timestamp and partition for data generator > ---

[jira] [Closed] (HUDI-1147) Generate valid timestamp and partition for data generator

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1147. Resolution: Fixed > Generate valid timestamp and partition for data generator >

[jira] [Updated] (HUDI-1493) Schema evolution does not allow INT to LONG

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1493: - Status: Open (was: New) > Schema evolution does not allow INT to LONG > -

[jira] [Closed] (HUDI-1493) Schema evolution does not allow INT to LONG

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-1493. Resolution: Fixed > Schema evolution does not allow INT to LONG > --

[jira] [Updated] (HUDI-1423) Support delete in java client

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1423: - Fix Version/s: 0.7.0 > Support delete in java client > - > >

[jira] [Updated] (HUDI-651) Incremental Query on Hive via Spark SQL does not return expected results

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-651: Fix Version/s: (was: 0.7.0) 0.8.0 > Incremental Query on Hive via Spark SQL do

[jira] [Updated] (HUDI-1502) Restore on MOR table leaves metadata table out-of-sync from data table

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1502: - Status: Patch Available (was: In Progress) > Restore on MOR table leaves metadata table out-of-sy

[jira] [Updated] (HUDI-304) Bring back spotless plugin

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-304: Fix Version/s: (was: 0.7.0) 0.8.0 > Bring back spotless plugin >

[jira] [Updated] (HUDI-909) Integrate hudi with flink engine

2021-01-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-909: Fix Version/s: (was: 0.7.0) > Integrate hudi with flink engine >

<    1   2   3   >