[jira] [Updated] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-716: Attachment: image-2020-03-21-13-37-17-039.png > Exception: Not an Avro data file when running

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063573#comment-17063573 ] lamber-ken edited comment on HUDI-716 at 3/20/20, 6:51 PM: --- Hi [~vbalaji], I

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063573#comment-17063573 ] lamber-ken commented on HUDI-716: - Hi [~vbalaji], I agree with your point. from code we can see that create

[jira] [Updated] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-716: Attachment: image-2020-03-21-02-45-25-099.png > Exception: Not an Avro data file when running

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-20 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063476#comment-17063476 ] lamber-ken commented on HUDI-716: - Also, we need to figure it out what jobs created these zero bytes files

[jira] [Commented] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

2020-03-19 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062761#comment-17062761 ] lamber-ken commented on HUDI-686: - [~vinoth] thanks for bring up this new idea. here are some concerns to

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-18 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:29 PM: --- I tried to reproduce

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-18 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:21 PM: --- I tried to reproduce

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-18 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken commented on HUDI-716: - I tried to reproduce it, but it works ok. *Step1: Use hudi 0.5.0

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-18 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:18 PM: --- I tried to reproduce

[jira] [Comment Edited] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-18 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061925#comment-17061925 ] lamber-ken edited comment on HUDI-716 at 3/18/20, 5:18 PM: --- I tried to reproduce

[jira] [Commented] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-18 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061888#comment-17061888 ] lamber-ken commented on HUDI-716: - [~vinoth] willing to take it. :)    Hi [~afilipchik], waiting for you,

[jira] [Updated] (HUDI-716) Exception: Not an Avro data file when running HoodieCleanClient.runClean

2020-03-18 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-716: Status: Open (was: New) > Exception: Not an Avro data file when running HoodieCleanClient.runClean >

[jira] [Commented] (HUDI-675) Add jdk13 to .travis.yml

2020-03-17 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061090#comment-17061090 ] lamber-ken commented on HUDI-675: - At jdk13, under statement will NPE. {code:java}

[jira] [Updated] (HUDI-388) Support DDL / DML SparkSQL statements which useful for admins

2020-03-16 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-388: Status: Open (was: New) > Support DDL / DML SparkSQL statements which useful for admins >

[jira] [Updated] (HUDI-504) Restructuring and auto-generation of docs

2020-03-16 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-504: Status: Open (was: New) > Restructuring and auto-generation of docs >

[jira] [Commented] (HUDI-685) Explore support for plugging in Spark data source V2

2020-03-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055233#comment-17055233 ] lamber-ken commented on HUDI-685: - (y) > Explore support for plugging in Spark data source V2 >

[jira] [Comment Edited] (HUDI-685) Explore support for plugging in Spark data source V2

2020-03-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055233#comment-17055233 ] lamber-ken edited comment on HUDI-685 at 3/9/20, 5:29 PM: -- Good news (y) was

[jira] [Comment Edited] (HUDI-669) HoodieDeltaStreamer offset not handled correctly when using LATEST offset reset strategy

2020-03-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055231#comment-17055231 ] lamber-ken edited comment on HUDI-669 at 3/9/20, 5:26 PM: -- hello, [~vbalaji] we

[jira] [Commented] (HUDI-669) HoodieDeltaStreamer offset not handled correctly when using LATEST offset reset strategy

2020-03-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055231#comment-17055231 ] lamber-ken commented on HUDI-669: - hello, [~vbalaji] we did the same thing ;)

[jira] [Updated] (HUDI-646) Re-enable TestUpdateSchemaEvolution after triaging weird CI issue

2020-03-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-646: Status: Open (was: New) > Re-enable TestUpdateSchemaEvolution after triaging weird CI issue >

[jira] [Resolved] (HUDI-673) Rename hudi-hive-bundle to hudi-hive-sync-bundle

2020-03-07 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-673. - Resolution: Fixed > Rename hudi-hive-bundle to hudi-hive-sync-bundle >

[jira] [Created] (HUDI-675) Add jdk13 to .travis.yml

2020-03-07 Thread lamber-ken (Jira)
lamber-ken created HUDI-675: --- Summary: Add jdk13 to .travis.yml Key: HUDI-675 URL: https://issues.apache.org/jira/browse/HUDI-675 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Updated] (HUDI-675) Add jdk13 to .travis.yml

2020-03-07 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-675: Status: Open (was: New) > Add jdk13 to .travis.yml > > > Key:

[jira] [Assigned] (HUDI-675) Add jdk13 to .travis.yml

2020-03-07 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-675: --- Assignee: lamber-ken > Add jdk13 to .travis.yml > > > Key:

[jira] [Resolved] (HUDI-553) Building/Running Hudi on higher java versions

2020-03-07 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-553. - Resolution: Fixed Fixed at master 

[jira] [Commented] (HUDI-516) Avoid need to import spark-avro package when submitting Hudi job in spark

2020-03-07 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053937#comment-17053937 ] lamber-ken commented on HUDI-516: - [~vinoth] right. [~uditme] thanks for reporting and talk about this,

[jira] [Resolved] (HUDI-516) Avoid need to import spark-avro package when submitting Hudi job in spark

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-516. - Resolution: Fixed > Avoid need to import spark-avro package when submitting Hudi job in spark >

[jira] [Commented] (HUDI-516) Avoid need to import spark-avro package when submitting Hudi job in spark

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053930#comment-17053930 ] lamber-ken commented on HUDI-516: - Right, fixed at master 5f85c267040fd51c186794fdae900162ab176b14 > Avoid

[jira] [Updated] (HUDI-674) Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-674: Status: Open (was: New) > Rename hudi-hadoop-mr-bundle to hudi-hive-bundle >

[jira] [Assigned] (HUDI-674) Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-674: --- Assignee: lamber-ken > Rename hudi-hadoop-mr-bundle to hudi-hive-bundle >

[jira] [Created] (HUDI-674) Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

2020-03-06 Thread lamber-ken (Jira)
lamber-ken created HUDI-674: --- Summary: Rename hudi-hadoop-mr-bundle to hudi-hive-bundle Key: HUDI-674 URL: https://issues.apache.org/jira/browse/HUDI-674 Project: Apache Hudi (incubating) Issue

[jira] [Updated] (HUDI-673) Rename hudi-hive-bundle to hudi-hive-sync-bundle

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-673: Status: Open (was: New) > Rename hudi-hive-bundle to hudi-hive-sync-bundle >

[jira] [Created] (HUDI-673) Rename hudi-hive-bundle to hudi-hive-sync-bundle

2020-03-06 Thread lamber-ken (Jira)
lamber-ken created HUDI-673: --- Summary: Rename hudi-hive-bundle to hudi-hive-sync-bundle Key: HUDI-673 URL: https://issues.apache.org/jira/browse/HUDI-673 Project: Apache Hudi (incubating) Issue

[jira] [Assigned] (HUDI-673) Rename hudi-hive-bundle to hudi-hive-sync-bundle

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-673: --- Assignee: lamber-ken > Rename hudi-hive-bundle to hudi-hive-sync-bundle >

[jira] [Resolved] (HUDI-598) Update quick start page

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-598. - Resolution: Fixed Fixed at asf-site 35b0aef62e27290657f5561658bf828b1a2c1b87 > Update quick start page >

[jira] [Resolved] (HUDI-604) Update docker page

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-604. - Resolution: Fixed Fixed at asf-site 5831e456cb3b37f83a2dbc92eb721a1a7b85bbb8 > Update docker page >

[jira] [Resolved] (HUDI-584) Relocate spark-avro dependency by maven-shade-plugin

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-584. - Resolution: Fixed Fixed at master 5f85c267040fd51c186794fdae900162ab176b14 > Relocate spark-avro

[jira] [Updated] (HUDI-516) Avoid need to import spark-avro package when submitting Hudi job in spark

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-516: Status: Open (was: New) > Avoid need to import spark-avro package when submitting Hudi job in spark >

[jira] [Resolved] (HUDI-654) Rename hudi-hive to hudi-hive-sync

2020-03-06 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-654. - Resolution: Fixed Fixed at master ccbf543607db2c3479094a3216f733f6844b6f06 > Rename hudi-hive to

[jira] [Created] (HUDI-663) Fix HoodieDeltaStreamer offset not handled correctly

2020-03-05 Thread lamber-ken (Jira)
lamber-ken created HUDI-663: --- Summary: Fix HoodieDeltaStreamer offset not handled correctly Key: HUDI-663 URL: https://issues.apache.org/jira/browse/HUDI-663 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-663) Fix HoodieDeltaStreamer offset not handled correctly

2020-03-05 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-663: Status: Open (was: New) > Fix HoodieDeltaStreamer offset not handled correctly >

[jira] [Assigned] (HUDI-663) Fix HoodieDeltaStreamer offset not handled correctly

2020-03-05 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-663: --- Assignee: lamber-ken > Fix HoodieDeltaStreamer offset not handled correctly >

[jira] [Closed] (HUDI-545) Throw NoSuchElementException when init IncrementalRelation

2020-03-04 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-545. --- Resolution: Duplicate Duplicated to https://issues.apache.org/jira/browse/HUDI-528 > Throw

[jira] [Resolved] (HUDI-332) Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-03-04 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-332. - Resolution: Fixed Fixed at master 8306205d7abb0acbb73a1d178e3eb90f2bc29a5e > Add operation type

[jira] [Resolved] (HUDI-353) Add support for Hive style partitioning path

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-353. - Resolution: Resolved Fixed at master e555aa516de867a4faf0322e79defa1f52d887ef > Add support for Hive

[jira] [Closed] (HUDI-449) Refactor the codes based on scala codestyle FileLineLengthChecker rule

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-449. --- Resolution: Fixed Moved over to https://issues.apache.org/jira/browse/HUDI-304 > Refactor the codes based on

[jira] [Closed] (HUDI-447) Refactor the codes based on scala codestyle IfBraceChecker rule

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-447. --- Resolution: Delivered Moved over to https://issues.apache.org/jira/browse/HUDI-304 > Refactor the codes based

[jira] [Closed] (HUDI-450) Refactor the codes based on scala codestyle MagicNumberChecker rule

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-450. --- Resolution: Delivered Moved over to https://issues.apache.org/jira/browse/HUDI-304 > Refactor the codes based

[jira] [Closed] (HUDI-448) Refactor the codes based on scala codestyle CyclomaticComplexityChecker rule

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-448. --- Resolution: Delivered Moved over to https://issues.apache.org/jira/browse/HUDI-304 > Refactor the codes based

[jira] [Closed] (HUDI-446) Refactor the codes based on scala codestyle PublicMethodsHaveTypeChecker rule

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-446. --- Resolution: Delivered Moved over to https://issues.apache.org/jira/browse/HUDI-304 > Refactor the codes based

[jira] [Closed] (HUDI-445) Refactor the codes based on scala codestyle BlockImportChecker rule

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-445. --- Resolution: Delivered Moved over to https://issues.apache.org/jira/browse/HUDI-304 > Refactor the codes based

[jira] [Closed] (HUDI-385) Refactor hudi scala checkstyle

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-385. --- Resolution: Delivered Moved over to https://issues.apache.org/jira/browse/HUDI-304 > Refactor hudi scala

[jira] [Resolved] (HUDI-478) build_local_docker_images.sh

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-478. - Resolution: Fixed Fixed at master e5a69ed6af18a3af131323b2297aae6c052ebc72 > build_local_docker_images.sh

[jira] [Resolved] (HUDI-606) Improve execute build_local_docker_images.sh script

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-606. - Resolution: Fixed Fixed at master 323fffad0dccf0ca5cb4e533e7fbcd2a2bcfaf3b > Improve execute

[jira] [Updated] (HUDI-655) Rename hudi-hadoop-mr to hudi-hive

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-655: Status: Open (was: New) > Rename hudi-hadoop-mr to hudi-hive > -- > >

[jira] [Assigned] (HUDI-654) Rename hudi-hive to hudi-hive-sync

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-654: --- Assignee: lamber-ken > Rename hudi-hive to hudi-hive-sync > -- > >

[jira] [Created] (HUDI-654) Rename hudi-hive to hudi-hive-sync

2020-03-03 Thread lamber-ken (Jira)
lamber-ken created HUDI-654: --- Summary: Rename hudi-hive to hudi-hive-sync Key: HUDI-654 URL: https://issues.apache.org/jira/browse/HUDI-654 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Created] (HUDI-655) Rename hudi-hadoop-mr to hudi-hive

2020-03-03 Thread lamber-ken (Jira)
lamber-ken created HUDI-655: --- Summary: Rename hudi-hadoop-mr to hudi-hive Key: HUDI-655 URL: https://issues.apache.org/jira/browse/HUDI-655 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Updated] (HUDI-654) Rename hudi-hive to hudi-hive-sync

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-654: Status: Open (was: New) > Rename hudi-hive to hudi-hive-sync > -- > >

[jira] [Assigned] (HUDI-655) Rename hudi-hadoop-mr to hudi-hive

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-655: --- Assignee: lamber-ken > Rename hudi-hadoop-mr to hudi-hive > -- > >

[jira] [Resolved] (HUDI-459) Redo hudi-hive log statements using SLF4J

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-459. - Resolution: Fixed Fixed at redo-log ac105e6d9b6dcd75f8145af6ce03600af40180e0 > Redo hudi-hive log

[jira] [Updated] (HUDI-553) Building/Running Hudi on higher java versions

2020-03-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-553: Status: Open (was: New) > Building/Running Hudi on higher java versions >

[jira] [Commented] (HUDI-635) MergeHandle's DiskBasedMap entries can be thinner

2020-02-28 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048052#comment-17048052 ] lamber-ken commented on HUDI-635: - I got it thank you. > MergeHandle's DiskBasedMap entries can be thinner

[jira] [Commented] (HUDI-553) Building/Running Hudi on higher java versions

2020-02-28 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047681#comment-17047681 ] lamber-ken commented on HUDI-553: - Hi [~rxu], [~vinoth] willing to drive it ;) > Building/Running Hudi on

[jira] [Comment Edited] (HUDI-635) MergeHandle's DiskBasedMap entries can be thinner

2020-02-27 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046186#comment-17046186 ] lamber-ken edited comment on HUDI-635 at 2/28/20 12:39 AM: --- Right, it's not

[jira] [Commented] (HUDI-553) Building/Running Hudi on higher java versions

2020-02-27 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047089#comment-17047089 ] lamber-ken commented on HUDI-553: - Thanks, let me try :) > Building/Running Hudi on higher java versions >

[jira] [Commented] (HUDI-553) Building/Running Hudi on higher java versions

2020-02-27 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046488#comment-17046488 ] lamber-ken commented on HUDI-553: - Oracle only supports Java SE 13, Java SE 11 (LTS), Java SE 8u241, Java

[jira] [Commented] (HUDI-635) MergeHandle's DiskBasedMap entries can be thinner

2020-02-26 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046186#comment-17046186 ] lamber-ken commented on HUDI-635: - Right, it's not simple.  > I dont think its related to this ticket? 

[jira] [Commented] (HUDI-635) MergeHandle's DiskBasedMap entries can be thinner

2020-02-26 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046166#comment-17046166 ] lamber-ken commented on HUDI-635: - hi [~vinoth], here are my initial thoughts, may be not correct Can we

[jira] [Resolved] (HUDI-34) HoodieArchivedTimeline not reading archived commits in CLI #425

2020-02-26 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-34. Resolution: Resolved Fixed at master 462fd025563b0ae8a4d4f28d366a9bbfca070d3f > HoodieArchivedTimeline not

[jira] [Assigned] (HUDI-34) HoodieArchivedTimeline not reading archived commits in CLI #425

2020-02-26 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-34: -- Assignee: satish > HoodieArchivedTimeline not reading archived commits in CLI #425 >

[jira] [Updated] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-636: Status: Open (was: New) > Fix could not get sources warnings while compiling >

[jira] [Updated] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-636: Description: During the voting process on rc1 0.5.1-incubating release, Justin pointed out that mvn log

[jira] [Assigned] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-636: --- Assignee: lamber-ken > Fix could not get sources warnings while compiling >

[jira] [Updated] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-636: Description: During the voting process on rc1 0.5.1-incubating release, Justin pointed out There are other

[jira] [Created] (HUDI-636) Fix could not get sources warnings while compiling

2020-02-25 Thread lamber-ken (Jira)
lamber-ken created HUDI-636: --- Summary: Fix could not get sources warnings while compiling Key: HUDI-636 URL: https://issues.apache.org/jira/browse/HUDI-636 Project: Apache Hudi (incubating) Issue

[jira] [Updated] (HUDI-580) Fix incorrect license header in files

2020-02-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-580: Summary: Fix incorrect license header in files (was: Incorrect license header in

[jira] [Assigned] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-24 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-625: --- Assignee: lamber-ken (was: Vinoth Chandar) > Address performance concerns on DiskBasedMap.get()

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-24 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043773#comment-17043773 ] lamber-ken commented on HUDI-625: - Thanks, if you don't mind, I think I'd like drive it :D > Address

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043117#comment-17043117 ] lamber-ken edited comment on HUDI-625 at 2/24/20 2:01 AM: -- The key issue is

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043117#comment-17043117 ] lamber-ken edited comment on HUDI-625 at 2/24/20 1:58 AM: -- The key issue is

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043117#comment-17043117 ] lamber-ken edited comment on HUDI-625 at 2/24/20 1:32 AM: -- The key issue is

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043117#comment-17043117 ] lamber-ken edited comment on HUDI-625 at 2/24/20 1:29 AM: -- The key issue is

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043117#comment-17043117 ] lamber-ken edited comment on HUDI-625 at 2/24/20 1:24 AM: -- The key issue is

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043117#comment-17043117 ] lamber-ken commented on HUDI-625: - The key issue is

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043098#comment-17043098 ] lamber-ken edited comment on HUDI-625 at 2/24/20 12:29 AM: --- hi [~vinoth], I sent

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043098#comment-17043098 ] lamber-ken edited comment on HUDI-625 at 2/24/20 12:23 AM: --- hi [~vinoth], I sent

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043098#comment-17043098 ] lamber-ken edited comment on HUDI-625 at 2/24/20 12:18 AM: --- hi [~vinoth], I sent

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043098#comment-17043098 ] lamber-ken commented on HUDI-625: - hi [~vinoth], I send some messages to you use slack, may be these

[jira] [Updated] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-23 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-625: Attachment: image-2020-02-24-08-15-48-615.png > Address performance concerns on DiskBasedMap.get() during

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-22 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042748#comment-17042748 ] lamber-ken commented on HUDI-625: - Let me check it, I took GenericRecord as a demo test here. Now, we know

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-22 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042597#comment-17042597 ] lamber-ken edited comment on HUDI-625 at 2/22/20 3:06 PM: -- hi [~vinoth], caching

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-22 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042597#comment-17042597 ] lamber-ken commented on HUDI-625: - hi [~vinoth], caching the class seems like a good way, but the 

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-22 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042356#comment-17042356 ] lamber-ken edited comment on HUDI-625 at 2/22/20 11:15 AM: --- Hi, [~vinoth] I

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-22 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042484#comment-17042484 ] lamber-ken edited comment on HUDI-625 at 2/22/20 11:09 AM: --- BTW, if we didn't use

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-22 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042484#comment-17042484 ] lamber-ken commented on HUDI-625: - BTW, if we didn't use , it will throw KryoException   {code:java}

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-22 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042483#comment-17042483 ] lamber-ken commented on HUDI-625: - It works, I defined a GenericDataRecordSerializer, then register it to

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042356#comment-17042356 ] lamber-ken edited comment on HUDI-625 at 2/22/20 4:49 AM: -- Hi, [~vinoth] I cached

[jira] [Comment Edited] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-21 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042356#comment-17042356 ] lamber-ken edited comment on HUDI-625 at 2/22/20 4:30 AM: -- Hi, [~vinoth] I cached

<    1   2   3   4   5   >