[jira] [Commented] (HUDI-480) Support a querying delete data methond in incremental view

2022-07-04 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17562303#comment-17562303 ] cdmikechen commented on HUDI-480: - [~fnie] Hi~ What progress have you made so far, I haven'

[jira] [Created] (HUDI-4274) Presto/Trino support hive timestamp type

2022-06-16 Thread cdmikechen (Jira)
cdmikechen created HUDI-4274: Summary: Presto/Trino support hive timestamp type Key: HUDI-4274 URL: https://issues.apache.org/jira/browse/HUDI-4274 Project: Apache Hudi Issue Type: Test

[jira] [Updated] (HUDI-3606) ClassNotFoundException: org.objenesis.strategy.InstantiatorStrategy

2022-03-10 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-3606: - Description: When using *hudi-timeline-server-bundle* in hadoop server (3.2.2), hudi will occasionally en

[jira] [Created] (HUDI-3606) ClassNotFoundException: org.objenesis.strategy.InstantiatorStrategy

2022-03-10 Thread cdmikechen (Jira)
cdmikechen created HUDI-3606: Summary: ClassNotFoundException: org.objenesis.strategy.InstantiatorStrategy Key: HUDI-3606 URL: https://issues.apache.org/jira/browse/HUDI-3606 Project: Apache Hudi

[jira] [Assigned] (HUDI-3245) Convert uppercase letters to lowercase in storage configs

2022-01-16 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-3245: Assignee: cdmikechen > Convert uppercase letters to lowercase in storage configs >

[jira] [Updated] (HUDI-3245) Convert uppercase letters to lowercase in storage configs

2022-01-14 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-3245: - Description: Spark use CaseInsensitiveMap to get options, so that we can not get some configs in *HoodieS

[jira] [Updated] (HUDI-3245) Convert uppercase letters to lowercase in storage configs

2022-01-14 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-3245: - Description: Spark use CaseInsensitiveMap to get options, so that we can not get some configs in *HoodieS

[jira] [Created] (HUDI-3245) Convert uppercase letters to lowercase in storage configs

2022-01-14 Thread cdmikechen (Jira)
cdmikechen created HUDI-3245: Summary: Convert uppercase letters to lowercase in storage configs Key: HUDI-3245 URL: https://issues.apache.org/jira/browse/HUDI-3245 Project: Apache Hudi Issue Typ

[jira] [Comment Edited] (HUDI-3244) UnsupportedOperationException when bulk insert to hudi

2022-01-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475893#comment-17475893 ] cdmikechen edited comment on HUDI-3244 at 1/14/22, 5:03 AM: Ne

[jira] [Reopened] (HUDI-3244) UnsupportedOperationException when bulk insert to hudi

2022-01-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reopened HUDI-3244: -- > UnsupportedOperationException when bulk insert to hudi > -

[jira] [Closed] (HUDI-3244) UnsupportedOperationException when bulk insert to hudi

2022-01-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen closed HUDI-3244. Resolution: Not A Problem > UnsupportedOperationException when bulk insert to hudi > ---

[jira] [Comment Edited] (HUDI-3244) UnsupportedOperationException when bulk insert to hudi

2022-01-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475893#comment-17475893 ] cdmikechen edited comment on HUDI-3244 at 1/14/22, 3:36 AM: It

[jira] [Comment Edited] (HUDI-3244) UnsupportedOperationException when bulk insert to hudi

2022-01-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475893#comment-17475893 ] cdmikechen edited comment on HUDI-3244 at 1/14/22, 3:31 AM: It

[jira] [Commented] (HUDI-3244) UnsupportedOperationException when bulk insert to hudi

2022-01-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475893#comment-17475893 ] cdmikechen commented on HUDI-3244: -- It seems like I imported *hudi-spark3-bundle_2.12* (2

[jira] [Created] (HUDI-3244) UnsupportedOperationException when bulk insert to hudi

2022-01-13 Thread cdmikechen (Jira)
cdmikechen created HUDI-3244: Summary: UnsupportedOperationException when bulk insert to hudi Key: HUDI-3244 URL: https://issues.apache.org/jira/browse/HUDI-3244 Project: Apache Hudi Issue Type:

[jira] [Commented] (HUDI-3216) Support timestamp with microseconds precision

2022-01-11 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17473273#comment-17473273 ] cdmikechen commented on HUDI-3216: --  I've noticed that flink recently submitted a related

[jira] [Created] (HUDI-3199) Hive sync config unification

2022-01-09 Thread cdmikechen (Jira)
cdmikechen created HUDI-3199: Summary: Hive sync config unification Key: HUDI-3199 URL: https://issues.apache.org/jira/browse/HUDI-3199 Project: Apache Hudi Issue Type: Bug Components:

[jira] [Resolved] (HUDI-3118) Add default HUDI_DIR in setupKafka.sh

2022-01-08 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen resolved HUDI-3118. -- > Add default HUDI_DIR in setupKafka.sh > - > > Key: HUD

[jira] [Updated] (HUDI-3119) KafkaConnect Always has a rollback transaction

2021-12-28 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-3119: - Attachment: screenshot-1.png > KafkaConnect Always has a rollback transaction > --

[jira] [Updated] (HUDI-3119) KafkaConnect Always has a rollback transaction

2021-12-28 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-3119: - Description: Transaction rollback often occurs during Kafka Connect is running.  This is part of the log

[jira] [Created] (HUDI-3119) KafkaConnect Always has a rollback transaction

2021-12-28 Thread cdmikechen (Jira)
cdmikechen created HUDI-3119: Summary: KafkaConnect Always has a rollback transaction Key: HUDI-3119 URL: https://issues.apache.org/jira/browse/HUDI-3119 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-3118) Add default HUDI_DIR in setupKafka.sh

2021-12-28 Thread cdmikechen (Jira)
cdmikechen created HUDI-3118: Summary: Add default HUDI_DIR in setupKafka.sh Key: HUDI-3118 URL: https://issues.apache.org/jira/browse/HUDI-3118 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-3117) Kafka Connect can not clearly distinguish every task log

2021-12-28 Thread cdmikechen (Jira)
cdmikechen created HUDI-3117: Summary: Kafka Connect can not clearly distinguish every task log Key: HUDI-3117 URL: https://issues.apache.org/jira/browse/HUDI-3117 Project: Apache Hudi Issue Type

[jira] [Created] (HUDI-3115) Kafka Connect should not be packaged as a bundle

2021-12-28 Thread cdmikechen (Jira)
cdmikechen created HUDI-3115: Summary: Kafka Connect should not be packaged as a bundle Key: HUDI-3115 URL: https://issues.apache.org/jira/browse/HUDI-3115 Project: Apache Hudi Issue Type: Improv

[jira] [Created] (HUDI-3114) Kafka Connect can not connect Hive by jdbc

2021-12-28 Thread cdmikechen (Jira)
cdmikechen created HUDI-3114: Summary: Kafka Connect can not connect Hive by jdbc Key: HUDI-3114 URL: https://issues.apache.org/jira/browse/HUDI-3114 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-3113) Kafka Connect create Multiple Embedded Timeline Services

2021-12-27 Thread cdmikechen (Jira)
cdmikechen created HUDI-3113: Summary: Kafka Connect create Multiple Embedded Timeline Services Key: HUDI-3113 URL: https://issues.apache.org/jira/browse/HUDI-3113 Project: Apache Hudi Issue Type

[jira] [Created] (HUDI-3112) KafkaConnect can not sync to Hive

2021-12-27 Thread cdmikechen (Jira)
cdmikechen created HUDI-3112: Summary: KafkaConnect can not sync to Hive Key: HUDI-3112 URL: https://issues.apache.org/jira/browse/HUDI-3112 Project: Apache Hudi Issue Type: Bug Compone

[jira] [Created] (HUDI-3104) Hudi-kafka-connect can not scan hadoop config files by HADOOP_CONF_DIR

2021-12-26 Thread cdmikechen (Jira)
cdmikechen created HUDI-3104: Summary: Hudi-kafka-connect can not scan hadoop config files by HADOOP_CONF_DIR Key: HUDI-3104 URL: https://issues.apache.org/jira/browse/HUDI-3104 Project: Apache Hudi

[jira] [Created] (HUDI-1802) Timeline Server Bundle need to include com.esotericsoftware package

2021-04-15 Thread cdmikechen (Jira)
cdmikechen created HUDI-1802: Summary: Timeline Server Bundle need to include com.esotericsoftware package Key: HUDI-1802 URL: https://issues.apache.org/jira/browse/HUDI-1802 Project: Apache Hudi

[jira] [Commented] (HUDI-480) Support a querying delete data methond in incremental view

2020-12-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248575#comment-17248575 ] cdmikechen commented on HUDI-480: - [~vinoth] Thanks for your reply ~. I retranslated it in

[jira] [Commented] (HUDI-480) Support a querying delete data methond in incremental view

2020-12-08 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245939#comment-17245939 ] cdmikechen commented on HUDI-480: - [~vinoth] [~yanghua] I opened a project in https://githu

[jira] [Comment Edited] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-14 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213671#comment-17213671 ] cdmikechen edited comment on HUDI-480 at 10/14/20, 7:09 AM: [~y

[jira] [Comment Edited] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-14 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213671#comment-17213671 ] cdmikechen edited comment on HUDI-480 at 10/14/20, 7:04 AM: [~y

[jira] [Commented] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-14 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213671#comment-17213671 ] cdmikechen commented on HUDI-480: - [~yanghua] In step 1, we just filter which files contain

[jira] [Comment Edited] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213102#comment-17213102 ] cdmikechen edited comment on HUDI-480 at 10/14/20, 6:55 AM: [~v

[jira] [Comment Edited] (HUDI-481) Support SQL-like method

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213618#comment-17213618 ] cdmikechen edited comment on HUDI-481 at 10/14/20, 5:20 AM: [~3

[jira] [Comment Edited] (HUDI-481) Support SQL-like method

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213618#comment-17213618 ] cdmikechen edited comment on HUDI-481 at 10/14/20, 5:20 AM: [~3

[jira] [Commented] (HUDI-481) Support SQL-like method

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213618#comment-17213618 ] cdmikechen commented on HUDI-481: - add a *relates to* by HUDI-1341 > Support SQL-like meth

[jira] [Commented] (HUDI-481) Support SQL-like method

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213502#comment-17213502 ] cdmikechen commented on HUDI-481: - I have create a github project in https://github.com/sha

[jira] [Comment Edited] (HUDI-481) Support SQL-like method

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213502#comment-17213502 ] cdmikechen edited comment on HUDI-481 at 10/14/20, 12:35 AM: - I

[jira] [Assigned] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-480: --- Assignee: cdmikechen > Support a querying delete data methond in incremental view > --

[jira] [Comment Edited] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213102#comment-17213102 ] cdmikechen edited comment on HUDI-480 at 10/13/20, 1:10 PM: [~v

[jira] [Comment Edited] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213102#comment-17213102 ] cdmikechen edited comment on HUDI-480 at 10/13/20, 1:09 PM: [~v

[jira] [Comment Edited] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213102#comment-17213102 ] cdmikechen edited comment on HUDI-480 at 10/13/20, 1:05 PM: [~v

[jira] [Comment Edited] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213102#comment-17213102 ] cdmikechen edited comment on HUDI-480 at 10/13/20, 1:04 PM: Sor

[jira] [Commented] (HUDI-480) Support a querying delete data methond in incremental view

2020-10-13 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213102#comment-17213102 ] cdmikechen commented on HUDI-480: - Sorry for starting to discuss this topic as long as so f

[jira] [Comment Edited] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-10-04 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207838#comment-17207838 ] cdmikechen edited comment on HUDI-83 at 10/5/20, 6:42 AM: -- Some cod

[jira] [Comment Edited] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-10-04 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207838#comment-17207838 ] cdmikechen edited comment on HUDI-83 at 10/5/20, 6:41 AM: -- Some cod

[jira] [Commented] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-10-04 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207838#comment-17207838 ] cdmikechen commented on HUDI-83: Some codes may have duplicate parts with HUDI-1302 . I will

[jira] [Commented] (HUDI-1302) Add support for timestamp field in HiveSync

2020-10-04 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207837#comment-17207837 ] cdmikechen commented on HUDI-1302: -- Some codes may have duplicate parts with [HUDI-83|ht

[jira] [Commented] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-09-08 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192611#comment-17192611 ] cdmikechen commented on HUDI-83: [~uditme] Yes, in hive3 it is supported, and we can just re

[jira] [Commented] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-09-08 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192604#comment-17192604 ] cdmikechen commented on HUDI-83: [~shivnarayan] I will open a PR recently. I have completed

[jira] [Updated] (HUDI-1254) TypedProperties can not get values by initializing an existing properties

2020-08-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-1254: - Description: If I create a test to new a TypedProperties by a Properties that exists like blow: {code:jav

[jira] [Created] (HUDI-1254) TypedProperties can not get values by initializing an existing properties

2020-08-30 Thread cdmikechen (Jira)
cdmikechen created HUDI-1254: Summary: TypedProperties can not get values by initializing an existing properties Key: HUDI-1254 URL: https://issues.apache.org/jira/browse/HUDI-1254 Project: Apache Hudi

[jira] [Assigned] (HUDI-1225) Avro Date logical type not handled correctly when converting to Spark Row

2020-08-27 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-1225: Assignee: Balaji Varadarajan (was: cdmikechen) Please review codes > Avro Date logical type not h

[jira] [Updated] (HUDI-1225) Avro Date logical type not handled correctly when converting to Spark Row

2020-08-27 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-1225: - Status: In Progress (was: Open) > Avro Date logical type not handled correctly when converting to Spark R

[jira] [Assigned] (HUDI-1225) Avro Date logical type not handled correctly when converting to Spark Row

2020-08-25 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-1225: Assignee: cdmikechen > Avro Date logical type not handled correctly when converting to Spark Row >

[jira] [Commented] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-05-25 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115769#comment-17115769 ] cdmikechen commented on HUDI-83: [~shivnarayan] I think the right type should be necessary.

[jira] [Commented] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-04-20 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088258#comment-17088258 ] cdmikechen commented on HUDI-83: [~vinoth] [~arw357] [~uditme] [~xleesf] I have custom a new

[jira] [Assigned] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-04-20 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-83: -- Assignee: cdmikechen > Map Timestamp type in spark to corresponding Timestamp type in Hive during > Hive

[jira] [Commented] (HUDI-480) Support a querying delete data methond in incremental view

2020-04-20 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088183#comment-17088183 ] cdmikechen commented on HUDI-480: - [~vinoth] [~yanghua] Maybe I can open a RFC and write do

[jira] [Commented] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2020-03-17 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061447#comment-17061447 ] cdmikechen commented on HUDI-83: [~vinoth] Sorry for delay. I recently was busy on doing som

[jira] [Comment Edited] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012371#comment-17012371 ] cdmikechen edited comment on HUDI-91 at 1/10/20 1:38 AM: - [~vinoth]

[jira] [Comment Edited] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012371#comment-17012371 ] cdmikechen edited comment on HUDI-91 at 1/10/20 1:37 AM: - [~vinoth]

[jira] [Commented] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012371#comment-17012371 ] cdmikechen commented on HUDI-91: [~vinoth] Yes, I know your point. We can use hudi fine by

[jira] [Commented] (HUDI-481) Support SQL-like method

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012328#comment-17012328 ] cdmikechen commented on HUDI-481: - [~vinoth] I opened Spark's GitHub again this morning, a

[jira] [Comment Edited] (HUDI-481) Support SQL-like method

2020-01-08 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011282#comment-17011282 ] cdmikechen edited comment on HUDI-481 at 1/9/20 1:12 AM: - [~vinoth]

[jira] [Commented] (HUDI-481) Support SQL-like method

2020-01-08 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011282#comment-17011282 ] cdmikechen commented on HUDI-481: - [~vinoth] Oh~ I‘ve seen in  [https://github.com/apache/

[jira] [Commented] (HUDI-481) Support SQL-like method

2020-01-06 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009320#comment-17009320 ] cdmikechen commented on HUDI-481: - [~vinoth] I checked the spark project. It seems that the

[jira] [Assigned] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-29: -- Assignee: Vinoth Chandar > Patch to Hive-sync to enable stats on Hive tables #393 > -

[jira] [Updated] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-29: --- Status: Closed (was: Patch Available) > Patch to Hive-sync to enable stats on Hive tables #393 > --

[jira] [Reopened] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reopened HUDI-29: > Patch to Hive-sync to enable stats on Hive tables #393 > --

[jira] [Assigned] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-29: -- Assignee: (was: Vinoth Chandar) > Patch to Hive-sync to enable stats on Hive tables #393 > --

[jira] [Updated] (HUDI-469) HoodieCommitMetadata only show first commit insert rows.

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-469: Status: Patch Available (was: In Progress) > HoodieCommitMetadata only show first commit insert rows. > ---

[jira] [Reopened] (HUDI-469) HoodieCommitMetadata only show first commit insert rows.

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reopened HUDI-469: - > HoodieCommitMetadata only show first commit insert rows. > -

[jira] [Updated] (HUDI-469) HoodieCommitMetadata only show first commit insert rows.

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-469: Status: Closed (was: Patch Available) > HoodieCommitMetadata only show first commit insert rows. >

[jira] [Commented] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005859#comment-17005859 ] cdmikechen commented on HUDI-91: [~vinoth] I've tested that hive can read column type decima

[jira] [Commented] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2019-12-30 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005858#comment-17005858 ] cdmikechen commented on HUDI-91: Want to know the progress of this PR now. I think not every

[jira] [Commented] (HUDI-233) Redo log statements using SLF4J

2019-12-29 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005123#comment-17005123 ] cdmikechen commented on HUDI-233: - Should we create a new branch, conduct unified testing,

[jira] [Updated] (HUDI-480) Support a querying delete data methond in incremental view

2019-12-29 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-480: Issue Type: Improvement (was: Bug) Summary: Support a querying delete data methond in incremental view

[jira] [Created] (HUDI-481) Support SQL-like method

2019-12-29 Thread cdmikechen (Jira)
cdmikechen created HUDI-481: --- Summary: Support SQL-like method Key: HUDI-481 URL: https://issues.apache.org/jira/browse/HUDI-481 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Created] (HUDI-480) Supporting a querying delete data methond in incremental view

2019-12-29 Thread cdmikechen (Jira)
cdmikechen created HUDI-480: --- Summary: Supporting a querying delete data methond in incremental view Key: HUDI-480 URL: https://issues.apache.org/jira/browse/HUDI-480 Project: Apache Hudi (incubating)

[jira] [Closed] (HUDI-467) Query RT Table in Hive found java.lang.NoClassDefFoundError Exception

2019-12-25 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen closed HUDI-467. --- Resolution: Not A Problem use hadoop-mr-bundle > Query RT Table in Hive found java.lang.NoClassDefFoundError E

[jira] [Updated] (HUDI-469) HoodieCommitMetadata only show first commit insert rows.

2019-12-25 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-469: Status: Patch Available (was: In Progress) > HoodieCommitMetadata only show first commit insert rows. > ---

[jira] [Created] (HUDI-469) HoodieCommitMetadata only show first commit insert rows.

2019-12-25 Thread cdmikechen (Jira)
cdmikechen created HUDI-469: --- Summary: HoodieCommitMetadata only show first commit insert rows. Key: HUDI-469 URL: https://issues.apache.org/jira/browse/HUDI-469 Project: Apache Hudi (incubating)

[jira] [Comment Edited] (HUDI-467) Query RT Table in Hive found java.lang.NoClassDefFoundError Exception

2019-12-24 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003095#comment-17003095 ] cdmikechen edited comment on HUDI-467 at 12/25/19 6:29 AM: --- I che

[jira] [Comment Edited] (HUDI-467) Query RT Table in Hive found java.lang.NoClassDefFoundError Exception

2019-12-24 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003095#comment-17003095 ] cdmikechen edited comment on HUDI-467 at 12/25/19 6:29 AM: --- I che

[jira] [Assigned] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-12-24 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-29: -- Assignee: Vinoth Chandar (was: cdmikechen) Have created a PR in https://github.com/apache/incubator-hudi

[jira] [Commented] (HUDI-467) Query RT Table in Hive found java.lang.NoClassDefFoundError Exception

2019-12-24 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003095#comment-17003095 ] cdmikechen commented on HUDI-467: - I checked mvn tree and found that mvn use parquet-avro i

[jira] [Updated] (HUDI-467) Query RT Table in Hive found java.lang.NoClassDefFoundError Exception

2019-12-24 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-467: Description: When creating a *MERGE_ON_READ* table in hudi and syn to hive, hudi will create two table named

[jira] [Created] (HUDI-467) Query RT Table in Hive found java.lang.NoClassDefFoundError Exception

2019-12-24 Thread cdmikechen (Jira)
cdmikechen created HUDI-467: --- Summary: Query RT Table in Hive found java.lang.NoClassDefFoundError Exception Key: HUDI-467 URL: https://issues.apache.org/jira/browse/HUDI-467 Project: Apache Hudi (incubatin

[jira] [Closed] (HUDI-451) Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shell

2019-12-22 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen closed HUDI-451. --- Resolution: Not A Problem > Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shell > -

[jira] [Updated] (HUDI-451) Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shell

2019-12-22 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-451: Status: In Progress (was: Open) > Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shel

[jira] [Commented] (HUDI-451) Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shell

2019-12-22 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002128#comment-17002128 ] cdmikechen commented on HUDI-451: - I reexamined it and found this is not hudi problems, so

[jira] [Commented] (HUDI-451) Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shell

2019-12-22 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002109#comment-17002109 ] cdmikechen commented on HUDI-451: - I found that hadoop, hive and spark have their own jerse

[jira] [Created] (HUDI-451) Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shell

2019-12-22 Thread cdmikechen (Jira)
cdmikechen created HUDI-451: --- Summary: Spark on yarn with Hudi get java.lang.ClassNotFoundException in spark-shell Key: HUDI-451 URL: https://issues.apache.org/jira/browse/HUDI-451 Project: Apache Hudi (inc

[jira] [Commented] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-12-22 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002029#comment-17002029 ] cdmikechen commented on HUDI-29: I will do this in this weeks. I have implemented it in hood

[jira] [Commented] (HUDI-276) Translate Documentation -> Configurations page

2019-09-24 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937375#comment-16937375 ] cdmikechen commented on HUDI-276: - 很高兴还有国内志同道合的同志使用hudi啊,你们目前已经在使用hudi了吗 > Translate Docum

[jira] [Commented] (HUDI-83) Support for timestamp datatype in Hudi

2019-09-20 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934546#comment-16934546 ] cdmikechen commented on HUDI-83: I raise an issue in Hive https://issues.apache.org/jira/bro

[jira] [Commented] (HUDI-83) Support for timestamp datatype in Hudi

2019-09-19 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933882#comment-16933882 ] cdmikechen commented on HUDI-83: This problem is not only related to spark-avro, but also to

  1   2   >