[GitHub] [hudi] bvaradar commented on issue #1971: Schema evoluation causes issue when using kafka source in hudi deltastreamer

2020-12-06 Thread GitBox
bvaradar commented on issue #1971: URL: https://github.com/apache/hudi/issues/1971#issuecomment-739735068 @jingweiz2017 : I believe the recent commit https://github.com/apache/hudi/commit/62b392b49c13455199e0372204dedf8a371b452c addresses the issue with transformers and null ordering.

[jira] [Updated] (HUDI-982) Make flink engine support MOR table

2020-12-06 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-982: --- Status: Open (was: New) > Make flink engine support MOR table > --- > >

[jira] [Updated] (HUDI-982) Make flink engine support MOR table

2020-12-06 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-982: --- Status: In Progress (was: Open) > Make flink engine support MOR table > --- >

[GitHub] [hudi] manijndl7 commented on pull request #2287: [HUDI-57] Added ORC Support

2020-12-06 Thread GitBox
manijndl7 commented on pull request #2287: URL: https://github.com/apache/hudi/pull/2287#issuecomment-739701693 @yanghua thanks for checking this out ! ya let me resolve all the conflicts This is an automated message from

[GitHub] [hudi] KarthickAN commented on issue #1977: Error running hudi on aws glue

2020-12-06 Thread GitBox
KarthickAN commented on issue #1977: URL: https://github.com/apache/hudi/issues/1977#issuecomment-73968 @ashok-workouts Verify if you're using the same version of spark-avro dependency as your spark version and also the scala build versions between spark-avro and hudi-spark-bundle.

[GitHub] [hudi] kpurella commented on issue #2240: [SUPPORT] Performance Issue : HUDI MOR ,UPSERT Job running forever

2020-12-06 Thread GitBox
kpurella commented on issue #2240: URL: https://github.com/apache/hudi/issues/2240#issuecomment-739681573 @bvaradar Thank you for your response., I will run my tests and provide you more info- This is an automated

[jira] [Updated] (HUDI-1402) Add example about how to use flink engine to quickstart

2020-12-06 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1402: -- Summary: Add example about how to use flink engine to quickstart (was: Add a blog about how to use

[GitHub] [hudi] bithw1 commented on issue #2297: [SUPPORT]Unexpected result when hive querying with select * and select count

2020-12-06 Thread GitBox
bithw1 commented on issue #2297: URL: https://github.com/apache/hudi/issues/2297#issuecomment-739626287 Thanks @pengzhiwei2018 for helping me out, I am using hive, and I rerun the query after setting the input format,the result is correct now. Thanks @pengzhiwei2018 . The

[GitHub] [hudi] yanghua commented on pull request #2287: [HUDI-57] Added ORC Support

2020-12-06 Thread GitBox
yanghua commented on pull request #2287: URL: https://github.com/apache/hudi/pull/2287#issuecomment-739625463 @manijndl7 thanks for your contribution. This pr has conflicting files, please fix, thanks. This is an automated

[hudi] branch master updated (319b7a5 -> de2fbea)

2020-12-06 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 319b7a5 [HUDI-1427] Fix FileAlreadyExistsException when set HOODIE_AUTO_COMMIT_PROP to true (#2295) add

[jira] [Closed] (HUDI-1412) Make HoodieWriteConfig support setting different default value according to engine type

2020-12-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-1412. -- Fix Version/s: 0.6.1 Resolution: Done Done via master: de2fbeac334e65abee38f5f5867805ad07b8dcd2 > Make

[jira] [Updated] (HUDI-1412) Make HoodieWriteConfig support setting different default value according to engine type

2020-12-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-1412: --- Status: Open (was: New) > Make HoodieWriteConfig support setting different default value according to >

[GitHub] [hudi] yanghua merged pull request #2278: [HUDI-1412] Make HoodieWriteConfig support setting different default …

2020-12-06 Thread GitBox
yanghua merged pull request #2278: URL: https://github.com/apache/hudi/pull/2278 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (2ae4c6e) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (2ae4c6e) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (98e2293) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (98e2293) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (98e2293) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (2ae4c6e) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (98e2293) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (2ae4c6e) into

[GitHub] [hudi] shenh062326 commented on a change in pull request #2286: [HUDI-1419] Add base implement for hudi java client

2020-12-06 Thread GitBox
shenh062326 commented on a change in pull request #2286: URL: https://github.com/apache/hudi/pull/2286#discussion_r537049270 ## File path: hudi-client/hudi-java-client/src/main/java/org/apache/hudi/table/action/clean/JavaCleanActionExecutor.java ## @@ -0,0 +1,131 @@ +/* + *

[GitHub] [hudi] pengzhiwei2018 edited a comment on issue #2297: [SUPPORT]Unexpected result when hive querying with select * and select count

2020-12-06 Thread GitBox
pengzhiwei2018 edited a comment on issue #2297: URL: https://github.com/apache/hudi/issues/2297#issuecomment-739499488 Hi @bithw1 , are you query the data with hive sql or spark sql. If using hive sql, you must add `set hive.input.format =

[GitHub] [hudi] pengzhiwei2018 edited a comment on issue #2297: [SUPPORT]Unexpected result when hive querying with select * and select count

2020-12-06 Thread GitBox
pengzhiwei2018 edited a comment on issue #2297: URL: https://github.com/apache/hudi/issues/2297#issuecomment-739499488 Hi @bithw1 , are you query the data with hive sql or spark sql. If hive sql,must add `set hive.input.format = org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat;`

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (0ff1f77) into

[GitHub] [hudi] pengzhiwei2018 edited a comment on issue #2297: [SUPPORT]Unexpected result when hive querying with select * and select count

2020-12-06 Thread GitBox
pengzhiwei2018 edited a comment on issue #2297: URL: https://github.com/apache/hudi/issues/2297#issuecomment-739499488 Hi @bithw1 ,I have also meet same issue when query hudi with spark sql. I think this is a bug. you can look at the issue in

[GitHub] [hudi] pengzhiwei2018 commented on issue #2297: [SUPPORT]Unexpected result when hive querying with select * and select count

2020-12-06 Thread GitBox
pengzhiwei2018 commented on issue #2297: URL: https://github.com/apache/hudi/issues/2297#issuecomment-739499488 Hi @bithw1 ,I have also meet same issue when query hudi whith spark sql. I think this is a bug. you can look at the issue in https://issues.apache.org/jira/browse/HUDI-1415.

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (63e8809) into

[GitHub] [hudi] pengzhiwei2018 edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
pengzhiwei2018 edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-739497762 > @pengzhiwei2018 would you please describe in more details about the issue? Hi @leesf ,Sorry for the late response. I find that when reading hudi table in

[GitHub] [hudi] pengzhiwei2018 edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
pengzhiwei2018 edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-739497762 > @pengzhiwei2018 would you please describe in more details about the issue? Hi @leesf ,Sorry for the late response. I find that when reading hudi table in

[GitHub] [hudi] pengzhiwei2018 edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
pengzhiwei2018 edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-739497762 > @pengzhiwei2018 would you please describe in more details about the issue? Hi @leesf ,Sorry for the late response. I find that when reading hudi table

[GitHub] [hudi] pengzhiwei2018 commented on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
pengzhiwei2018 commented on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-739497762 > @pengzhiwei2018 would you please describe in more details about the issue? > @pengzhiwei2018 would you please describe in more details about the issue?

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (0ff1f77) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2283: [HUDI-1415] Incorrect query result for hudi hive table when using spa…

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2283: URL: https://github.com/apache/hudi/pull/2283#issuecomment-734137301 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=h1) Report > Merging [#2283](https://codecov.io/gh/apache/hudi/pull/2283?src=pr=desc) (63e8809) into

[GitHub] [hudi] leesf commented on pull request #2262: [HUDI-1383] Modify hive partition synchronization

2020-12-06 Thread GitBox
leesf commented on pull request #2262: URL: https://github.com/apache/hudi/pull/2262#issuecomment-739495957 @n3nash would you please review this again when free? This is an automated message from the Apache Git Service. To

[GitHub] [hudi] codecov-io edited a comment on pull request #2286: [HUDI-1419] Add base implement for hudi java client

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2286: URL: https://github.com/apache/hudi/pull/2286#issuecomment-735375388 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] codecov-io edited a comment on pull request #2286: [HUDI-1419] Add base implement for hudi java client

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2286: URL: https://github.com/apache/hudi/pull/2286#issuecomment-735375388 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2286?src=pr=h1) Report > Merging [#2286](https://codecov.io/gh/apache/hudi/pull/2286?src=pr=desc) (8a6b3a8) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2286: [HUDI-1419] Add base implement for hudi java client

2020-12-06 Thread GitBox
codecov-io edited a comment on pull request #2286: URL: https://github.com/apache/hudi/pull/2286#issuecomment-735375388 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2286?src=pr=h1) Report > Merging [#2286](https://codecov.io/gh/apache/hudi/pull/2286?src=pr=desc) (8a6b3a8) into