[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] wangxianghu commented on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
wangxianghu commented on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846363453 @yanghua please take a look when free -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter commented on pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
codecov-commenter commented on pull request #2978: URL: https://github.com/apache/hudi/pull/2978#issuecomment-846335495 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2978?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache

[jira] [Updated] (HUDI-1920) Set "archived" as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang updated HUDI-1920: --- Description: Currently, hudi has already used {{archived}} as the default value of {{HOODIE_ARCHIVELOG

[GitHub] [hudi] wangxianghu opened a new pull request #2978: [HUDI-1920] Set archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread GitBox
wangxianghu opened a new pull request #2978: URL: https://github.com/apache/hudi/pull/2978 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Updated] (HUDI-1920) Set "archived" as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1920: - Labels: pull-request-available (was: ) > Set "archived" as the default value of HOODIE_ARCHIVELOG

[jira] [Updated] (HUDI-1920) Set "archived" as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang updated HUDI-1920: --- Summary: Set "archived" as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME (was: Set “archive

[jira] [Assigned] (HUDI-1920) Set "archived" as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang reassigned HUDI-1920: -- Assignee: Xianghu Wang > Set "archived" as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_N

[jira] [Created] (HUDI-1920) Set “archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME

2021-05-21 Thread Xianghu Wang (Jira)
Xianghu Wang created HUDI-1920: -- Summary: Set “archived as the default value of HOODIE_ARCHIVELOG_FOLDER_PROP_NAME Key: HUDI-1920 URL: https://issues.apache.org/jira/browse/HUDI-1920 Project: Apache Hudi

[jira] [Updated] (HUDI-1919) Fix column misalignment occurs when reading the copy_on_write type of hudi table through Flink

2021-05-21 Thread Well Tang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Well Tang updated HUDI-1919: Description: The timing of the exception is: when the specified partition column field is not at the end of

[jira] [Updated] (HUDI-1919) Fix column misalignment occurs when reading the copy_on_write type of hudi table through Flink

2021-05-21 Thread Well Tang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Well Tang updated HUDI-1919: Summary: Fix column misalignment occurs when reading the copy_on_write type of hudi table through Flink (wa

[jira] [Updated] (HUDI-1919) Column misalignment occurs when reading the copy_on_write type of hudi table through Flink

2021-05-21 Thread Well Tang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Well Tang updated HUDI-1919: Description: The timing of the exception is: when the specified partition column field is not at the end of

[jira] [Updated] (HUDI-1919) Column misalignment occurs when reading the copy_on_write type of hudi table through Flink

2021-05-21 Thread Well Tang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Well Tang updated HUDI-1919: Description: The timing of the exception is: when the specified partition column field is not at the end of

[GitHub] [hudi] wangxianghu closed pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-05-21 Thread GitBox
wangxianghu closed pull request #2963: URL: https://github.com/apache/hudi/pull/2963 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pleas

[GitHub] [hudi] AirToSupply edited a comment on issue #2976: [SUPPORT] Column misalignment occurs when reading the COPY_ON_WRITE type of hudi table through Flink

2021-05-21 Thread GitBox
AirToSupply edited a comment on issue #2976: URL: https://github.com/apache/hudi/issues/2976#issuecomment-846086036 @AirToSupply Thanks, https://issues.apache.org/jira/browse/HUDI-1919 issue created here ~ -- This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Commented] (HUDI-1739) Standardize usage of replacecommit files across the code base

2021-05-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349474#comment-17349474 ] Vinoth Chandar commented on HUDI-1739: -- [~satishkotha] from the PR, it seems like we

[hudi] branch master updated (99b14a7 -> 685f77b)

2021-05-21 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 99b14a7 [HUDI-1918] Fix incorrect keyBy field cause serious data skew, to avoid multiple subtasks write to a partitio

[GitHub] [hudi] vinothchandar merged pull request #2784: [HUDI-1740] Fix insert-overwrite API archival

2021-05-21 Thread GitBox
vinothchandar merged pull request #2784: URL: https://github.com/apache/hudi/pull/2784 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, ple

[jira] [Updated] (HUDI-1739) Standardize usage of replacecommit files across the code base

2021-05-21 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1739: - Summary: Standardize usage of replacecommit files across the code base (was: insert_overwrite_tab

[GitHub] [hudi] vinothchandar commented on a change in pull request #2784: [HUDI-1740] Fix insert-overwrite API archival

2021-05-21 Thread GitBox
vinothchandar commented on a change in pull request #2784: URL: https://github.com/apache/hudi/pull/2784#discussion_r637218096 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/MetadataConversionUtils.java ## @@ -107,14 +119,25 @@ public s

[GitHub] [hudi] pmathew-coder closed issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
pmathew-coder closed issue #2974: URL: https://github.com/apache/hudi/issues/2974 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please c

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-828792354 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2833?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] vinothchandar commented on issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
vinothchandar commented on issue #2974: URL: https://github.com/apache/hudi/issues/2974#issuecomment-846127424 @xushiyan this might interest you? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] pmathew-coder commented on issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
pmathew-coder commented on issue #2974: URL: https://github.com/apache/hudi/issues/2974#issuecomment-846108312 The jar is available at https://public.nexus.pentaho.org , adding this repo will resole the issue. -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hudi] tandonraghav commented on issue #2948: [SUPPORT] EMR (5.33.x) Presto Query on _rt tables

2021-05-21 Thread GitBox
tandonraghav commented on issue #2948: URL: https://github.com/apache/hudi/issues/2948#issuecomment-846090904 @n3nash Were you able to reproduce this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hudi] AirToSupply commented on issue #2976: [SUPPORT] Column misalignment occurs when reading the COPY_ON_WRITE type of hudi table through Flink

2021-05-21 Thread GitBox
AirToSupply commented on issue #2976: URL: https://github.com/apache/hudi/issues/2976#issuecomment-846086036 @AirToSupply Is there a JIRA for this issue if not can you file one and ping it here so we can close the github issue ? Thanks, https://issues.apache.org/jira/browse/HUDI-1919 iss

[jira] [Updated] (HUDI-1919) Column misalignment occurs when reading the copy_on_write type of hudi table through Flink

2021-05-21 Thread tangchenhao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangchenhao updated HUDI-1919: -- Summary: Column misalignment occurs when reading the copy_on_write type of hudi table through Flink (wa

[jira] [Created] (HUDI-1919) Column misalignment occurs when reading the COPY_ON_WRITE type of hudi table through Flink

2021-05-21 Thread tangchenhao (Jira)
tangchenhao created HUDI-1919: - Summary: Column misalignment occurs when reading the COPY_ON_WRITE type of hudi table through Flink Key: HUDI-1919 URL: https://issues.apache.org/jira/browse/HUDI-1919 Proj

[GitHub] [hudi] nsivabalan commented on pull request #2751: [HUDI-1748] Read operation will possiblity fail on mor table rt view when a write operations is concurrency running

2021-05-21 Thread GitBox
nsivabalan commented on pull request #2751: URL: https://github.com/apache/hudi/pull/2751#issuecomment-846058878 @n3nash : once you verify the issue, please move it to "ready to review" col in the PR board. -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [hudi] nsivabalan commented on pull request #2768: [HUDI-485]: corrected the check for incremental sql

2021-05-21 Thread GitBox
nsivabalan commented on pull request #2768: URL: https://github.com/apache/hudi/pull/2768#issuecomment-846057546 @pratyakshsharma : can you please respond to vinoth's feedback when you get a chance. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] nsivabalan commented on pull request #2012: [HUDI-1129] Deltastreamer Add support for schema evolution

2021-05-21 Thread GitBox
nsivabalan commented on pull request #2012: URL: https://github.com/apache/hudi/pull/2012#issuecomment-846037950 @sbernauer : We would appreciate if you can try out our fix https://github.com/apache/hudi/pull/2927 and let us know if it work for you. We can sync up via slack if you are avai

[GitHub] [hudi] nsivabalan commented on a change in pull request #2967: Added blog for Hudi cleaner service

2021-05-21 Thread GitBox
nsivabalan commented on a change in pull request #2967: URL: https://github.com/apache/hudi/pull/2967#discussion_r637005303 ## File path: docs/_posts/2021-05-19-employing-right-configurations-for-hudi-cleaner.md ## @@ -0,0 +1,77 @@ +--- +title: "Employing correct configuration

[GitHub] [hudi] pmathew-coder commented on issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
pmathew-coder commented on issue #2974: URL: https://github.com/apache/hudi/issues/2974#issuecomment-84602 Thanks, but looks like I ran into some access issues. There are some workarounds suggested on this link but nothing has worked. If you have seen this or recognize this error pleas

[GitHub] [hudi] codecov-commenter commented on pull request #2977: [HUDI-1763][WIP] Fixing honoring of Ordering val in DefaultHoodieRecordPayload.preCombine

2021-05-21 Thread GitBox
codecov-commenter commented on pull request #2977: URL: https://github.com/apache/hudi/pull/2977#issuecomment-846016572 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2977?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache

[GitHub] [hudi] nsivabalan commented on pull request #1817: [HUDI-651] Fix incremental queries in hive for MOR tables

2021-05-21 Thread GitBox
nsivabalan commented on pull request #1817: URL: https://github.com/apache/hudi/pull/1817#issuecomment-845989221 @garyli1019 and @n3nash : can we have some owner for this. if not, I can take it up, but I haven't worked on incremental path before, but willing to expand my knowledge :) --

[jira] [Updated] (HUDI-1560) How to deduce bloom filter configs

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1560: -- Status: In Progress (was: Open) > How to deduce bloom filter configs >

[jira] [Resolved] (HUDI-1560) How to deduce bloom filter configs

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1560. --- Fix Version/s: 0.9.0 Resolution: Fixed > How to deduce bloom filter configs > -

[jira] [Updated] (HUDI-1806) Honor "skipROSuffix" in spark ds

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1806: -- Status: Closed (was: Patch Available) > Honor "skipROSuffix" in spark ds >

[jira] [Resolved] (HUDI-1806) Honor "skipROSuffix" in spark ds

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1806. --- Resolution: Fixed > Honor "skipROSuffix" in spark ds > ---

[jira] [Reopened] (HUDI-1806) Honor "skipROSuffix" in spark ds

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-1806: --- Assignee: sivabalan narayanan > Honor "skipROSuffix" in spark ds > ---

[jira] [Reopened] (HUDI-1722) hive beeline/spark-sql query specified field on mor table occur NPE

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-1722: --- > hive beeline/spark-sql query specified field on mor table occur NPE > -

[jira] [Updated] (HUDI-1722) hive beeline/spark-sql query specified field on mor table occur NPE

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1722: -- Status: Closed (was: Patch Available) > hive beeline/spark-sql query specified field o

[jira] [Resolved] (HUDI-1722) hive beeline/spark-sql query specified field on mor table occur NPE

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1722. --- Resolution: Fixed > hive beeline/spark-sql query specified field on mor table occur N

[jira] [Assigned] (HUDI-1602) Corrupted Avro schema extracted from parquet file

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-1602: - Assignee: Nishith Agarwal (was: Vinoth Chandar) > Corrupted Avro schema extracte

[jira] [Commented] (HUDI-1763) DefaultHoodieRecordPayload does not honor ordering value when records within multiple log files are merged

2021-05-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349290#comment-17349290 ] sivabalan narayanan commented on HUDI-1763: --- [~nishith29]: sure.  I have taken

[GitHub] [hudi] leesf merged pull request #2972: [HUDI-1918] Fix incorrect keyBy field cause serious data skew, to avo…

2021-05-21 Thread GitBox
leesf merged pull request #2972: URL: https://github.com/apache/hudi/pull/2972 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please cont

[jira] [Updated] (HUDI-1763) DefaultHoodieRecordPayload does not honor ordering value when records within multiple log files are merged

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1763: - Labels: pull-request-available sev:critical (was: sev:critical) > DefaultHoodieRecordPayload does

[GitHub] [hudi] nsivabalan opened a new pull request #2977: [HUDI-1763][WIP] Fixing honoring of Ordering val in DefaultHoodieRecordPayload.preCombine

2021-05-21 Thread GitBox
nsivabalan opened a new pull request #2977: URL: https://github.com/apache/hudi/pull/2977 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[hudi] branch master updated: [HUDI-1918] Fix incorrect keyBy field cause serious data skew, to avoid multiple subtasks write to a partition at the same time (#2972)

2021-05-21 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 99b14a7 [HUDI-1918] Fix incorrect keyBy field caus

[GitHub] [hudi] nsivabalan commented on pull request #2845: [HUDI-1723] Fix path selector listing files with the same mod date

2021-05-21 Thread GitBox
nsivabalan commented on pull request #2845: URL: https://github.com/apache/hudi/pull/2845#issuecomment-845918161 LGTM. can you please check why CI is failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[hudi] branch master updated: [HUDI-1888] Fix NPE when the nested partition path field has null value (#2957)

2021-05-21 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a96034d [HUDI-1888] Fix NPE when the nested pa

[GitHub] [hudi] nsivabalan merged pull request #2957: [HUDI-1888] Fix NPE when the nested partition path field has null value

2021-05-21 Thread GitBox
nsivabalan merged pull request #2957: URL: https://github.com/apache/hudi/pull/2957 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] wangxianghu commented on pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-05-21 Thread GitBox
wangxianghu commented on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-845912212 it is backwards compatible now :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] AirToSupply opened a new issue #2976: [SUPPORT] Column misalignment occurs when reading the COPY_ON_WRITE type of hudi table through Flink

2021-05-21 Thread GitBox
AirToSupply opened a new issue #2976: URL: https://github.com/apache/hudi/issues/2976 **To Reproduce** Steps to reproduce the behavior: 1.Build from source with branch [master], the version is 0.9.0-SNAPSHOT. 2.Start a Fink1.12.x streaming job, read data from hudi table to

[GitHub] [hudi] fengjian428 edited a comment on issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
fengjian428 edited a comment on issue #2974: URL: https://github.com/apache/hudi/issues/2974#issuecomment-845800073 > repo2 Mirror from Maven Repo2 https://repo.spring.io/plugins-release/ central ' I also

[GitHub] [hudi] fengjian428 edited a comment on issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
fengjian428 edited a comment on issue #2974: URL: https://github.com/apache/hudi/issues/2974#issuecomment-845800073 ` repo2 Mirror from Maven Repo2 https://repo.spring.io/plugins-release/ central ' I also met this

[GitHub] [hudi] fengjian428 commented on issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
fengjian428 commented on issue #2974: URL: https://github.com/apache/hudi/issues/2974#issuecomment-845800073 repo2 Mirror from Maven Repo2 https://repo.spring.io/plugins-release/ central I also met this yesterda

[GitHub] [hudi] fengjian428 edited a comment on issue #2974: [SUPPORT] Docker demo hudi build error

2021-05-21 Thread GitBox
fengjian428 edited a comment on issue #2974: URL: https://github.com/apache/hudi/issues/2974#issuecomment-845800073 > ` repo2 Mirror from Maven Repo2 https://repo.spring.io/plugins-release/ central ' I also me

[GitHub] [hudi] yanghua commented on pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-05-21 Thread GitBox
yanghua commented on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-845799391 @vinothchandar Can we refactor all SchemaProviders without respecting compatibility? The current layout of these classes is a bit confusing. And I believe they can be engine-indepe

[GitHub] [hudi] liujinhui1994 commented on pull request #2438: [HUDI-1447] DeltaStreamer kafka source supports consuming from specified timestamp

2021-05-21 Thread GitBox
liujinhui1994 commented on pull request #2438: URL: https://github.com/apache/hudi/pull/2438#issuecomment-845791067 > @liujinhui1994 : were you able to make progress on this. would be nice to have this in before next release. Sorry, I was too busy with work before~ I just sorted out

[GitHub] [hudi] peanut-chenzhong commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command

2021-05-21 Thread GitBox
peanut-chenzhong commented on issue #2955: URL: https://github.com/apache/hudi/issues/2955#issuecomment-845794327 @n3nash Dear community supporter, we have fixed this issue in our local branch, how could we submit this enhance to master branch? -- This is an automated message from the Ap

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-843155329 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2963?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-828792354 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2833?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2957: [HUDI-1888] Fix NPE when the nested partition path field has null value

2021-05-21 Thread GitBox
codecov-commenter edited a comment on pull request #2957: URL: https://github.com/apache/hudi/pull/2957#issuecomment-842064788 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2957?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The