[jira] [Resolved] (HUDI-1197) Fix build issue in scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1197. - Resolution: Fixed > Fix build issue in scala 2.12 > - > >

[GitHub] [hudi] UZi5136225 commented on pull request #1970: [HUDI-1193] Upgrade http dependent version

UZi5136225 commented on pull request #1970: URL: https://github.com/apache/hudi/pull/1970#issuecomment-675887993 @leesf This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[jira] [Reopened] (HUDI-1197) Fix build issue in scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1197: - > Fix build issue in scala 2.12 > - > > Key: HUDI-1197 >

[jira] [Updated] (HUDI-1197) Fix build issue in scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-1197: Status: Closed (was: Patch Available) > Fix build issue in scala 2.12 > ---

[jira] [Commented] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180305#comment-17180305 ] liujinhui commented on HUDI-1193: - [~vinoth]  hello, please help review this problem. Does

[jira] [Updated] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1193: Priority: Blocker (was: Major) > Upgrade http dependent version > -- > >

[jira] [Updated] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1193: Priority: Major (was: Blocker) > Upgrade http dependent version > -- > >

[GitHub] [hudi] UZi5136225 commented on pull request #1970: [HUDI-1193] Upgrade http dependent version

UZi5136225 commented on pull request #1970: URL: https://github.com/apache/hudi/pull/1970#issuecomment-675887212 Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 4.0 failed 4 times, most recent failure: Lost task 0.3 in stage 4.0 (TID 77, x,

[jira] [Comment Edited] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180302#comment-17180302 ] liujinhui edited comment on HUDI-1193 at 8/19/20, 6:48 AM: --- {cod

[jira] [Commented] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180302#comment-17180302 ] liujinhui commented on HUDI-1193: - {code:java} Caused by: org.apache.spark.SparkException:

[jira] [Issue Comment Deleted] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1193: Comment: was deleted (was: Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Ta

[jira] [Commented] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180301#comment-17180301 ] liujinhui commented on HUDI-1193: - Caused by: org.apache.spark.SparkException: Job aborted

[jira] [Updated] (HUDI-1193) Upgrade http dependent version

[ https://issues.apache.org/jira/browse/HUDI-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1193: Affects Version/s: 0.6.0 > Upgrade http dependent version > -- > >

[jira] [Commented] (HUDI-1200) KeyGenerator does not work,java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180291#comment-17180291 ] liujinhui commented on HUDI-1200: - This is my complete configuration, I found the problem

[jira] [Commented] (HUDI-1200) KeyGenerator does not work,java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180287#comment-17180287 ] liujinhui commented on HUDI-1200: - df.write().format("org.apache.hudi"). options(getQuick

[jira] [Commented] (HUDI-1200) KeyGenerator does not work,java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180283#comment-17180283 ] Bhavani Sudha commented on HUDI-1200: - [~liujinhui] Have you configured `hoodie.dataso

[jira] [Commented] (HUDI-1200) KeyGenerator does not work,java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180279#comment-17180279 ] liujinhui commented on HUDI-1200: - [~vinoth]I am dealing with this issue urgently  > KeyG

[jira] [Updated] (HUDI-1200) KeyGenerator does not work,java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1200: Summary: KeyGenerator does not work,java.lang.NullPointerException (was: KeyGenerator does not work,) > Ke

[jira] [Updated] (HUDI-1200) KeyGenerator does not work,

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1200: Affects Version/s: 0.6.0 > KeyGenerator does not work, > --- > > Key

[jira] [Updated] (HUDI-1200) KeyGenerator does not work,java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1200: Status: Open (was: New) > KeyGenerator does not work,java.lang.NullPointerException > -

[jira] [Updated] (HUDI-1200) KeyGenerator does not work,java.lang.NullPointerException

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1200: Status: In Progress (was: Open) > KeyGenerator does not work,java.lang.NullPointerException > -

[jira] [Updated] (HUDI-1200) KeyGenerator does not work,

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1200: Description:   {code:java} 2020-08-19 11:03:30 INFO Driver scheduler.DAGScheduler:57 - Job 7 failed: isEmpt

[jira] [Commented] (HUDI-1200) KeyGenerator does not work,

[ https://issues.apache.org/jira/browse/HUDI-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180275#comment-17180275 ] liujinhui commented on HUDI-1200: - option("hoodie.datasource.write.partitionpath.field", "

[jira] [Created] (HUDI-1200) KeyGenerator does not work,

liujinhui created HUDI-1200: --- Summary: KeyGenerator does not work, Key: HUDI-1200 URL: https://issues.apache.org/jira/browse/HUDI-1200 Project: Apache Hudi Issue Type: Bug Reporter: liu

[GitHub] [hudi] wfhartford commented on issue #1943: [SUPPORT] Gradle fails with dependency on org.apache.hudi:hudi-spark_2.12:0.5.3

wfhartford commented on issue #1943: URL: https://github.com/apache/hudi/issues/1943#issuecomment-675861588 I believe that is the command I used to build HUDI. The issue does not come from the fact that I built from source. The linked repository exhibits the issue and relies only the the p

[GitHub] [hudi] n3nash commented on a change in pull request #1963: [HUDI-1188] Hbase index MOR tables records not being deduplicated

n3nash commented on a change in pull request #1963: URL: https://github.com/apache/hudi/pull/1963#discussion_r472687401 ## File path: hudi-client/src/main/java/org/apache/hudi/index/hbase/HBaseIndex.java ## @@ -177,13 +176,11 @@ private Get generateStatement(String key) throws

[GitHub] [hudi] vinothchandar merged pull request #1949: [MINOR] Fix release script for onetime uploading of gpgkeys

vinothchandar merged pull request #1949: URL: https://github.com/apache/hudi/pull/1949 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[hudi] branch master updated: [MINOR] Fix release script for onetime uploading of gpgkeys (#1949)

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6fa371a [MINOR] Fix release script for onetime up

[GitHub] [hudi] vinothchandar commented on pull request #1953: [HUDI-1181] Fix decimal type display issue for record key field

vinothchandar commented on pull request #1953: URL: https://github.com/apache/hudi/pull/1953#issuecomment-675845027 cc @umehrot2 This is an automated message from the Apache Git Service. To respond to the message, please log

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #374

See Changes: -- [...truncated 2.58 KB...] cdi-api-1.0.jar cdi-api.license commons-cli-1.4.jar commons-cli.license commons-io-2.5.jar commons-io.license commons-lang3-3.5.jar

[GitHub] [hudi] linshan-ma commented on pull request #1953: [HUDI-1181] Fix decimal type display issue for record key field

linshan-ma commented on pull request #1953: URL: https://github.com/apache/hudi/pull/1953#issuecomment-675810867 hudi-1154 is the same problem as this one，I've already tested this pr，it is ok。LGTM This is an automated mess

[jira] [Commented] (HUDI-1154) Hive Sync Partition Extractor not handling decimal types properly

[ https://issues.apache.org/jira/browse/HUDI-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180208#comment-17180208 ] linshan-ma commented on HUDI-1154: -- hi [~vbalaji], Hudi-1181（https://issues.apache.org/ji

[GitHub] [hudi] Ac-Rush opened a new issue #1982: [SUPPORT] Not able to write to ADLS Gen2 in Azure Databricks, with error has invalid authority.

Ac-Rush opened a new issue #1982: URL: https://github.com/apache/hudi/issues/1982 I got below error when saving data to ADLS Gen2 with hudi format, But I can save it to Delta Lake with the same credential. abfss://x.dfs.core.windows.net/hudi-tables/xxx has invalid authority.

[GitHub] [hudi] UZi5136225 commented on pull request #1931: [HUDI-210] hudi-support-prometheus-pushgateway

UZi5136225 commented on pull request #1931: URL: https://github.com/apache/hudi/pull/1931#issuecomment-675804567 Right Prometheus does not support, these are specially made for pushgateway @sbernauer This is an automated

[GitHub] [hudi] bhasudha commented on issue #1943: [SUPPORT] Gradle fails with dependency on org.apache.hudi:hudi-spark_2.12:0.5.3

bhasudha commented on issue #1943: URL: https://github.com/apache/hudi/issues/1943#issuecomment-675787730 @wfhartford I am doubting the issue is coming from how you built Hudi for scala 2.12. Can you confirm if this is how you are building Hudi from source with Scala 2.12 ? - `mvn clean

[GitHub] [hudi] xushiyan commented on pull request #1871: [HUDI-781] Introduce HoodieTestTable for test preparation

xushiyan commented on pull request #1871: URL: https://github.com/apache/hudi/pull/1871#issuecomment-675767130 > No worries. @xushiyan could you reopen another one? Yea @vinothchandar i'm about to submitting another one. but the major change in `TestCleaner` is unresolvably conflicte

[jira] [Commented] (HUDI-1177) fix TimestampBasedKeyGenerator Task not serializableException

[ https://issues.apache.org/jira/browse/HUDI-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180167#comment-17180167 ] Vinoth Chandar commented on HUDI-1177: -- yikes. this seems like something we should fi

[GitHub] [hudi] vinothchandar commented on pull request #1871: [HUDI-781] Introduce HoodieTestTable for test preparation

vinothchandar commented on pull request #1871: URL: https://github.com/apache/hudi/pull/1871#issuecomment-675765424 No worries. @xushiyan could you reopen another one? This is an automated message from the Apache Git Service

[GitHub] [hudi] vinothchandar commented on issue #1981: [SUPPORT] Huge performance Difference Between Hudi and Regular Parquet in Athena

vinothchandar commented on issue #1981: URL: https://github.com/apache/hudi/issues/1981#issuecomment-675757583 cc @bschell @umehrot2 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] vinothchandar commented on pull request #1781: [MINOR] Relocate jetty during shading/packaging for Databricks runtime

vinothchandar commented on pull request #1781: URL: https://github.com/apache/hudi/pull/1781#issuecomment-675756118 https://issues.apache.org/jira/browse/HUDI-1199 filed for this This is an automated message from the Apache

[jira] [Created] (HUDI-1199) Shade jetty to enable hudi deltastreamer working on databricks runtime

Vinoth Chandar created HUDI-1199: Summary: Shade jetty to enable hudi deltastreamer working on databricks runtime Key: HUDI-1199 URL: https://issues.apache.org/jira/browse/HUDI-1199 Project: Apache Hu

[GitHub] [hudi] vinothchandar commented on pull request #1781: [MINOR] Relocate jetty during shading/packaging for Databricks runtime

vinothchandar commented on pull request #1781: URL: https://github.com/apache/hudi/pull/1781#issuecomment-675755592 cc @pratyakshsharma do you want to take this up? please let me know This is an automated message from the Ap

[GitHub] [hudi] vinothchandar commented on issue #1908: [SUPPORT]There are too many close_wait sockets on 50010 port when I use SparkStreaming to save kafka data to Hudi.

vinothchandar commented on issue #1908: URL: https://github.com/apache/hudi/issues/1908#issuecomment-675755135 yikes. did you downgrade manually. how did you end up solving this? it will be helpful for others if you can share --

[GitHub] [hudi] rubenssoto opened a new issue #1981: [SUPPORT] Huge performance Difference Between Hudi and Regular Parquet in Athena

rubenssoto opened a new issue #1981: URL: https://github.com/apache/hudi/issues/1981 Hi, How are you? I have two tables in my datalake, a bigger one with 300GB in regular parquet, I can execute a simple count in Athena on this table takes 8 seconds select count(1) from table

[GitHub] [hudi] vinothchandar commented on issue #1943: [SUPPORT] Gradle fails with dependency on org.apache.hudi:hudi-spark_2.12:0.5.3

vinothchandar commented on issue #1943: URL: https://github.com/apache/hudi/issues/1943#issuecomment-675751011 Thanks for reporting this @wfhartford ! cc @bvaradar @bhasudha this is being fixed in 0.6.0. This is an automate

[GitHub] [hudi] vinothchandar commented on issue #1977: Error running hudi on aws glue

vinothchandar commented on issue #1977: URL: https://github.com/apache/hudi/issues/1977#issuecomment-675746111 cc @umehrot2 are you able to help? This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [hudi] jiegzhan opened a new issue #1980: [SUPPORT] Small files (423KB) generated after running delete operation

jiegzhan opened a new issue #1980: URL: https://github.com/apache/hudi/issues/1980 I ran a `delete` query on my hudi table and found out there are a lot newly generated small files (423KB) (see screenshot). Is there a way to control the size of these small files when running `delete` query

[GitHub] [hudi] vinothchandar commented on issue #1961: [SUPPORT] Jetty Not able to find method java.lang.NoSuchMethodError: org.eclipse.jetty.server.session.SessionHandler.setHttpOnly(Z)V on Databri

vinothchandar commented on issue #1961: URL: https://github.com/apache/hudi/issues/1961#issuecomment-675731041 Apologies for the delay. Just added you This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hudi] garyli1019 commented on issue #1823: [SUPPORT] MOR trigger compaction from Hudi CLI

garyli1019 commented on issue #1823: URL: https://github.com/apache/hudi/issues/1823#issuecomment-675600081 > @garyli1019 : Trying to catchup on this. Is this still an issue ? @bvaradar I think this issue is reproducible when the log file group is larger than 2GB. -

[hudi] branch release-0.6.0 updated: [HUDI-1197] Fix import issue that fails scala 2.12 build (#1976)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch release-0.6.0 in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.6.0 by this push: new 85a17b2 [HUDI-1197] Fix impor

[GitHub] [hudi] bhasudha merged pull request #1976: [HUDI-1197] Fix import issue that fails scala 2.12 build

bhasudha merged pull request #1976: URL: https://github.com/apache/hudi/pull/1976 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[hudi] branch master updated: [HUDI-1197] Fix import issue that fails scala 2.12 build (#1976)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 824f23b [HUDI-1197] Fix import issue that f

[GitHub] [hudi] hughfdjackson opened a new issue #1979: [SUPPORT]: Incremental read returns all upserted rows, even if no material change has occurred.

hughfdjackson opened a new issue #1979: URL: https://github.com/apache/hudi/issues/1979 **Describe the problem you faced** My team are interested in writing to Hudi tables using a repeated batch process that often upserts data that's identical to what's already there. For instance,

[hudi] branch master updated: [HUDI-1025] Meter RPC calls in HoodieWrapperFileSystem (#1916)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new bedbb82 [HUDI-1025] Meter RPC calls in HoodieWrapp

[GitHub] [hudi] leesf merged pull request #1916: [HUDI-1025] Meter RPC calls in HoodieWrapperFileSystem

leesf merged pull request #1916: URL: https://github.com/apache/hudi/pull/1916 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [hudi] leesf commented on pull request #1931: [HUDI-210] hudi-support-prometheus-pushgateway

leesf commented on pull request #1931: URL: https://github.com/apache/hudi/pull/1931#issuecomment-675519379 > Hi @UZi5136225 it is currently not possible to set the metric with `hoodie.metrics.prometheus.metric.prefix`. Is this intended? @UZi5136225 would you please take a look at th

[GitHub] [hudi] leesf commented on pull request #1970: [HUDI-1193] Upgrade http dependent version

leesf commented on pull request #1970: URL: https://github.com/apache/hudi/pull/1970#issuecomment-675518753 @UZi5136225 Hi, what's the exception when trying to write to oss? This is an automated message from the Apache Git Se

[jira] [Updated] (HUDI-1184) Support updatePartitionPath for HBaseIndex

[ https://issues.apache.org/jira/browse/HUDI-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1184: - Labels: pull-request-available (was: ) > Support updatePartitionPath for HBaseIndex > ---

[GitHub] [hudi] hj2016 opened a new pull request #1978: [HUDI-1184] Fix the support of hbase index partition path change

hj2016 opened a new pull request #1978: URL: https://github.com/apache/hudi/pull/1978 - *Fixed the support for changes to the hbase index partition path, and added the HBASE_INDEX_UPDATE_PARTITION_PATH parameter to turn on and off similar to GlobalBloom.* - *Added hbase index pa

[GitHub] [hudi] bvaradar closed issue #1923: [SUPPORT] Hive Sync fails to add decimal partition

bvaradar closed issue #1923: URL: https://github.com/apache/hudi/issues/1923 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar commented on issue #1923: [SUPPORT] Hive Sync fails to add decimal partition

bvaradar commented on issue #1923: URL: https://github.com/apache/hudi/issues/1923#issuecomment-675465931 Thanks @rufferjr We will target this for the next release. Closing this ticket as we have jira to track it. This is

[GitHub] [hudi] bvaradar closed issue #1940: [SUPPORT] In CDC scenario, Does Hudi support schema enforcement like Delta Lake?

bvaradar closed issue #1940: URL: https://github.com/apache/hudi/issues/1940 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar commented on issue #1941: [SUPPORT] partition's value changed with hbase index

bvaradar commented on issue #1941: URL: https://github.com/apache/hudi/issues/1941#issuecomment-675463139 @n3nash : When you get a chance, please take a look at this issue. THanks This is an automated message from the Apache

[jira] [Commented] (HUDI-1154) Hive Sync Partition Extractor not handling decimal types properly

[ https://issues.apache.org/jira/browse/HUDI-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17179577#comment-17179577 ] Balaji Varadarajan commented on HUDI-1154: -- [~linshan] : Any updates on this tick

[GitHub] [hudi] bvaradar closed issue #1909: [SUPPORT] "Failed to get update last commit time synced to 20200804071144"

bvaradar closed issue #1909: URL: https://github.com/apache/hudi/issues/1909 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar commented on issue #1909: [SUPPORT] "Failed to get update last commit time synced to 20200804071144"

bvaradar commented on issue #1909: URL: https://github.com/apache/hudi/issues/1909#issuecomment-675451013 Closing this ticket. Please reopen if this issue is specific to Hudi This is an automated message from the Apache Git

[jira] [Assigned] (HUDI-1198) Promote write performance

[ https://issues.apache.org/jira/browse/HUDI-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-1198: --- Assignee: liujinhui > Promote write performance > -- > > Key

[jira] [Created] (HUDI-1198) Promote write performance

liujinhui created HUDI-1198: --- Summary: Promote write performance Key: HUDI-1198 URL: https://issues.apache.org/jira/browse/HUDI-1198 Project: Apache Hudi Issue Type: Improvement Report

[GitHub] [hudi] bvaradar commented on issue #1910: [SUPPORT] Upsert operation duplicating records in a partition

bvaradar commented on issue #1910: URL: https://github.com/apache/hudi/issues/1910#issuecomment-675441022 @mingujotemp : Any updates ? This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [hudi] bvaradar closed issue #1866: [SUPPORT]Clean up does not seem to happen on MOR table

bvaradar closed issue #1866: URL: https://github.com/apache/hudi/issues/1866 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar commented on issue #1860: [SUPPORT] Issue when querying from Spark Datasource if COW table is being written to at the same time

bvaradar commented on issue #1860: URL: https://github.com/apache/hudi/issues/1860#issuecomment-675438762 Closing this due to inactivity This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [hudi] bvaradar closed issue #1860: [SUPPORT] Issue when querying from Spark Datasource if COW table is being written to at the same time

bvaradar closed issue #1860: URL: https://github.com/apache/hudi/issues/1860 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar commented on issue #1854: query MOR table using spark sql error

bvaradar commented on issue #1854: URL: https://github.com/apache/hudi/issues/1854#issuecomment-675438304 Closing this ticket as it is not a Hudi issue. This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] bvaradar closed issue #1854: query MOR table using spark sql error

bvaradar closed issue #1854: URL: https://github.com/apache/hudi/issues/1854 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar closed issue #1833: [SUPPORT] 100% update on 10mn keys in single partition slow

bvaradar closed issue #1833: URL: https://github.com/apache/hudi/issues/1833 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar commented on issue #1823: [SUPPORT] MOR trigger compaction from Hudi CLI

bvaradar commented on issue #1823: URL: https://github.com/apache/hudi/issues/1823#issuecomment-675436943 @garyli1019 : Trying to catchup on this. Is this still an issue ? This is an automated message from the Apache Git Serv

[GitHub] [hudi] bvaradar closed issue #1771: [SUPPORT] https://hudi.apache.org/docs/configurations.html does not mention GLOBAL_BLOOM in hoodie.index.type section

bvaradar closed issue #1771: URL: https://github.com/apache/hudi/issues/1771 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] bvaradar commented on issue #1771: [SUPPORT] https://hudi.apache.org/docs/configurations.html does not mention GLOBAL_BLOOM in hoodie.index.type section

bvaradar commented on issue #1771: URL: https://github.com/apache/hudi/issues/1771#issuecomment-675435535 Closing this ticket as we have https://issues.apache.org/jira/browse/HUDI-1100 to track. This is an automated message

[jira] [Commented] (HUDI-1100) Docs: Update index type in Configuration section and fix typo in deployment page

[ https://issues.apache.org/jira/browse/HUDI-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17179565#comment-17179565 ] Balaji Varadarajan commented on HUDI-1100: -- [~shivnarayan]: Can you take care of

[jira] [Assigned] (HUDI-1100) Docs: Update index type in Configuration section and fix typo in deployment page

[ https://issues.apache.org/jira/browse/HUDI-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan reassigned HUDI-1100: Assignee: sivabalan narayanan (was: Balaji Varadarajan) > Docs: Update index type

[GitHub] [hudi] bvaradar commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records

bvaradar commented on issue #1491: URL: https://github.com/apache/hudi/issues/1491#issuecomment-675432638 @lamber-ken : Would you be able to handle https://issues.apache.org/jira/browse/HUDI-818 that is assigned to you ? Thi

[GitHub] [hudi] KarthickAN opened a new issue #1977: Error running hudi on aws glue

KarthickAN opened a new issue #1977: URL: https://github.com/apache/hudi/issues/1977 Hi, I am trying to get the hudi script run using aws glue2.0. I have uploaded the jars (spark-avro_2.11-2.4.3.jar, hudi-spark-bundle_2.12-0.5.3.jar) to s3 and referenced them using --extra-jars par

[GitHub] [hudi] nsivabalan commented on a change in pull request #1976: [HUDI-1197] Fix import issue that fails scala 2.12 build

nsivabalan commented on a change in pull request #1976: URL: https://github.com/apache/hudi/pull/1976#discussion_r472099722 ## File path: hudi-spark/src/main/scala/org/apache/hudi/HoodieWriterUtils.scala ## @@ -20,8 +20,8 @@ package org.apache.hudi import org.apache.hudi.DataS

[GitHub] [hudi] sathyaprakashg commented on issue #1972: Deltasteamer with Transformation has schema issue

sathyaprakashg commented on issue #1972: URL: https://github.com/apache/hudi/issues/1972#issuecomment-675366954 If I pass schemaprovier as `NullTargetSchemaRegistryProvider` instead of `SchemaRegistryProvider` it is working fine. But I think we should still fix this issue to make sure even

[jira] [Updated] (HUDI-1197) Fix build issue in scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-1197: Status: In Progress (was: Open) > Fix build issue in scala 2.12 > - > >

[jira] [Updated] (HUDI-1197) Fix build issue in scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-1197: Status: Patch Available (was: In Progress) > Fix build issue in scala 2.12 > --

[GitHub] [hudi] bhasudha opened a new pull request #1976: [HUDI-1197] Fix import issue that fails scala 2.12 build

bhasudha opened a new pull request #1976: URL: https://github.com/apache/hudi/pull/1976 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the pu

[jira] [Updated] (HUDI-1197) Fix build issue in scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1197: - Labels: pull-request-available (was: ) > Fix build issue in scala 2.12 >

[jira] [Updated] (HUDI-1197) Fix build issue in scala 2.12

[ https://issues.apache.org/jira/browse/HUDI-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-1197: Status: Open (was: New) > Fix build issue in scala 2.12 > - > >

[jira] [Created] (HUDI-1197) Fix build issue in scala 2.12

Bhavani Sudha created HUDI-1197: --- Summary: Fix build issue in scala 2.12 Key: HUDI-1197 URL: https://issues.apache.org/jira/browse/HUDI-1197 Project: Apache Hudi Issue Type: Bug Compo

[GitHub] [hudi] saumyasuhagiya commented on issue #1961: [SUPPORT] Jetty Not able to find method java.lang.NoSuchMethodError: org.eclipse.jetty.server.session.SessionHandler.setHttpOnly(Z)V on Databr

saumyasuhagiya commented on issue #1961: URL: https://github.com/apache/hudi/issues/1961#issuecomment-675311510 @vinothchandar @bhasudha any update to allow me in slack channel? Thanks. This is an automated message from the

[hudi] annotated tag 0.6.0-rc1 updated (efb3025 -> 03daa27)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a change to annotated tag 0.6.0-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag 0.6.0-rc1 was modified! *** from efb3025 (commit) to 03daa27 (tag) tagging efb302