xushiyan commented on issue #3672:
URL: https://github.com/apache/hudi/issues/3672#issuecomment-922665870
also mentioned in #3609
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific co
[
https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1689:
-
Parent: HUDI-1658
Issue Type: Sub-task (was: Improvement)
> Support Multipath query for HoodieFil
[
https://issues.apache.org/jira/browse/HUDI-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1292:
-
Priority: Critical (was: Major)
> [Umbrella] RFC-15 : File Listing and Query Planning Optimizations
> --
[
https://issues.apache.org/jira/browse/HUDI-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1297:
-
Priority: Critical (was: Major)
> [Umbrella] Revamp Spark Datasource support using Spark 3 APIs
> ---
[
https://issues.apache.org/jira/browse/HUDI-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu closed HUDI-30.
--
Resolution: Duplicate
> Explore support for Spark Datasource V2
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-893:
Parent Issue: HUDI-1297 (was: HUDI-30)
> Add spark datasource V2 reader support for Hudi tables
> --
[
https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1307:
-
Labels: sev:high user-support-issues (was: sev:normal user-support-issues)
> spark datasource load path f
[
https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1307:
-
Priority: Critical (was: Major)
> spark datasource load path format is confused for snapshot and incremen
[
https://issues.apache.org/jira/browse/HUDI-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1608:
-
Priority: Critical (was: Major)
> MOR fetches all records for read optimized query w/ spark sql
> ---
[
https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1689:
-
Priority: Critical (was: Major)
> Support Multipath query for HoodieFileIndex
> -
[
https://issues.apache.org/jira/browse/HUDI-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1894:
-
Priority: Critical (was: Major)
> NULL values in timestamp column defaulted
> --
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Labels: schema sev:critical (was: schema sev:high)
> Upsert of Case Class with single field causes Schema
[
https://issues.apache.org/jira/browse/HUDI-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2071:
-
Priority: Critical (was: Major)
> Support Reading Bootstrap MOR RT Table In Spark DataSource Table
> ---
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Labels: schema sev sev:high (was: schema sev:high)
> Upsert of Case Class with single field causes Schema
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Priority: Critical (was: Major)
> Upsert of Case Class with single field causes SchemaParseException
> --
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Labels: schema sev:high (was: schema sev sev:high)
> Upsert of Case Class with single field causes Schema
[
https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1079:
-
Labels: schema sev:critical user-support-issues (was: sev:critical
user-support-issues)
> Cannot upsert
[
https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1079:
-
Labels: sev:critical user-support-issues (was: sev:high
user-support-issues)
> Cannot upsert on schema w
[
https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1079:
-
Priority: Critical (was: Blocker)
> Cannot upsert on schema with Array of Record with single field
>
[
https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1079:
-
Priority: Blocker (was: Major)
> Cannot upsert on schema with Array of Record with single field
> ---
[
https://issues.apache.org/jira/browse/HUDI-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1117:
-
Component/s: (was: Spark Integration)
Hive Integration
> Add tdunning json library to
[
https://issues.apache.org/jira/browse/HUDI-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1278:
-
Component/s: (was: Spark Integration)
> Need a generic payload class which can skip late arriving data
[
https://issues.apache.org/jira/browse/HUDI-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1491:
-
Parent: HUDI-1297
Issue Type: Sub-task (was: Improvement)
> Support partition pruning for MOR sna
[
https://issues.apache.org/jira/browse/HUDI-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1272:
-
Parent: HUDI-1297
Issue Type: Sub-task (was: New Feature)
> Add utility scripts to manage Savepoi
[
https://issues.apache.org/jira/browse/HUDI-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1271:
-
Parent: HUDI-1297
Issue Type: Sub-task (was: New Feature)
> Add utility scripts to perform Restor
[
https://issues.apache.org/jira/browse/HUDI-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1341:
-
Parent: HUDI-1297
Issue Type: Sub-task (was: New Feature)
> hudi cli command such as rollback 、bo
[
https://issues.apache.org/jira/browse/HUDI-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1368:
-
Issue Type: Bug (was: New Feature)
> Merge On Read Snapshot Reader not working for Databricks on ADLS Gen
[
https://issues.apache.org/jira/browse/HUDI-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1608:
-
Labels: pull-request-available sev:critical (was: pull-request-available)
> MOR fetches all records for r
[
https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417453#comment-17417453
]
Raymond Xu commented on HUDI-1689:
--
[~pzw2018] to confirm, I think this is a feature enha
[
https://issues.apache.org/jira/browse/HUDI-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu closed HUDI-1680.
Fix Version/s: (was: 0.10.0)
Resolution: Won't Do
Closing due to inactive
> Add getPreferredLoca
[
https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1689:
-
Labels: (was: sev:high)
> Support Multipath query for HoodieFileIndex
>
[
https://issues.apache.org/jira/browse/HUDI-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1894:
-
Labels: schema sev:high triaged (was: sev:high triaged)
> NULL values in timestamp column defaulted
> --
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Labels: schema sev:high (was: AvroSchema sev:high)
> Upsert of Case Class with single field causes Schema
[
https://issues.apache.org/jira/browse/HUDI-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1926:
-
Labels: sev:triage (was: )
> Concurrent write conflict when generating same instanttime
> --
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Labels: AvroSchema sev:high (was: AvroSchema)
> Upsert of Case Class with single field causes SchemaParse
[
https://issues.apache.org/jira/browse/HUDI-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-17:
---
Priority: Minor (was: Major)
> Better documentation for paths passed to incr and ro views from Spark
> datasou
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Labels: AvroSchema (was: )
> Upsert of Case Class with single field causes SchemaParseException
> ---
[
https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2323:
-
Priority: Major (was: Minor)
> Upsert of Case Class with single field causes SchemaParseException
> -
[
https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2390:
-
Summary: KeyGenerator discrepancy between DataFrame writer and SQL (was:
KeyGenerator discrepancy between
[
https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417449#comment-17417449
]
Raymond Xu commented on HUDI-2390:
--
Pivoting this ticket to an improvement: to address di
[
https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2390:
-
Labels: (was: features)
> KeyGenerator discrepancy between DataFrame writer and Spark SQL
>
[
https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2390:
-
Summary: KeyGenerator discrepancy between DataFrame writer and Spark SQL
(was: Create table by hudisql,wr
[
https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2390:
-
Issue Type: Improvement (was: Bug)
> Create table by hudisql,write data into table by datasource,hudi del
[
https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2390:
-
Priority: Minor (was: Critical)
> Create table by hudisql,write data into table by datasource,hudi delete
[
https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2390:
-
Priority: Critical (was: Major)
> Create table by hudisql,write data into table by datasource,hudi delete
[
https://issues.apache.org/jira/browse/HUDI-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2452:
-
Labels: sev:critical (was: )
> spark on hudi metadata key length < 0
> --
[
https://issues.apache.org/jira/browse/HUDI-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu resolved HUDI-2387.
--
Resolution: Information Provided
> Too many HEAD requests from Hudi to S3
> ---
[
https://issues.apache.org/jira/browse/HUDI-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417438#comment-17417438
]
Raymond Xu commented on HUDI-2387:
--
[~souravtri] Have you contacted AWS support to get so
[
https://issues.apache.org/jira/browse/HUDI-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2387:
-
Component/s: (was: Spark Integration)
(was: Common Core)
Usabilit
[
https://issues.apache.org/jira/browse/HUDI-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2387:
-
Issue Type: Improvement (was: Bug)
> Too many HEAD requests from Hudi to S3
> --
[
https://issues.apache.org/jira/browse/HUDI-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2452:
-
Labels: (was: pull-request-available)
> spark on hudi metadata key length < 0
>
[
https://issues.apache.org/jira/browse/HUDI-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2452:
-
Description:
spark on hudi metadata key length <= 0, but data primary key is not "" or
null,error message
xushiyan commented on pull request #3691:
URL: https://github.com/apache/hudi/pull/3691#issuecomment-922617121
@YannByron Don't see this is a problem. The package command ran ok on
master. Can you confirm if this is a local issue in your environment?
--
This is an automated message from
[
https://issues.apache.org/jira/browse/HUDI-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu reassigned HUDI-2455:
Assignee: Yann Byron
> Fail to build Spark caused by spark_avro dependency
> --
[
https://issues.apache.org/jira/browse/HUDI-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2455:
-
Component/s: (was: Spark Integration)
> Fail to build Spark caused by spark_avro dependency
>
[
https://issues.apache.org/jira/browse/HUDI-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu reassigned HUDI-2456:
Assignee: Yann Byron
> Support show partitions SQL
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-2456:
-
Status: In Progress (was: Open)
> Support show partitions SQL
> ---
>
>
hudi-bot edited a comment on pull request #3693:
URL: https://github.com/apache/hudi/pull/3693#issuecomment-922600059
## CI report:
* 6f1ded9808d42381fd2ce644d441f8830a5a55cb Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res
t822876884 commented on issue #3689:
URL: https://github.com/apache/hudi/issues/3689#issuecomment-922604125
> Hi, you may need to use the 0.9.0 with flink 1.12.2 or master with flink
1.13.1. You also need to open the checkpoint.
tks,i will try again,I think the official website sugge
hudi-bot edited a comment on pull request #3693:
URL: https://github.com/apache/hudi/pull/3693#issuecomment-922600059
## CI report:
* 6f1ded9808d42381fd2ce644d441f8830a5a55cb Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res
nsivabalan commented on a change in pull request #3413:
URL: https://github.com/apache/hudi/pull/3413#discussion_r711845020
##
File path:
hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java
##
@@ -1398,6 +1399,34 @@ private void testP
[
https://issues.apache.org/jira/browse/HUDI-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-2456:
-
Labels: features pull-request-available (was: features)
> Support show partitions SQL
> -
hudi-bot commented on pull request #3693:
URL: https://github.com/apache/hudi/pull/3693#issuecomment-922600059
## CI report:
* 6f1ded9808d42381fd2ce644d441f8830a5a55cb UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run travis`
[
https://issues.apache.org/jira/browse/HUDI-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1071:
-
Labels: new-to-hudi (was: newbie)
> Upgrade dropwizard metrics to make use of SettableGauge
> ---
[
https://issues.apache.org/jira/browse/HUDI-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1355:
-
Labels: new-to-hudi patch starter (was: patch starter)
> Allowing multipleSourceOrdering fields for doing
[
https://issues.apache.org/jira/browse/HUDI-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-904:
Labels: new-to-hudi (was: newbie)
> Segregate metrics configs by reporter type
> ---
[
https://issues.apache.org/jira/browse/HUDI-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu reassigned HUDI-2454:
Assignee: Raymond Xu
> Remove travis config from asf-site branch
>
danny0405 commented on pull request #3203:
URL: https://github.com/apache/hudi/pull/3203#issuecomment-922561725
> @danny0405 Thank you for your attention to this pr。 This pr has not been
updated for a long time. Do we still need this now?
We need it definitely, for a complete Hive re
codejoyan closed issue #3581:
URL: https://github.com/apache/hudi/issues/3581
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@
codejoyan commented on issue #3581:
URL: https://github.com/apache/hudi/issues/3581#issuecomment-922536416
It works without the file listing step and is reading from metadata table
!!!
@xushiyan Thanks a lot for the solution.
--
This is an automated message from the Apache Git Servi
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 9c71829 [HUDI-2457] Fixing minor issues in
nsivabalan merged pull request #3692:
URL: https://github.com/apache/hudi/pull/3692
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubs
[
https://issues.apache.org/jira/browse/HUDI-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-2457:
-
Labels: pull-request-available (was: )
> Fix hudi website for current and 090 for spark bundle ve
nsivabalan opened a new pull request #3692:
URL: https://github.com/apache/hudi/pull/3692
## What is the purpose of the pull request
*(For example: This pull request adds quick-start document.)*
## Brief change log
*(for example:)*
- *Modify AnnotationLocation check
sivabalan narayanan created HUDI-2457:
-
Summary: Fix hudi website for current and 090 for spark bundle
versions.
Key: HUDI-2457
URL: https://issues.apache.org/jira/browse/HUDI-2457
Project: Apach
[
https://issues.apache.org/jira/browse/HUDI-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan reassigned HUDI-2457:
-
Assignee: sivabalan narayanan
> Fix hudi website for current and 090 for spark bu
nsivabalan commented on issue #3676:
URL: https://github.com/apache/hudi/issues/3676#issuecomment-922508543
I found the rootcause. Looks like in MOR, when an index is used which cannot
index log files (which is the case for all out of box indexes in hudi), we just
choose the smallest parqu
YannByron commented on issue #3555:
URL: https://github.com/apache/hudi/issues/3555#issuecomment-922441246
jira to show partitions: https://issues.apache.org/jira/browse/HUDI-2455
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitH
Yann Byron created HUDI-2456:
Summary: Support show partitions SQL
Key: HUDI-2456
URL: https://issues.apache.org/jira/browse/HUDI-2456
Project: Apache Hudi
Issue Type: Improvement
Compo
79 matches
Mail list logo