[
https://issues.apache.org/jira/browse/HUDI-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
steven zhang updated HUDI-1392:
---
Description:
Reproduce the issue with below steps:
set hoodie.datasource.write.hive_style_par
[
https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229809#comment-17229809
]
Song Jun commented on HUDI-432:
---
Have we decided to use HFile to store index?
what's the nex
hong dongdong created HUDI-1393:
---
Summary: Add compaction action in archive command
Key: HUDI-1393
URL: https://issues.apache.org/jira/browse/HUDI-1393
Project: Apache Hudi
Issue Type: Bug
steven zhang created HUDI-1392:
--
Summary: lose partition info when using spark parameter "basePath"
Key: HUDI-1392
URL: https://issues.apache.org/jira/browse/HUDI-1392
Project: Apache Hudi
Issu
codecov-io edited a comment on pull request #2192:
URL: https://github.com/apache/hudi/pull/2192#issuecomment-717655063
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2192?src=pr&el=h1) Report
> Merging
[#2192](https://codecov.io/gh/apache/hudi/pull/2192?src=pr&el=desc) (f82b423)
in
[
https://issues.apache.org/jira/browse/HUDI-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229689#comment-17229689
]
liujinhui commented on HUDI-1391:
-
Currently getting CDC data from Kafka will encounter da
[
https://issues.apache.org/jira/browse/HUDI-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujinhui reassigned HUDI-1391:
---
Assignee: liujinhui
> Added tools: support to obtain multiple data of different schema types from a
[
https://issues.apache.org/jira/browse/HUDI-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujinhui updated HUDI-1391:
Status: In Progress (was: Open)
> Added tools: support to obtain multiple data of different schema types fr
liujinhui created HUDI-1391:
---
Summary: Added tools: support to obtain multiple data of different
schema types from a single topic
Key: HUDI-1391
URL: https://issues.apache.org/jira/browse/HUDI-1391
Project:
[
https://issues.apache.org/jira/browse/HUDI-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujinhui updated HUDI-1391:
Status: Open (was: New)
> Added tools: support to obtain multiple data of different schema types from a
>
codecov-io edited a comment on pull request #2227:
URL: https://github.com/apache/hudi/pull/2227#issuecomment-720892015
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2227?src=pr&el=h1) Report
> Merging
[#2227](https://codecov.io/gh/apache/hudi/pull/2227?src=pr&el=desc) (d3fe5e0)
in
liujinhui1994 opened a new pull request #2242:
URL: https://github.com/apache/hudi/pull/2242
Abstract DFSPathSelector
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
[
https://issues.apache.org/jira/browse/HUDI-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229629#comment-17229629
]
wangxianghu commented on HUDI-1377:
---
[~wangshikai] please assign this ticket to yourself
[
https://issues.apache.org/jira/browse/HUDI-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229626#comment-17229626
]
wangxianghu commented on HUDI-1377:
---
done via master branch : 430d4b428e7c5b325c7414a187
[
https://issues.apache.org/jira/browse/HUDI-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-1377:
--
Status: Open (was: New)
> clean duplicate code in HoodieSparkSqlWriter
> --
vinothchandar commented on a change in pull request #2136:
URL: https://github.com/apache/hudi/pull/2136#discussion_r520944072
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/HoodieIndexUtils.java
##
@@ -85,4 +91,61 @@ public static HoodieRecor
vinothchandar commented on pull request #2106:
URL: https://github.com/apache/hudi/pull/2106#issuecomment-725032426
@Karl-WangSK any updates on this? Happy to help with any open ended issues
here
This is an automated message
vinothchandar commented on a change in pull request #2216:
URL: https://github.com/apache/hudi/pull/2216#discussion_r520939276
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieWriteStat.java
##
@@ -49,6 +49,12 @@
*/
private String prevCommit;
[
https://issues.apache.org/jira/browse/HUDI-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-60:
---
Labels: gsoc gsoc2021 mentor (was: gsoc2021 mentor)
> [UMBRELLA] Support Apache Beam for incremental tailing
>
[
https://issues.apache.org/jira/browse/HUDI-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1390:
-
Labels: gsoc gsoc2021 mentor (was: gsoc2021 mentor)
> [UMBRELLA] Support schema inference for unstructure
[
https://issues.apache.org/jira/browse/HUDI-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1385:
-
Labels: gsoc gsoc2021 mentor (was: gsoc2021 mentor)
> [UMBRELLA] Improve source ingestion support in Delt
[
https://issues.apache.org/jira/browse/HUDI-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1237:
-
Labels: gsoc gsoc2021 mentor (was: gsoc2021 mentor)
> [UMBRELLA] Checkstyle, formatting, warnings, spotle
[
https://issues.apache.org/jira/browse/HUDI-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1387:
-
Labels: gsoc gsoc2021 mentor (was: gsoc2021 mentor)
> [UMBRELLA] Support Apache Calcite for querying Hudi
[
https://issues.apache.org/jira/browse/HUDI-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1389:
-
Labels: gsoc gsoc2021 mentor (was: gsoc2021 mentor)
> [UMBRELLA] Survey indexing technique for better que
[
https://issues.apache.org/jira/browse/HUDI-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1388:
-
Labels: gsoc gsoc2021 mentor (was: gsoc2021 mentor)
> [UMBRELLA] Improve CLI features and usabilities
> -
[
https://issues.apache.org/jira/browse/HUDI-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-60:
---
Summary: [UMBRELLA] Support Apache Beam for incremental tailing (was:
[UMBRELLA] Beam IO module to support incr
[
https://issues.apache.org/jira/browse/HUDI-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1237:
-
Component/s: (was: Testing)
Code Cleanup
> [UMBRELLA] Checkstyle, formatting, warning
[
https://issues.apache.org/jira/browse/HUDI-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1389:
-
Component/s: Performance
> [UMBRELLA] Survey indexing technique for better query performance
> ---
[
https://issues.apache.org/jira/browse/HUDI-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1388:
-
Component/s: Usability
> [UMBRELLA] Improve CLI features and usabilities
> ---
Raymond Xu created HUDI-1390:
Summary: [UMBRELLA] Support schema inference for unstructured data
Key: HUDI-1390
URL: https://issues.apache.org/jira/browse/HUDI-1390
Project: Apache Hudi
Issue Typ
Raymond Xu created HUDI-1389:
Summary: [UMBRELLA] Survey indexing technique for better query
performance
Key: HUDI-1389
URL: https://issues.apache.org/jira/browse/HUDI-1389
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-145:
Labels: (was: gsoc2021 mentor)
> Limit the amount of partitions considered for GlobalBloomIndex
> -
[
https://issues.apache.org/jira/browse/HUDI-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-74:
---
Labels: (was: gsoc2021 mentor)
> Improve compaction support in HoodieDeltaStreamer & CLI
> ---
[
https://issues.apache.org/jira/browse/HUDI-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-388:
Labels: (was: gsoc2021 mentor)
> Support DDL / DML SparkSQL statements which useful for admins
> --
[
https://issues.apache.org/jira/browse/HUDI-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-67:
---
Labels: (was: gsoc2021 mentor)
> Tool to convert sequence file based archived commits to log format #224
> ---
[
https://issues.apache.org/jira/browse/HUDI-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1388:
-
Labels: gsoc2021 mentor (was: )
> [UMBRELLA] Improve CLI features and usabilities
> -
Raymond Xu created HUDI-1388:
Summary: [UMBRELLA] Improve CLI features and usabilities
Key: HUDI-1388
URL: https://issues.apache.org/jira/browse/HUDI-1388
Project: Apache Hudi
Issue Type: Improve
[
https://issues.apache.org/jira/browse/HUDI-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229508#comment-17229508
]
Raymond Xu commented on HUDI-1387:
--
[~vinoth] Made this under presto integration componen
Raymond Xu created HUDI-1387:
Summary: [UMBRELLA] Support Apache Calcite for querying Hudi
datasets
Key: HUDI-1387
URL: https://issues.apache.org/jira/browse/HUDI-1387
Project: Apache Hudi
Issue
[
https://issues.apache.org/jira/browse/HUDI-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-60:
---
Summary: [UMBRELLA] Beam IO module to support incremental tailing of Hoodie
Hive/Spark tables (was: Beam IO mod
[
https://issues.apache.org/jira/browse/HUDI-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-60:
---
Description: (More details to be added) (was:
https://github.com/uber/hudi/issues/8)
> Beam IO module to suppo
[
https://issues.apache.org/jira/browse/HUDI-96?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-96:
---
Labels: newbie pull-request-available (was: gsoc2021 mentor newbie
pull-request-available)
> Use Command line
Raymond Xu created HUDI-1386:
Summary: AWS kinesis data source for DeltaStreamer
Key: HUDI-1386
URL: https://issues.apache.org/jira/browse/HUDI-1386
Project: Apache Hudi
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/HUDI-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-74:
---
Component/s: CLI
> Improve compaction support in HoodieDeltaStreamer & CLI
> ---
[
https://issues.apache.org/jira/browse/HUDI-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-735:
Labels: (was: bug-bash-0.6.0)
> Improve deltastreamer error message when case mismatch of commandline
> ar
[
https://issues.apache.org/jira/browse/HUDI-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-735:
Labels: bug-bash-0.6.0 (was: bug-bash-0.6.0 gsoc2021 mentor)
> Improve deltastreamer error message when case
[
https://issues.apache.org/jira/browse/HUDI-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-735:
Component/s: (was: Utilities)
Code Cleanup
> Improve deltastreamer error message when ca
[
https://issues.apache.org/jira/browse/HUDI-73?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-73:
---
Labels: pull-request-available (was: gsoc2021 mentor
pull-request-available)
> Support vanilla Avro Kafka Sour
[
https://issues.apache.org/jira/browse/HUDI-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-246:
Labels: (was: gsoc2021 mentor)
> Apache Pulsar data source for Hudi
> --
>
[
https://issues.apache.org/jira/browse/HUDI-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1385:
-
Summary: [UMBRELLA] Improve source ingestion support in DeltaStreamer
(was: [UMBRELLA] Improve source sup
[
https://issues.apache.org/jira/browse/HUDI-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1290:
-
Labels: (was: gsoc2021 mentor)
> Implement Debezium avro source for Delta Streamer
> ---
[
https://issues.apache.org/jira/browse/HUDI-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-488:
Labels: (was: gsoc2021 mentor)
> Refactor Source classes in hudi-utilities
> -
Raymond Xu created HUDI-1385:
Summary: [UMBRELLA] Improve source support in DeltaStreamer
Key: HUDI-1385
URL: https://issues.apache.org/jira/browse/HUDI-1385
Project: Apache Hudi
Issue Type: Impr
[
https://issues.apache.org/jira/browse/HUDI-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-60:
---
Labels: gsoc2021 mentor (was: )
> Beam IO module to support incremental tailing of Hoodie Hive/Spark tables #8
[
https://issues.apache.org/jira/browse/HUDI-534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-534:
Labels: (was: gsoc2021 mentor)
> Explore a new way to fix import order
> --
[
https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-304:
Labels: bug-bash-0.6.0 help-wanted pull-request-available (was:
bug-bash-0.6.0 gsoc2021 help-wanted mentor p
[
https://issues.apache.org/jira/browse/HUDI-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-1001:
-
Labels: (was: gsoc2021 mentor)
> Add implementation to translate source partition paths when doing metad
kpurella commented on issue #2240:
URL: https://github.com/apache/hudi/issues/2240#issuecomment-724917083
@bvaradar Thank you for your quick response.
1) we are not using any ordering as my key is a composite key ( combination
4 attributes).
-sure I will give a try with hoodie.bloom.i
[
https://issues.apache.org/jira/browse/HUDI-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-270:
Labels: (was: gsoc2021 mentor)
> [UMBRELLA] Improve Hudi website UI and documentation
> ---
[
https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-233:
Labels: pull-request-available (was: gsoc2021 mentor
pull-request-available)
> Redo log statements using SL
[
https://issues.apache.org/jira/browse/HUDI-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-767:
Labels: (was: gsoc2021 mentor)
> Support transformation when export to Hudi
> -
[
https://issues.apache.org/jira/browse/HUDI-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-904:
Labels: (was: gsoc2021 mentor)
> Segregate metrics configs by reporter type
> -
[
https://issues.apache.org/jira/browse/HUDI-791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-791:
Status: Closed (was: Patch Available)
> Replace null by Option in Delta Streamer
> -
bvaradar commented on issue #2239:
URL: https://github.com/apache/hudi/issues/2239#issuecomment-724875552
@shenbinglife : Are you seeing the same issue with 0.6.0 ?
This is an automated message from the Apache Git Service
vinothchandar merged pull request #2235:
URL: https://github.com/apache/hudi/pull/2235
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.
from 42b6aec [HUDI-1358] Fix Memory Leak in HoodieLogFormatWriter (#2217)
add 430d4b4 [HUDI-1377] remove duplicate co
bvaradar commented on issue #2238:
URL: https://github.com/apache/hudi/issues/2238#issuecomment-724872746
@nsivabalan : Can you please take a look at this ?
This is an automated message from the Apache Git Service.
To respond
bvaradar commented on issue #2240:
URL: https://github.com/apache/hudi/issues/2240#issuecomment-724872433
Does your record key has any natural ordering ? If not, you can disable
"hoodie.bloom.index.prune.by.ranges=false".
Also, you are using GLOBAL_BLOOM which is expected to scan all
codecov-io edited a comment on pull request #2241:
URL: https://github.com/apache/hudi/pull/2241#issuecomment-724710949
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2241?src=pr&el=h1) Report
> Merging
[#2241](https://codecov.io/gh/apache/hudi/pull/2241?src=pr&el=desc) (519f16e)
in
codecov-io edited a comment on pull request #2241:
URL: https://github.com/apache/hudi/pull/2241#issuecomment-724710949
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2241?src=pr&el=h1) Report
> Merging
[#2241](https://codecov.io/gh/apache/hudi/pull/2241?src=pr&el=desc) (519f16e)
in
codecov-io commented on pull request #2241:
URL: https://github.com/apache/hudi/pull/2241#issuecomment-724710949
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2241?src=pr&el=h1) Report
> Merging
[#2241](https://codecov.io/gh/apache/hudi/pull/2241?src=pr&el=desc) (519f16e)
into
[ma
[
https://issues.apache.org/jira/browse/HUDI-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229208#comment-17229208
]
Gary Li commented on HUDI-791:
--
[~rxu] please close. not sure why but this apache account does
[
https://issues.apache.org/jira/browse/HUDI-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1384:
-
Labels: pull-request-available (was: )
> Decoupling hive jdbc dependency when HIVE_USE_JDBC_OPT_
pengzhiwei2018 opened a new pull request #2241:
URL: https://github.com/apache/hudi/pull/2241
…Y set false
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## Wha
pengzhiwei created HUDI-1384:
Summary: Decoupling hive jdbc dependency when
HIVE_USE_JDBC_OPT_KEY set false
Key: HUDI-1384
URL: https://issues.apache.org/jira/browse/HUDI-1384
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
linshan-ma reassigned HUDI-1383:
Assignee: linshan-ma
> Incorrect partitions getting hive synced
> -
kpurella opened a new issue #2240:
URL: https://github.com/apache/hudi/issues/2240
**_Tips before filing an issue_**
- Have you gone through our
[FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? yes
- Join the mailing list to engage in conversations and get faster
77 matches
Mail list logo