[
https://issues.apache.org/jira/browse/HUDI-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157818#comment-17157818
]
Hong Shen commented on HUDI-1090:
-
[~710514878] Please describe the issue in English.
> presto读取hudi数据错位
[
https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157341#comment-17157341
]
Hong Shen edited comment on HUDI-1082 at 7/15/20, 1:12 AM:
---
It seems does not
[
https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157341#comment-17157341
]
Hong Shen edited comment on HUDI-1082 at 7/15/20, 1:08 AM:
---
It seems does not
[
https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157341#comment-17157341
]
Hong Shen edited comment on HUDI-1082 at 7/14/20, 12:53 PM:
It seems does not
[
https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157341#comment-17157341
]
Hong Shen edited comment on HUDI-1082 at 7/14/20, 12:52 PM:
It seems does not
[
https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157341#comment-17157341
]
Hong Shen commented on HUDI-1082:
-
It seems does not matter, we just need to ensure the distribution of
[
https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157284#comment-17157284
]
Hong Shen commented on HUDI-1082:
-
OK, I will add testcase and fix it.
> Bug in deciding the
[
https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156259#comment-17156259
]
Hong Shen commented on HUDI-1082:
-
I can work on this if you have not start.
> Bug in deciding the
[
https://issues.apache.org/jira/browse/HUDI-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-1058:
---
Assignee: Hong Shen
> Make delete marker configurable
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147826#comment-17147826
]
Hong Shen commented on HUDI-1058:
-
If you haven't started yet, I can take this.
> Make delete marker
[
https://issues.apache.org/jira/browse/HUDI-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147506#comment-17147506
]
Hong Shen commented on HUDI-1057:
-
Did you use hivemeta? Whether the int32 type is defined in hivemeta, or
[
https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146989#comment-17146989
]
Hong Shen commented on HUDI-983:
[~rxu] I have pull a request in [https://github.com/apache/hudi/pull/1769]
[
https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146094#comment-17146094
]
Hong Shen commented on HUDI-983:
Sounds good. I will move deployment#metrics to the new metrics section.
>
[
https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145958#comment-17145958
]
Hong Shen commented on HUDI-983:
[~rxu] Currently, there are doc for metrics in two places, at
[
https://issues.apache.org/jira/browse/HUDI-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-1046:
---
Assignee: Hong Shen
> Support updates during clustering in CoW mode
>
[
https://issues.apache.org/jira/browse/HUDI-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-1004:
---
Assignee: Hong Shen
> Support update metrics in HoodieDeltaStreamer
>
[
https://issues.apache.org/jira/browse/HUDI-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132815#comment-17132815
]
Hong Shen commented on HUDI-1004:
-
I will add a PR to suppport update metrics this weekend.
> Support
[
https://issues.apache.org/jira/browse/HUDI-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-1004:
Description:
When I run HoodieDeltaStreamer with hoodie.metrics.on=true and
[
https://issues.apache.org/jira/browse/HUDI-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-1004:
Summary: Support update metrics in HoodieDeltaStreamer (was: Failed to
send metrics in
[
https://issues.apache.org/jira/browse/HUDI-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-1005.
-
Resolution: Fixed
> NPE in HoodieWriteClient.clean
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-1005:
Status: Open (was: New)
> NPE in HoodieWriteClient.clean
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-1016:
Status: Open (was: New)
> [Minor] Code optimization
> -
>
> Key:
[
https://issues.apache.org/jira/browse/HUDI-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-1016.
-
Resolution: Fixed
> [Minor] Code optimization
> -
>
> Key:
[
https://issues.apache.org/jira/browse/HUDI-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-1004:
Summary: Failed to send metrics in HoodieDeltaStreamer (was: Failed to
send metrics when
[
https://issues.apache.org/jira/browse/HUDI-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-1016:
---
Assignee: Hong Shen
> [Minor] Code optimization
> -
>
> Key:
Hong Shen created HUDI-1016:
---
Summary: [Minor] Code optimization
Key: HUDI-1016
URL: https://issues.apache.org/jira/browse/HUDI-1016
Project: Apache Hudi
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-1002:
Status: Open (was: New)
> Ignore case when setting incremental mode in hive query
>
[
https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-1002.
-
Resolution: Fixed
> Ignore case when setting incremental mode in hive query
>
[
https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127926#comment-17127926
]
Hong Shen commented on HUDI-1002:
-
[~xleesf] I'm going to work on this. :D
> Ignore case when setting
[
https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-1002:
---
Assignee: Hong Shen
> Ignore case when setting incremental mode in hive query
>
Hong Shen created HUDI-1005:
---
Summary: NPE in HoodieWriteClient.clean
Key: HUDI-1005
URL: https://issues.apache.org/jira/browse/HUDI-1005
Project: Apache Hudi
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HUDI-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-1004:
Description:
When I run HoodieDeltaStreamer with hoodie.metrics.on=true and
Hong Shen created HUDI-1004:
---
Summary: Failed to send metrics when HoodieDeltaStreamer
Key: HUDI-1004
URL: https://issues.apache.org/jira/browse/HUDI-1004
Project: Apache Hudi
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-983:
--
Assignee: Hong Shen
> Add Metrics section to asf-site
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125009#comment-17125009
]
Hong Shen commented on HUDI-983:
[~rxu] I am interested in it, I will add a pull request in this weekend.
[
https://issues.apache.org/jira/browse/HUDI-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124926#comment-17124926
]
Hong Shen commented on HUDI-957:
[~nishith29] We also want to do this, please @ me if need.
> Umbrella
[
https://issues.apache.org/jira/browse/HUDI-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-908:
--
Assignee: Hong Shen
> Consistent test data generation with data type coverage
>
[
https://issues.apache.org/jira/browse/HUDI-908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119297#comment-17119297
]
Hong Shen commented on HUDI-908:
[~vinoth] [~shivnarayan] I am interested in it, I will add a pull request
Hong Shen created HUDI-903:
--
Summary: Add hudi java client that do not depend on spark
Key: HUDI-903
URL: https://issues.apache.org/jira/browse/HUDI-903
Project: Apache Hudi (incubating)
Issue
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-866.
Resolution: Fixed
Resolve by
https://issues.apache.org/jira/browse/HUDI-870
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-866:
---
Status: Open (was: New)
> Some classes that rely on JavaSparkContext to obtain Configuration can make
> them
[
https://issues.apache.org/jira/browse/HUDI-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-881.
Resolution: Fixed
> Replace part of Spark context by hadoop configuration in AbstractHoodieClient
>
[
https://issues.apache.org/jira/browse/HUDI-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-886.
Resolution: Fixed
> Replace jsc.hadoopConfiguration by hadoop configuration in hudi-client
> testcase
>
[
https://issues.apache.org/jira/browse/HUDI-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-881:
---
Fix Version/s: 0.6.0
> Replace part of Spark context by hadoop configuration in AbstractHoodieClient
>
[
https://issues.apache.org/jira/browse/HUDI-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105212#comment-17105212
]
Hong Shen commented on HUDI-886:
https://github.com/apache/incubator-hudi/pull/1621
> Replace
[
https://issues.apache.org/jira/browse/HUDI-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105213#comment-17105213
]
Hong Shen commented on HUDI-881:
https://github.com/apache/incubator-hudi/pull/1620
> Replace part of
[
https://issues.apache.org/jira/browse/HUDI-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-886:
---
Status: In Progress (was: Open)
> Replace jsc.hadoopConfiguration by hadoop configuration in hudi-client
>
Hong Shen created HUDI-886:
--
Summary: Replace jsc.hadoopConfiguration by hadoop configuration
in hudi-client testcase
Key: HUDI-886
URL: https://issues.apache.org/jira/browse/HUDI-886
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-886:
--
Assignee: Hong Shen
> Replace jsc.hadoopConfiguration by hadoop configuration in hudi-client
>
[
https://issues.apache.org/jira/browse/HUDI-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-886:
---
Status: Open (was: New)
> Replace jsc.hadoopConfiguration by hadoop configuration in hudi-client
> testcase
[
https://issues.apache.org/jira/browse/HUDI-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-880.
Resolution: Fixed
> Replace part of spark context by hadoop configuration in HoodieTable
>
[
https://issues.apache.org/jira/browse/HUDI-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-881:
---
Status: In Progress (was: Open)
> Replace part of Spark context by hadoop configuration in
[
https://issues.apache.org/jira/browse/HUDI-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-881:
---
Status: Open (was: New)
> Replace part of Spark context by hadoop configuration in AbstractHoodieClient
>
[
https://issues.apache.org/jira/browse/HUDI-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-880:
---
Status: In Progress (was: Open)
> Replace part of spark context by hadoop configuration in HoodieTable
>
[
https://issues.apache.org/jira/browse/HUDI-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-880:
---
Status: Open (was: New)
> Replace part of spark context by hadoop configuration in HoodieTable
>
[
https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-870:
---
Status: In Progress (was: Open)
> Remove spark context in ClientUtils and HoodieIndex
>
[
https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen resolved HUDI-870.
Resolution: Fixed
> Remove spark context in ClientUtils and HoodieIndex
>
[
https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-870:
---
Status: Open (was: New)
> Remove spark context in ClientUtils and HoodieIndex
>
Hong Shen created HUDI-881:
--
Summary: Replace part of Spark context by hadoop configuration in
AbstractHoodieClient
Key: HUDI-881
URL: https://issues.apache.org/jira/browse/HUDI-881
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-880:
--
Assignee: Hong Shen
> Replace part of spark context by hadoop configuration in HoodieTable
>
Hong Shen created HUDI-880:
--
Summary: Replace part of spark context by hadoop configuration in
HoodieTable
Key: HUDI-880
URL: https://issues.apache.org/jira/browse/HUDI-880
Project: Apache Hudi (incubating)
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195
]
Hong Shen edited comment on HUDI-866 at 5/9/20, 2:38 PM:
-
I sorted out the classes
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195
]
Hong Shen edited comment on HUDI-866 at 5/9/20, 8:36 AM:
-
I sorted out the classes
[
https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen reassigned HUDI-870:
--
Assignee: Hong Shen
> Remove spark context in ClientUtils and HoodieIndex
>
[
https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-870:
---
Summary: Remove spark context in ClientUtils and HoodieIndex (was: Replace
spark context directly with hadoop
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195
]
Hong Shen edited comment on HUDI-866 at 5/9/20, 8:27 AM:
-
I sorted out the classes
Hong Shen created HUDI-870:
--
Summary: Replace spark context directly with hadoop configuration
in ClientUtils and HoodieTimelineArchiveLog
Key: HUDI-870
URL: https://issues.apache.org/jira/browse/HUDI-870
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195
]
Hong Shen commented on HUDI-866:
I sorted out the classes in hudi-client that can replace spark context
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102692#comment-17102692
]
Hong Shen commented on HUDI-866:
[~yanghua] agree, I will split the pull request.
> Some classes that
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-866:
---
Summary: Some classes that rely on JavaSparkContext to obtain Configuration
can make them Spark-free. (was:
[
https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-866:
---
Parent: HUDI-538
Issue Type: Sub-task (was: Task)
> Replace Spark context directly with Hadoop
Hong Shen created HUDI-866:
--
Summary: Replace Spark context directly with Hadoop configuration
object in some scenarios
Key: HUDI-866
URL: https://issues.apache.org/jira/browse/HUDI-866
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096380#comment-17096380
]
Hong Shen commented on HUDI-538:
[~yanghua] please @ me if need.
> Restructuring hudi client module for
[
https://issues.apache.org/jira/browse/HUDI-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-782:
---
Issue Type: New Feature (was: Bug)
> Add support for aliyun OSS
> --
>
>
[
https://issues.apache.org/jira/browse/HUDI-657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hong Shen updated HUDI-657:
---
Description:
When I write data to hudi, I find it's lots of loading table properties log,
and each take
Hong Shen created HUDI-657:
--
Summary: It's lots of ClientUtils.createMetaClient when write to
hudi
Key: HUDI-657
URL: https://issues.apache.org/jira/browse/HUDI-657
Project: Apache Hudi (incubating)
76 matches
Mail list logo