[
https://issues.apache.org/jira/browse/HUDI-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-9111:
------------------------------
Description:
[https://github.com/apache/hudi/pull/12874#discussion_r1966456842]
rdd.reduceByKey and other transformation APIs can take parallelism. We should
revisit all APIs provided in HoodieSparkEngineContext around setting the
parallelism.
was:
[https://github.com/apache/hudi/pull/12874#discussion_r1966456842]
rdd.reduceByKey and other transformation APIs can take parallelism. We should
revisit all APIs provided in
> Revisit parallelism config for Spark transformations in
> HoodieSparkEngineContext
> --------------------------------------------------------------------------------
>
> Key: HUDI-9111
> URL: https://issues.apache.org/jira/browse/HUDI-9111
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Y Ethan Guo
> Priority: Major
> Fix For: 1.1.0
>
>
> [https://github.com/apache/hudi/pull/12874#discussion_r1966456842]
> rdd.reduceByKey and other transformation APIs can take parallelism. We
> should revisit all APIs provided in HoodieSparkEngineContext around setting
> the parallelism.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
