[
https://issues.apache.org/jira/browse/HIVE-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158129#comment-16158129
]
Lefty Leverenz commented on HIVE-17362:
---------------------------------------
Okay, I moved *hive.prewarm.spark.timeout* to the Spark section and added "when
*hive.prewarm.enabled* is true" to the description. I also added links to the
other prewarm configs, which remain in the Tez section to avoid duplication.
* Spark section: [hive.prewarm.spark.timeout |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.prewarm.spark.timeout]
* Tez section: [hive.prewarm.enabled |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.prewarm.enabled]
* Tez section: [hive.prewarm.numcontainers |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.prewarm.numcontainers]
> The MAX_PREWARM_TIME should be configurable on HoS
> --------------------------------------------------
>
> Key: HIVE-17362
> URL: https://issues.apache.org/jira/browse/HIVE-17362
> Project: Hive
> Issue Type: Improvement
> Components: Spark
> Affects Versions: 3.0.0
> Reporter: Peter Vary
> Assignee: Peter Vary
> Fix For: 3.0.0
>
> Attachments: HIVE-17362.2.patch, HIVE-17362.patch
>
>
> When using HIVE_PREWARM_ENABLED, we are waiting MAX_PREWARM_TIME for the
> containers to warm up. This is currently set to 5s. This is often not enough
> for a spark session to initialize the executors. We should be able to
> configure this, so we can set a value which has an effect.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
