[
https://issues.apache.org/jira/browse/IMPALA-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy updated IMPALA-14840:
---------------------------------------
Description:
Based on the following comments a query can use unlimited resources if
* Pool has no Min and Max Query Memory LImit
* Query option MEM_LIMIT is not set
https://github.com/apache/impala/blob/787b63a4b88b91bf441200e336ca0bac873541b9/be/src/scheduling/schedule-state.cc#L301-L303
{noformat}
// If the min_query_mem_limit and max_query_mem_limit are not set in the pool
config
// then it falls back to traditional(old) behavior, which means that, it sets
the
// mem_limit if it is set in the query options, else sets it to -1 (no limit).
{noformat}
https://github.com/apache/impala/blob/787b63a4b88b91bf441200e336ca0bac873541b9/be/src/scheduling/schedule-state.cc#L411
This can lead to using more memory than the specified "Max Memory" for the pool.
was:
Based on the following comments a query can use unlimited resources if
* Pool has no Min and Max Query Memory LImit
* Query option MEM_LIMIT is not set
https://github.com/apache/impala/blob/787b63a4b88b91bf441200e336ca0bac873541b9/be/src/scheduling/schedule-state.cc#L301-L303
{noformat}
// If the min_query_mem_limit and max_query_mem_limit are not set in the pool
config
// then it falls back to traditional(old) behavior, which means that, it sets
the
// mem_limit if it is set in the query options, else sets it to -1 (no limit).
{noformat}
https://github.com/apache/impala/blob/787b63a4b88b91bf441200e336ca0bac873541b9/be/src/scheduling/schedule-state.cc#L411
This can lead to using more memory than the "Max Memory" specified for the pool.
> Pool can use more memory than Max Memory when Min/Max Query Memory limit is
> not set
> -----------------------------------------------------------------------------------
>
> Key: IMPALA-14840
> URL: https://issues.apache.org/jira/browse/IMPALA-14840
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Reporter: Zoltán Borók-Nagy
> Priority: Major
>
> Based on the following comments a query can use unlimited resources if
> * Pool has no Min and Max Query Memory LImit
> * Query option MEM_LIMIT is not set
> https://github.com/apache/impala/blob/787b63a4b88b91bf441200e336ca0bac873541b9/be/src/scheduling/schedule-state.cc#L301-L303
> {noformat}
> // If the min_query_mem_limit and max_query_mem_limit are not set in the
> pool config
> // then it falls back to traditional(old) behavior, which means that, it
> sets the
> // mem_limit if it is set in the query options, else sets it to -1 (no
> limit).
> {noformat}
> https://github.com/apache/impala/blob/787b63a4b88b91bf441200e336ca0bac873541b9/be/src/scheduling/schedule-state.cc#L411
> This can lead to using more memory than the specified "Max Memory" for the
> pool.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
