[
https://issues.apache.org/jira/browse/FLINK-19327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Igal Shilman updated FLINK-19327:
---------------------------------
Description:
Currently our Helm chart specify the value of
jobmanager.memory.process.size to be 500mb which causes the JobManager to crush
on start with:
{code:java}
INFO [] - Loading configuration property: jobmanager.memory.process.size, 500m
INFO [] - Loading configuration property: taskmanager.memory.process.size, 4g
INFO [] - Loading configuration property: parallelism.default, 3
INFO [] - The derived from fraction jvm overhead memory (50.000mb (52428800
bytes)) is less than its min value 192.000mb (201326592 bytes), min value will
be used instead
Exception in thread "main"
org.apache.flink.configuration.IllegalConfigurationException: The configured
Total Flink Memory (52.000mb (54525952 bytes)) is less than the configured
Off-heap Memory (128.000mb (134217728 bytes)).
at
org.apache.flink.runtime.util.config.memory.jobmanager.JobManagerFlinkMemoryUtils.deriveFromTotalFlinkMemory(JobManagerFlinkMemoryUtils.java:107)
at
org.apache.flink.runtime.util.config.memory.jobmanager.JobManagerFlinkMemoryUtils.deriveFromTotalFlinkMemory(JobManagerFlinkMemoryUtils.java:36)
at
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveProcessSpecWithTotalProcessMemory(ProcessMemoryUtils.java:105)
at
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.memoryProcessSpecFromConfig(ProcessMemoryUtils.java:79)
at
org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfig(JobManagerProcessUtils.java:76)
at
org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:71)
at
org.apache.flink.runtime.util.bash.BashJavaUtils.getJmResourceParams(BashJavaUtils.java:102)
at
org.apache.flink.runtime.util.bash.BashJavaUtils.runCommand(BashJavaUtils.java:73)
at
org.apache.flink.runtime.util.bash.BashJavaUtils.main(BashJavaUtils.java:61)
{code}
was:
Currently our Helm chart specfiy the value of
jobmanager.memory.process.size to be 500mb which causes the JobManager to crush
on start with:
{code:java}
INFO [] - Loading configuration property: jobmanager.memory.process.size, 500m
INFO [] - Loading configuration property: taskmanager.memory.process.size, 4g
INFO [] - Loading configuration property: parallelism.default, 3
INFO [] - The derived from fraction jvm overhead memory (50.000mb (52428800
bytes)) is less than its min value 192.000mb (201326592 bytes), min value will
be used instead
Exception in thread "main"
org.apache.flink.configuration.IllegalConfigurationException: The configured
Total Flink Memory (52.000mb (54525952 bytes)) is less than the configured
Off-heap Memory (128.000mb (134217728 bytes)).
at
org.apache.flink.runtime.util.config.memory.jobmanager.JobManagerFlinkMemoryUtils.deriveFromTotalFlinkMemory(JobManagerFlinkMemoryUtils.java:107)
at
org.apache.flink.runtime.util.config.memory.jobmanager.JobManagerFlinkMemoryUtils.deriveFromTotalFlinkMemory(JobManagerFlinkMemoryUtils.java:36)
at
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveProcessSpecWithTotalProcessMemory(ProcessMemoryUtils.java:105)
at
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.memoryProcessSpecFromConfig(ProcessMemoryUtils.java:79)
at
org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfig(JobManagerProcessUtils.java:76)
at
org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:71)
at
org.apache.flink.runtime.util.bash.BashJavaUtils.getJmResourceParams(BashJavaUtils.java:102)
at
org.apache.flink.runtime.util.bash.BashJavaUtils.runCommand(BashJavaUtils.java:73)
at
org.apache.flink.runtime.util.bash.BashJavaUtils.main(BashJavaUtils.java:61)
{code}
> Helm charts specify a too low value for the job manager's heap size
> -------------------------------------------------------------------
>
> Key: FLINK-19327
> URL: https://issues.apache.org/jira/browse/FLINK-19327
> Project: Flink
> Issue Type: Bug
> Components: Stateful Functions
> Reporter: Igal Shilman
> Priority: Major
>
> Currently our Helm chart specify the value of
> jobmanager.memory.process.size to be 500mb which causes the JobManager to
> crush on start with:
> {code:java}
> INFO [] - Loading configuration property: jobmanager.memory.process.size,
> 500m
> INFO [] - Loading configuration property: taskmanager.memory.process.size, 4g
> INFO [] - Loading configuration property: parallelism.default, 3
> INFO [] - The derived from fraction jvm overhead memory (50.000mb (52428800
> bytes)) is less than its min value 192.000mb (201326592 bytes), min value
> will be used instead
> Exception in thread "main"
> org.apache.flink.configuration.IllegalConfigurationException: The configured
> Total Flink Memory (52.000mb (54525952 bytes)) is less than the configured
> Off-heap Memory (128.000mb (134217728 bytes)).
> at
> org.apache.flink.runtime.util.config.memory.jobmanager.JobManagerFlinkMemoryUtils.deriveFromTotalFlinkMemory(JobManagerFlinkMemoryUtils.java:107)
> at
> org.apache.flink.runtime.util.config.memory.jobmanager.JobManagerFlinkMemoryUtils.deriveFromTotalFlinkMemory(JobManagerFlinkMemoryUtils.java:36)
> at
> org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveProcessSpecWithTotalProcessMemory(ProcessMemoryUtils.java:105)
> at
> org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.memoryProcessSpecFromConfig(ProcessMemoryUtils.java:79)
> at
> org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfig(JobManagerProcessUtils.java:76)
> at
> org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:71)
> at
> org.apache.flink.runtime.util.bash.BashJavaUtils.getJmResourceParams(BashJavaUtils.java:102)
> at
> org.apache.flink.runtime.util.bash.BashJavaUtils.runCommand(BashJavaUtils.java:73)
> at
> org.apache.flink.runtime.util.bash.BashJavaUtils.main(BashJavaUtils.java:61)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
