[jira] [Created] (FLINK-14884) User defined function for checkpoint trigger time and interval behavior
Shuwen Zhou created FLINK-14884: --- Summary: User defined function for checkpoint trigger time and interval behavior Key: FLINK-14884 URL: https://issues.apache.org/jira/browse/FLINK-14884 Project: Flink Issue Type: Wish Components: Runtime / Checkpointing Reporter: Shuwen Zhou Hi, I wish to have control on checkpoint trigger time and interval time behavior by user defined function. For some cases I would like to skip checkpoint during a certain hour or certain minutes or vice versa. And some cases during several hours I would like to increase checkpoint interval. And some case A crontab style could be used simply. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-14538) Metrics of Status.JVM.Memory.NonHeap.Max is always -1
[
https://issues.apache.org/jira/browse/FLINK-14538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960759#comment-16960759
]
Shuwen Zhou commented on FLINK-14538:
-
[~wind_ljy]
It was deployed on Yarn cluster.
The command of job manager is following:
{code:java}
/usr/lib/jvm/java-1.8.0-openjdk/bin/java -Xms2304m -Xmx2304m -XX:+PrintHeapAtGC
-XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution
-Dlog.file=/ebs_hadoop_data/yarn-data/log/application_156508035_24/container_e20_156508035_24_01_01/jobmanager.log
-Dlog4j.configuration=file:log4j.properties
org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint
{code}
The command of task manager is :
{code:java}
/usr/lib/jvm/java-1.8.0-openjdk/bin/java -Xms9830m -Xmx9830m
-XX:MaxDirectMemorySize=6554m -XX:+PrintHeapAtGC -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution
-Dlog.file=/ebs_hadoop_data/yarn-data/log/application_156508035_24/container_e20_156508035_24_01_000163/taskmanager.log
-Dlog4j.configuration=file:./log4j.properties
org.apache.flink.yarn.YarnTaskExecutorRunner --configDir .
{code}
Thanks.
I was expecting NonHeap memory will be logged as default value.
> Metrics of Status.JVM.Memory.NonHeap.Max is always -1
> -
>
> Key: FLINK-14538
> URL: https://issues.apache.org/jira/browse/FLINK-14538
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
>Affects Versions: 1.9.0
>Reporter: Shuwen Zhou
>Priority: Minor
> Attachments: image-2019-10-28-12-34-53-413.png
>
>
> I'm collecting JobManager and TaskManager status metrics to DataDog.
> While all metrics of both JobManager and TaskManager
> Status.JVM.Memory.NonHeap.Max is always -1
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14538) Metrics of Status.JVM.Memory.NonHeap.Max is always -1
[ https://issues.apache.org/jira/browse/FLINK-14538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuwen Zhou updated FLINK-14538: Description: I'm collecting JobManager and TaskManager status metrics to DataDog. While all metrics of both JobManager and TaskManager Status.JVM.Memory.NonHeap.Max is always -1 was: I'm collecting TaskManager status metrics to DataDog. While all metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 > Metrics of Status.JVM.Memory.NonHeap.Max is always -1 > - > > Key: FLINK-14538 > URL: https://issues.apache.org/jira/browse/FLINK-14538 > Project: Flink > Issue Type: Bug > Components: Runtime / Metrics >Affects Versions: 1.9.0 >Reporter: Shuwen Zhou >Priority: Minor > Attachments: image-2019-10-28-12-34-53-413.png > > > I'm collecting JobManager and TaskManager status metrics to DataDog. > While all metrics of both JobManager and TaskManager > Status.JVM.Memory.NonHeap.Max is always -1 > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14538) Metrics of Status.JVM.Memory.NonHeap.Max is always -1
[ https://issues.apache.org/jira/browse/FLINK-14538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuwen Zhou updated FLINK-14538: Summary: Metrics of Status.JVM.Memory.NonHeap.Max is always -1 (was: Metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1) > Metrics of Status.JVM.Memory.NonHeap.Max is always -1 > - > > Key: FLINK-14538 > URL: https://issues.apache.org/jira/browse/FLINK-14538 > Project: Flink > Issue Type: Bug > Components: Runtime / Metrics >Affects Versions: 1.9.0 >Reporter: Shuwen Zhou >Priority: Minor > Attachments: image-2019-10-28-12-34-53-413.png > > > I'm collecting TaskManager status metrics to DataDog. > While all metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14538) Metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1
[ https://issues.apache.org/jira/browse/FLINK-14538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuwen Zhou updated FLINK-14538: Description: I'm collecting TaskManager status metrics to DataDog. While all metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 was: I'm collecting TaskManager status metrics to DataDog. While all metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 !image-2019-10-28-12-34-53-413.png! > Metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 > - > > Key: FLINK-14538 > URL: https://issues.apache.org/jira/browse/FLINK-14538 > Project: Flink > Issue Type: Bug > Components: Runtime / Metrics >Affects Versions: 1.9.0 >Reporter: Shuwen Zhou >Priority: Minor > Attachments: image-2019-10-28-12-34-53-413.png > > > I'm collecting TaskManager status metrics to DataDog. > While all metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-14538) Metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1
Shuwen Zhou created FLINK-14538: --- Summary: Metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 Key: FLINK-14538 URL: https://issues.apache.org/jira/browse/FLINK-14538 Project: Flink Issue Type: Bug Components: Runtime / Metrics Affects Versions: 1.9.0 Reporter: Shuwen Zhou Attachments: image-2019-10-28-12-34-53-413.png I'm collecting TaskManager status metrics to DataDog. While all metrics of TaskManager Status.JVM.Memory.NonHeap.Max is always -1 !image-2019-10-28-12-34-53-413.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
