[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-09-15 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196111#comment-17196111 ] Chesnay Schepler commented on FLINK-19005: -- [~gestevez]From what I can tell the dump looks OK

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-09-01 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188456#comment-17188456 ] Guillermo Sánchez commented on FLINK-19005: --- Thanks [~chesnay], [~trohrmann], I tried your

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-31 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187492#comment-17187492 ] Till Rohrmann commented on FLINK-19005: --- The per-job mode does also work in standalone mode via

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-28 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186472#comment-17186472 ] João Boto commented on FLINK-19005: --- [~trohrmann] that can be applied to a standalone cluster?

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-28 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186389#comment-17186389 ] Chesnay Schepler commented on FLINK-19005: -- I don't think anyone has a plan to solve it. I can

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-28 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186384#comment-17186384 ] Till Rohrmann commented on FLINK-19005: --- One thing you can do is to use Flink's per job mode

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-28 Thread ShenDa (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186353#comment-17186353 ] ShenDa commented on FLINK-19005: [~chesnay] Looks like it's hard to solve the problem. Do we any plan

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-28 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186325#comment-17186325 ] Chesnay Schepler commented on FLINK-19005: -- Well of course that works; you clean _all drivers,_

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-27 Thread ShenDa (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186221#comment-17186221 ] ShenDa commented on FLINK-19005: [~chesnay] Thanks for your detailed instruction. But I still think

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-25 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183942#comment-17183942 ] Chesnay Schepler commented on FLINK-19005: -- [~DaDaShen] * load heapdump in ecliplse MAT *

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-25 Thread ShenDa (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183928#comment-17183928 ] ShenDa commented on FLINK-19005: [~chesnay] I'm willing to know how you can analyze the class leaking is

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-25 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183906#comment-17183906 ] Chesnay Schepler commented on FLINK-19005: -- [~Echo Lee] The JMX thingie is probably fine since

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-25 Thread Echo Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183904#comment-17183904 ] Echo Lee commented on FLINK-19005: -- Yes, I turned on JMX in order to monitor the changes of Metaspace

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-25 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183894#comment-17183894 ] Chesnay Schepler commented on FLINK-19005: -- [~Echo Lee] similar problem, user classloader is

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-25 Thread Echo Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183887#comment-17183887 ] Echo Lee commented on FLINK-19005: -- [~chesnay] Wordcount.jar is not easy to reproduce this issue, but

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-24 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183623#comment-17183623 ] Chesnay Schepler commented on FLINK-19005: -- My conclusion is that Flink is not leaking

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-24 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183217#comment-17183217 ] Chesnay Schepler commented on FLINK-19005: -- Small update, the TaskExecutor crashed while things

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-24 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183182#comment-17183182 ] Chesnay Schepler commented on FLINK-19005: -- I've added a summary to the Jira description.

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-24 Thread Echo Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182968#comment-17182968 ] Echo Lee commented on FLINK-19005: -- [~chesnay] Is there any new progress on this issue?  > used

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181871#comment-17181871 ] Matthias commented on FLINK-19005: -- Thanks for the update: A quick diff shows already that there is a

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181864#comment-17181864 ] Guillermo Sánchez commented on FLINK-19005: --- I have uploaded heap_dump_after_1_executions.zip

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181848#comment-17181848 ] Matthias commented on FLINK-19005: -- Hi [~gestevez], thanks for getting back to us. It looks like

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181810#comment-17181810 ] Guillermo Sánchez commented on FLINK-19005: --- [~chesnay], [~mapohl], I have attached the heap

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181754#comment-17181754 ] Guillermo Sánchez commented on FLINK-19005: --- Its the same problem that I have > used

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread ShenDa (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181741#comment-17181741 ] ShenDa commented on FLINK-19005: [~chesnay] I didn't do this on a local cluster. I use a script to

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181739#comment-17181739 ] Chesnay Schepler commented on FLINK-19005: -- [~DaDaShen] Does this happen on a local cluster?

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Echo Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181737#comment-17181737 ] Echo Lee commented on FLINK-19005: -- [~chesnay] I also encountered this problem, which I raised in the

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread ShenDa (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181718#comment-17181718 ] ShenDa commented on FLINK-19005: [~chesnay] Yes, I use flink 1.11.0 with it's batch word count on jdk11

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181709#comment-17181709 ] Chesnay Schepler commented on FLINK-19005: -- [~DaDaShen] Are you also using 1.11.0? Are you

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-21 Thread ShenDa (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181704#comment-17181704 ] ShenDa commented on FLINK-19005: [~mapohl] Hi Matthias, I meet the same problem as [~gestevez] does. To

[jira] [Commented] (FLINK-19005) used metaspace grow on every execution

2020-08-20 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181205#comment-17181205 ] Matthias commented on FLINK-19005: -- Hi Robert, this looks like a Metaspace leak. The memory used for