[jira] [Created] (FLINK-15358) [configuration] the flink conf yaml file will skip the rest of value after a `#` comment sign
BlaBlabla created FLINK-15358: - Summary: [configuration] the flink conf yaml file will skip the rest of value after a `#` comment sign Key: FLINK-15358 URL: https://issues.apache.org/jira/browse/FLINK-15358 Project: Flink Issue Type: Bug Components: Runtime / Configuration Affects Versions: 1.9.1 Reporter: BlaBlabla Hello, I have to use influx metrics reporter ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: metrics.reporter.influxdb.password: xxpasssxx#blabla #blabla is parsed as an end line comment. Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the flink conf yaml file will skip the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Description: Hello, I have to use influx metrics reporter ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: *metrics.reporter.influxdb.password: xxpasssxx#blabla* *#blabla* is parsed as an end line comment. Can you guys fix it? was: Hello, I have to use influx metrics reporter ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: ` metrics.reporter.influxdb.password: xxpasssxx#blabla ` *#blabla* is parsed as an end line comment. Can you guys fix it? > [configuration] the flink conf yaml file will skip the rest of value after a > `#` comment sign > -- > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to use influx metrics reporter ,however the password contains a # > sign, then the flink will skip the rest part of the password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the flink conf yaml file will skip the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Description: Hello, I have to use influx metrics reporter ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: ` metrics.reporter.influxdb.password: xxpasssxx#blabla ` *#blabla* is parsed as an end line comment. Can you guys fix it? was: Hello, I have to use influx metrics reporter ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: metrics.reporter.influxdb.password: xxpasssxx#blabla #blabla is parsed as an end line comment. Can you guys fix it? > [configuration] the flink conf yaml file will skip the rest of value after a > `#` comment sign > -- > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to use influx metrics reporter ,however the password contains a # > sign, then the flink will skip the rest part of the password after #, eg: > ` metrics.reporter.influxdb.password: xxpasssxx#blabla ` > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the flink conf yaml file will skip the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Description: Hello, I have to config influx metrics reporter in conf/flink-conf.yaml ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: *metrics.reporter.influxdb.password: xxpasssxx#blabla* *#blabla* is parsed as an end line comment. Can you guys fix it? was: Hello, I have to use influx metrics reporter ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: *metrics.reporter.influxdb.password: xxpasssxx#blabla* *#blabla* is parsed as an end line comment. Can you guys fix it? > [configuration] the flink conf yaml file will skip the rest of value after a > `#` comment sign > -- > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in conf/flink-conf.yaml ,however the > password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the Flink global configuration will skip the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Summary: [configuration] the Flink global configuration will skip the rest of value after a `#` comment sign (was: [configuration] the flink conf yaml file will skip the rest of value after a `#` comment sign) > [configuration] the Flink global configuration will skip the rest of value > after a `#` comment sign > > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in conf/flink-conf.yaml ,however the > password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the Flink global configuration will skip the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Description: Hello, I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: *metrics.reporter.influxdb.password: xxpasssxx#blabla* *#blabla* is parsed as an end line comment. Can you guys fix it? was: Hello, I have to config influx metrics reporter in conf/flink-conf.yaml ,however the password contains a # sign, then the flink will skip the rest part of the password after #, eg: *metrics.reporter.influxdb.password: xxpasssxx#blabla* *#blabla* is parsed as an end line comment. Can you guys fix it? > [configuration] the Flink global configuration will skip the rest of value > after a `#` comment sign > > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however > the password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the global configuration will skip the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Summary: [configuration] the global configuration will skip the rest of value after a `#` comment sign (was: [configuration] the Flink global configuration will skip the rest of value after a `#` comment sign) > [configuration] the global configuration will skip the rest of value after a > `#` comment sign > - > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however > the password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the global configuration value will be trimmed the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Summary: [configuration] the global configuration value will be trimmed the rest of value after a `#` comment sign (was: [configuration] the global configuration will skip the rest of value after a `#` comment sign) > [configuration] the global configuration value will be trimmed the rest of > value after a `#` comment sign > -- > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however > the password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the global configuration value will be trimmed that the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Summary: [configuration] the global configuration value will be trimmed that the rest of value after a `#` comment sign (was: [configuration] the global configuration value will be trimmed the rest of value after a `#` comment sign) > [configuration] the global configuration value will be trimmed that the rest > of value after a `#` comment sign > -- > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however > the password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-15358) [configuration] the global configuration will trim the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BlaBlabla updated FLINK-15358: -- Summary: [configuration] the global configuration will trim the rest of value after a `#` comment sign (was: [configuration] the global configuration value will be trimmed that the rest of value after a `#` comment sign) > [configuration] the global configuration will trim the rest of value after a > `#` comment sign > - > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however > the password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-15358) [configuration] the global configuration will trim the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002161#comment-17002161 ] BlaBlabla commented on FLINK-15358: --- [~fly_in_gis] , Actually , I changed the influx password to the one that doesn't include a comment (#) sign. :D > [configuration] the global configuration will trim the rest of value after a > `#` comment sign > - > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however > the password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (FLINK-15358) [configuration] the global configuration will trim the rest of value after a `#` comment sign
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002161#comment-17002161 ] BlaBlabla edited comment on FLINK-15358 at 12/23/19 8:39 AM: - [~fly_in_gis] , Actually , I changed the influxdb password to the one that doesn't include a comment (#) sign. :D was (Author: blablabla123): [~fly_in_gis] , Actually , I changed the influx password to the one that doesn't include a comment (#) sign. :D > [configuration] the global configuration will trim the rest of value after a > `#` comment sign > - > > Key: FLINK-15358 > URL: https://issues.apache.org/jira/browse/FLINK-15358 > Project: Flink > Issue Type: Bug > Components: Runtime / Configuration >Affects Versions: 1.9.1 >Reporter: BlaBlabla >Priority: Major > > Hello, > I have to config influx metrics reporter in _conf/flink-conf.yaml_ ,however > the password contains a # sign, then the flink will skip the rest part of the > password after #, eg: > *metrics.reporter.influxdb.password: xxpasssxx#blabla* > > *#blabla* is parsed as an end line comment. > Can you guys fix it? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16397) [metric] flink metric graphite will format double metrics to "%2.2f"
BlaBlabla created FLINK-16397:
-
Summary: [metric] flink metric graphite will format double metrics
to "%2.2f"
Key: FLINK-16397
URL: https://issues.apache.org/jira/browse/FLINK-16397
Project: Flink
Issue Type: Bug
Components: Runtime / Metrics
Reporter: BlaBlabla
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. like CPU_LOAD metric was converted to a wired
value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-16397) [metric] flink metric graphite will format double metrics to "%2.2f"
[
https://issues.apache.org/jira/browse/FLINK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16397:
--
Description:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. like Status.JVM.CPU.Load metric was converted
to a wired value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
was:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. like CPU_LOAD metric was converted to a wired
value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
> [metric] flink metric graphite will format double metrics to "%2.2f"
>
>
> Key: FLINK-16397
> URL: https://issues.apache.org/jira/browse/FLINK-16397
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
>Reporter: BlaBlabla
>Priority: Major
>
> I'm using flink GraphiteReporter to monitor metrics. But I found that the
> GraphiteReporter will convert double / float type metrics to the format :
> "%2.2f", only keep two fractions. like Status.JVM.CPU.Load metric was
> converted to a wired value, like 0.00, 0.01 .
> it is bad :(
> For more detail, see the double format function in dropwizard metrics
> project::
> [https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
> {code:java}
> protected String format(double v) {
> // the Carbon plaintext format is pretty underspecified, but it seems
> like it just wants
> // US-formatted digits
> return String.format(Locale.US, "%2.2f", v);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-16397) [metric] flink metric graphite will format double metrics to "%2.2f"
[
https://issues.apache.org/jira/browse/FLINK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16397:
--
Description:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric was
converted to a wired value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
was:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. like Status.JVM.CPU.Load metric was converted
to a wired value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
> [metric] flink metric graphite will format double metrics to "%2.2f"
>
>
> Key: FLINK-16397
> URL: https://issues.apache.org/jira/browse/FLINK-16397
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
>Reporter: BlaBlabla
>Priority: Major
>
> I'm using flink GraphiteReporter to monitor metrics. But I found that the
> GraphiteReporter will convert double / float type metrics to the format :
> "%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric
> was converted to a wired value, like 0.00, 0.01 .
> it is bad :(
> For more detail, see the double format function in dropwizard metrics
> project::
> [https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
> {code:java}
> protected String format(double v) {
> // the Carbon plaintext format is pretty underspecified, but it seems
> like it just wants
> // US-formatted digits
> return String.format(Locale.US, "%2.2f", v);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-16397) [metric] flink metric graphite will format double metrics to "%2.2f"
[
https://issues.apache.org/jira/browse/FLINK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16397:
--
Description:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric was
converted to a loss precision value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
was:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric was
converted to a wired value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
> [metric] flink metric graphite will format double metrics to "%2.2f"
>
>
> Key: FLINK-16397
> URL: https://issues.apache.org/jira/browse/FLINK-16397
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
>Reporter: BlaBlabla
>Priority: Major
>
> I'm using flink GraphiteReporter to monitor metrics. But I found that the
> GraphiteReporter will convert double / float type metrics to the format :
> "%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric
> was converted to a loss precision value, like 0.00, 0.01 .
> it is bad :(
> For more detail, see the double format function in dropwizard metrics
> project::
> [https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
> {code:java}
> protected String format(double v) {
> // the Carbon plaintext format is pretty underspecified, but it seems
> like it just wants
> // US-formatted digits
> return String.format(Locale.US, "%2.2f", v);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-16397) [metric] flink metric graphite will format double metrics to "%2.2f"
[
https://issues.apache.org/jira/browse/FLINK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16397:
--
Description:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric is
loss of precision, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
was:
I'm using flink GraphiteReporter to monitor metrics. But I found that the
GraphiteReporter will convert double / float type metrics to the format :
"%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric was
converted to a loss precision value, like 0.00, 0.01 .
it is bad :(
For more detail, see the double format function in dropwizard metrics project::
[https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
{code:java}
protected String format(double v) {
// the Carbon plaintext format is pretty underspecified, but it seems
like it just wants
// US-formatted digits
return String.format(Locale.US, "%2.2f", v);
{code}
> [metric] flink metric graphite will format double metrics to "%2.2f"
>
>
> Key: FLINK-16397
> URL: https://issues.apache.org/jira/browse/FLINK-16397
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
>Reporter: BlaBlabla
>Priority: Major
>
> I'm using flink GraphiteReporter to monitor metrics. But I found that the
> GraphiteReporter will convert double / float type metrics to the format :
> "%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric
> is loss of precision, like 0.00, 0.01 .
> it is bad :(
> For more detail, see the double format function in dropwizard metrics
> project::
> [https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
> {code:java}
> protected String format(double v) {
> // the Carbon plaintext format is pretty underspecified, but it seems
> like it just wants
> // US-formatted digits
> return String.format(Locale.US, "%2.2f", v);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-16142) Memory Leak causes Metaspace OOM error on repeated job submission
[
https://issues.apache.org/jira/browse/FLINK-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049888#comment-17049888
]
BlaBlabla commented on FLINK-16142:
---
I met this issue , when I upgraded flink from 1.9.2 to 1.10.0. However I found
that the default meta space is only 128MB, so I changed to 256M, then the flink
never crash agaign
> Memory Leak causes Metaspace OOM error on repeated job submission
> -
>
> Key: FLINK-16142
> URL: https://issues.apache.org/jira/browse/FLINK-16142
> Project: Flink
> Issue Type: Bug
> Components: Client / Job Submission
>Affects Versions: 1.10.0
>Reporter: Thomas Wozniakowski
>Priority: Blocker
> Fix For: 1.10.1, 1.11.0
>
> Attachments: Leak-GC-root.png, java_pid1.hprof, java_pid1.hprof
>
>
> Hi Guys,
> We've just tried deploying 1.10.0 as it has lots of shiny stuff that fits our
> use-case exactly (RocksDB state backend running in a containerised cluster).
> Unfortunately, it seems like there is a memory leak somewhere in the job
> submission logic. We are getting this error:
> {code:java}
> 2020-02-18 10:22:10,020 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - OPERATOR_NAME
> switched from RUNNING to FAILED.
> java.lang.OutOfMemoryError: Metaspace
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:757)
> at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
> at
> org.apache.flink.util.ChildFirstClassLoader.loadClass(ChildFirstClassLoader.java:60)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.jmx.SdkMBeanRegistrySupport.registerMetricAdminMBean(SdkMBeanRegistrySupport.java:27)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.metrics.AwsSdkMetrics.registerMetricAdminMBean(AwsSdkMetrics.java:398)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.metrics.AwsSdkMetrics.(AwsSdkMetrics.java:359)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.AmazonWebServiceClient.requestMetricCollector(AmazonWebServiceClient.java:728)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.AmazonWebServiceClient.isRMCEnabledAtClientOrSdkLevel(AmazonWebServiceClient.java:660)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.AmazonWebServiceClient.isRequestMetricsEnabled(AmazonWebServiceClient.java:652)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.AmazonWebServiceClient.createExecutionContext(AmazonWebServiceClient.java:611)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.AmazonWebServiceClient.createExecutionContext(AmazonWebServiceClient.java:606)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.executeListShards(AmazonKinesisClient.java:1534)
> at
> org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.listShards(AmazonKinesisClient.java:1528)
> at
> org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.listShards(KinesisProxy.java:439)
> at
> org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.getShardsOfStream(KinesisProxy.java:389)
> at
> org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.getShardList(KinesisProxy.java:279)
> at
> org.apache.flink.streaming.connectors.kinesis.internals.KinesisDataFetcher.discoverNewShardsToSubscribe(KinesisDataFetcher.java:686)
> at
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.run(FlinkKinesisConsumer.java:287)
> at
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:100)
> at
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:63)
> {code}
> (The only change in the above text is the OPERATOR_NAME text where I removed
> some of the internal specifics of our system).
> This will reliably happen on a fresh cluster after submitting and cancelling
> our job 3 times.
> We are using the presto-s3 plugin, the CEP library and the Kinesis connector.
> Please let me know what other diagnostics would be useful.
> Tom
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-16397) [metric] flink metric graphite will format double metrics to "%2.2f"
[
https://issues.apache.org/jira/browse/FLINK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16397:
--
Affects Version/s: 1.9.2
1.10.0
> [metric] flink metric graphite will format double metrics to "%2.2f"
>
>
> Key: FLINK-16397
> URL: https://issues.apache.org/jira/browse/FLINK-16397
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
>Affects Versions: 1.9.2, 1.10.0
>Reporter: BlaBlabla
>Priority: Major
>
> I'm using flink GraphiteReporter to monitor metrics. But I found that the
> GraphiteReporter will convert double / float type metrics to the format :
> "%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric
> is loss of precision, like 0.00, 0.01 .
> it is bad :(
> For more detail, see the double format function in dropwizard metrics
> project::
> [https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
> {code:java}
> protected String format(double v) {
> // the Carbon plaintext format is pretty underspecified, but it seems
> like it just wants
> // US-formatted digits
> return String.format(Locale.US, "%2.2f", v);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Reopened] (FLINK-16397) flink metric graphite will format double metrics to "%2.2f"
[
https://issues.apache.org/jira/browse/FLINK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla reopened FLINK-16397:
---
There is a new feature to support custom floating point formatter in Graphite
reporter, can flink community consider to update the flink grahpite metric and
fix it?
h1. Support custom floating point formatter in Graphite reporter #1573
[https://github.com/dropwizard/metrics/pull/1573]
> flink metric graphite will format double metrics to "%2.2f"
> ---
>
> Key: FLINK-16397
> URL: https://issues.apache.org/jira/browse/FLINK-16397
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
>Affects Versions: 1.9.2, 1.10.0
>Reporter: BlaBlabla
>Priority: Major
>
> I'm using flink GraphiteReporter to monitor metrics. But I found that the
> GraphiteReporter will convert double / float type metrics to the format :
> "%2.2f", only keep two fractions. For instance, Status.JVM.CPU.Load metric
> is loss of precision, like 0.00, 0.01 .
> it is bad :(
> For more detail, see the double format function in dropwizard metrics
> project::
> [https://github.com/dropwizard/metrics/blob/4.1-development/metrics-graphite/src/main/java/com/codahale/metrics/graphite/GraphiteReporter.java#L401]
> {code:java}
> protected String format(double v) {
> // the Carbon plaintext format is pretty underspecified, but it seems
> like it just wants
> // US-formatted digits
> return String.format(Locale.US, "%2.2f", v);
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-16058) Could not start TaskManager in flink 1.10.0
[
https://issues.apache.org/jira/browse/FLINK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16058:
--
Description:
Hello ,
When I submit a app on yarn in Flink 1.10.0:
But there is a error could not find commons-cli package jar:
{code:java}
2020-02-14 18:07:28,047 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_03.
2020-02-14 18:07:28,045 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_02.
java.lang.NoSuchMethodError:
org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
at
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.(CommandLineOptions.java:28)
at
org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
at
java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
at
org.apache.flink.runtime.clusterframework.BootstrapTools.getDynamicPropertiesAsString(BootstrapTools.java:653)
at
org.apache.flink.yarn.YarnResourceManager.createTaskExecutorLaunchContext(YarnResourceManager.java:578)
at
org.apache.flink.yarn.YarnResourceManager.startTaskExecutorInContainer(YarnResourceManager.java:384)
at java.lang.Iterable.forEach(Iterable.java:75)
at
org.apache.flink.yarn.YarnResourceManager.lambda$onContainersAllocated$1(YarnResourceManager.java:366)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
at akka.actor.ActorCell.invoke(ActorCell.scala:561)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
at akka.dispatch.Mailbox.run(Mailbox.scala:225)
at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2020-02-14 18:07:28,046 INFO org.apache.flink.yarn.YarnResourceManager -
Requesting new TaskExecutor container with resources .
Number pending requests 1.
2020-02-14 18:07:28,047 INFO org.apache.flink.yarn.YarnResourceManager -
TaskExecutor container_e28_1578502086570_2319694_01_03 will be started on
ip-10-128-158-97.idata-server.shopee.io with TaskExecutorProcessSpec
{cpuCores=4.0, frameworkHeapSize=128.000mb (134217728 bytes),
frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=2.403gb
(2580335775 bytes), taskOffHeapSize=0 bytes, networkMemSize=543.360mb
(569754262 bytes), managedMemorySize=2.123gb (2279017051 bytes),
jvmMetaspaceSize=96.000mb (100663296 bytes), jvmOverheadSize=614.400mb
(644245104 bytes)}.
2020-02-14 18:07:28,047 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_03.
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions
at
org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
at java.util.HashMap$KeySp
[jira] [Created] (FLINK-16058) Could not start TaskManager in flink 1.10.0
BlaBlabla created FLINK-16058:
-
Summary: Could not start TaskManager in flink 1.10.0
Key: FLINK-16058
URL: https://issues.apache.org/jira/browse/FLINK-16058
Project: Flink
Issue Type: Bug
Components: Client / Job Submission
Affects Versions: 1.10.0
Reporter: BlaBlabla
Hello ,
When I summit the app on yarn in flink 1.10.0:
But there is a error could not find commons-cli package jar:
{code:java}
2020-02-14 18:07:28,047 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_03.
2020-02-14 18:07:28,045 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_02.
java.lang.NoSuchMethodError:
org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
at
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.(CommandLineOptions.java:28)
at
org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
at
java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
at
org.apache.flink.runtime.clusterframework.BootstrapTools.getDynamicPropertiesAsString(BootstrapTools.java:653)
at
org.apache.flink.yarn.YarnResourceManager.createTaskExecutorLaunchContext(YarnResourceManager.java:578)
at
org.apache.flink.yarn.YarnResourceManager.startTaskExecutorInContainer(YarnResourceManager.java:384)
at java.lang.Iterable.forEach(Iterable.java:75)
at
org.apache.flink.yarn.YarnResourceManager.lambda$onContainersAllocated$1(YarnResourceManager.java:366)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
at akka.actor.ActorCell.invoke(ActorCell.scala:561)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
at akka.dispatch.Mailbox.run(Mailbox.scala:225)
at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2020-02-14 18:07:28,046 INFO org.apache.flink.yarn.YarnResourceManager -
Requesting new TaskExecutor container with resources .
Number pending requests 1.
2020-02-14 18:07:28,047 INFO org.apache.flink.yarn.YarnResourceManager -
TaskExecutor container_e28_1578502086570_2319694_01_03 will be started on
ip-10-128-158-97.idata-server.shopee.io with TaskExecutorProcessSpec
{cpuCores=4.0, frameworkHeapSize=128.000mb (134217728 bytes),
frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=2.403gb
(2580335775 bytes), taskOffHeapSize=0 bytes, networkMemSize=543.360mb
(569754262 bytes), managedMemorySize=2.123gb (2279017051 bytes),
jvmMetaspaceSize=96.000mb (100663296 bytes), jvmOverheadSize=614.400mb
(644245104 bytes)}.
2020-02-14 18:07:28,047 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_03.
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions
at
org.apache.flink.runtime.clusterframew
[jira] [Updated] (FLINK-16058) Could not start TaskManager in flink 1.10.0
[
https://issues.apache.org/jira/browse/FLINK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16058:
--
Description:
Hello ,
When I submit a app on yarn in Flink 1.10.0:
But there is a error could not find commons-cli package jar:
{code:java}
2020-02-14 18:07:28,045 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_02.
java.lang.NoSuchMethodError:
org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
at
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.(CommandLineOptions.java:28)
at
org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
at
java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
at
org.apache.flink.runtime.clusterframework.BootstrapTools.getDynamicPropertiesAsString(BootstrapTools.java:653)
at
org.apache.flink.yarn.YarnResourceManager.createTaskExecutorLaunchContext(YarnResourceManager.java:578)
at
org.apache.flink.yarn.YarnResourceManager.startTaskExecutorInContainer(YarnResourceManager.java:384)
at java.lang.Iterable.forEach(Iterable.java:75)
at
org.apache.flink.yarn.YarnResourceManager.lambda$onContainersAllocated$1(YarnResourceManager.java:366)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
at akka.actor.ActorCell.invoke(ActorCell.scala:561)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
at akka.dispatch.Mailbox.run(Mailbox.scala:225)
at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2020-02-14 18:07:28,046 INFO org.apache.flink.yarn.YarnResourceManager -
Requesting new TaskExecutor container with resources .
Number pending requests 1.
2020-02-14 18:07:28,047 INFO org.apache.flink.yarn.YarnResourceManager -
TaskExecutor container_e28_1578502086570_2319694_01_03 will be started on
ip-10-128-158-97.idata-server.shopee.io with TaskExecutorProcessSpec
{cpuCores=4.0, frameworkHeapSize=128.000mb (134217728 bytes),
frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=2.403gb
(2580335775 bytes), taskOffHeapSize=0 bytes, networkMemSize=543.360mb
(569754262 bytes), managedMemorySize=2.123gb (2279017051 bytes),
jvmMetaspaceSize=96.000mb (100663296 bytes), jvmOverheadSize=614.400mb
(644245104 bytes)}.
2020-02-14 18:07:28,047 ERROR org.apache.flink.yarn.YarnResourceManager - Could
not start TaskManager in container
container_e28_1578502086570_2319694_01_03.
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions
at
org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at
java.util.stream.AbstractPipeline
[jira] [Commented] (FLINK-16058) Could not start TaskManager in flink 1.10.0
[
https://issues.apache.org/jira/browse/FLINK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036885#comment-17036885
]
BlaBlabla commented on FLINK-16058:
---
I added commons-cli-1.3.1 jar in flink yarn ship library, it works now. I'm
not sure whether it was caused by including commons-cli-1.2.jar in current
hadoop share library
> Could not start TaskManager in flink 1.10.0
>
>
> Key: FLINK-16058
> URL: https://issues.apache.org/jira/browse/FLINK-16058
> Project: Flink
> Issue Type: Bug
> Components: Client / Job Submission
>Affects Versions: 1.10.0
>Reporter: BlaBlabla
>Priority: Major
>
> Hello ,
>
> When I submit a app on yarn in Flink 1.10.0:
> But there is a error could not find commons-cli package jar:
> {code:java}
> 2020-02-14 18:07:28,045 ERROR org.apache.flink.yarn.YarnResourceManager -
> Could not start TaskManager in container
> container_e28_1578502086570_2319694_01_02.
> java.lang.NoSuchMethodError:
> org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
> at
> org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.(CommandLineOptions.java:28)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
> at
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
> at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
> at
> java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
> at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.getDynamicPropertiesAsString(BootstrapTools.java:653)
> at
> org.apache.flink.yarn.YarnResourceManager.createTaskExecutorLaunchContext(YarnResourceManager.java:578)
> at
> org.apache.flink.yarn.YarnResourceManager.startTaskExecutorInContainer(YarnResourceManager.java:384)
> at java.lang.Iterable.forEach(Iterable.java:75)
> at
> org.apache.flink.yarn.YarnResourceManager.lambda$onContainersAllocated$1(YarnResourceManager.java:366)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
> at
> org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
> at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
> at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
> at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> 2020-02-14 18:07:28,046 INFO org.apache.flink.yarn.YarnResourceManager -
> Requesting new TaskExecutor container with resources .
> Number pending requests 1.
> 2020-02-14 18:07:28,047 INFO org.apache.flink.yarn.YarnResourceManager -
> TaskExecutor container_e28_1578502086570_2319694_01_03 will be started on
> ip-10-128-158-97.idata-server.shopee.io with TaskExecutorProcessSpec
> {cpuCores=4.0, frameworkHeapSize=128.000mb (134217728 bytes),
> frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=2.403gb
> (2580335775 bytes), taskOffHeapSize=0 bytes, networkMemSize=543.360mb
> (569754262 bytes), managedMemorySize=2.123gb (2279017051 bytes),
> jvmMetaspaceSize=96.
[jira] [Updated] (FLINK-16058) Could not start TaskManager in flink 1.10.0
[
https://issues.apache.org/jira/browse/FLINK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla updated FLINK-16058:
--
Component/s: (was: Client / Job Submission)
Deployment / YARN
> Could not start TaskManager in flink 1.10.0
>
>
> Key: FLINK-16058
> URL: https://issues.apache.org/jira/browse/FLINK-16058
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.10.0
>Reporter: BlaBlabla
>Priority: Major
>
> Hello ,
>
> When I submit a app on yarn in Flink 1.10.0:
> But there is a error could not find commons-cli package jar:
> {code:java}
> 2020-02-14 18:07:28,045 ERROR org.apache.flink.yarn.YarnResourceManager -
> Could not start TaskManager in container
> container_e28_1578502086570_2319694_01_02.
> java.lang.NoSuchMethodError:
> org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
> at
> org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.(CommandLineOptions.java:28)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
> at
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
> at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
> at
> java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
> at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.getDynamicPropertiesAsString(BootstrapTools.java:653)
> at
> org.apache.flink.yarn.YarnResourceManager.createTaskExecutorLaunchContext(YarnResourceManager.java:578)
> at
> org.apache.flink.yarn.YarnResourceManager.startTaskExecutorInContainer(YarnResourceManager.java:384)
> at java.lang.Iterable.forEach(Iterable.java:75)
> at
> org.apache.flink.yarn.YarnResourceManager.lambda$onContainersAllocated$1(YarnResourceManager.java:366)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
> at
> org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
> at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
> at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
> at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> 2020-02-14 18:07:28,046 INFO org.apache.flink.yarn.YarnResourceManager -
> Requesting new TaskExecutor container with resources .
> Number pending requests 1.
> 2020-02-14 18:07:28,047 INFO org.apache.flink.yarn.YarnResourceManager -
> TaskExecutor container_e28_1578502086570_2319694_01_03 will be started on
> ip-10-128-158-97.idata-server.shopee.io with TaskExecutorProcessSpec
> {cpuCores=4.0, frameworkHeapSize=128.000mb (134217728 bytes),
> frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=2.403gb
> (2580335775 bytes), taskOffHeapSize=0 bytes, networkMemSize=543.360mb
> (569754262 bytes), managedMemorySize=2.123gb (2279017051 bytes),
> jvmMetaspaceSize=96.000mb (100663296 bytes), jvmOverheadSize=614.400mb
> (644245104 bytes)}.
> 2020-02-14 18:07:28,047 ERROR org.apache.flink.yarn.YarnResourceManager -
>
[jira] [Commented] (FLINK-16058) Could not start TaskManager in flink 1.10.0
[
https://issues.apache.org/jira/browse/FLINK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038752#comment-17038752
]
BlaBlabla commented on FLINK-16058:
---
[~libenchao] thanks for noticing , I will seed to that email group in the
future. [~fly_in_gis] thanks also
> Could not start TaskManager in flink 1.10.0
>
>
> Key: FLINK-16058
> URL: https://issues.apache.org/jira/browse/FLINK-16058
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.10.0
>Reporter: BlaBlabla
>Priority: Major
>
> Hello ,
>
> When I submit a app on yarn in Flink 1.10.0:
> But there is a error could not find commons-cli package jar:
> {code:java}
> 2020-02-14 18:07:28,045 ERROR org.apache.flink.yarn.YarnResourceManager -
> Could not start TaskManager in container
> container_e28_1578502086570_2319694_01_02.
> java.lang.NoSuchMethodError:
> org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
> at
> org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.(CommandLineOptions.java:28)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
> at
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
> at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
> at
> java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
> at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.getDynamicPropertiesAsString(BootstrapTools.java:653)
> at
> org.apache.flink.yarn.YarnResourceManager.createTaskExecutorLaunchContext(YarnResourceManager.java:578)
> at
> org.apache.flink.yarn.YarnResourceManager.startTaskExecutorInContainer(YarnResourceManager.java:384)
> at java.lang.Iterable.forEach(Iterable.java:75)
> at
> org.apache.flink.yarn.YarnResourceManager.lambda$onContainersAllocated$1(YarnResourceManager.java:366)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
> at
> org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
> at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
> at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
> at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> 2020-02-14 18:07:28,046 INFO org.apache.flink.yarn.YarnResourceManager -
> Requesting new TaskExecutor container with resources .
> Number pending requests 1.
> 2020-02-14 18:07:28,047 INFO org.apache.flink.yarn.YarnResourceManager -
> TaskExecutor container_e28_1578502086570_2319694_01_03 will be started on
> ip-10-128-158-97.idata-server.shopee.io with TaskExecutorProcessSpec
> {cpuCores=4.0, frameworkHeapSize=128.000mb (134217728 bytes),
> frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=2.403gb
> (2580335775 bytes), taskOffHeapSize=0 bytes, networkMemSize=543.360mb
> (569754262 bytes), managedMemorySize=2.123gb (2279017051 bytes),
> jvmMetaspaceSize=96.000mb (100663296 bytes), jvmOverheadSize=614.400mb
> (644245104 bytes)}
[jira] [Closed] (FLINK-16058) Could not start TaskManager in flink 1.10.0
[
https://issues.apache.org/jira/browse/FLINK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BlaBlabla closed FLINK-16058.
-
Resolution: Won't Fix
> Could not start TaskManager in flink 1.10.0
>
>
> Key: FLINK-16058
> URL: https://issues.apache.org/jira/browse/FLINK-16058
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.10.0
>Reporter: BlaBlabla
>Priority: Major
>
> Hello ,
>
> When I submit a app on yarn in Flink 1.10.0:
> But there is a error could not find commons-cli package jar:
> {code:java}
> 2020-02-14 18:07:28,045 ERROR org.apache.flink.yarn.YarnResourceManager -
> Could not start TaskManager in container
> container_e28_1578502086570_2319694_01_02.
> java.lang.NoSuchMethodError:
> org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
> at
> org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.(CommandLineOptions.java:28)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.lambda$getDynamicPropertiesAsString$0(BootstrapTools.java:647)
> at
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
> at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1553)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
> at
> java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
> at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
> at
> org.apache.flink.runtime.clusterframework.BootstrapTools.getDynamicPropertiesAsString(BootstrapTools.java:653)
> at
> org.apache.flink.yarn.YarnResourceManager.createTaskExecutorLaunchContext(YarnResourceManager.java:578)
> at
> org.apache.flink.yarn.YarnResourceManager.startTaskExecutorInContainer(YarnResourceManager.java:384)
> at java.lang.Iterable.forEach(Iterable.java:75)
> at
> org.apache.flink.yarn.YarnResourceManager.lambda$onContainersAllocated$1(YarnResourceManager.java:366)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
> at
> org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
> at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
> at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
> at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
> at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
> at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> 2020-02-14 18:07:28,046 INFO org.apache.flink.yarn.YarnResourceManager -
> Requesting new TaskExecutor container with resources .
> Number pending requests 1.
> 2020-02-14 18:07:28,047 INFO org.apache.flink.yarn.YarnResourceManager -
> TaskExecutor container_e28_1578502086570_2319694_01_03 will be started on
> ip-10-128-158-97.idata-server.shopee.io with TaskExecutorProcessSpec
> {cpuCores=4.0, frameworkHeapSize=128.000mb (134217728 bytes),
> frameworkOffHeapSize=128.000mb (134217728 bytes), taskHeapSize=2.403gb
> (2580335775 bytes), taskOffHeapSize=0 bytes, networkMemSize=543.360mb
> (569754262 bytes), managedMemorySize=2.123gb (2279017051 bytes),
> jvmMetaspaceSize=96.000mb (100663296 bytes), jvmOverheadSize=614.400mb
> (644245104 bytes)}.
> 2020-02-14 18:07:28,047 ERROR org.apache.flink.yarn.YarnResourceManager -
> Could not start TaskManager in container
> container_e28_15785
