????????????????????????jar????????????????flink????????????????????????flink????????
------------------ ???????? ------------------ ??????: "rockey...@163.com"<rockey...@163.com>; ????????: 2019??7??26??(??????) ????10:22 ??????: "user-zh"<user-zh@flink.apache.org>; ????: Re: Re: flink kafka???????????????? ???? taskmanager ???? ??????zhisheng?? ?????????????? flink-metrics-prometheus???????????????????????????? ?????? org/apache/kafka/common/metrics/stats/Rate$1 ????????????????????flink???????????? rockey...@163.com ???????? zhisheng ?????????? 2019-07-25 17:27 ???????? user-zh ?????? Re: flink kafka???????????????? ???? taskmanager ???? hi??rockeycui ?????????? flink-metrics-prometheus ?? report metrics ?????????????????? metrics ?????????? rockey...@163.com <rockey...@163.com> ??2019??7??25?????? ????5:12?????? > ??????flink ?????????????????????????????????????????????? > > 2019-07-23 10:52:01,420 INFO org.apache.kafka.common.utils.AppInfoParser > - Kafka version : 0.9.0.1 > 2019-07-23 10:52:01,420 INFO org.apache.kafka.common.utils.AppInfoParser > - Kafka commitId : 23c69d62a0cabf06 > 2019-07-23 10:52:01,560 INFO org.apache.flink.runtime.taskmanager.Task > - Attempting to cancel task Source: Custom Source -> Map > -> Filter -> Map -> Map -> to: Row -> Map -> Sink: Unnamed (3/3) > (02dd0b294a75cb672899e83c53985034). > 2019-07-23 10:52:01,560 INFO org.apache.flink.runtime.taskmanager.Task > - Source: Custom Source -> Map -> Filter -> Map -> Map -> > to: Row -> Map -> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034) > switched from RUNNING to CANCELING. > 2019-07-23 10:52:01,560 INFO org.apache.flink.runtime.taskmanager.Task > - Triggering cancellation of task code Source: Custom > Source -> Map -> Filter -> Map -> Map -> to: Row -> Map -> Sink: Unnamed > (3/3) (02dd0b294a75cb672899e83c53985034). > 2019-07-23 10:52:01,563 INFO > org.apache.kafka.clients.producer.KafkaProducer - Closing the > Kafka producer with timeoutMillis = 9223372036854775807 ms. > 2019-07-23 10:52:01,571 INFO org.apache.flink.runtime.taskmanager.Task > - Source: Custom Source -> Map -> Filter -> Map -> Map -> > to: Row -> Map -> Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034) > switched from CANCELING to CANCELED. > 2019-07-23 10:52:01,571 INFO org.apache.flink.runtime.taskmanager.Task > - Freeing task resources for Source: Custom Source -> Map > -> Filter -> Map -> Map -> to: Row -> Map -> Sink: Unnamed (3/3) > (02dd0b294a75cb672899e83c53985034). > 2019-07-23 10:52:01,572 INFO org.apache.flink.runtime.taskmanager.Task > - Ensuring all FileSystem streams are closed for task > Source: Custom Source -> Map -> Filter -> Map -> Map -> to: Row -> Map -> > Sink: Unnamed (3/3) (02dd0b294a75cb672899e83c53985034) [CANCELED] > 2019-07-23 10:52:01,572 INFO > org.apache.flink.runtime.taskexecutor.TaskExecutor - > Un-registering task and sending final execution state CANCELED to > JobManager for task Source: Custom Source -> Map -> Filter -> Map -> Map -> > to: Row -> Map -> Sink: Unnamed 02dd0b294a75cb672899e83c53985034. > 2019-07-23 10:52:01,574 ERROR > org.apache.flink.runtime.util.FatalExitExceptionHandler - FATAL: > Thread 'flink-metrics-57' produced an uncaught exception. Stopping the > process... > java.lang.NoClassDefFoundError: > org/apache/kafka/common/metrics/stats/Rate$1 > at org.apache.kafka.common.metrics.stats.Rate.convert(Rate.java:98) > at org.apache.kafka.common.metrics.stats.Rate.measure(Rate.java:67) > at org.apache.kafka.common.metrics.KafkaMetric.value(KafkaMetric.java:61) > at org.apache.kafka.common.metrics.KafkaMetric.value(KafkaMetric.java:52) > at > org.apache.flink.streaming.connectors.kafka.internal.metrics.KafkaMetricMutableWrapper.getValue(KafkaMetricMutableWrapper.java:39) > at > org.apache.flink.streaming.connectors.kafka.internal.metrics.KafkaMetricMutableWrapper.getValue(KafkaMetricMutableWrapper.java:29) > at > org.apache.flink.runtime.metrics.dump.MetricDumpSerialization.serializeGauge(MetricDumpSerialization.java:254) > at > org.apache.flink.runtime.metrics.dump.MetricDumpSerialization.access$200(MetricDumpSerialization.java:53) > at > org.apache.flink.runtime.metrics.dump.MetricDumpSerialization$MetricDumpSerializer.serialize(MetricDumpSerialization.java:166) > at > org.apache.flink.runtime.metrics.dump.MetricQueryService.onReceive(MetricQueryService.java:118) > at > akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:165) > at akka.actor.Actor$class.aroundReceive(Actor.scala:502) > at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:95) > at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526) > at akka.actor.ActorCell.invoke(ActorCell.scala:495) > at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257) > at akka.dispatch.Mailbox.run(Mailbox.scala:224) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.ClassNotFoundException: > org.apache.kafka.common.metrics.stats.Rate$1 > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at > org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader.loadClass(FlinkUserCodeClassLoaders.java:129) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 20 more > 2019-07-23 10:52:01,576 INFO > org.apache.flink.runtime.blob.TransientBlobCache - Shutting > down BLOB cache > 2019-07-23 10:52:01,576 INFO > org.apache.flink.runtime.blob.PermanentBlobCache - Shutting > down BLOB cache > 2019-07-23 10:52:01,577 INFO > org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - > Shutting down TaskExecutorLocalStateStoresManager. > 2019-07-23 10:52:01,580 INFO > org.apache.flink.runtime.io.disk.iomanager.IOManager > - I/O manager removed spill file directory > /tmp/flink-io-3e88d484-6424-4ae6-8eae-1694fa1ed526 > > > > > rockey...@163.com >