Dear Team,
We are facing the below issue while connecting to confluent kafka
Can someone please help here.
2023-11-23 06:09:36,989 INFO org.apache.flink.runtime.executiongraph.
ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (1/1)
(496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
switched from SCHEDULED to DEPLOYING.
2023-11-23 06:09:36,994 INFO org.apache.flink.runtime.executiongraph.
ExecutionGraph [] - Deploying Source: src_source -> Sink: Print to Std.
Out (1/1) (attempt #0) with attempt id
496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0
and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to flink-taskmanager:6122-
23f057 @ flink-taskmanager.flink.svc.cluster.local (dataPort=46589) with
allocation id 80fe79389102bd305dd87a00247413eb
2023-11-23 06:09:37,011 INFO
org.apache.kafka.common.security.authenticator.AbstractLogin [] -
Successfully logged in.
2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
AdminClientConfig [] - The configuration 'key.deserializer' was
supplied but isn't a known config.
2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
AdminClientConfig [] - The configuration 'value.deserializer'
was supplied but isn't a known config.
2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
AdminClientConfig [] - The configuration 'client.id.prefix' was
supplied but isn't a known config.
2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
AdminClientConfig [] - The configuration '
partition.discovery.interval.ms' was supplied but isn't a known config.
2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
AdminClientConfig [] - The configuration
'commit.offsets.on.checkpoint' was supplied but isn't a known config.
2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
AdminClientConfig [] - The configuration 'enable.auto.commit'
was supplied but isn't a known config.
2023-11-23 06:09:37,111 WARN org.apache.kafka.clients.admin.
AdminClientConfig [] - The configuration 'auto.offset.reset'
was supplied but isn't a known config.
2023-11-23 06:09:37,113 INFO org.apache.kafka.common.utils.AppInfoParser
[] - Kafka version: 3.2.2
2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.AppInfoParser
[] - Kafka commitId: 38c22ad893fb6cf5
2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.AppInfoParser
[] - Kafka startTimeMs: 1700719777111
2023-11-23 06:09:37,117 INFO
org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
[] - Starting the KafkaSourceEnumerator for consumer group null without
periodic partition discovery.
2023-11-23 06:09:37,199 INFO org.apache.flink.runtime.executiongraph.
ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (1/1)
(496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
switched from DEPLOYING to INITIALIZING.
2023-11-23 06:09:37,302 INFO org.apache.flink.runtime.source.coordinator.
SourceCoordinator [] - Source Source: src_source registering reader for
parallel task 0 (#0) @ flink-taskmanager
2023-11-23 06:09:37,313 INFO org.apache.flink.runtime.executiongraph.
ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (1/1)
(496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
switched from INITIALIZING to RUNNING.
2023-11-23 06:09:38,713 INFO
org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
[] - Discovered new partitions: [aiops-3, aiops-2, aiops-1, aiops-0, aiops-5,
aiops-4]
2023-11-23 06:09:38,719 INFO
org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
[] - Assigning splits to readers {0=[[Partition: aiops-1, StartingOffset: -1,
StoppingOffset: -9223372036854775808], [Partition: aiops-2, StartingOffset:
-1, StoppingOffset: -9223372036854775808], [Partition: aiops-0,
StartingOffset: -1, StoppingOffset: -9223372036854775808], [Partition:
aiops-4, StartingOffset: -1, StoppingOffset: -9223372036854775808], [
Partition: aiops-3, StartingOffset: -1, StoppingOffset: -9223372036854775808],
[Partition: aiops-5, StartingOffset: -1, StoppingOffset: -
9223372036854775808]]}
2023-11-23 06:09:57,651 INFO akka.remote.transport.ProtocolStateActor
[] - No response from remote for outbound association.
Associate timed out after [20000 ms].
2023-11-23 06:09:57,651 WARN akka.remote.ReliableDeliverySupervisor
[] - Association with remote system
[akka.tcp://flink-metrics@flink-taskmanager:33837] has failed, address is
now gated for [50] ms. Reason: [Association failed with
[akka.tcp://flink-metrics@flink-taskmanager:33837]] Caused by: [No response
from remote for outbound association. Associate timed out after [20000 ms].]
2023-11-23 06:09:57,668 WARN akka.remote.transport.netty.NettyTransport
[] - Remote connection to [null] failed with
org.jboss.netty.channel.ConnectTimeoutException: connection timed out:
flink-taskmanager/172.20.208.151:33837
2023-11-23 06:14:38,188 INFO org.apache.kafka.clients.NetworkClient
[] - [AdminClient
clientId=KafkaSource-7770001137980494918-enumerator-admin-client]
Node -1 disconnected.
2023-11-23 06:19:38,354 INFO org.apache.kafka.clients.NetworkClient
[] - [AdminClient
clientId=KafkaSource-7770001137980494918-enumerator-admin-client]
Node 9 disconnected.
2023-11-23 06:24:39,060 INFO org.apache.kafka.clients.NetworkClient
[] - [AdminClient
clientId=KafkaSource-7770001137980494918-enumerator-admin-client]
Node 6 disconnected.
2023-11-23 06:29:39,801 INFO org.apache.kafka.clients.NetworkClient
[] - [AdminClient
clientId=KafkaSource-7770001137980494918-enumerator-admin-client]
Node 8 disconnected.
2023-11-23 06:34:40,544 INFO org.apache.kafka.clients.NetworkClient
[] - [AdminClient
clientId=KafkaSource-7770001137980494918-enumerator-admin-client]
Node 13 disconnected.
2023-11-23 06:39:41,245 INFO org.apache.kafka.clients.NetworkClient
[] - [AdminClient
clientId=KafkaSource-7770001137980494918-enumerator-admin-client]
Node 3 disconnected.
2023-11-23 06:44:41,976 INFO org.apache.kafka.clients.NetworkClient
[] - [AdminClient
clientId=KafkaSource-7770001137980494918-enumerator-admin-client]
Node 2 disconnected.
Thanks,
Tauseef
