Thanks Hang.
I got it now. I will check on this and get back to you.
Thanks,
Tauseef.
On Thu, 23 Nov 2023 at 17:29, Hang Ruan <ruanhang1...@gmail.com> wrote:
> Hi, Tauseef.
>
> This error is not that you can not access the Kafka cluster. Actually,
> this error means that the JM cannot access its TM.
> Have you ever checked whether the JM is able to access the TM?
>
> Best,
> Hang
>
> Tauseef Janvekar <tauseefjanve...@gmail.com> 于2023年11月23日周四 16:04写道：
>
>> Dear Team,
>>
>> We are facing the below issue while connecting to confluent kafka
>> Can someone please help here.
>>
>> 2023-11-23 06:09:36,989 INFO org.apache.flink.runtime.executiongraph.
>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (
>> 1/1) (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>> switched from SCHEDULED to DEPLOYING.
>> 2023-11-23 06:09:36,994 INFO org.apache.flink.runtime.executiongraph.
>> ExecutionGraph [] - Deploying Source: src_source -> Sink: Print to
>> Std. Out (1/1) (attempt #0) with attempt id
>> 496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0
>> and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to flink-taskmanager:
>> 6122-23f057 @ flink-taskmanager.flink.svc.cluster.local (dataPort=46589)
>> with allocation id 80fe79389102bd305dd87a00247413eb
>> 2023-11-23 06:09:37,011 INFO
>> org.apache.kafka.common.security.authenticator.AbstractLogin [] -
>> Successfully logged in.
>> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
>> AdminClientConfig [] - The configuration 'key.deserializer'
>> was supplied but isn't a known config.
>> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
>> AdminClientConfig [] - The configuration 'value.deserializer'
>> was supplied but isn't a known config.
>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>> AdminClientConfig [] - The configuration 'client.id.prefix'
>> was supplied but isn't a known config.
>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>> AdminClientConfig [] - The configuration '
>> partition.discovery.interval.ms' was supplied but isn't a known config.
>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>> AdminClientConfig [] - The configuration
>> 'commit.offsets.on.checkpoint' was supplied but isn't a known config.
>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>> AdminClientConfig [] - The configuration 'enable.auto.commit'
>> was supplied but isn't a known config.
>> 2023-11-23 06:09:37,111 WARN org.apache.kafka.clients.admin.
>> AdminClientConfig [] - The configuration 'auto.offset.reset'
>> was supplied but isn't a known config.
>> 2023-11-23 06:09:37,113 INFO org.apache.kafka.common.utils.AppInfoParser
>> [] - Kafka version: 3.2.2
>> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.AppInfoParser
>> [] - Kafka commitId: 38c22ad893fb6cf5
>> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.AppInfoParser
>> [] - Kafka startTimeMs: 1700719777111
>> 2023-11-23 06:09:37,117 INFO
>> org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
>> [] - Starting the KafkaSourceEnumerator for consumer group null without
>> periodic partition discovery.
>> 2023-11-23 06:09:37,199 INFO org.apache.flink.runtime.executiongraph.
>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (
>> 1/1) (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>> switched from DEPLOYING to INITIALIZING.
>> 2023-11-23 06:09:37,302 INFO
>> org.apache.flink.runtime.source.coordinator.SourceCoordinator [] -
>> Source Source: src_source registering reader for parallel task 0 (#0) @
>> flink-taskmanager
>> 2023-11-23 06:09:37,313 INFO org.apache.flink.runtime.executiongraph.
>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (
>> 1/1) (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>> switched from INITIALIZING to RUNNING.
>> 2023-11-23 06:09:38,713 INFO
>> org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
>> [] - Discovered new partitions: [aiops-3, aiops-2, aiops-1, aiops-0,
>> aiops-5, aiops-4]
>> 2023-11-23 06:09:38,719 INFO
>> org.apache.flink.connector.kafka.source.enumerator.KafkaSourceEnumerator
>> [] - Assigning splits to readers {0=[[Partition: aiops-1, StartingOffset:
>> -1, StoppingOffset: -9223372036854775808], [Partition: aiops-2,
>> StartingOffset: -1, StoppingOffset: -9223372036854775808], [Partition:
>> aiops-0, StartingOffset: -1, StoppingOffset: -9223372036854775808], [
>> Partition: aiops-4, StartingOffset: -1, StoppingOffset: -
>> 9223372036854775808], [Partition: aiops-3, StartingOffset: -1,
>> StoppingOffset: -9223372036854775808], [Partition: aiops-5,
>> StartingOffset: -1, StoppingOffset: -9223372036854775808]]}
>> 2023-11-23 06:09:57,651 INFO akka.remote.transport.ProtocolStateActor
>> [] - No response from remote for outbound association.
>> Associate timed out after [20000 ms].
>> 2023-11-23 06:09:57,651 WARN akka.remote.ReliableDeliverySupervisor
>> [] - Association with remote system
>> [akka.tcp://flink-metrics@flink-taskmanager:33837] has failed, address
>> is now gated for [50] ms. Reason: [Association failed with
>> [akka.tcp://flink-metrics@flink-taskmanager:33837]] Caused by: [No
>> response from remote for outbound association. Associate timed out after
>> [20000 ms].]
>> 2023-11-23 06:09:57,668 WARN akka.remote.transport.netty.NettyTransport
>> [] - Remote connection to [null] failed with
>> org.jboss.netty.channel.ConnectTimeoutException: connection timed out:
>> flink-taskmanager/172.20.208.151:33837
>> 2023-11-23 06:14:38,188 INFO org.apache.kafka.clients.NetworkClient
>> [] - [AdminClient clientId=KafkaSource-
>> 7770001137980494918-enumerator-admin-client] Node -1 disconnected.
>> 2023-11-23 06:19:38,354 INFO org.apache.kafka.clients.NetworkClient
>> [] - [AdminClient clientId=KafkaSource-
>> 7770001137980494918-enumerator-admin-client] Node 9 disconnected.
>> 2023-11-23 06:24:39,060 INFO org.apache.kafka.clients.NetworkClient
>> [] - [AdminClient clientId=KafkaSource-
>> 7770001137980494918-enumerator-admin-client] Node 6 disconnected.
>> 2023-11-23 06:29:39,801 INFO org.apache.kafka.clients.NetworkClient
>> [] - [AdminClient clientId=KafkaSource-
>> 7770001137980494918-enumerator-admin-client] Node 8 disconnected.
>> 2023-11-23 06:34:40,544 INFO org.apache.kafka.clients.NetworkClient
>> [] - [AdminClient clientId=KafkaSource-
>> 7770001137980494918-enumerator-admin-client] Node 13 disconnected.
>> 2023-11-23 06:39:41,245 INFO org.apache.kafka.clients.NetworkClient
>> [] - [AdminClient clientId=KafkaSource-
>> 7770001137980494918-enumerator-admin-client] Node 3 disconnected.
>> 2023-11-23 06:44:41,976 INFO org.apache.kafka.clients.NetworkClient
>> [] - [AdminClient clientId=KafkaSource-
>> 7770001137980494918-enumerator-admin-client] Node 2 disconnected.
>>
>>
>> Thanks,
>> Tauseef
>>
>
