Flink CDC Issue Import created FLINK-34755:
----------------------------------------------
Summary: Encountered a problem reading tidb data
Key: FLINK-34755
URL: https://issues.apache.org/jira/browse/FLINK-34755
Project: Flink
Issue Type: Bug
Components: Flink CDC
Reporter: Flink CDC Issue Import
**Describe the bug(Please use English)**
The console has been updated as follows when reading tidb, using print.sink,
but the console has no data printing.
**Environment :**
- Flink version : 1.14.5
- Flink CDC version: 2.3.0
- Database and version: tidb-v6.1.0
**To Reproduce**
Steps to reproduce the behavior:
1. The test code to connect to tidb :
```
" ) WITH ( " +
" 'connector' = 'tidb-cdc'," +
" 'scan.startup.mode' = 'latest-offset'," +
" 'tikv.grpc.timeout_in_ms' = '20000', " +
" 'pd-addresses' = '192.168.100.10:2379'," +
" 'database-name' = 'device'," +
" 'table-name' = 'real_time_record'" +
" )";
```
1. The error :
```
[pool-24-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.234:20160] is not reachable
[pool-20-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.234:20160] is not reachable
[pool-26-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.71:20160] is not reachable
[pool-27-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.71:20160] is not reachable
[pool-23-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.71:20160] is not reachable
[pool-22-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.234:20160] is not reachable
[pool-25-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.64:20160] is not reachable
[pool-21-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.71:20160] is not reachable
[pool-26-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.64:20160] is not reachable
[pool-23-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.234:20160] is not reachable
[pool-27-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.234:20160] is not reachable
[pool-25-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.71:20160] is not reachable
[pool-21-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.234:20160] is not reachable
[pool-22-thread-1] WARN org.tikv.common.region.StoreHealthyChecker - store
[172.16.0.64:20160] is not reachable
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(5/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(1/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(6/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(8/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(3/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(4/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(5/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(2/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(3/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(6/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(2/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(7/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862555353140, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(7/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(4/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(8/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(1/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453862817497106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(8/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(3/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(6/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(4/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(1/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(5/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(5/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(3/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(6/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(2/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(2/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(7/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863079641102, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(7/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(4/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(4/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863603929106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(8/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(8/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863603929106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(2/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863603929106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(1/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863341785118, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(1/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863603929106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(1/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863879180289, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(5/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863603929106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(5/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863879180289, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(6/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863603929106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(8/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863879180289, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(6/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863879180289, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(4/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863879180289, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(3/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863603929106, regionId: 213496
[Legacy Source Thread - Source: TableSourceScan(table=[[default_catalog,
default_database, time_record]], fields=[id, employee_id, date, fence_status])
(3/8)([#0|https://github.com/apache/flink-cdc/issues/0] |
[FLINK-0|https://issues.apache.org/jira/browse/FLINK-0])] INFO
org.tikv.cdc.CDCClient - handle resolvedTs: 437453863879180289, regionId: 213496
[PDClient-update-leader-pool-0] WARN org.tikv.common.PDClient - failed to get
member from pd server.
org.tikv.shade.io.grpc.StatusRuntimeException: UNAVAILABLE: Keepalive failed.
The connection is likely gone
at
org.tikv.shade.io.grpc.stub.ClientCalls.toStatusRuntimeException(ClientCalls.java:287)
at
org.tikv.shade.io.grpc.stub.ClientCalls.getUnchecked(ClientCalls.java:268)
at
org.tikv.shade.io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:175)
at org.tikv.kvproto.PDGrpc$PDBlockingStub.getMembers(PDGrpc.java:1868)
at org.tikv.common.PDClient.getMembers(PDClient.java:443)
at org.tikv.common.PDClient.tryUpdateLeader(PDClient.java:565)
at org.tikv.common.PDClient.lambda$initCluster$15(PDClient.java:730)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[PDClient-update-leader-pool-0] WARN org.tikv.common.PDClient - failed to get
member from pd server.
```
**Additional Description**
If applicable, add screenshots to help explain your problem.
---------------- Imported from GitHub ----------------
Url: https://github.com/apache/flink-cdc/issues/1761
Created by: [dadong-13|https://github.com/dadong-13]
Labels: bug,
Created at: Fri Nov 18 16:57:15 CST 2022
State: open
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
