[ https://issues.apache.org/jira/browse/IOTDB-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
陈哲涵 reassigned IOTDB-4623: -------------------------- Assignee: 陈哲涵 (was: Gaofei Cao) > [ remove ConfigNode ] Surviving confignodes after removing other confignodes > need to be updated confignode_list > --------------------------------------------------------------------------------------------------------------- > > Key: IOTDB-4623 > URL: https://issues.apache.org/jira/browse/IOTDB-4623 > Project: Apache IoTDB > Issue Type: Bug > Components: mpp-cluster > Affects Versions: 0.14.0-SNAPSHOT > Reporter: 刘珍 > Assignee: 陈哲涵 > Priority: Major > Attachments: config.properties > > > master_1010_9917053 > 3 ConfigNode , Successfully removed 1 confignode (follower ,ip:port ,ip66) , > remove another follower confignode (NodeID ,ip68),{color:#DE350B}*Error > reported, but removed successfully *{color}: > 2022-10-12 10:40:21,083 [main] WARN > o.a.i.c.c.s.c.SyncConfigNodeClientPool:95 - REMOVE_CONFIG_NODE > {color:#DE350B}*failed on ConfigNode TEndPoint(ip:192.168.10.66, > port:22277)*{color}, because Borrow client from pool for node > TEndPoint(ip:192.168.10.66, port:22277) failed., retrying 5... > 2022-10-12 10:40:24,284 [main] ERROR > o.a.i.c.c.s.c.SyncConfigNodeClientPool:104 - REMOVE_CONFIG_NODE failed on > ConfigNode TEndPoint(ip:192.168.10.66, port:22277) > java.io.IOException: Borrow client from pool for node > TEndPoint(ip:192.168.10.66, port:22277) failed. > at > org.apache.iotdb.commons.client.ClientManager.borrowClient(ClientManager.java:61) > at > org.apache.iotdb.confignode.client.sync.confignode.SyncConfigNodeClientPool.sendSyncRequestToConfigNodeWithRetry(SyncConfigNodeClientPool.java:72) > at > org.apache.iotdb.confignode.conf.ConfigNodeRemoveCheck.removeConfigNode(ConfigNodeRemoveCheck.java:98) > at > org.apache.iotdb.confignode.service.ConfigNodeCommandLine.doRemoveNode(ConfigNodeCommandLine.java:112) > at > org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:83) > at > org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58) > at > org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:71) > Caused by: net.sf.cglib.core.CodeGenerationException: > org.apache.thrift.transport.TTransportException-->java.net.ConnectException: > Connection refused (Connection refused) > at net.sf.cglib.core.ReflectUtils.newInstance(ReflectUtils.java:235) > at net.sf.cglib.core.ReflectUtils.newInstance(ReflectUtils.java:220) > at > net.sf.cglib.proxy.Enhancer.createUsingReflection(Enhancer.java:639) > at net.sf.cglib.proxy.Enhancer.firstInstance(Enhancer.java:538) > at > net.sf.cglib.core.AbstractClassGenerator.create(AbstractClassGenerator.java:231) > at net.sf.cglib.proxy.Enhancer.createHelper(Enhancer.java:377) > at net.sf.cglib.proxy.Enhancer.create(Enhancer.java:304) > at > org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.newErrorHandler(SyncThriftClientWithErrorHandler.java:48) > at > org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$Factory.makeObject(SyncConfigNodeIServiceClient.java:115) > at > org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$Factory.makeObject(SyncConfigNodeIServiceClient.java:94) > at > org.apache.commons.pool2.impl.GenericKeyedObjectPool.create(GenericKeyedObjectPool.java:780) > at > org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:439) > at > org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:350) > at > org.apache.iotdb.commons.client.ClientManager.borrowClient(ClientManager.java:50) > ... 6 common frames omitted > Caused by: org.apache.thrift.transport.TTransportException: > java.net.ConnectException: Connection refused (Connection refused) > at org.apache.thrift.transport.TSocket.open(TSocket.java:243) > at > org.apache.iotdb.rpc.TElasticFramedTransport.open(TElasticFramedTransport.java:91) > at > org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient.<init>(SyncConfigNodeIServiceClient.java:62) > at > org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$763d90ac.<init>(<generated>) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at net.sf.cglib.core.ReflectUtils.newInstance(ReflectUtils.java:228) > ... 19 common frames omitted > Caused by: java.net.ConnectException: Connection refused (Connection refused) > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:476) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:218) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:200) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:394) > at java.net.Socket.connect(Socket.java:606) > at org.apache.thrift.transport.TSocket.open(TSocket.java:238) > ... 27 common frames omitted > 2022-10-12 10:40:26,358 [main] {color:#DE350B}*INFO > o.a.i.c.s.ConfigNodeCommandLine:116 - IoTDB-ConfigNode is removed.*{color} > Test environment > 1. 192.168.10.62/66/68 > ConfigNode : > MAX_HEAP_SIZE="8G" > MAX_DIRECT_MEMORY_SIZE="8G" > schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus > data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus > schema_replication_factor=3 > data_replication_factor=3 > DataNode : > MAX_HEAP_SIZE="192G" > MAX_DIRECT_MEMORY_SIZE="32G" > max_connection_for_internal_service=1100 > enable_timed_flush_seq_memtable=true > seq_memtable_flush_interval_in_ms=3600000 > seq_memtable_flush_check_interval_in_ms=600000 > enable_timed_flush_unseq_memtable=true > unseq_memtable_flush_interval_in_ms=3600000 > unseq_memtable_flush_check_interval_in_ms=600000 > max_waiting_time_when_insert_blocked=3600000 > query_timeout_threshold=36000000 > enable_auto_create_schema=false > 2. benchmark configuration (attachment) -- This message was sent by Atlassian Jira (v8.20.10#820010)