cqutwangyu commented on issue #6333:
URL: https://github.com/apache/seatunnel/issues/6333#issuecomment-1925598428
seatunnel task logs during RocketMQ service exceptions :
```
2024-02-01 23:23:05,744 INFO
org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback
configuration key 'plugin_name' instead of key 'factory'
2024-02-01 23:23:05,745 INFO
org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback
configuration key 'plugin_name' instead of key 'factory'
2024-02-01 23:23:05,749 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load
SeaTunnelSink Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel
2024-02-01 23:23:05,758 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery
plugin jar: Rocketmq at:
file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-rocketmq-2.3.4-SNAPSHOT.jar
2024-02-01 23:23:05,759 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery
plugin jar: Rocketmq at:
file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-rocketmq-2.3.4-SNAPSHOT.jar
2024-02-01 23:23:05,764 INFO
org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start
generating all sources.
2024-02-01 23:23:05,765 INFO
org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback
configuration key 'plugin_name' instead of key 'factory'
2024-02-01 23:23:05,776 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load
SeaTunnelSource Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel
2024-02-01 23:23:05,781 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery
plugin jar: Rocketmq at:
file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-rocketmq-2.3.4-SNAPSHOT.jar
2024-02-01 23:23:05,787 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load plugin:
PluginIdentifier{engineType='seatunnel', pluginType='source',
pluginName='Rocketmq'} from classpath
2024-02-01 23:23:05,802 INFO
org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start
generating all transforms.
2024-02-01 23:23:05,802 INFO
org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start
generating all sinks.
2024-02-01 23:23:05,803 INFO
org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback
configuration key 'plugin_name' instead of key 'factory'
2024-02-01 23:23:05,806 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load
SeaTunnelSink Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel
2024-02-01 23:23:05,807 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery
plugin jar: Rocketmq at:
file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-rocketmq-2.3.4-SNAPSHOT.jar
2024-02-01 23:23:05,809 INFO
org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load plugin:
PluginIdentifier{engineType='seatunnel', pluginType='sink',
pluginName='Rocketmq'} from classpath
2024-02-01 23:23:05,845 INFO
org.apache.seatunnel.engine.client.job.ClientJobProxy - Start submit job, job
id: 805458141411016705, with plugin jar
[file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-rocketmq-2.3.4-SNAPSHOT.jar]
2024-02-01 23:23:05,932 INFO
org.apache.seatunnel.engine.client.job.ClientJobProxy - Submit job finished,
job id: 805458141411016705, job name: SeaTunnel
2024-02-01 23:23:05,941 WARN
org.apache.seatunnel.engine.client.job.JobMetricsRunner - Failed to get job
metrics summary, it maybe first-run
[INFO] 2024-02-01 23:23:52.244 +0800 - ->
2024-02-01 23:23:51,556 INFO
org.apache.seatunnel.engine.client.job.ClientJobProxy - Job
(805458141411016705) end with state FAILED
2024-02-01 23:23:51,557 INFO com.hazelcast.core.LifecycleService -
hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is
SHUTTING_DOWN
2024-02-01 23:23:51,567 INFO
com.hazelcast.client.impl.connection.ClientConnectionManager - hz.client_1
[seatunnel] [5.1] Removed connection to endpoint:
[localhost]:5801:382638e7-e321-4675-acea-247579799b4b, connection:
ClientConnection{alive=false, connectionId=1,
channel=NioChannel{/127.0.0.1:47785->localhost/127.0.0.1:5801},
remoteAddress=[localhost]:5801, lastReadTime=2024-02-01 23:23:51.542,
lastWriteTime=2024-02-01 23:23:50.429, closedTime=2024-02-01 23:23:51.562,
connected server version=5.1}
2024-02-01 23:23:51,567 INFO com.hazelcast.core.LifecycleService -
hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is
CLIENT_DISCONNECTED
2024-02-01 23:23:51,570 INFO com.hazelcast.core.LifecycleService -
hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is
SHUTDOWN
2024-02-01 23:23:51,572 INFO
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand -
Closed SeaTunnel client......
2024-02-01 23:23:51,572 INFO
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand -
Closed metrics executor service ......
2024-02-01 23:23:51,572 ERROR
org.apache.seatunnel.core.starter.SeaTunnel -
===============================================================================
2024-02-01 23:23:51,573 ERROR
org.apache.seatunnel.core.starter.SeaTunnel - Fatal Error,
2024-02-01 23:23:51,573 ERROR
org.apache.seatunnel.core.starter.SeaTunnel - Please submit bug report in
https://github.com/apache/seatunnel/issues
2024-02-01 23:23:51,573 ERROR
org.apache.seatunnel.core.starter.SeaTunnel - Reason:SeaTunnel job executed
failed
2024-02-01 23:23:51,574 ERROR
org.apache.seatunnel.core.starter.SeaTunnel - Exception
StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException:
SeaTunnel job executed failed
at
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:191)
at
org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
at
org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by:
org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException:
org.apache.seatunnel.connectors.seatunnel.rocketmq.exception.RocketMqConnectorException:
ErrorCode:[ROCKETMQ-11], ErrorDescription:[Failed to get topic min and max
topic]
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.common.RocketMqAdminUtil.offsetTopics(RocketMqAdminUtil.java:231)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.source.RocketMqSourceSplitEnumerator.getTopicInfo(RocketMqSourceSplitEnumerator.java:211)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.source.RocketMqSourceSplitEnumerator.fetchPendingPartitionSplit(RocketMqSourceSplitEnumerator.java:197)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.source.RocketMqSourceSplitEnumerator.run(RocketMqSourceSplitEnumerator.java:119)
at
org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
at
org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
at
org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.rocketmq.remoting.exception.RemotingConnectException: connect to
172.30.3.52:20911 failed
at
org.apache.rocketmq.remoting.netty.NettyRemotingClient.invokeSync(NettyRemotingClient.java:407)
at
org.apache.rocketmq.client.impl.MQClientAPIImpl.getTopicStatsInfo(MQClientAPIImpl.java:1190)
at
org.apache.rocketmq.tools.admin.DefaultMQAdminExtImpl.examineTopicStats(DefaultMQAdminExtImpl.java:266)
at
org.apache.rocketmq.tools.admin.DefaultMQAdminExt.examineTopicStats(DefaultMQAdminExt.java:226)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.common.RocketMqAdminUtil.offsetTopics(RocketMqAdminUtil.java:223)
... 11 more
at
org.apache.seatunnel.engine.client.job.ClientJobProxy.waitForJobComplete(ClientJobProxy.java:122)
at
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:184)
... 2 more
2024-02-01 23:23:51,575 ERROR
org.apache.seatunnel.core.starter.SeaTunnel -
===============================================================================
Exception in thread "main"
org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel
job executed failed
at
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:191)
at
org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
at
org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by:
org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException:
org.apache.seatunnel.connectors.seatunnel.rocketmq.exception.RocketMqConnectorException:
ErrorCode:[ROCKETMQ-11], ErrorDescription:[Failed to get topic min and max
topic]
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.common.RocketMqAdminUtil.offsetTopics(RocketMqAdminUtil.java:231)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.source.RocketMqSourceSplitEnumerator.getTopicInfo(RocketMqSourceSplitEnumerator.java:211)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.source.RocketMqSourceSplitEnumerator.fetchPendingPartitionSplit(RocketMqSourceSplitEnumerator.java:197)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.source.RocketMqSourceSplitEnumerator.run(RocketMqSourceSplitEnumerator.java:119)
at
org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.stateProcess(SourceSplitEnumeratorTask.java:303)
at
org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.call(SourceSplitEnumeratorTask.java:134)
at
org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.rocketmq.remoting.exception.RemotingConnectException: connect to
172.30.3.52:20911 failed
at
org.apache.rocketmq.remoting.netty.NettyRemotingClient.invokeSync(NettyRemotingClient.java:407)
at
org.apache.rocketmq.client.impl.MQClientAPIImpl.getTopicStatsInfo(MQClientAPIImpl.java:1190)
at
org.apache.rocketmq.tools.admin.DefaultMQAdminExtImpl.examineTopicStats(DefaultMQAdminExtImpl.java:266)
at
org.apache.rocketmq.tools.admin.DefaultMQAdminExt.examineTopicStats(DefaultMQAdminExt.java:226)
at
org.apache.seatunnel.connectors.seatunnel.rocketmq.common.RocketMqAdminUtil.offsetTopics(RocketMqAdminUtil.java:223)
... 11 more
at
org.apache.seatunnel.engine.client.job.ClientJobProxy.waitForJobComplete(ClientJobProxy.java:122)
at
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:184)
... 2 more
2024-02-01 23:23:51,577 INFO
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand - run
shutdown hook because get close signal
[INFO] 2024-02-01 23:23:52.245 +0800 - process has exited. execute
path:/tmp/dolphinscheduler/exec/process/default/12205486712512/12282914882752_4/81783/34841,
processId:91968 ,exitStatusCode:1 ,processWaitForStatus:true
,processExitValue:1
[INFO] 2024-02-01 23:23:52.246 +0800 -
***********************************************************************************************
[INFO] 2024-02-01 23:23:52.246 +0800 - *********************************
Finalize task instance ************************************
[INFO] 2024-02-01 23:23:52.246 +0800 -
***********************************************************************************************
[INFO] 2024-02-01 23:23:52.246 +0800 - Upload output files: [] successfully
[INFO] 2024-02-01 23:23:52.246 +0800 - Send task execute status: FAILURE to
master : 10.11.50.37:1234
[INFO] 2024-02-01 23:23:52.246 +0800 - Remove the current task execute
context from worker cache
[INFO] 2024-02-01 23:23:52.246 +0800 - The current execute mode isn't
develop mode, will clear the task execute file:
/tmp/dolphinscheduler/exec/process/default/12205486712512/12282914882752_4/81783/34841
[INFO] 2024-02-01 23:23:52.247 +0800 - Success clear the task execute file:
/tmp/dolphinscheduler/exec/process/default/12205486712512/12282914882752_4/81783/34841
[INFO] 2024-02-01 23:23:52.247 +0800 - FINALIZE_SESSION
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
