Dear:
Wechat group "Apache Linkis(incubating) community Development group "chat
records are as follows: 微信群"Apache Linkis(incubating) 社区开发群"的聊天记录如下:
————— 2023-2-08 —————
zhinan 之南 17:57
i dock linkis and seatunnel with code， the result has been queried in the
blog，but still an error， the code also shows failed， what‘s the reason？
我用代码 linkis 操作 seaTunnel。日志中已经查询出结果了。但是后续还是报错了。代码也显示Failed。是什么原因呢
zhinan 之南 17:58
Exception caught (might be ok if at shutdown) java.lang.IllegalStateException:
Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
~[?:1.8.0_65]
at java.lang.Runtime.removeShutdownHook(Runtime.java:239) ~[?:1.8.0_65]
at
com.netflix.util.concurrent.ShutdownEnabledTimer.cancel(ShutdownEnabledTimer.java:70)
~[netflix-commons-util-0.3.0.jar:0.3.0]
at
com.netflix.loadbalancer.BaseLoadBalancer.cancelPingTask(BaseLoadBalancer.java:632)
~[ribbon-loadbalancer-2.3.0.jar:2.3.0]
at
com.netflix.loadbalancer.BaseLoadBalancer.shutdown(BaseLoadBalancer.java:883)
~[ribbon-loadbalancer-2.3.0.jar:2.3.0]
at
com.netflix.loadbalancer.DynamicServerListLoadBalancer.shutdown(DynamicServerListLoadBalancer.java:285)
~[ribbon-loadbalancer-2.3.0.jar:2.3.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_65]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_65]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_65]
at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_65]
at
org.springframework.beans.factory.support.DisposableBeanAdapter.invokeCustomDestroyMethod(DisposableBeanAdapter.java:286)
~[spring-beans-5.2.22.RELEASE.jar:5.2.22.RELEASE]
at
org.springframework.beans.factory.support.DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:220)
~[spring-beans-5.2.22.RELEASE.jar:5.2.22.RELEASE]
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:587)
~[spring-beans-5.2.22.RELEASE.jar:5.2.22.RELEASE]
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:559)
~[spring-beans-5.2.22.RELEASE.jar:5.2.22.RELEASE]
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingleton(DefaultLis
zhinan 之南 17:58
this is the subsequent error display. 然后这个是后续的报错
tree 乔木。 18:01
I'm just like you.我也是你这个现象
zhinan 之南 18:03
did you solve it? 你解决了吗?
tree 乔木。 18:05
I didn't ,you debug it, does the result show success? 没有 你debug试试 是不是结果又是成功
zhinan 之南 18:07
zhinan 之南 18:07
not, still is F
不是 还是F
tree 乔木。 18:10
did you try more times？ 多试几次呢
peacewong@WDS 18:10
@Dlimeng could you help him with the bug？ _李孟 帮忙看看
South of zhinan 18:16
zhinan 之南 18:16
It's all Failed
都是Failed
Li Meng 18:16
李孟 18:16
Get a full log file
来个全的日志文件
The South 18:18
之南 18:18
@dlimeng_Li Meng
@Dlimeng_李孟
Z. Nan 18:19
之南 18:19
The stderr file is empty
stderr 文件为空
The South 18:44
之南 18:44
@dlimeng_Mengge Lee, what's the reason
@Dlimeng_李孟 哥，是什么原因呢
Li Meng 19:12
李孟 19:12
The last is to close the process log, it doesn't matter, there is a real
problem calling api state not flipped
最后是关闭进程日志，没关系，真正有问题调用api状态没翻转
South of the Earth 19:28
之南 19:28
When I call the Api, it actually works.就是我调用Api之后，其实已经成功了。 But the status
hasn't changed, has it?但是状态没改是吗？
zhinan之南 19:28
package org.apache.linkis.computation.client;
import org.apache.linkis.common.conf.Configuration;
import
org.apache.linkis.computation.client.once.simple.SubmittableSimpleOnceJob;
import org.apache.linkis.computation.client.utils.LabelKeyUtils;
public class SeatunnelOnceJobTest {
public static void main(String[] args) {
LinkisJobClient.config().setDefaultServerUrl("http://ip:9001";);
String code =
"\n"
+ "env {\n"
+ " spark.app.name = \"SeaTunnel\"\n"
+ "spark.executor.instances = 2\n"
+ "spark.executor.cores = 1\n"
+ " spark.executor.memory = \"1g\"\n"
+ "}\n"
+ "\n"
+ "source {\n"
+ "Fake {\n"
+ " result_table_name = \"my_dataset\"\n"
+ " }\n"
+ "\n"
+ "}\n"
+ "\n"
+ "transform {\n"
+ "}\n"
+ "\n"
+ "sink {\n"
+ " Console {}\n"
+ "}";
SubmittableSimpleOnceJob onceJob =
LinkisJobClient.once()
.simple()
.builder()
.setCreateService("seatunnel-Test")
.setMaxSubmitTime(300000)
.addLabel(LabelKeyUtils.ENGINE_TYPE_LABEL_KEY(),
"seatunnel-2.1.2")
.addLabel(LabelKeyUtils.USER_CREATOR_LABEL_KEY(),
"hadoop-seatunnel")
.addLabel(LabelKeyUtils.ENGINE_CONN_MODE_LABEL_KEY(),
"once")
.addStartupParam(Configuration.IS_TEST_MODE().key(),
true)
.addExecuteUser("hadoop")
.addJobContent("runType", "sspark")
.addJobContent("code", code)
.addJobContent("master", "local[4]")
.addJobContent("deploy-mode", "client")
.addSource("jobName", "OnceJobTest")
.build();
onceJob. submit();
System.out.println(onceJob.getId());
onceJob. waitForCompleted();
System.out.println(onceJob.getStatus());
LinkisJobMetrics jobMetrics = onceJob. getJobMetrics();
System.out.println(jobMetrics.getMetrics());
}
}
South of the Earth 19:29
之南 19:29
I use this official code.我就是用的这个官方的code。 Need to change the source code of
linkis
需要改linkis的源码是吗
peacewong@WDS 19:41
peacewong@WDS 19:41
Are you using version 1.3.1, which releases the eatunnel plugin
你用的是发布eatunnel 插件的1.3.1版本吗
The South of the 20:05
之南 20:05
The 1.3.1 source code is compiled by itself.1.3.1的源码自己编译的。 The material of
1.3.1 was not found on the official website
官网没看到1.3.1的物料
casion 20:49
https://linkis.apache.org/zh-CN/blog/2022/04/15/how-to-download-engineconn-plugin
https://linkis.apache.org/zh-CN/blog/2022/04/15/how-to-download-engineconn-plugin
The South of the south 22:32
之南 22:32
@Xia Chen thanks, I will try it tomorrow, I saw the latest 1.3.0 when I
deployed it earlier@夏晨 感谢，我明天试一下，之前部署的时候看到最新的是1.3.0的
casion 20:49
https://linkis.apache.org/zh-CN/blog/2022/04/15/how-to-download-engineconn-plugin
之南 22:32@夏晨 感谢，我明天试一下，之前部署的时候看到最新的是1.3.0的
--
Best Regards
------
康悦 ritakang
GitHub：Ritakang0451
E-mail：[email protected]
