环境版本: sqoop-1.4.6 hadoop-3.3.3 hive-3.1.3 java-1.8.0_333 linkis-1.4.0 dss-1.1.2 exchangis-1.1.2 ...
问题描述:
通过dss的工作流,添加sqoop引擎,执行hive数据导入到mysql子任务。任务执行一直重试。
exchangis日志提示:[errCode: 31888 ,desc: Fail to submit to linkis server with
unexpected final status: [WaitForRetry]。
linkis引擎日志:Failed to start bean 'webServerStartStop'; nested exception is
org.springframework.boot.web.server.WebServerException: Unable to start
embedded Jetty server
Caused by: java.lang.IllegalStateException
at
org.eclipse.jetty.servlet.ServletHolder.setClassFrom(ServletHolder.java:300)
~[jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
Caused by: org.springframework.boot.web.server.WebServerException: Unable to
start embedded Jetty server
at
org.springframework.boot.web.embedded.jetty.JettyWebServer.start(JettyWebServer.java:194)
at
org.springframework.boot.web.servlet.context.WebServerStartStopLifecycle.start(WebServerStartStopLifecycle.java:43)
at
org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182)
... 20 more
Caused by: java.lang.IllegalStateException
at
org.eclipse.jetty.servlet.ServletHolder.setClassFrom(ServletHolder.java:300)
at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:347)
linkis目录查找jetty相关包结果见附件linkis-jetty.txt。
生成的engineConnExec.sh文件见附件。
sqoop引擎执行的完整日志见附件stderr文件。
请教一下,此问题应该如何解决。github有相关issue,都有查看讨论和分析,但都未找到可行的解决方法。
通过日志和jetty相关jar包版本分析,怀疑是否是jar包冲突。
其中hive的jetty包版本是9.3.20.v20170531,hadoop的jetty包版本是9.4.43.v20210629,而linkis的jar包版本是9.4.48.v20220622。
如果是因为jar包冲突导致,应该如何处理,升降版本是否会导致hadoop,hive或linkis出现问题。
[root@iotdb-03 linkis]# find ./ -name jetty* ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-annotations-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-client-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-continuation-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-http-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-io-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-plus-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-security-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-server-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-servlet-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-servlets-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-util-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-util-ajax-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-webapp-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/jetty-xml-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-servlets-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-server-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-continuation-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-servlet-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-http-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-plus-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-io-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-util-ajax-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-security-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-webapp-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-xml-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-util-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/spark/dist/3.1.3/lib/jetty-annotations-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/hive/dist/3.1.3/lib/jetty-rewrite-9.4.48.v20220622.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-servlets-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-continuation-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-http-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-util-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-io-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-webapp-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-xml-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-servlet-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-security-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-server-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-util-ajax-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-client-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-annotations-9.4.42.v20210604.jar ./lib/linkis-engineconn-plugins/appconn/dist/1/lib/jetty-plus-9.4.42.v20210604.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-annotations-9.4.48.v20220622.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-client-9.4.48.v20220622.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-continuation-9.4.48.v20220622.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-http-9.4.48.v20220622.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-io-9.4.48.v20220622.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-plus-9.4.48.v20220622.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-servlets-9.4.48.v20220622.jar ./lib/linkis-spring-cloud-services/linkis-mg-gateway/jetty-util-9.4.48.v20220622.jar ./lib/linkis-public-enhancements/linkis-ps-publicservice/metadataquery-service/hive/jetty-rewrite-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-annotations-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-client-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-continuation-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-http-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-io-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-plus-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-security-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-server-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-servlet-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-servlets-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-webapp-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-util-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-util-ajax-9.4.48.v20220622.jar ./lib/linkis-commons/public-module/jetty-xml-9.4.48.v20220622.jar ./lib_bk/jetty-annotations-9.4.48.v20220622.jar ./lib_bk/jetty-client-9.4.48.v20220622.jar ./lib_bk/jetty-continuation-9.4.48.v20220622.jar ./lib_bk/jetty-http-9.4.48.v20220622.jar ./lib_bk/jetty-io-9.4.48.v20220622.jar ./lib_bk/jetty-plus-9.4.48.v20220622.jar ./lib_bk/jetty-security-9.4.48.v20220622.jar ./lib_bk/jetty-server-9.4.48.v20220622.jar ./lib_bk/jetty-servlet-9.4.48.v20220622.jar ./lib_bk/jetty-servlets-9.4.48.v20220622.jar ./lib_bk/jetty-util-9.4.48.v20220622.jar ./lib_bk/jetty-util-ajax-9.4.48.v20220622.jar ./lib_bk/jetty-webapp-9.4.48.v20220622.jar ./lib_bk/jetty-xml-9.4.48.v20220622.jar ./lib_bk/replace/jetty-annotations-9.4.43.v20210629.jar ./lib_bk/replace/jetty-client-9.4.43.v20210629.jar ./lib_bk/replace/jetty-continuation-9.4.43.v20210629.jar ./lib_bk/replace/jetty-http-9.4.43.v20210629.jar ./lib_bk/replace/jetty-io-9.4.43.v20210629.jar ./lib_bk/replace/jetty-plus-9.4.43.v20210629.jar ./lib_bk/replace/jetty-security-9.4.43.v20210629.jar ./lib_bk/replace/jetty-server-9.4.43.v20210629.jar ./lib_bk/replace/jetty-servlet-9.4.43.v20210629.jar ./lib_bk/replace/jetty-servlets-9.4.43.v20210629.jar ./lib_bk/replace/jetty-util-9.4.43.v20210629.jar ./lib_bk/replace/jetty-util-ajax-9.4.43.v20210629.jar ./lib_bk/replace/jetty-webapp-9.4.43.v20210629.jar ./lib_bk/replace/jetty-xml-9.4.43.v20210629.jar
engineConnExec.sh
Description: Bourne shell script
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
