isMrH commented on issue #2698:
URL:
https://github.com/apache/incubator-seatunnel/issues/2698#issuecomment-1241751749
@Carl-Zhou-CN Thank you for your answer.
I removed `connectors/spark/seatunnel-connector-spark-tidb-2.1.2`.
Do I need to do anything else?
I also tried replacing `seatunnel-connector-spark-tidb-2.1.2` with
`tispark-assembly-2.4.3-scala_2.11.jar` but it still doesn't work
The following error occurred.
```
22/09/09 17:24:13 INFO yarn.Client:
client token: N/A
diagnostics: User class threw exception: java.lang.RuntimeException:
java.lang.ClassNotFoundException: Plugin class not found by name :[tidb]
at
org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:185)
at java.util.ArrayList.forEach(ArrayList.java:1257)
at
org.apache.seatunnel.core.base.config.PluginFactory.createPlugins(PluginFactory.java:179)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:55)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:62)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:673)
Caused by: java.lang.ClassNotFoundException: Plugin class not found by name
:[tidb]
at
org.apache.seatunnel.core.base.config.PluginFactory.createPluginInstanceIgnoreCase(PluginFactory.java:221)
at
org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:181)
... 11 more
ApplicationMaster host: cdh-07.qd.link-x.host
ApplicationMaster RPC port: 43493
queue: root.users.root
start time: 1662715437408
final status: FAILED
tracking URL:
http://cdh-01.qd.link-x.host:8088/proxy/application_1662097049317_8037/
user: root
22/09/09 17:24:13 ERROR yarn.Client: Application diagnostics message: User
class threw exception: java.lang.RuntimeException:
java.lang.ClassNotFoundException: Plugin class not found by name :[tidb]
at
org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:185)
at java.util.ArrayList.forEach(ArrayList.java:1257)
at
org.apache.seatunnel.core.base.config.PluginFactory.createPlugins(PluginFactory.java:179)
at
org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:55)
at
org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:62)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at
org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:673)
Caused by: java.lang.ClassNotFoundException: Plugin class not found by name
:[tidb]
at
org.apache.seatunnel.core.base.config.PluginFactory.createPluginInstanceIgnoreCase(PluginFactory.java:221)
at
org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:181)
... 11 more
Exception in thread "main" org.apache.spark.SparkException: Application
application_1662097049317_8037 finished with failed status
at org.apache.spark.deploy.yarn.Client.run(Client.scala:1155)
at
org.apache.spark.deploy.yarn.YarnClusterApplication.start(Client.scala:1603)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:851)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:926)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:935)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/09/09 17:24:13 INFO util.ShutdownHookManager: Shutdown hook called
22/09/09 17:24:13 INFO util.ShutdownHookManager: Deleting directory
/tmp/spark-126a149f-8c22-43e0-b80e-5dbfab8a199a
22/09/09 17:24:13 INFO util.ShutdownHookManager: Deleting directory
/tmp/spark-ab7f566d-bd3b-4031-9816-5ca2c4a49285
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
