viirya commented on issue #182: URL: https://github.com/apache/datafusion-comet/issues/182#issuecomment-2113165672
Based on https://spark.apache.org/docs/latest/submitting-applications.html > When using spark-submit, the application jar along with any jars included with the --jars option will be automatically transferred to the cluster. URLs supplied after --jars must be separated by commas. That list is included in the driver and executor classpaths. Directory expansion does not work with --jars. Seems the jars of `--jars` will be included in the driver and executor classpaths. Maybe it is why `spark-submit` is okay and only `spark-shell` has the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
