Dear all,

I'm trying to submit SQL jobs to session cluster on k8s, which need
external local udfs jars.

I meet some proplems below:

   - 'pipeline.jars' will be overwritten by '-j' option which only accepts
   one jar.
   - 'pipeline.classpaths' will not be uploaded, so local files could not
   be found in TM.
   - 'pipelines.cached-files' will not be added to classpaths. In
   Task#createUserCodeClassloader and
   ClientUtils#buildUserCodeClassLoader, only 'pipeline.jars' and
   'pipeline.classpaths' are added to user class loader.


Is there a better way to submit with external jars?
Or could we make 'pipeline.jars' directly used by users?

Best regards,
Sitan Pang

Reply via email to