Hi Kamil, You are right that it comes with JAR packages of scala 2.11 in the PyFlink package as it has to select one version of JARs to bundle, either 2.11 or 2.12. Whether it works with scala 2.12 depends on how you submit your job. - If you execute the job locally, then it will use the JARs bundled in the PyFlink installation by default, that's scala 2.11. However, you could set the environment variable 'FLINK_HOME' [1] to the directory of a custom Flink distribution of 2.12 if you want to work with scala 2.12. - If you execute the job remotely, e.g using `flink run` to submit the job to a remote session cluster, YARN cluster, etc. Then it depends on the Flink distribution from which the `flink run` command refers to. If you want to work with scala 2.12, it should refer to a custom Flink distribution of 2.12.
Regards, Dian [1] https://github.com/apache/flink/blob/master/flink-python/pyflink/find_flink_home.py#L46 On Wed, Nov 10, 2021 at 3:12 AM Kamil ty <kamilt...@gmail.com> wrote: > Hello, > > Just wanted to verify if the default build of pyflink available from PyPi > is compatible with flink - scala version 2.12. I have noticed that the PyPi > pyflink version comes with apache-flink-libraries targeted for scala 2.11 > only and I was wondering if this might be the cause of some issues that I'm > running into. > > Kind regards > Kamil >
