Piotr Nowojski created FLINK-14306:
--------------------------------------
Summary: flink-python build fails with No module named
pkg_resources
Key: FLINK-14306
URL: https://issues.apache.org/jira/browse/FLINK-14306
Project: Flink
Issue Type: Bug
Components: API / Python
Affects Versions: 1.10.0
Reporter: Piotr Nowojski
Fix For: 1.10.0
[Benchmark
builds|http://codespeed.dak8s.net:8080/job/flink-master-benchmarks/4576/console]
started to fail with
{noformat}
[INFO] Adding generated sources (java):
/home/jenkins/workspace/flink-master-benchmarks/flink/flink-python/target/generated-sources
[INFO]
[INFO] --- exec-maven-plugin:1.5.0:exec (Protos Generation) @ flink-python_2.11
---
Traceback (most recent call last):
File
"/home/jenkins/workspace/flink-master-benchmarks/flink/flink-python/pyflink/gen_protos.py",
line 33, in <module>
import pkg_resources
ImportError: No module named pkg_resources
[ERROR] Command execution failed.
(...)
[INFO] flink-state-processor-api .......................... SUCCESS [ 0.299 s]
[INFO] flink-python ....................................... FAILURE [ 0.434 s]
[INFO] flink-scala-shell .................................. SKIPPED
{noformat}
because of this ticket: https://issues.apache.org/jira/browse/FLINK-14018
I think I can solve the benchmark builds failing quite easily by installing
{{setuptools}} python package, so this ticket is not about this, but about
deciding how should we treat such kind of external dependencies. I don't see
this dependency being mentioned anywhere in the documentation ([for example
here|https://ci.apache.org/projects/flink/flink-docs-stable/flinkDev/building.html]).
Probably at the very least those external dependencies should be documented,
but also I fear about such kind of manual steps to do before building the Flink
can become a problem if would grow out of control. Some questions:
# Do we really need this dependency?
# Could this dependency be resolve automatically? By installing into a local
python virtual environment?
# Should we document those dependencies somewhere?
CC [~hequn] [~dian.fu] [~trohrmann]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
