Digging a bit more, looks like this impyla change <https://github.com/cloudera/impyla/commit/0b5967259d350c6e24d8a2a9ffdaeccb4d7eb7dc> broke from 2 days ago broke our dependency chain. For now I unblocked my build with the following diff, but I'm not totally sure that is the right approach, since we have a patched version of thrift in $IMPALA_HOME/toolchain/thrift-0.9.0-p11/python/lib/python2.7/site-packages
pip experts, any thoughts? diff --git a/infra/python/deps/compiled-requirements.txt b/infra/python/deps/compiled-requirements.txt index 2c5590e..0adb5aa 100644 --- a/infra/python/deps/compiled-requirements.txt +++ b/infra/python/deps/compiled-requirements.txt @@ -28,6 +28,7 @@ impyla == 0.14.0 sasl == 0.1.3 six == 1.11.0 thrift-sasl == 0.1.0 + thrift == 0.9.3 psutil == 0.7.1 # Required for Kudu: Cython == 0.23.4 On Thu, Jul 19, 2018 at 4:26 PM Bharath Vissapragada <[email protected]> wrote: > I started hitting this suddenly (on Ubuntu-14.04). Anyone knows how to fix > this? > > INFO:bootstrap_virtualenv:Installing compiled requirements into the > virtualenv > Traceback (most recent call last): > File "/home/bharath/Impala/bin/../infra/python/bootstrap_virtualenv.py", > line 390, in <module> > if install_compiled_deps_if_possible(): > File "/home/bharath/Impala/bin/../infra/python/bootstrap_virtualenv.py", > line 239, in install_compiled_deps_if_possible > exec_pip_install(["-r", COMPILED_REQS_PATH], cc=cc, env=env) > File "/home/bharath/Impala/bin/../infra/python/bootstrap_virtualenv.py", > line 165, in exec_pip_install > exec_cmd(cmd, env=env) > File "/home/bharath/Impala/bin/../infra/python/bootstrap_virtualenv.py", > line 102, in exec_cmd > % (args, output)) > Exception: Command returned non-zero status > .......... > .......... <snip> > .......... > Collecting thrift (from impyla==0.14.0->-r > /home/bharath/Impala/bin/../infra/python/deps/compiled-requirements.txt > (line 6)) > 0 location(s) to search for versions of thrift: > Found link > file:///home/bharath/Impala/infra/python/deps/thrift_sasl-0.1.0.tar.gz, > version: sasl-0.1.0 > Local files found: > /home/bharath/Impala/infra/python/deps/thrift_sasl-0.1.0.tar.gz > Could not find a version that satisfies the requirement thrift (from > impyla==0.14.0->-r > /home/bharath/Impala/bin/../infra/python/deps/compiled-requirements.txt > (line 6)) (from versions: sasl-0.1.0) > Cleaning up... > Removing source in /tmp/pip-build-Xn5A25/argparse > Removing source in /tmp/pip-build-Xn5A25/Fabric > Removing source in /tmp/pip-build-Xn5A25/paramiko > Removing source in /tmp/pip-build-Xn5A25/ecdsa > Removing source in /tmp/pip-build-Xn5A25/pycrypto > Removing source in /tmp/pip-build-Xn5A25/impyla > Removing source in /tmp/pip-build-Xn5A25/bitarray > Removing source in /tmp/pip-build-Xn5A25/sasl > Removing source in /tmp/pip-build-Xn5A25/thrift-sasl > Removing source in /tmp/pip-build-Xn5A25/psutil > Removing source in /tmp/pip-build-Xn5A25/Cython > Removing source in /tmp/pip-build-Xn5A25/numpy > Removing source in /tmp/pip-build-Xn5A25/pytz > No matching distribution found for thrift (from impyla==0.14.0->-r > /home/bharath/Impala/bin/../infra/python/deps/compiled-requirements.txt > (line 6)) > Exception information: > Traceback (most recent call last): > File > "/home/bharath/Impala/infra/python/env/local/lib/python2.7/site-packages/pip/basecommand.py", > line 223, in main > status = self.run(options, args) > File > "/home/bharath/Impala/infra/python/env/local/lib/python2.7/site-packages/pip/commands/install.py", > line 282, in run > requirement_set.prepare_files(finder) > File > "/home/bharath/Impala/infra/python/env/local/lib/python2.7/site-packages/pip/req/req_set.py", > line 334, in prepare_files > functools.partial(self._prepare_file, finder)) > File > "/home/bharath/Impala/infra/python/env/local/lib/python2.7/site-packages/pip/req/req_set.py", > line 321, in _walk_req_to_install > more_reqs = handler(req_to_install) > File > "/home/bharath/Impala/infra/python/env/local/lib/python2.7/site-packages/pip/req/req_set.py", > line 461, in _prepare_file > req_to_install.populate_link(finder, self.upgrade) > File > "/home/bharath/Impala/infra/python/env/local/lib/python2.7/site-packages/pip/req/req_install.py", > line 249, in populate_link > self.link = finder.find_requirement(self, upgrade) > File > "/home/bharath/Impala/infra/python/env/local/lib/python2.7/site-packages/pip/index.py", > line 571, in find_requirement > 'No matching distribution found for %s' % req > DistributionNotFound: No matching distribution found for thrift (from > impyla==0.14.0->-r > /home/bharath/Impala/bin/../infra/python/deps/compiled-requirements.txt > (line 6)) > >
