[ https://issues.apache.org/jira/browse/ARROW-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wes McKinney updated ARROW-2872: -------------------------------- Summary: [Python] Add pytest mark to opt into TensorFlow-related unit tests (was: [Python] Add pytest mark to opt into TensorFlow unit tests) > [Python] Add pytest mark to opt into TensorFlow-related unit tests > ------------------------------------------------------------------ > > Key: ARROW-2872 > URL: https://issues.apache.org/jira/browse/ARROW-2872 > Project: Apache Arrow > Issue Type: Bug > Components: Python > Reporter: Wes McKinney > Priority: Major > Fix For: 0.10.0 > > > After pulling in ARROW-1744, I found this a little bit unfriendly: > {code} > pyarrow/tests/test_plasma_tf_op.py::test_plasma_tf_op FAILED > [ 82%] > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> captured stdout > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > TensorFlow version: 1.8.0 > Compiling Plasma TensorFlow Op... > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> captured stderr > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > +++ dirname /home/wesm/code/arrow/python/pyarrow/tensorflow/build.sh > ++ cd /home/wesm/code/arrow/python/pyarrow/tensorflow > ++ pwd > + PYARROW_TENSORFLOW_DIR=/home/wesm/code/arrow/python/pyarrow/tensorflow > ++ python -c 'import tensorflow as tf; print(" > ".join(tf.sysconfig.get_compile_flags()))' > + > TF_CFLAGS='-I/home/wesm/miniconda/envs/arrow-dev/lib/python3.6/site-packages/tensorflow/include > -D_GLIBCXX_USE_CXX11_ABI=0' > ++ python -c 'import tensorflow as tf; print(" > ".join(tf.sysconfig.get_link_flags()))' > + > TF_LFLAGS='-L/home/wesm/miniconda/envs/arrow-dev/lib/python3.6/site-packages/tensorflow > -ltensorflow_framework' > ++ uname > + '[' Linux == Darwin ']' > + NDEBUG=-DNDEBUG > ++ pkg-config --cflags --libs plasma arrow arrow-python > + g++ -std=c++11 -g -shared > /home/wesm/code/arrow/python/pyarrow/tensorflow/plasma_op.cc -o > /home/wesm/code/arrow/python/pyarrow/tensorflow/plasma_op.so -DNDEBUG > -I/home/wesm/local/include > -I/home/wesm/miniconda/envs/arrow-dev/include/python3.6m > -I/home/wesm/local/include -L/home/wesm/local/lib -lplasma -larrow_python > -larrow -fPIC > -I/home/wesm/miniconda/envs/arrow-dev/lib/python3.6/site-packages/tensorflow/include > -D_GLIBCXX_USE_CXX11_ABI=0 > -L/home/wesm/miniconda/envs/arrow-dev/lib/python3.6/site-packages/tensorflow > -ltensorflow_framework -O2 > /home/wesm/code/arrow/python/pyarrow/tensorflow/plasma_op.cc:33:10: fatal > error: arrow/adapters/tensorflow/convert.h: No such file or directory > #include "arrow/adapters/tensorflow/convert.h" > ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > compilation terminated. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> traceback > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > use_gpu = False > @pytest.mark.plasma > def test_plasma_tf_op(use_gpu=False): > import pyarrow.plasma as plasma > > > plasma.build_plasma_tensorflow_op() > pyarrow/tests/test_plasma_tf_op.py:89: > _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > _ _ _ _ > pyarrow/plasma.py:56: in build_plasma_tensorflow_op > subprocess.check_call(["bash", script_path]) > _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > _ _ _ _ > popenargs = (['bash', > '/home/wesm/code/arrow/python/pyarrow/tensorflow/build.sh'],) > kwargs = {}, retcode = 1 > cmd = ['bash', '/home/wesm/code/arrow/python/pyarrow/tensorflow/build.sh'] > def check_call(*popenargs, **kwargs): > """Run command with arguments. Wait for command to complete. If > the exit code was zero then return, otherwise raise > CalledProcessError. The CalledProcessError object will have the > return code in the returncode attribute. > > The arguments are the same as for the call function. Example: > > check_call(["ls", "-l"]) > """ > retcode = call(*popenargs, **kwargs) > if retcode: > cmd = kwargs.get("args") > if cmd is None: > cmd = popenargs[0] > > raise CalledProcessError(retcode, cmd) > E subprocess.CalledProcessError: Command '['bash', > '/home/wesm/code/arrow/python/pyarrow/tensorflow/build.sh']' returned > non-zero exit status 1. > ../../../miniconda/envs/arrow-dev/lib/python3.6/subprocess.py:291: > CalledProcessError > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> entering PDB > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > /home/wesm/miniconda/envs/arrow-dev/lib/python3.6/subprocess.py(291)check_call() > -> raise CalledProcessError(retcode, cmd) > {code} > If you pass {{-DARROW_PLASMA=ON}} but do not also pass > {{-DARROW_TENSORFLOW=ON}} then this occurs -- This message was sent by Atlassian JIRA (v7.6.3#76005)