[ https://issues.apache.org/jira/browse/ARROW-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345903#comment-16345903 ]
Wes McKinney commented on ARROW-1880: ------------------------------------- I was able to get this error locally {code} $ py.test pyarrow/tests/test_plasma.py --pdb -v ==================================================== test session starts ===================================================== platform linux -- Python 3.5.2, pytest-3.0.6, py-1.4.31, pluggy-0.4.0 -- /home/wesm/anaconda3/envs/arrow-test/bin/python cachedir: .cache rootdir: /home/wesm/code/arrow/python, inifile: setup.cfg collected 20 items pyarrow/tests/test_plasma.py::TestPlasmaClient::test_connection_failure_raises_exception PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_create PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_create_with_metadata PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_create_existing PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_get PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_put_and_get PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_put_and_get_serialization_context PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_store_arrow_objects PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_store_pandas_dataframe PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_pickle_object_ids PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_store_full PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_contains PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_hash PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_many_hashes PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_illegal_functionality PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_evict PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_subscribe PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_subscribe_deletions PASSED pyarrow/tests/test_plasma.py::TestPlasmaClient::test_use_one_memory_mapped_file ERROR >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> traceback >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> self = <pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7f7763c66400> test_method = <bound method TestPlasmaClient.test_use_one_memory_mapped_file of <pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7f7763c66400>> def setup_method(self, test_method): use_one_memory_mapped_file = (test_method == self.test_use_one_memory_mapped_file) import pyarrow.plasma as plasma # Start Plasma store. plasma_store_name, self.p = start_plasma_store( use_valgrind=os.getenv("PLASMA_VALGRIND") == "1", use_one_memory_mapped_file=use_one_memory_mapped_file) # Connect to Plasma. > self.plasma_client = plasma.connect(plasma_store_name, "", 64) pyarrow/tests/test_plasma.py:166: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ pyarrow/plasma.pyx:678: in pyarrow.plasma.connect (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/plasma.cxx:8311) check_status(result.client.get() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > raise ArrowIOError(message) E pyarrow.lib.ArrowIOError: ../src/plasma/client.cc:600 code: ConnectIpcSocketRetry(store_socket_name, num_retries, -1, &store_conn_) E Could not connect to socket /tmp/plasma_store42362948 pyarrow/error.pxi:79: ArrowIOError >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> entering PDB >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > /home/wesm/code/arrow/python/pyarrow/error.pxi(79)pyarrow.lib.check_status > (/home/wesm/code/arrow/python/build/temp.linux-x86_64-3.5/lib.cxx:8373)() -> raise ArrowIOError(message) (Pdb) {code} Starting the Plasma store fails with {code} (Pdb) plasma_store_name, self.p = start_plasma_store(use_valgrind=os.getenv("PLASMA_VALGRIND") == "1",use_one_memory_mapped_file=use_one_memory_mapped_file) Allowing the Plasma store to use up to 0.536871GB of memory. Starting object store with directory /dev/shm and huge page support disabled ../src/plasma/store.cc:744 Check failed: pointer != NULL {code} This happened when I tried reducing the amount of memory available to the Plasma store by default in 512MB > [Python] Plasma test flakiness in Travis CI > ------------------------------------------- > > Key: ARROW-1880 > URL: https://issues.apache.org/jira/browse/ARROW-1880 > Project: Apache Arrow > Issue Type: Bug > Components: Python > Reporter: Wes McKinney > Priority: Major > > We've been seeing intermittent flakiness of the variety: > {code} > ==================================== ERRORS > ==================================== > ______ ERROR at setup of TestPlasmaClient.test_use_one_memory_mapped_file > ______ > self = <pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7fb85e67d668> > test_method = <bound method TestPlasmaClient.test_use_one_memory_mapped_file > of <pyarrow.tests.test_plasma.TestPlasmaClient object at 0x7fb85e67d668>> > [1m def setup_method(self, test_method):[0m > [1m use_one_memory_mapped_file = (test_method ==[0m > [1m > self.test_use_one_memory_mapped_file)[0m > [1m [0m > [1m import pyarrow.plasma as plasma[0m > [1m # Start Plasma store.[0m > [1m plasma_store_name, self.p = start_plasma_store([0m > [1m use_valgrind=os.getenv("PLASMA_VALGRIND") == "1",[0m > [1m use_one_memory_mapped_file=use_one_memory_mapped_file)[0m > [1m # Connect to Plasma.[0m > [1m> self.plasma_client = plasma.connect(plasma_store_name, "", 64)[0m > [1m[31mpyarrow-test-3.6/lib/python3.6/site-packages/pyarrow/tests/test_plasma.py[0m:164: > > _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > _ > [1m[31mplasma.pyx[0m:672: in pyarrow.plasma.connect > [1m ???[0m > _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > _ > [1m> ???[0m > [1m[31mE pyarrow.lib.ArrowIOError: Could not connect to socket > /tmp/plasma_store43998835[0m > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)