[ https://issues.apache.org/jira/browse/ARROW-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wes McKinney updated ARROW-2956: -------------------------------- Summary: [Python] Arrow plasma throws ArrowIOError and process crashed (was: [Python]Arrow plasma throws ArrowIOError and process crashed) > [Python] Arrow plasma throws ArrowIOError and process crashed > ------------------------------------------------------------- > > Key: ARROW-2956 > URL: https://issues.apache.org/jira/browse/ARROW-2956 > Project: Apache Arrow > Issue Type: Bug > Components: Python > Reporter: He Kaisheng > Priority: Major > > hello, > We start a plasma store with 100k memory. when storage is full, it throws > ArrowIOError and the *process crashed,* not the expected PlasmaStoreFull > error. > code: > {code:java} > import pyarrow.plasma as plasma > import numpy as np > plasma_client = plasma.connect(plasma_socket, '', 0) > ref = [] > for _ in range(1000): > obj_id = plasma_client.put(np.random.randint(100, size=(100, 100), > dtype=np.int16)) > data = plasma_client.get(obj_id) > ref.append(data) > {code} > error: > {noformat} > --------------------------------------------------------------------------- > ArrowIOError Traceback (most recent call last) > <ipython-input-2-07ec7f6f4b82> in <module>() > 2 ref = [] > 3 for _ in range(1000): > ----> 4 obj_id = plasma_client.put(np.random.randint(100, size=(100, > 100), dtype=np.int16)) > 5 data = plasma_client.get(obj_id) > 6 ref.append(data) > plasma.pyx in pyarrow.plasma.PlasmaClient.put() > plasma.pyx in pyarrow.plasma.PlasmaClient.create() > error.pxi in pyarrow.lib.check_status() > ArrowIOError: Encountered unexpected EOF{noformat} > this problem doesn't exist when dtype is np.int64 or share memory is > larger(like more than 100M), it seems so strange, anybody knows the reason? > Thanks a lot. > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)