Hey Jieun,
Currently we can only transfer RecordBatch objects using Plasma between C++
and Python unfortunately. I just opened a JIRA for doing it with Java too
in https://issues.apache.org/jira/browse/ARROW-2892.
The necessary pieces are there (in particular there is a low level API to
access
Philipp Moritz created ARROW-2892:
-
Summary: [Plasma] Implement interface to get Java arrow objects
from Plasma
Key: ARROW-2892
URL: https://issues.apache.org/jira/browse/ARROW-2892
Project: Apache
Jonathan Kulzick created ARROW-2891:
---
Summary: Preserve schema in write_to_dataset
Key: ARROW-2891
URL: https://issues.apache.org/jira/browse/ARROW-2891
Project: Apache Arrow
Issue Type:
Philipp Moritz created ARROW-2890:
-
Summary: [Plasma] Make Python PlasmaClient.release private
Key: ARROW-2890
URL: https://issues.apache.org/jira/browse/ARROW-2890
Project: Apache Arrow
Also you should avoid calling release directly, because it will also be
called automatically here:
https://github.com/apache/arrow/blob/master/python/pyarrow/_plasma.pyx#L222
Instead, you should call "del buffer" on the PlasmaBuffer. I'll submit a PR
to make the release method private.
The only
Hi Corey,
It is possible that the current eviction policy will evict a ton of objects
at once. Since the plasma store is single threaded, this could cause the
plasma store to be unresponsive while the eviction is happening (though it
should not hang permanently, just temporarily).
You could
Robert,
Yes I am using separate Plasma clients in each different thread. I also
verified that I am not using up all the file descriptors or reaching the
overcommit limit.
I do see that the Plasma server is evicting objects every so often. I'm
assuming this eviction may be going on in the
Wes McKinney created ARROW-2889:
---
Summary: [C++] Add optional argument to ADD_ARROW_TEST CMake
function to add unit test prefix
Key: ARROW-2889
URL: https://issues.apache.org/jira/browse/ARROW-2889
Wes McKinney created ARROW-2888:
---
Summary: [Plasma] Several GPU-related APIs are used in places
where errors cannot be appropriately handled
Key: ARROW-2888
URL: https://issues.apache.org/jira/browse/ARROW-2888
Wes McKinney created ARROW-2887:
---
Summary: [Plasma] Methods in plasma/store.h returning PlasmaError
should return Status instead
Key: ARROW-2887
URL: https://issues.apache.org/jira/browse/ARROW-2887
I think options 1-3 should all be okay. Do we need to run a formal vote to
approve? It seems like they are just the logo and the name so I'm not sure
anything further is needed. Items 4-6 introduce colors and I think we
should probably do further exploration before adding more colors to the
"Arrow
11 matches
Mail list logo
