[jira] [Created] (ARROW-1522) [C++] Support pyarrow.Buffer as built-in type in pyarrow.serialize

2017-09-10 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1522: --- Summary: [C++] Support pyarrow.Buffer as built-in type in pyarrow.serialize Key: ARROW-1522 URL: https://issues.apache.org/jira/browse/ARROW-1522 Project: Apache Arrow

Re: Reuse Buffer or BufferOutputStream

2017-09-10 Thread Wes McKinney
It depends (I assume this is Python we are talking about). The BufferOutputStream is single use -- you write a stream and then get the result as a Buffer (BufferOutputStream.get_result). Same in C++. In principle we could add a reset method: https://issues.apache.org/jira/browse/ARROW-1521 You ca

[jira] [Created] (ARROW-1521) [C++] Add Reset method to BufferOutputStream to enable object reuse

2017-09-10 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1521: --- Summary: [C++] Add Reset method to BufferOutputStream to enable object reuse Key: ARROW-1521 URL: https://issues.apache.org/jira/browse/ARROW-1521 Project: Apache Arrow

Reuse Buffer or BufferOutputStream

2017-09-10 Thread Rares Vernica
Hi, During the life of the program, can/should the Buffer or BufferOutputStream be resused? If the data in them is no longer needed, can they be reset? Or should I not worry about this as they get out of scope and just create new instances? What is the intended pattern? Thanks! Rares

Re: pipe Feather bytes between processes

2017-09-10 Thread Wes McKinney
I suggest that you use the Arrow streaming format for this purpose instead (http://arrow.apache.org/docs/python/ipc.html). The Feather APIs exist for backwards compatibility, and require an IO interface that supports random access. - Wes On Sun, Sep 10, 2017 at 10:05 PM, Rares Vernica wrote: > H

pipe Feather bytes between processes

2017-09-10 Thread Rares Vernica
Hi, I am having trouble piping Feather structures between two processes. On the receiving-process side, I get: pyarrow.lib.ArrowIOError: [Errno 29] Illegal seek I have process A and process B which communicate via pipes. Process A sends the bytes of a Feather structure to process B. Process A co

[jira] [Created] (ARROW-1520) [Docs] PyArrow docs missing Feather documentation

2017-09-10 Thread Rares Vernica (JIRA)
Rares Vernica created ARROW-1520: Summary: [Docs] PyArrow docs missing Feather documentation Key: ARROW-1520 URL: https://issues.apache.org/jira/browse/ARROW-1520 Project: Apache Arrow Issue

[jira] [Created] (ARROW-1519) Move DecimalUtil functions to methods on the Int128 class

2017-09-10 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-1519: Summary: Move DecimalUtil functions to methods on the Int128 class Key: ARROW-1519 URL: https://issues.apache.org/jira/browse/ARROW-1519 Project: Apache Arrow

[jira] [Created] (ARROW-1518) [C++/Python] Append column to Feather file

2017-09-10 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1518: --- Summary: [C++/Python] Append column to Feather file Key: ARROW-1518 URL: https://issues.apache.org/jira/browse/ARROW-1518 Project: Apache Arrow Issue Type: Imp

[jira] [Created] (ARROW-1517) Remove unnecessary temporary in DecimalUtil::ToString function

2017-09-10 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-1517: Summary: Remove unnecessary temporary in DecimalUtil::ToString function Key: ARROW-1517 URL: https://issues.apache.org/jira/browse/ARROW-1517 Project: Apache Arrow

[jira] [Created] (ARROW-1516) [GLib] Update document

2017-09-10 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-1516: --- Summary: [GLib] Update document Key: ARROW-1516 URL: https://issues.apache.org/jira/browse/ARROW-1516 Project: Apache Arrow Issue Type: Improvement C

[jira] [Created] (ARROW-1515) [GLib] Detect version directly

2017-09-10 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-1515: --- Summary: [GLib] Detect version directly Key: ARROW-1515 URL: https://issues.apache.org/jira/browse/ARROW-1515 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-1514) [C++] Fix a typo in document

2017-09-10 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-1514: --- Summary: [C++] Fix a typo in document Key: ARROW-1514 URL: https://issues.apache.org/jira/browse/ARROW-1514 Project: Apache Arrow Issue Type: Bug Com