Re: list scope question

hi Mike, I recommend using record batches along with io::MemoryMappedFile. You can write the table with ipc::FileWriter: https://github.com/apache/arrow/blob/master/cpp/src/arrow/ipc/writer.h#L111 and then read it with ipc::FileReader. If you use MemoryMappedFile, then the read will be

RE: list scope question

Great! What I'd like to do is create a table that can be shared among multiple processes. I see, e.g., this in the comments where RecordBatch is defined: // A record batch is a simpler and more rigid table data structure intended for // use primarily in shared memory IPC. It contains a schema

[jira] [Created] (ARROW-1005) NullableDecimalVector.set(int, byte[]...) throws UnsupportedOperationException

Jacques Nadeau created ARROW-1005: - Summary: NullableDecimalVector.set(int, byte[]...) throws UnsupportedOperationException Key: ARROW-1005 URL: https://issues.apache.org/jira/browse/ARROW-1005

Re: list scope question

I think we opted to not create a user list yet, as using arrow is likely going to require some willingness to poke around in the library until we can fill out the docs and some more complete example usages. So as far as I know this is the place to ask, what were you looking to do? On Wed, May 10,

[jira] [Created] (ARROW-1004) ArrowInvalid: Invalid: Python object of type float is not None and is not a string, bool, or date object

William Cox created ARROW-1004: -- Summary: ArrowInvalid: Invalid: Python object of type float is not None and is not a string, bool, or date object Key: ARROW-1004 URL:

list scope question

Is there a good place for user-oriented arrow questions and discussions? (my apologies in advance if this isn't the appropriate venue) -Mike DISCLAIMER: This e-mail message and any attachments are intended solely for the use of the individual or entity to which it is addressed and may

[jira] [Created] (ARROW-1002) [C++] It is not necessary to add padding after the magic header in the FileWriter implementation

Wes McKinney created ARROW-1002: --- Summary: [C++] It is not necessary to add padding after the magic header in the FileWriter implementation Key: ARROW-1002 URL: https://issues.apache.org/jira/browse/ARROW-1002

[jira] [Created] (ARROW-1001) [GLib] Unify writer files

Kouhei Sutou created ARROW-1001: --- Summary: [GLib] Unify writer files Key: ARROW-1001 URL: https://issues.apache.org/jira/browse/ARROW-1001 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-1000) [GLib] Move install document to Website

Kouhei Sutou created ARROW-1000: --- Summary: [GLib] Move install document to Website Key: ARROW-1000 URL: https://issues.apache.org/jira/browse/ARROW-1000 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-997) [Java] Implement transfer in FixedSizeListVector

Emilio Lahr-Vivaz created ARROW-997: --- Summary: [Java] Implement transfer in FixedSizeListVector Key: ARROW-997 URL: https://issues.apache.org/jira/browse/ARROW-997 Project: Apache Arrow

[jira] [Created] (ARROW-996) [Website] Add 0.3 release announce in Japanese

Kouhei Sutou created ARROW-996: -- Summary: [Website] Add 0.3 release announce in Japanese Key: ARROW-996 URL: https://issues.apache.org/jira/browse/ARROW-996 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-995) [Website] Fix a typo

Kouhei Sutou created ARROW-995: -- Summary: [Website] Fix a typo Key: ARROW-995 URL: https://issues.apache.org/jira/browse/ARROW-995 Project: Apache Arrow Issue Type: Bug Components:

[jira] [Created] (ARROW-994) Arrow is unable to reuse Memory chunk in the Pool.

Deng Changchun created ARROW-994: Summary: Arrow is unable to reuse Memory chunk in the Pool. Key: ARROW-994 URL: https://issues.apache.org/jira/browse/ARROW-994 Project: Apache Arrow Issue