Re: Compression in Arrow - Question

2020-08-29 Thread Micah Kornfield
Hi Mark, See the most recent previous discussion about alternate encodings [1]. This is something that in the long run should be added, I'd personally prefer to start with simpler encodings. I don't think we should add anything more with regard to compression/encoding until at least 3 languages

Compression in Arrow - Question

2020-08-29 Thread mark
I was looking at compression in arrow had a couple questions. If I've understood compression currently, it is only used 'in flight' in either IPC or Arrow Flight, using a block compression, but still decoded into Ram at the destination in full array form. Is this correct ? Given

ORC writer

2020-08-29 Thread Ying Zhou
Hi, I’m interested in writing a binder so that we can write ORC files in Arrow. I likely should contribute mostly to https://github.com/apache/arrow/tree/master/cpp/src/arrow/adapters/orc as well as editing the relevant

[NIGHTLY] Arrow Build Report for Job nightly-2020-08-29-0

2020-08-29 Thread Crossbow
Arrow Build Report for Job nightly-2020-08-29-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-29-0 Failed Tasks: - conda-osx-clang-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-29-0-azure-conda-osx-clang-py36 -