Re: Add support for Decimal64

2021-11-23 Thread siddharth teotia
If the timeline is not tight, I can help with Java side implementation. IIRC, we already have have 16 byte and 32 byte 2's complement based decimal vector implementations in Java based off BigDecimal. Is this similar work for 4 and 8 byte implementations? I will have to refresh my memory of code b

[Doc] ORC-related documentation

2021-11-23 Thread Ian Joiner
Hi, Today I found that pretty much none of our ORC-related work (e.g. ORC writer in C++ & Python, Arrow Dataset with ORC) has ever been documented. This is something we have to fix or users won’t even be aware that ORC support exists, let alone how to use it. >From my understanding it seems that

Re: Add support for Decimal64

2021-11-23 Thread Micah Kornfield
It would be nice to round off support. I think there might be a stake PR that started in C++ side. Unfortunately, I do but have bandwidth to help with the effort. On Tuesday, November 23, 2021, Wang Xudong wrote: > Yes, It's very nice to add 32-bit and 64-bit decimal support to Arrow. If > we

Re: Add support for Decimal64

2021-11-23 Thread Wang Xudong
Yes, It's very nice to add 32-bit and 64-bit decimal support to Arrow. If we decide to do it, I think I can help to work on C++ support. -- xudong963 Wes McKinney 于2021年11月24日周三 上午11:28写道: > I think we should consider adding 32-bit and 64-bit decimal support to > Arrow — this also needs to be a

Re: Add support for Decimal64

2021-11-23 Thread Wes McKinney
I think we should consider adding 32-bit and 64-bit decimal support to Arrow — this also needs to be added at the specification level and we would need volunteers to work on Java and C++ support as well as integration testing. What do others think? On Thu, Nov 18, 2021 at 11:13 PM Stephen Jiang w

Re: Arrow Flight SQL status, documentation

2021-11-23 Thread David Li
An update on things: The C++ PR [1] has been available for a while now, as has the Java PR and spec [2]. If there's any other feedback from interested people, it would be much appreciated, and thanks to Kyle and his collaborators for getting things implemented, as well as to Micah, Kou, Kriszti

Re: [DISCUSS] next iteration of flatbuffer structures

2021-11-23 Thread Micah Kornfield
Sorry I just took a closer look and left some comments. I think the one substantive issue, is the document linked talks about different length columns in the Bag, and this isn't mentioned in the flatbuffers? Could you comment/update the documentations in flatbuffers accordingly? Thanks, Micah On

Re: [VOTE] Release Apache Arrow JS 6.0.2

2021-11-23 Thread Dominik Moritz
Ahh, thank you for the clarification. There are no breaking changes in this point release, just fixes. @PMC, could you please vote on this point release. Would anyone volunteer as the release manager with me to give me a better understanding of the process? On Nov 23, 2021 at 13:09:47, Benson M

Re: [VOTE] Release Apache Arrow JS 6.0.2

2021-11-23 Thread Adam Lippai
I think the voting makes sense, but not because it's similar to the Rust release process. A big difference is that the Rust release is a minor release with a lot of code and features added and not patch release with essential bug fixes only. Best regards, Adam Lippai On Tue, Nov 23, 2021, 19:10 B

Re: [DISCUSS] next iteration of flatbuffer structures

2021-11-23 Thread David Li
Thanks for putting that up. It doesn't look like there's been too much discussion here. If people agree it's useful, maybe the next step is to draft an implementation in Java or C++ for feedback? There was some discussion on the use cases in the document, do we feel like we need to clarify that

Re: [VOTE] Release Apache Arrow JS 6.0.2

2021-11-23 Thread Benson Muite
https://issues.apache.org/jira/browse/ARROW-14801 Rust has its own repository and does frequent point releases: https://github.com/apache/arrow-rs/tree/master/dev/release however, even point releases require 3 PMC binding +1 votes and API breaking changes can only take place on major releases.

Re: [VOTE] Release Apache Arrow JS 6.0.2

2021-11-23 Thread Dominik Moritz
I tested Node v14.18.1 and tests pass. I think we can go ahead and make a release. @Benson, could you help me update the script to work off of branches. I don’t know what the expected process for release verification is. I’d be happy to adopt another process. On Nov 20, 2021 at 09:57:53, Dominik