Re: Documentation hosting

2017-01-03 Thread Julian Hyde
If you decide to take this approach, feel free to copy whatever you like from Calcite (not that you need my permission - this is ASL!) and please let me know if can help. On Tue, Jan 3, 2017 at 3:46 PM, Jason Altekruse wrote: > +1 > > Jason Altekruse > Software Engineer at Dremio > Apache Arrow C

[jira] [Updated] (ARROW-427) [C++] Implement dictionary-encoded array container

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-427: --- Assignee: Wes McKinney WIP PR: https://github.com/apache/arrow/pull/268 > [C++] Implement dictionary-e

Re: Documentation hosting

2017-01-03 Thread Jason Altekruse
+1 Jason Altekruse Software Engineer at Dremio Apache Arrow Committer On Tue, Jan 3, 2017 at 2:59 PM, Leif Walsh wrote: > +1 this sounds pretty sane > On Fri, Dec 30, 2016 at 06:02 Uwe L. Korn wrote: > > > I just had a look over the Apache Calcite approach and I like it very > > much. Both, fr

Re: Best way to create/set validity bitmap buffer in Java

2017-01-03 Thread Li Jin
To answer myself: the above doesn't work because mutator doesn't update writerIndex (only ArrowBuf.writeXXX does). Still wondering if there is a good way of setting validity map in Java? Li On Tue, Jan 3, 2017 at 5:11 PM, Li Jin wrote: > Hi, > > I am working on a function where I want to creat

Re: Documentation hosting

2017-01-03 Thread Leif Walsh
+1 this sounds pretty sane On Fri, Dec 30, 2016 at 06:02 Uwe L. Korn wrote: > I just had a look over the Apache Calcite approach and I like it very > much. Both, from a technical and the structural (i.e. keeping the > website in the main repo). This will enable us to have the format spec > on Git

Best way to create/set validity bitmap buffer in Java

2017-01-03 Thread Li Jin
Hi, I am working on a function where I want to create an arrow record batch from Spark dataset. I am curious what's the best way to create validity bitmap buffer for a field? I found BitVector which has a mutator

[jira] [Commented] (ARROW-273) Lists use unsigned offset vectors instead of signed (as defined in the spec)

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796298#comment-15796298 ] Wes McKinney commented on ARROW-273: [~julienledem] since we now have working integrati

[jira] [Resolved] (ARROW-227) [C++/Python] Hook arrow_io generic reader / writer interface into arrow_parquet

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-227. Resolution: Fixed This was resolved back in July in https://github.com/apache/arrow/commit/ff6132f8a

[jira] [Commented] (ARROW-411) [Java] Move Intergration.compare and Intergration.compareSchemas to a public utils class

2017-01-03 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795536#comment-15795536 ] Li Jin commented on ARROW-411: -- I am happy to take a shot. PR: https://github.com/apache/arro

[jira] [Assigned] (ARROW-411) [Java] Move Intergration.compare and Intergration.compareSchemas to a public utils class

2017-01-03 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin reassigned ARROW-411: Assignee: Li Jin > [Java] Move Intergration.compare and Intergration.compareSchemas to a public > utils cla

[jira] [Resolved] (ARROW-415) C++: Add Equals implementation to compare Tables

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-415. Resolution: Fixed Done in https://github.com/apache/arrow/commit/fdbc57941fd3615c71b3a61b409b63eb6a4

[jira] [Resolved] (ARROW-416) C++: Add Equals implementation to compare Columns

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-416. Resolution: Fixed Done in https://github.com/apache/arrow/commit/fdbc57941fd3615c71b3a61b409b63eb6a4

[jira] [Resolved] (ARROW-224) [C++] Address static linking of boost dependencies

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-224. Resolution: Fixed Assignee: Wes McKinney This was done some time ago in https://github.com/apa

[jira] [Resolved] (ARROW-340) [C++] Opening a writeable file on disk that already exists does not truncate to zero

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-340. Resolution: Fixed Assignee: Wes McKinney Resolved in https://github.com/apache/arrow/commit/d9

[jira] [Resolved] (ARROW-417) C++: Add Equals implementation to compare ChunkedArrays

2017-01-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-417. Resolution: Fixed Issue resolved by pull request 259 [https://github.com/apache/arrow/pull/259] > C+