[jira] [Commented] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429156#comment-15429156 ] Wes McKinney commented on ARROW-81: --- [~emkornfi...@gmail.com] what you've proposed has the nice property

[jira] [Resolved] (ARROW-266) [C++] Fix the broken build

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-266. Resolution: Fixed Issue resolved by pull request 122 [https://github.com/apache/arrow/pull/122] >

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429030#comment-15429030 ] Micah Kornfield edited comment on ARROW-81 at 8/19/16 11:33 PM: Yeah, sorry,

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429030#comment-15429030 ] Micah Kornfield edited comment on ARROW-81 at 8/19/16 11:33 PM: Yeah, sorry,

[jira] [Commented] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429030#comment-15429030 ] Micah Kornfield commented on ARROW-81: -- Yeah, sorry, I should be more consistent with terminology. In

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429030#comment-15429030 ] Micah Kornfield edited comment on ARROW-81 at 8/19/16 11:20 PM: Yeah, sorry,

[jira] [Created] (ARROW-266) [C++] Fix the broken build

2016-08-19 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-266: -- Summary: [C++] Fix the broken build Key: ARROW-266 URL: https://issues.apache.org/jira/browse/ARROW-266 Project: Apache Arrow Issue Type: Bug

[jira] [Updated] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-81: -- Summary: [Format] Add a Category logical type (distinct from dictionary-encoding) (was: C++: Add a

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428957#comment-15428957 ] Wes McKinney commented on ARROW-81: --- We're running into what "first class type" means again. I'm going to

Re: committing in arrow

2016-08-19 Thread Wes McKinney
Also, this patch https://github.com/apache/arrow/commit/e7e399db5fc6913e67426514279f81766a0778d2 broke the build. We should try to never break the build -- feel free to ping the folks working on C++ if there is work needed to address an API change in shared code (like the flatbuffers). On Fri,

Re: committing in arrow

2016-08-19 Thread William Wood
Can someone remove me from this? Thanks Sent from my iPhone > On Aug 19, 2016, at 2:36 PM, Julien Le Dem wrote: > > Committers: > We've been a little inconsistent in the way we merge stuff to master. > Please use the script dev/merge_arrow_pr.py in the repo. > This

Re: regular arrow sync up

2016-08-19 Thread Julien Le Dem
William, You have subscribed to dev@arrow.apache.org. to unsubscribe email dev-unsubscr...@arrow.apache.org On Thu, Aug 18, 2016 at 7:57 PM, William Wood wrote: > Can someone remove me from this thread, please. > > Thanks > > Sent from my iPhone > > > On Aug 18,

Re: regular arrow sync up

2016-08-19 Thread Wes McKinney
hi William — you will need to send an email to dev-unsubscr...@arrow.apache.org On Fri, Aug 19, 2016 at 11:57 AM, William Wood wrote: > Can someone remove me from this thread, please. > > Thanks > > Sent from my iPhone > >> On Aug 18, 2016, at 8:54 PM, Micah

Re: [jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Wes McKinney
hi Pino, can you reply on JIRA for the sake of keeping the discussion in one place? >From what I know about sector categorization I think this is a slightly separate question -- here we are only concerned with the metadata and memory representation of data with a fixed number of categories (where

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428657#comment-15428657 ] Wes McKinney commented on ARROW-81: --- Here's a couple examples from Python and R (I believe SAS / Stata /

[jira] [Commented] (ARROW-263) Design an initial IPC mechanism for Arrow Vectors

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428637#comment-15428637 ] Micah Kornfield commented on ARROW-263: --- [~pcmoritz] this looks cool. I think JNI might be a

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Jacques Nadeau (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428316#comment-15428316 ] Jacques Nadeau commented on ARROW-81: - Can you guys provide two small example datasets in JSON format

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Hadley Wickham (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428308#comment-15428308 ] Hadley Wickham commented on ARROW-81: - I agree with Wes that factors/categories are a fundamental data