[jira] [Commented] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429254#comment-15429254 ] Micah Kornfield commented on ARROW-81: -- Do we want to make an exception for requiring d

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429218#comment-15429218 ] Julien Le Dem edited comment on ARROW-81 at 8/20/16 4:53 AM: - [~

[jira] [Commented] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429218#comment-15429218 ] Julien Le Dem commented on ARROW-81: [~wesmckinn] and [~emkornfi...@gmail.com]: the prop

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429156#comment-15429156 ] Wes McKinney edited comment on ARROW-81 at 8/20/16 2:02 AM: [~em

[jira] [Commented] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429156#comment-15429156 ] Wes McKinney commented on ARROW-81: --- [~emkornfi...@gmail.com] what you've proposed has the

[jira] [Resolved] (ARROW-266) [C++] Fix the broken build

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-266. Resolution: Fixed Issue resolved by pull request 122 [https://github.com/apache/arrow/pull/122] > [C

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429030#comment-15429030 ] Micah Kornfield edited comment on ARROW-81 at 8/19/16 11:33 PM: --

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429030#comment-15429030 ] Micah Kornfield edited comment on ARROW-81 at 8/19/16 11:33 PM: --

[jira] [Commented] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429030#comment-15429030 ] Micah Kornfield commented on ARROW-81: -- Yeah, sorry, I should be more consistent with t

[jira] [Comment Edited] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429030#comment-15429030 ] Micah Kornfield edited comment on ARROW-81 at 8/19/16 11:20 PM: --

[jira] [Commented] (ARROW-264) Create an Arrow File format

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15429008#comment-15429008 ] Wes McKinney commented on ARROW-264: Looks like a good start to me. We should add some

[jira] [Created] (ARROW-266) [C++] Fix the broken build

2016-08-19 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-266: -- Summary: [C++] Fix the broken build Key: ARROW-266 URL: https://issues.apache.org/jira/browse/ARROW-266 Project: Apache Arrow Issue Type: Bug Component

[jira] [Updated] (ARROW-81) [Format] Add a Category logical type (distinct from dictionary-encoding)

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-81: -- Summary: [Format] Add a Category logical type (distinct from dictionary-encoding) (was: C++: Add a Catego

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428957#comment-15428957 ] Wes McKinney commented on ARROW-81: --- We're running into what "first class type" means agai

Re: committing in arrow

2016-08-19 Thread Wes McKinney
Also, this patch https://github.com/apache/arrow/commit/e7e399db5fc6913e67426514279f81766a0778d2 broke the build. We should try to never break the build -- feel free to ping the folks working on C++ if there is work needed to address an API change in shared code (like the flatbuffers). On Fri, A

[jira] [Created] (ARROW-265) Negative decimal values have wrong padding

2016-08-19 Thread Steven Phillips (JIRA)
Steven Phillips created ARROW-265: - Summary: Negative decimal values have wrong padding Key: ARROW-265 URL: https://issues.apache.org/jira/browse/ARROW-265 Project: Apache Arrow Issue Type: B

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428834#comment-15428834 ] Micah Kornfield commented on ARROW-81: -- Thanks @wesm, I was going to post that I think

[jira] [Created] (ARROW-264) Create an Arrow File format

2016-08-19 Thread Julien Le Dem (JIRA)
Julien Le Dem created ARROW-264: --- Summary: Create an Arrow File format Key: ARROW-264 URL: https://issues.apache.org/jira/browse/ARROW-264 Project: Apache Arrow Issue Type: Improvement

Re: committing in arrow

2016-08-19 Thread William Wood
Can someone remove me from this? Thanks Sent from my iPhone > On Aug 19, 2016, at 2:36 PM, Julien Le Dem wrote: > > Committers: > We've been a little inconsistent in the way we merge stuff to master. > Please use the script dev/merge_arrow_pr.py in the repo. > This automates merging a pull req

committing in arrow

2016-08-19 Thread Julien Le Dem
Committers: We've been a little inconsistent in the way we merge stuff to master. Please use the script dev/merge_arrow_pr.py in the repo. This automates merging a pull request and standardizes a few things: - It will squash the PR - commit it with the right message to close the PR - close the c

Re: regular arrow sync up

2016-08-19 Thread Julien Le Dem
William, You have subscribed to dev@arrow.apache.org. to unsubscribe email dev-unsubscr...@arrow.apache.org On Thu, Aug 18, 2016 at 7:57 PM, William Wood wrote: > Can someone remove me from this thread, please. > > Thanks > > Sent from my iPhone > > > On Aug 18, 2016, at 8:54 PM, Micah Kornfield

Re: regular arrow sync up

2016-08-19 Thread Wes McKinney
hi William — you will need to send an email to dev-unsubscr...@arrow.apache.org On Fri, Aug 19, 2016 at 11:57 AM, William Wood wrote: > Can someone remove me from this thread, please. > > Thanks > > Sent from my iPhone > >> On Aug 18, 2016, at 8:54 PM, Micah Kornfield wrote: >> >> Thanks Julien

Re: [jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Wes McKinney
hi Pino, can you reply on JIRA for the sake of keeping the discussion in one place? >From what I know about sector categorization I think this is a slightly separate question -- here we are only concerned with the metadata and memory representation of data with a fixed number of categories (where

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428657#comment-15428657 ] Wes McKinney commented on ARROW-81: --- Here's a couple examples from Python and R (I believe

[jira] [Commented] (ARROW-263) Design an initial IPC mechanism for Arrow Vectors

2016-08-19 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428637#comment-15428637 ] Micah Kornfield commented on ARROW-263: --- [~pcmoritz] this looks cool. I think JNI mi

Re: [jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread pino patera
For the Financial World, category time series are very important (i.e. industry/sector categories are different over time). How would this structure look like in this scenario? On Fri, Aug 19, 2016 at 5:12 PM Jacques Nadeau (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/ARROW-81

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Jacques Nadeau (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428316#comment-15428316 ] Jacques Nadeau commented on ARROW-81: - Can you guys provide two small example datasets i

[jira] [Commented] (ARROW-81) C++: Add a Category nested type

2016-08-19 Thread Hadley Wickham (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428308#comment-15428308 ] Hadley Wickham commented on ARROW-81: - I agree with Wes that factors/categories are a fu