[jira] [Comment Edited] (ARROW-883) [JAVA] Introduction of new types has shifted Enumerations

2017-04-23 Thread Julien Le Dem (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980708#comment-15980708
 ] 

Julien Le Dem edited comment on ARROW-883 at 4/24/17 4:15 AM:
--

[~jnadeau] To clarify, You are referring to the ordinals of the Types.MinorType 
enum?


was (Author: julienledem):
To clarify, You are referring to the ordinals of the Types.MinorType enum?

> [JAVA] Introduction of new types has shifted Enumerations
> -
>
> Key: ARROW-883
> URL: https://issues.apache.org/jira/browse/ARROW-883
> Project: Apache Arrow
>  Issue Type: Bug
>Reporter: Jacques Nadeau
>Assignee: Julien Le Dem
>Priority: Blocker
> Fix For: 0.3.0
>
>
> The introduction of new types in 
> https://github.com/apache/arrow/blame/master/java/vector/src/main/java/org/apache/arrow/vector/types/Types.java
> Has shifted the enumeration ordinals, causing compatibility problems with 
> older java code that serializes the ordinals. Should be fixed before 0.3 
> release



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (ARROW-883) [JAVA] Introduction of new types has shifted Enumerations

2017-04-23 Thread Julien Le Dem (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980708#comment-15980708
 ] 

Julien Le Dem commented on ARROW-883:
-

To clarify, You are referring to the ordinals of the Types.MinorType enum?

> [JAVA] Introduction of new types has shifted Enumerations
> -
>
> Key: ARROW-883
> URL: https://issues.apache.org/jira/browse/ARROW-883
> Project: Apache Arrow
>  Issue Type: Bug
>Reporter: Jacques Nadeau
>Assignee: Julien Le Dem
>Priority: Blocker
> Fix For: 0.3.0
>
>
> The introduction of new types in 
> https://github.com/apache/arrow/blame/master/java/vector/src/main/java/org/apache/arrow/vector/types/Types.java
> Has shifted the enumeration ordinals, causing compatibility problems with 
> older java code that serializes the ordinals. Should be fixed before 0.3 
> release



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (ARROW-865) [Python] Verify Parquet roundtrips for new date/time types

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney reassigned ARROW-865:
--

Assignee: Wes McKinney

> [Python] Verify Parquet roundtrips for new date/time types
> --
>
> Key: ARROW-865
> URL: https://issues.apache.org/jira/browse/ARROW-865
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: Python
>Reporter: Wes McKinney
>Assignee: Wes McKinney
> Fix For: 0.3.0
>
>
> Requires PARQUET-915. Going to try to get this into the release



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ARROW-884) [C++] Exclude internal classes from documentation

2017-04-23 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-884:
--

 Summary: [C++] Exclude internal classes from documentation
 Key: ARROW-884
 URL: https://issues.apache.org/jira/browse/ARROW-884
 Project: Apache Arrow
  Issue Type: Bug
  Components: C++
Reporter: Wes McKinney


Our API docs are a bit smelly with quite a few internal classes and methods:

http://arrow.apache.org/docs/cpp/annotated.html

We should add internal constructs to an {{arrow::internal}} namespace so that 
we can use the EXCLUDE_SYMBOLS rule in Doxygen to exclude them from the 
documentation. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (ARROW-883) [JAVA] Introduction of new types has shifted Enumerations

2017-04-23 Thread Jacques Nadeau (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacques Nadeau updated ARROW-883:
-
Summary: [JAVA] Introduction of new types has shifted Enumerations  (was: 
Introduction of new types has shifted Enumerations)

> [JAVA] Introduction of new types has shifted Enumerations
> -
>
> Key: ARROW-883
> URL: https://issues.apache.org/jira/browse/ARROW-883
> Project: Apache Arrow
>  Issue Type: Bug
>Reporter: Jacques Nadeau
>Assignee: Julien Le Dem
>Priority: Blocker
> Fix For: 0.3.0
>
>
> The introduction of new types in 
> https://github.com/apache/arrow/blame/master/java/vector/src/main/java/org/apache/arrow/vector/types/Types.java
> Has shifted the enumeration ordinals, causing compatibility problems with 
> older java code that serializes the ordinals. Should be fixed before 0.3 
> release



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ARROW-883) Introduction of new types has shifted Enumerations

2017-04-23 Thread Jacques Nadeau (JIRA)
Jacques Nadeau created ARROW-883:


 Summary: Introduction of new types has shifted Enumerations
 Key: ARROW-883
 URL: https://issues.apache.org/jira/browse/ARROW-883
 Project: Apache Arrow
  Issue Type: Bug
Reporter: Jacques Nadeau
Assignee: Julien Le Dem
Priority: Blocker
 Fix For: 0.3.0


The introduction of new types in 

https://github.com/apache/arrow/blame/master/java/vector/src/main/java/org/apache/arrow/vector/types/Types.java

Has shifted the enumeration ordinals, causing compatibility problems with older 
java code that serializes the ordinals. Should be fixed before 0.3 release



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (ARROW-880) [GLib] Add garrow_primitive_array_get_buffer()

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney resolved ARROW-880.

Resolution: Fixed

Issue resolved by pull request 586
[https://github.com/apache/arrow/pull/586]

> [GLib] Add garrow_primitive_array_get_buffer()
> --
>
> Key: ARROW-880
> URL: https://issues.apache.org/jira/browse/ARROW-880
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: GLib
>Reporter: Kouhei Sutou
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (ARROW-843) [Python] Parquet merging unequal but equivalent schemas

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-843:
---
Fix Version/s: 0.4.0

> [Python] Parquet merging unequal but equivalent schemas
> ---
>
> Key: ARROW-843
> URL: https://issues.apache.org/jira/browse/ARROW-843
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: Python
>Reporter: Wes McKinney
> Fix For: 0.4.0
>
>
> Some Parquet datasets may contain schemas with mixed REQUIRED/OPTIONAL 
> repetition types. While such schemas aren't strictly equal, we will need to 
> consider them equivalent on the read path



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (ARROW-480) [Python] Add accessors for Parquet column statistics

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-480:
---
Fix Version/s: (was: 0.3.0)
   0.4.0

> [Python] Add accessors for Parquet column statistics 
> -
>
> Key: ARROW-480
> URL: https://issues.apache.org/jira/browse/ARROW-480
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: Python
>Reporter: Wes McKinney
>Assignee: Wes McKinney
> Fix For: 0.4.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (ARROW-480) [Python] Add accessors for Parquet column statistics

2017-04-23 Thread Wes McKinney (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980567#comment-15980567
 ] 

Wes McKinney commented on ARROW-480:


I'm going to let this one slip to 0.4. 

> [Python] Add accessors for Parquet column statistics 
> -
>
> Key: ARROW-480
> URL: https://issues.apache.org/jira/browse/ARROW-480
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: Python
>Reporter: Wes McKinney
>Assignee: Wes McKinney
> Fix For: 0.3.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (ARROW-879) compat with pandas 0.20.0

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney resolved ARROW-879.

Resolution: Fixed

Issue resolved by pull request 585
[https://github.com/apache/arrow/pull/585]

> compat with pandas 0.20.0
> -
>
> Key: ARROW-879
> URL: https://issues.apache.org/jira/browse/ARROW-879
> Project: Apache Arrow
>  Issue Type: Bug
>Reporter: Jeff Reback
>Priority: Blocker
>
> pandas changes the location of an import for ``DatetimeTZDtype``: 
> http://pandas-docs.github.io/pandas-docs-travis/whatsnew.html#reorganization-of-the-library-privacy-changes



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (ARROW-879) compat with pandas 0.20.0

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney reassigned ARROW-879:
--

Assignee: Jeff Reback

> compat with pandas 0.20.0
> -
>
> Key: ARROW-879
> URL: https://issues.apache.org/jira/browse/ARROW-879
> Project: Apache Arrow
>  Issue Type: Bug
>Reporter: Jeff Reback
>Assignee: Jeff Reback
>Priority: Blocker
>
> pandas changes the location of an import for ``DatetimeTZDtype``: 
> http://pandas-docs.github.io/pandas-docs-travis/whatsnew.html#reorganization-of-the-library-privacy-changes



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (ARROW-98) Java: API documentation

2017-04-23 Thread Wes McKinney (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-98?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980559#comment-15980559
 ] 

Wes McKinney commented on ARROW-98:
---

I added Javadoc support in https://github.com/apache/arrow/pull/589 and 
published current version to http://arrow.apache.org/docs/java/

> Java: API documentation
> ---
>
> Key: ARROW-98
> URL: https://issues.apache.org/jira/browse/ARROW-98
> Project: Apache Arrow
>  Issue Type: Task
>  Components: Java - Memory
>Reporter: Uwe L. Korn
>Assignee: Wes McKinney
> Fix For: 0.3.0
>
>
> For developers using Arrow via Java, we should provide an automatically 
> generated API documentation with a typical tool used in the Java world.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (ARROW-98) Java: API documentation

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-98?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-98:
--
Fix Version/s: 0.3.0

> Java: API documentation
> ---
>
> Key: ARROW-98
> URL: https://issues.apache.org/jira/browse/ARROW-98
> Project: Apache Arrow
>  Issue Type: Task
>  Components: Java - Memory
>Reporter: Uwe L. Korn
> Fix For: 0.3.0
>
>
> For developers using Arrow via Java, we should provide an automatically 
> generated API documentation with a typical tool used in the Java world.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (ARROW-98) Java: API documentation

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-98?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney reassigned ARROW-98:
-

Assignee: Wes McKinney

> Java: API documentation
> ---
>
> Key: ARROW-98
> URL: https://issues.apache.org/jira/browse/ARROW-98
> Project: Apache Arrow
>  Issue Type: Task
>  Components: Java - Memory
>Reporter: Uwe L. Korn
>Assignee: Wes McKinney
> Fix For: 0.3.0
>
>
> For developers using Arrow via Java, we should provide an automatically 
> generated API documentation with a typical tool used in the Java world.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (ARROW-798) [Docs] Publish Format Markdown documents somehow on arrow.apache.org

2017-04-23 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney reassigned ARROW-798:
--

Assignee: Wes McKinney

> [Docs] Publish Format Markdown documents somehow on arrow.apache.org
> 
>
> Key: ARROW-798
> URL: https://issues.apache.org/jira/browse/ARROW-798
> Project: Apache Arrow
>  Issue Type: Task
>  Components: Format
>Reporter: Wes McKinney
>Assignee: Wes McKinney
> Fix For: 0.3.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ARROW-882) [C++] On Windows statically built lib file overwrites lib file of shared build

2017-04-23 Thread Max Risuhin (JIRA)
Max Risuhin created ARROW-882:
-

 Summary: [C++] On Windows statically built lib file overwrites lib 
file of shared build
 Key: ARROW-882
 URL: https://issues.apache.org/jira/browse/ARROW-882
 Project: Apache Arrow
  Issue Type: Bug
  Components: C++
 Environment: Windows
Reporter: Max Risuhin
Assignee: Max Risuhin
Priority: Minor


Statically built arrow.lib file overwrites previously built arrow.lib file of 
shared build. This possible should be resolved by renaming of statically built 
library, for instance, to arrow_static.lib



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ARROW-881) Reconstruct Pandas DataFrame indexes using custom_metadata

2017-04-23 Thread Phillip Cloud (JIRA)
Phillip Cloud created ARROW-881:
---

 Summary: Reconstruct Pandas DataFrame indexes using custom_metadata
 Key: ARROW-881
 URL: https://issues.apache.org/jira/browse/ARROW-881
 Project: Apache Arrow
  Issue Type: Bug
Reporter: Phillip Cloud
Assignee: Phillip Cloud






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (ARROW-879) compat with pandas 0.20.0

2017-04-23 Thread Jeff Reback (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980447#comment-15980447
 ] 

Jeff Reback commented on ARROW-879:
---

closed via https://github.com/apache/arrow/pull/585

> compat with pandas 0.20.0
> -
>
> Key: ARROW-879
> URL: https://issues.apache.org/jira/browse/ARROW-879
> Project: Apache Arrow
>  Issue Type: Bug
>Reporter: Jeff Reback
>Priority: Blocker
>
> pandas changes the location of an import for ``DatetimeTZDtype``: 
> http://pandas-docs.github.io/pandas-docs-travis/whatsnew.html#reorganization-of-the-library-privacy-changes



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (ARROW-483) [C++/Python] Provide access to "custom_metadata" Field attribute in IPC setting

2017-04-23 Thread Phillip Cloud (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phillip Cloud reassigned ARROW-483:
---

Assignee: Phillip Cloud

> [C++/Python] Provide access to "custom_metadata" Field attribute in IPC 
> setting
> ---
>
> Key: ARROW-483
> URL: https://issues.apache.org/jira/browse/ARROW-483
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Phillip Cloud
>
> This will make it easier to write adapters for custom data types embedded in 
> built-in Arrow types



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ARROW-879) compat with pandas 0.20.0

2017-04-23 Thread Jeff Reback (JIRA)
Jeff Reback created ARROW-879:
-

 Summary: compat with pandas 0.20.0
 Key: ARROW-879
 URL: https://issues.apache.org/jira/browse/ARROW-879
 Project: Apache Arrow
  Issue Type: Bug
Reporter: Jeff Reback
Priority: Blocker


pandas changes the location of an import for ``DatetimeTZDtype``: 
http://pandas-docs.github.io/pandas-docs-travis/whatsnew.html#reorganization-of-the-library-privacy-changes




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)