[DISCUSS] Parquet C++/Rust: Rename Parquet::LogicalType to Parquet::ConvertedType

2019-05-28 Thread Deepak Majeti
Hi Everyone, In the early days of parquet-cpp development, the developers mapped the thrift::ConvertedType to parquet::LogicalType. This now leads to confusion with the recent introduction of thrift::LogicalType. Parquet Rust also adopted this incorrect naming convention. Are there any objection

[jira] [Created] (PARQUET-1587) Parquet Writer doesn't support to write list of Groups directly into hadoop

2019-05-28 Thread Udit Joshi (JIRA)
Udit Joshi created PARQUET-1587: --- Summary: Parquet Writer doesn't support to write list of Groups directly into hadoop Key: PARQUET-1587 URL: https://issues.apache.org/jira/browse/PARQUET-1587 Project:

[jira] [Updated] (PARQUET-1422) [C++] Use Arrow IO interfaces natively rather than current parquet:: wrappers

2019-05-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated PARQUET-1422: Labels: pull-request-available (was: ) > [C++] Use Arrow IO interfaces natively rather t

Bugfix: Apache parquet documentation, Need help with contribution

2019-05-28 Thread Priya Ranjan Singh
Hello (everyone), I have a bugfix for documentation website. Bug is on mobile browsers, navigation disappears and so all the important links including link for documentation disappears. I have a fix in my local computer and I could not proceed further because of no access rights to https://svn.apac

[jira] [Commented] (PARQUET-1422) [C++] Use Arrow IO interfaces natively rather than current parquet:: wrappers

2019-05-28 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850249#comment-16850249 ] Wes McKinney commented on PARQUET-1422: --- I went ahead and ported the "expanding-p

[jira] [Commented] (PARQUET-1422) [C++] Use Arrow IO interfaces natively rather than current parquet:: wrappers

2019-05-28 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850097#comment-16850097 ] Wes McKinney commented on PARQUET-1422: --- [~pitrou] I ran into a snag working on t

Re: Announcement for c++ parquet encryption

2019-05-28 Thread Gidon Gershinsky
Hi Wes, Yep, I meant private as in not under apache/arrow. Will be more careful with that term. https://github.com/apache/parquet-testing seems to currently contain only data (.parquet) files. Our samples are C++ and Java code files, that write and read .parquet files in different encryption con

Re: Announcement for c++ parquet encryption

2019-05-28 Thread Wes McKinney
hi Gidon, Surely you don't mean "private" private -- this was always on GitHub right (otherwise this runs against the Apache Way)? I think we should try to have all of the testing code in the upstream repositories. If there are sample files you need to check in (and they are not too large), pleas

Re: Announcement for c++ parquet encryption

2019-05-28 Thread Gidon Gershinsky
Hi Deepak, Sounds good. Here goes the current cpp interop sample (not final yet). We have a sample with a similar code in Java. https://github.com/newrevit13/arrow/blob/interop_tests/cpp/examples/parquet/low-level-api/encryption-interop-tests.cc Please let me know if we should add this file to t

[jira] [Commented] (PARQUET-1441) SchemaParseException: Can't redefine: list in AvroIndexedRecordConverter

2019-05-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849692#comment-16849692 ] ASF GitHub Bot commented on PARQUET-1441: - zivanfi commented on pull request #5