Re: [parquet-cpp] [parquet-tools] Problem in reading file's Metadata

2017-01-12 Thread Julien Le Dem
This looks like a bug in parquet-tools when printing the schema to the console. Possibly adding a @JsonValue annotation to intValue() [1] in Type would fix it. [1]

[parquet-cpp] [parquet-tools] Problem in reading file's Metadata

2017-01-12 Thread James Pirz
Hi, I am trying to use a sample parquet file (generated via an existing example [1] in parquet-cpp) against parquet-tools [2] (in local mode) from parquet-mr project to check its content. However, parquet-tools can not read the schema and footer of the generated file successfully showing the

Re: [PARQUET_CPP] Why does the arrow reader in parquet does an extra copy?

2017-01-12 Thread Keith Chapman
Cool, Thanks for the update Wes. I was wondering if there was some deign issue I was not aware of :). I will keep my eyes on the PR and llok to make more optimizations and upstream it. Regards, Keith. http://keith-chapman.com On Thu, Jan 12, 2017 at 5:15 PM, Wes McKinney

Re: parquet-cpp problem with Thrift library

2017-01-12 Thread James Pirz
Dear Wes, Thanks for your reply and help. As I do not have any reason to stick to Thrift 0.9.3 (I am just installing Thrift to be able to build parquet-cpp), I switched to Thrift 0.9.1 and exporting CXXFLAGS=-fPIC and passing it explicitly as an arg to 'configure' in Thrift fixed my problem and I

[PARQUET_CPP] Why does the arrow reader in parquet does an extra copy?

2017-01-12 Thread Keith Chapman
Hi, I'm using the the parquet-cpp library to read in some parquet files. I seen that the parquet-cpp library has support for arrow and hence I thought of giving it a shot. When running experiments I did not see any significant increase in performance hence I was taking a look at the code. It

FOSDEM 2017 Open Source Conference - Brussels

2017-01-12 Thread Sharan F
Hello Everyone This email is to tell you about ASF participation at FOSDEM. The event will be held in Brussels on 4^th & 5^th February 2017 and we are hoping that many people from our ASF projects will be there. https://fosdem.org/2017/ Attending FOSDEM is completely free and the ASF will

[jira] [Commented] (PARQUET-803) "How to contribute" link is broken on the webpage

2017-01-12 Thread Lars Volker (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820777#comment-15820777 ] Lars Volker commented on PARQUET-803: - I forgot about the other Jira, apologies for any confusion.

[jira] [Commented] (PARQUET-802) The link to "Google Hangout" on parquet.apache.org is broken

2017-01-12 Thread Gabor Szadovszky (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820753#comment-15820753 ] Gabor Szadovszky commented on PARQUET-802: -- [~julienledem], do you agree to remove the hangouts

[jira] [Commented] (PARQUET-803) "How to contribute" link is broken on the webpage

2017-01-12 Thread Gabor Szadovszky (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820744#comment-15820744 ] Gabor Szadovszky commented on PARQUET-803: -- Thanks for pointing this other issue, [~lv] however,

[jira] [Updated] (PARQUET-803) "How to contribute" link is broken on the webpage

2017-01-12 Thread Gabor Szadovszky (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky updated PARQUET-803: - Attachment: PARQUET-803.patch > "How to contribute" link is broken on the webpage >

[jira] [Assigned] (PARQUET-803) "How to contribute" link is broken on the webpage

2017-01-12 Thread Gabor Szadovszky (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky reassigned PARQUET-803: Assignee: Gabor Szadovszky > "How to contribute" link is broken on the webpage >

[jira] [Commented] (PARQUET-820) C++: Decoders should directly emit arrays with spacing for null entries

2017-01-12 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820443#comment-15820443 ] Uwe L. Korn commented on PARQUET-820: - PR: https://github.com/apache/parquet-cpp/pull/218 > C++: