[jira] [Resolved] (PARQUET-891) [C++] Do not search for Snappy in default system paths

2017-02-22 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-891. - Resolution: Fixed Fix Version/s: cpp-1.0.0 Issue resolved by pull request 258

[jira] [Updated] (PARQUET-893) GroupColumnIO.getFirst() doesn't check for empty groups

2017-02-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated PARQUET-893: --- Description: The following Spark snippet reproduces this issue with Spark 2.1 (with parquet-mr

[jira] [Created] (PARQUET-893) GroupColumnIO.getFirst() doesn't check for empty groups

2017-02-22 Thread Cheng Lian (JIRA)
Cheng Lian created PARQUET-893: -- Summary: GroupColumnIO.getFirst() doesn't check for empty groups Key: PARQUET-893 URL: https://issues.apache.org/jira/browse/PARQUET-893 Project: Parquet Issue

[jira] [Updated] (PARQUET-892) [C++] Clean up link library targets in CMake files

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated PARQUET-892: - Priority: Major (was: Blocker) > [C++] Clean up link library targets in CMake files >

[jira] [Updated] (PARQUET-892) [C++] Clean up link library targets in CMake files

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated PARQUET-892: - Summary: [C++] Clean up link library targets in CMake files (was: [C++] Transitive dependencies

[jira] [Commented] (PARQUET-892) [C++] Clean up link library targets in CMake files

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879796#comment-15879796 ] Wes McKinney commented on PARQUET-892: -- This ended up being a bit of a red herring, because the

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Hi Wes, Here is the shell transcript [1], I ran it with your patch included, and it's still not resolved. [1] https://gist.github.com/keithgchapman/b3e9ee2df2d2a3e6d6efde1f2b6c6d89 Regards, Keith. http://keith-chapman.com On Wed, Feb 22, 2017 at 1:14 PM, Wes McKinney

[jira] [Assigned] (PARQUET-892) [C++] Transitive dependencies of parquet_static are not being linked in some CMake versions

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned PARQUET-892: Assignee: Wes McKinney PR: https://github.com/apache/parquet-cpp/pull/259 > [C++]

[jira] [Created] (PARQUET-892) [C++] Transitive dependencies of parquet_static are not being linked in some CMake versions

2017-02-22 Thread Wes McKinney (JIRA)
Wes McKinney created PARQUET-892: Summary: [C++] Transitive dependencies of parquet_static are not being linked in some CMake versions Key: PARQUET-892 URL: https://issues.apache.org/jira/browse/PARQUET-892

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Wes McKinney
Thanks, this is helpful. The shared library 3rd-party dependencies are not being properly linked in the executables. It seems (?) it could depend on the CMake version. For example, on my system (Ubuntu 14.04) with $ cmake --version cmake version 2.8.12.2 with $CC and $CXX set and cmake ..

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Hi Wes, You can find the shell transcript here [1]. [1] https://gist.github.com/keithgchapman/ee2ce6f27868f532d7c0dfceaae874ed Regards, Keith. http://keith-chapman.com On Wed, Feb 22, 2017 at 12:14 PM, Keith Chapman wrote: > I actually had 2 versions of boost, I

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
I actually had 2 versions of boost, I built 1.54 once for a different project (which I do not need anymore), I got rid of it and now it picks up 1.58 but still gives the same error. Will upload a complete shell transcript. Regards, Keith. http://keith-chapman.com On Wed, Feb 22, 2017 at 12:04

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Wes McKinney
How did you build Boost? If you could upload a complete shell transcript starting from a clean git clone (run "git clean -fdx ." in your clone) to GitHub gist or someplace else I can take a closer look. Ubuntu 16.04 claims to be shipping Boost 1.58, so you may need to set a different $BOOST_ROOT

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Interestingly if I build with the following (instead of having -DCMAKE_CXX_COMPILER=g++-4.9 -DCMAKE_C_COMPILER=gcc-4.9) export CC="gcc-4.9" export CXX="g++-4.9" cmake .. -DCMAKE_BUILD_TYPE=release -DPARQUET_BUILD_TESTS=Off I get rid of the arrow related linkage errors and end up with only boost

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Yes, I get it on a clean build. Regards, Keith. http://keith-chapman.com On Wed, Feb 22, 2017 at 11:42 AM, Wes McKinney wrote: > Do you get these errors from a clean build (i.e. you've removed all > the artifacts and CMake files from your prior build)? We are building >

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Wes McKinney
Do you get these errors from a clean build (i.e. you've removed all the artifacts and CMake files from your prior build)? We are building in Travis CI with gcc/g++ 4.9 and have not been having any issues: https://github.com/apache/parquet-cpp/blob/master/ci/before_script_travis.sh#L20 On Wed,

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Hi Wes, Tried the patch and it does the trick, thank you for the prompt response. Also I noticed another issue, not sure if you'd regard it as a bug or not but I'll throw it out for your consideration. If I build the parquet library with "cmake . -DCMAKE_BUILD_TYPE=release

[jira] [Updated] (PARQUET-371) Bumps Thrift version to 0.9.3

2017-02-22 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PARQUET-371: -- Summary: Bumps Thrift version to 0.9.3 (was: Bumps Thrift version to 0.9.0) > Bumps Thrift

[jira] [Resolved] (PARQUET-889) Fix compilation when PARQUET_USE_SSE is on

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved PARQUET-889. -- Resolution: Fixed Fix Version/s: cpp-1.0.0 Issue resolved by pull request 257

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Wes McKinney
You can try out this patch if you like: https://github.com/apache/parquet-cpp/pull/258 This should be included in the next 1.0.0 RC On Wed, Feb 22, 2017 at 1:32 PM, Keith Chapman wrote: > Thanks Wes. > > Regards, > Keith. > > http://keith-chapman.com > > On Wed, Feb

[jira] [Assigned] (PARQUET-891) [C++] Do not search for Snappy in default system paths

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned PARQUET-891: Assignee: Wes McKinney > [C++] Do not search for Snappy in default system paths >

[jira] [Commented] (PARQUET-891) [C++] Do not search for Snappy in default system paths

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878978#comment-15878978 ] Wes McKinney commented on PARQUET-891: -- PR: https://github.com/apache/parquet-cpp/pull/258 > [C++]

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Thanks Wes. Regards, Keith. http://keith-chapman.com On Wed, Feb 22, 2017 at 10:30 AM, Wes McKinney wrote: > I'm able to reproduce the issue on Ubuntu 14.04 > > Linking CXX shared library debug/libparquet.so > /usr/bin/ld: /usr/lib/libsnappy.a(snappy.o): relocation

[jira] [Created] (PARQUET-891) [C++] Do not search for Snappy in default system paths

2017-02-22 Thread Wes McKinney (JIRA)
Wes McKinney created PARQUET-891: Summary: [C++] Do not search for Snappy in default system paths Key: PARQUET-891 URL: https://issues.apache.org/jira/browse/PARQUET-891 Project: Parquet

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Wes McKinney
I'm able to reproduce the issue on Ubuntu 14.04 Linking CXX shared library debug/libparquet.so /usr/bin/ld: /usr/lib/libsnappy.a(snappy.o): relocation R_X86_64_32S against `.rodata' can not be used when making a shared object; recompile with -fPIC /usr/lib/libsnappy.a: error adding symbols: Bad

Re: [PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Hi Wes, No I don't have SNAPPY_HOME set. Yes this seems similar to 885 On Feb 22, 2017 10:25 AM, "Wes McKinney" wrote: > hi Keith, > > It's not caused by PARQUET-885, but it is the same type of problem. Do > you have $SNAPPY_HOME set? If you compile your own thirdparty >

[PARQUET-CPP] Build failure on master

2017-02-22 Thread Keith Chapman
Hi, I'm trying to build master and I get the following error, I have the .so versions of the files as seen below too, Is this somewhat relaped to Parquet-885? ls /usr/lib/x86_64-linux-gnu/libsnappy. libsnappy.a libsnappy.solibsnappy.so.1 libsnappy.so.1.3.0 Error seen:

[jira] [Assigned] (PARQUET-849) [C++] Upgrade default Thrift in thirdparty toolchain to 0.9.3 or 0.10

2017-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned PARQUET-849: Assignee: Julien Lafaye (was: Wes McKinney) > [C++] Upgrade default Thrift in thirdparty

[jira] [Updated] (PARQUET-890) C++: Support I/O of DATE columns in parquet_arrow

2017-02-22 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-890: Description: Currently we can only write Timestamp columns but no DATE columns to/from Arrow. This

[jira] [Created] (PARQUET-890) C++: Support I/O of DATE columns in parquet_arrow

2017-02-22 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-890: --- Summary: C++: Support I/O of DATE columns in parquet_arrow Key: PARQUET-890 URL: https://issues.apache.org/jira/browse/PARQUET-890 Project: Parquet Issue

[jira] [Created] (PARQUET-889) Fix compilation when PARQUET_USE_SSE is on

2017-02-22 Thread Thomas Sanchez (JIRA)
Thomas Sanchez created PARQUET-889: -- Summary: Fix compilation when PARQUET_USE_SSE is on Key: PARQUET-889 URL: https://issues.apache.org/jira/browse/PARQUET-889 Project: Parquet Issue Type: