Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Krisztián Szűcs
Perhaps an R conda-forge feedstock? I'm not sure how widely conda-forge is used in the R commmunity, but it already hosts around a thousand packages[1]. [1] https://github.com/conda-forge?&q=r- On Wed, Jan 2, 2019 at 6:09 PM Wes McKinney wrote: > hi folks, > > With 0.12 around the corner and si

[jira] [Created] (ARROW-4148) [CI/Python] Disable ORC on nightly Alpine builds

2019-01-03 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4148: -- Summary: [CI/Python] Disable ORC on nightly Alpine builds Key: ARROW-4148 URL: https://issues.apache.org/jira/browse/ARROW-4148 Project: Apache Arrow Iss

[jira] [Created] (ARROW-4149) [CI/C++] Parquet test misses ZSTD compression codec in CMake 3.2 nightly builds

2019-01-03 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4149: -- Summary: [CI/C++] Parquet test misses ZSTD compression codec in CMake 3.2 nightly builds Key: ARROW-4149 URL: https://issues.apache.org/jira/browse/ARROW-4149 Pro

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Jonathan Chiang
Hi, Long term, I believe getting an arrow package onto cran would be most useful for R users. Building arrow in R on Mac was easier than Linux for me. I was still having trouble installing after spending a couple hours or so. Typically if you can install.package from cran is most convenient

[NOTICE] Mandatory migration of git repositories to gitbox.apache.org

2019-01-03 Thread Apache Infrastructure Team
Hello, arrow folks. As stated earlier in 2018, all git repositories must be migrated from the git-wip-us.apache.org URL to gitbox.apache.org, as the old service is being decommissioned. Your project is receiving this email because you still have repositories on git-wip-us that needs to be migrated.

Parallel processing

2019-01-03 Thread Romain Francois
Hello, Are the functions in parallel.h the de facto model for parallelisation in arrow ? https://github.com/apache/arrow/blob/42cf69abfc1368c9884f4581811e2e7900c98fcd/cpp/src/arrow/util/parallel.h

Re: Bison error when making thrift on macOS

2019-01-03 Thread Romain Francois
Thanks. I'll give that a go if/when I need to build thrift. Romain > Le 2 janv. 2019 à 17:07, Wes McKinney a écrit : > > You stumbled on https://issues.apache.org/jira/browse/PARQUET-1319. > See > https://github.com/apache/parquet-cpp/commit/d15d2687e9f154e69e956e2a56c8d1fd6c3b7ac8 > (which is

Re: Parallel processing

2019-01-03 Thread Antoine Pitrou
Hi Romain, No, it's better if you use the CPU thread pool directly (or through TaskGroup, if that suits your execution model better). Regards Antoine. Le 03/01/2019 à 14:29, Romain Francois a écrit : > Hello, > > Are the functions in parallel.h the de facto model for parallelisation in >

Move arrow-site.git to gitbox

2019-01-03 Thread Uwe L. Korn
Hello, as requested per the mail from ASF infra, I would like to move the arrow-site git repo to gitbox. This is the repo used for the distribution of the rendered version of the website. Some +1s or a point why we should consider alternatives would help to bring this forward. If there is conse

Re: Move arrow-site.git to gitbox

2019-01-03 Thread Wes McKinney
+1 On Thu, Jan 3, 2019, 9:22 AM Uwe L. Korn Hello, > > as requested per the mail from ASF infra, I would like to move the > arrow-site git repo to gitbox. This is the repo used for the distribution > of the rendered version of the website. Some +1s or a point why we should > consider alternatives

[jira] [Created] (ARROW-4150) [C++] Buffer data should never be null

2019-01-03 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-4150: - Summary: [C++] Buffer data should never be null Key: ARROW-4150 URL: https://issues.apache.org/jira/browse/ARROW-4150 Project: Apache Arrow Issue Type: Wis

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Uwe L. Korn
We probably need to support both, conda-forge and CRAN. As a first shot, conda-forge will be much easier to setup as we should have a better build toolchain available there and this could also then be used in the multilanguage scenario demos really well. From my experience, the usage of conda in

Please Remove me From List

2019-01-03 Thread Zack Reder
Thanks!

Re: Please Remove me From List

2019-01-03 Thread Moshik Hershcovitch
Please remove me also Moshik Hershcovitch

Re: Please Remove me From List

2019-01-03 Thread Wes McKinney
You have to email dev-unsubscr...@arrow.apache.org to unsubscribe On Thu, Jan 3, 2019, 10:23 AM Moshik Hershcovitch Please remove me also > Moshik Hershcovitch > >

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Wes McKinney
To have non-trivial R use, we have to get install.package working, which I think means integration with CRAN. There are a lot of logistical issues around build and packaging on each platform. It would be great to have a written summary of the best practices for each platform for getting bindings pl

[jira] [Created] (ARROW-4151) [Rust] Restructure project directories

2019-01-03 Thread Chao Sun (JIRA)
Chao Sun created ARROW-4151: --- Summary: [Rust] Restructure project directories Key: ARROW-4151 URL: https://issues.apache.org/jira/browse/ARROW-4151 Project: Apache Arrow Issue Type: Task

Re: Move arrow-site.git to gitbox

2019-01-03 Thread Krisztián Szűcs
+1 On Thu, Jan 3, 2019 at 4:34 PM Wes McKinney wrote: > +1 > > On Thu, Jan 3, 2019, 9:22 AM Uwe L. Korn > > Hello, > > > > as requested per the mail from ASF infra, I would like to move the > > arrow-site git repo to gitbox. This is the repo used for the distribution > > of the rendered version

[jira] [Created] (ARROW-4152) [GLib] Remove an example to show Torch integration

2019-01-03 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4152: --- Summary: [GLib] Remove an example to show Torch integration Key: ARROW-4152 URL: https://issues.apache.org/jira/browse/ARROW-4152 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-4153) [GLib] Add builder_append_value() for consistency

2019-01-03 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4153: --- Summary: [GLib] Add builder_append_value() for consistency Key: ARROW-4153 URL: https://issues.apache.org/jira/browse/ARROW-4153 Project: Apache Arrow Issue Ty

Re: [Rust] crate versions and release process

2019-01-03 Thread Andy Grove
+1 from me. Keeping the code in a single repo makes sense but no need to artificially keep versions numbers consistent between the sub-crates. Andy. On Wed, Jan 2, 2019 at 10:28 PM Chao Sun wrote: > Hi, > > This is related to an earlier email I sent regarding separating the Rust > implementatio

[jira] [Created] (ARROW-4154) [GLib] Add GArrowDecimal128DataType

2019-01-03 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4154: --- Summary: [GLib] Add GArrowDecimal128DataType Key: ARROW-4154 URL: https://issues.apache.org/jira/browse/ARROW-4154 Project: Apache Arrow Issue Type: New Featur

Format specification document?

2019-01-03 Thread Kohei KaiGai
Hello, I'm now trying to understand the Apache Arrow format for my application. Is there a format specification document including meta-data layout? I checked out the description at: https://github.com/apache/arrow/tree/master/docs/source/format https://github.com/apache/arrow/tree/master/format

[jira] [Created] (ARROW-4155) [Rust] Implement array_ops::sum() for PrimitiveArray

2019-01-03 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4155: - Summary: [Rust] Implement array_ops::sum() for PrimitiveArray Key: ARROW-4155 URL: https://issues.apache.org/jira/browse/ARROW-4155 Project: Apache Arrow Issue Typ