Re: PyArrow Size in 0.15 version

2019-10-22 Thread Wes McKinney
Someone might try writing a "slim" version of https://github.com/apache/arrow/blob/master/python/manylinux1/build_arrow.sh That would be the place to start On Tue, Oct 22, 2019 at 5:17 PM Tim Paine wrote: > > Arrow has lots of configuration arguments, and PyArrow allows you to build > certain

Re: PyArrow Size in 0.15 version

2019-10-22 Thread Tim Paine
Arrow has lots of configuration arguments, and PyArrow allows you to build certain subsets of Arrow’s functionality. Depending on what you need, you can probably start out by building from source and turning off Parquet, Plasma, and Gandiva support. When running cmake, use -DARROW_PARQUET=OFF

PyArrow Size in 0.15 version

2019-10-22 Thread Kiran Padmanabhui
Hi, I am trying to use PyArrow in AWS Lambda but the size is 190 MB which is too big for AWS Lambda. Is there a way I can compile it and reduce it to less than 20-30 MB? Thanks Kiran