I'm looking at options to replace the custom Arrow logic in cuDF with Arrow library calls. What's the recommended way to declare a dependency on pyarrow/arrowcpp with CUDA support?

I see in the docs it says to build from source, but that's only an option for an (advanced) end-user. And building/vendoring libarrow_cuda.so isn't a great option for a non-Arrow library, because someone who does source build Arrow-with-cuda will conflict with the version we ship.

Right now we're considering statically linking libarrow_cuda into libcudf.so and vendoring Arrow's cuda cython alongside ours, but this increases compile times/library size.

Is there a package management solution (like pip/conda install pyarrow[cuda]) that I'm missing? If not, should there be?

Best,

Paul

Reply via email to