charlesbluca opened a new pull request, #350:
URL: https://github.com/apache/arrow-datafusion-python/pull/350
# Rationale for this change
<!--
Why are you proposing this change? If this is already explained clearly in
the issue then this section is not needed.
Explaining clearly why changes are proposed helps reviewers understand your
changes and offer better suggestions for fixes.
-->
When attempting to import the generated conda nightlies on a non-Linux OS,
we get an error message looking something like:
```python
>>> import datafusion
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File
"/Users/charlesb/mambaforge/envs/test-datafustion-packages/lib/python3.10/site-packages/datafusion/__init__.py",
line 28, in <module>
from ._internal import (
ImportError:
dlopen(/Users/charlesb/mambaforge/envs/test-datafustion-packages/lib/python3.10/site-packages/datafusion/_internal.abi3.so,
0x0002): tried:
'/Users/charlesb/mambaforge/envs/test-datafustion-packages/lib/python3.10/site-packages/datafusion/_internal.abi3.so'
(not a mach-o file),
'/System/Volumes/Preboot/Cryptexes/OS/Users/charlesb/mambaforge/envs/test-datafustion-packages/lib/python3.10/site-packages/datafusion/_internal.abi3.so'
(no such file),
'/Users/charlesb/mambaforge/envs/test-datafustion-packages/lib/python3.10/site-packages/datafusion/_internal.abi3.so'
(not a mach-o file)
```
I'm fairly sure this is due to the package being built as `noarch` right
now, and I think can be resolved by specifying an architecture-dependent Rust
compiler at build time (though probably won't be able to get full verification
on this until we run against conda-forge's CI if we intend to publish there).
# What changes are included in this PR?
<!--
There is no need to duplicate the description in the issue here but it is
sometimes worth providing a summary of the individual changes in this PR.
-->
Modifications to the conda nightly recipe to enable architectured builds of
the nightly packages, which should hopefully unblock import errors on other
operating systems.
Might also push some temporary changes to roughly verify that things build
correctly on Windows/macOS, though was planning to follow dask-sql's practice
of only testing builds against Linux.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
