dongjoon-hyun commented on PR #46232:
URL: https://github.com/apache/spark/pull/46232#issuecomment-2267834361
For the record, MLFlow 2.15.0 was released on July 29th, but the requirement
is the same. We cannot use `pyarrow` `16.0.0` and `17.0.0`.
- https://pypi.org/project/mlflow/2.15.0/
dongjoon-hyun commented on PR #46232:
URL: https://github.com/apache/spark/pull/46232#issuecomment-2240617380
We need to use 17.0.0 due to SPARK-48940
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
dongjoon-hyun commented on PR #46232:
URL: https://github.com/apache/spark/pull/46232#issuecomment-2103795700
This is still blocked by `mlflow 2.12.2`
```
mlflow 2.12.2 requires pyarrow<16,>=4.0.0, but you have pyarrow 16.0.0 which
is incompatible.
```
--
This is an automated mes
dongjoon-hyun commented on PR #46232:
URL: https://github.com/apache/spark/pull/46232#issuecomment-2077798542
This is blocked by `mlflow` currently.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
dongjoon-hyun opened a new pull request, #46232:
URL: https://github.com/apache/spark/pull/46232
…
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
