Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20473 BTW @ueshin, I think we should use `require_minimum_pyarrow_version` here: https://github.com/apache/spark/blob/ec63e2d0743a4f75e1cce21d0fe2b54407a86a4a/python/pyspark/sql/tests.py#L78-L84 because we declared >= 0.8.0 as you already know: https://github.com/apache/spark/blob/b8bfce51abf28c66ba1fc67b0f25fe1617c81025/python/setup.py#L204 Would you like me to double check other files and fix it separately or would you be willing to fix it?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org