viirya commented on PR #403:
URL: https://github.com/apache/datafusion-comet/pull/403#issuecomment-2101797372
Besides, the Java Arrow bus is supported to be fixed in Arrow Java 16. But I
still see it happens in a few pipelines:
```
- multiple column distinct count *** FAILED *** (392 milliseconds)
org.apache.spark.SparkException: Job aborted due to stage failure: Task 5
in stage 59.0 failed 1 times, most recent failure: Lost task 5.0 in stage 59.0
(TID 117) (74d216948a65 executor driver):
org.apache.comet.CometNativeException: Fail to process Arrow array with reason
C Data interface error: The external buffer at position 2 is null..
```
And more interesting is, the test doesn't always have the failure. I also
cannot reproduce it locally.
Wondering if there are more than one Java Arrow jar is included to randomly
it picks up an older version. 🤔
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
