timsaucer commented on PR #1311: URL: https://github.com/apache/datafusion-python/pull/1311#issuecomment-3589642937
> I checked and in the previous version the reader.read_all() method in the test_arrow_c_stream_interrupted never has a chance to call the check_signals method. It executes PartitionedDataFrameStreamReader::next, which in turn calls poll_next_batch, which immediately returns the result, so the tokio::select! exits right away. In the new datafusion version a batch is never generated. Are you sure this isn't during the first call to `wait_for_future`? We should get one call that returns very fast in `execute_stream_partitioned` and then another call during `PartitionedDataFrameStreamReader::next` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
