SparkApplicationMaster commented on issue #2036: URL: https://github.com/apache/datafusion-comet/issues/2036#issuecomment-3115360009
@coderfender thanks for response! Actually, there is a whole bunch of such inconsistencies in different spark functions between datafusion output and what spark needs to return So I would like to discuss what to do with all this with some who cares Maybe add that to datafusion backlog if it is possible To make datafusion more consistent with spark, so it won't be needed to overcome this type of differences in every function But feel free to implement this in comet if you would like to You can even start with my code closing linked issue in sail, because it passes spark-tests and is written in pure datafusion expressions without the need to go deeper to arrow buffers: https://github.com/lakehq/sail/commit/97b462263edfb63e7553716d0cd7a046f6390695 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
