andishgar commented on issue #54026: URL: https://github.com/apache/arrow/issues/54026#issuecomment-6263384501
@pitrou, I understand why this happens: the current algorithm assumes that two dictionary arrays are equal only if their dictionaries are equal: https://github.com/apache/arrow/blob/f0988511a8ab25a914fe70e4260a07d2e08460db/cpp/src/arrow/compare.cc#L490-L494 However, as I demonstrated [here](https://github.com/apache/arrow/issues/54026#issue-5897393261), two dictionary arrays can have different dictionaries but the same logical representation. My question is: **Are two dictionary arrays required to have identical dictionary data to be considered equal?** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
