RussellSpitzer commented on issue #15427: URL: https://github.com/apache/iceberg/issues/15427#issuecomment-3949257815
I don't think it's a bug to not normalize or change white space in provided string values. While we could provide optional trim modifiers to spark or flink writers, that really seems like an engine concern and not part of Iceberg. We aren't really in the business of sanitizing user input. While in this case the trailing white space may be a user mistake, I don't think that's something we can assume. As for statistics and info about printing, we already surface those metrics in the spark metric system so they could be tracked. This may be more of an iceberg concern though once we add in constraints, at that point iceberg will have a true mechanism for describing valid input values. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
