HyukjinKwon commented on PR #58603: URL: https://github.com/apache/spark/pull/58603#issuecomment-5584830685
Closing after review. Spark's XML reader (Woodstox, shaded in hadoop-client) enforces a default maximum element depth (1000) and raises a clean XMLStreamException well before the JVM stack is exhausted, and that exception is already handled per the configured parse mode. So a deeply nested record does not actually escape as an unhandled error during inference, and this change is effectively dead code. If bounding inference depth is ever desired, making Woodstox's limit explicit and configurable (WstxInputProperties.P_MAX_ELEMENT_DEPTH) would be the deterministic way to do it; that can be a separate change. Closing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
