Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/22952
@gaborgsomogyi @steveloughran
Please take a look at 17b9b9a043ead0d448048c88b30f544228bd230b which just
leverages GlobFilter. You may find that when the depth of archive path is more
than 2, there's no chance for final destination to be picked up from
FileStreamSource: so most of usual cases overlap will not happen, as well as
Spark can determine this as only comparing depths.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
