Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/22339
no, no cost penalties. Slightly lower namenode load too. If you had many,
many spark streaming clients scanning directories, HDFS ops teams would
eventually get upset. This will postpone the day--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
