Le 05 nov. 2017 à 22:02, ayan guha écrivait : > Can you confirm if JDBC DF Reader actually loads all data from source to > driver > memory and then distributes to the executors?
apparently yes when not using partition column > And this is true even when a > partition column is provided? No, in this case, each worker send a jdbc call accordingly to documentation https://spark.apache.org/docs/latest/sql-programming-guide.html#jdbc-to-other-databases --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
