Query data in subdirectories in Hive Partitions using Spark SQL

2017-02-15 Thread Ahmed Kamal Abdelfatah
Hi folks, How can I force spark sql to recursively get data stored in parquet format from subdirectories ? In Hive, I could achieve this by setting few Hive configs. set hive.input.dir.recursive=true; set hive.mapred.supports.subdirectories=true; set hive.supports.subdirectories=true; set

unsubscribe

2022-05-02 Thread Ahmed Kamal Abdelfatah
-- *This email, including any information it contains and any attachments to it, is confidential and may be privileged. This email is intended only for the use of the named recipient(s). If you are not a named recipient, please notify the sender immediately by replying to this