Re: [SQL] Reading from hive table is listing all files in S3

> > À: "Mehdi Meziane" <mehdi.mezi...@ldmobile.net> > Cc: "user @spark" <user@spark.apache.org> > Envoyé: Mercredi 3 Août 2016 16h47:46 GMT +01:00 Amsterdam / Berlin / > Berne / Rome / Stockholm / Vienne > Objet: Re: [SQL] Reading from hive

Re: [SQL] Reading from hive table is listing all files in S3

park" <user@spark.apache.org> Envoyé: Mercredi 3 Août 2016 16h47:46 GMT +01:00 Amsterdam / Berlin / Berne / Rome / Stockholm / Vienne Objet: Re: [SQL] Reading from hive table is listing all files in S3 Hi, Do you have a schema definition for this Hive table? What format is t

[SQL] Reading from hive table is listing all files in S3

Hi all, We have a hive table stored in S3 and registered in a hive metastore. This table is partitionned with a key "day". So we access this table through the spark dataframe API as : sqlContext.read() .table("tablename) .where(col("day").between("2016-08-01","2016-08-02")) When