quot;
<balaraju.kagid...@gmail.com<mailto:balaraju.kagid...@gmail.com>>,
"user@spark.apache.org<mailto:user@spark.apache.org>"
<user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: Re: General Question (Spark Hive integration )
Hi Bala,
It depends
k.apache.org<mailto:user@spark.apache.org>>
Subject: General Question (Spark Hive integration )
Hi ,
I have simple question regarding Spark Hive integration with DataFrames.
When we query for a table, does spark loads whole table into memory and
applies the filter on top of it or it onl
it.
>
> From: Silvio Fiorito <silvio.fior...@granturing.com>
> Date: Thursday, January 21, 2016 at 10:02 PM
> To: "Balaraju.Kagidala Kagidala" <balaraju.kagid...@gmail.com>,
> "user@spark.apache.org" <user@spark.apache.org>
> Subject: Re: Ge
Hi ,
I have simple question regarding Spark Hive integration with DataFrames.
When we query for a table, does spark loads whole table into memory and
applies the filter on top of it or it only loads the data with filter
applied.
for example if the my query 'select * from employee where
