Re: Spark SQL Optimization

2016-03-23 Thread Takeshi Yamamuro
Filter (user_name#13659 = user) >> Scan >> >> ParquetRelation[snackfs://shared:9042/aladdin_data_beta/table3.parquet][anc_user_group#13658,user_name#13659] >>ConvertToUnsafe >> Project [perm_group#13667,user_group#13665] >> Fil

Re: Spark SQL Optimization

2016-03-22 Thread Rishi Mishra
ject [perm_group#13667,user_group#13665] > Filter (perm_type#13666 = TEST) > Scan > > ParquetRelation[snackfs://shared:9042/aladdin_data_beta/table2.parquet][perm_group#13667,user_group#13665,perm_type#13666] > ConvertToUnsafe > Scan > > Parqu

Re: Spark SQL Optimization

2016-03-21 Thread gtinside
://shared:9042/aladdin_data_beta/table1.parquet][portfolio_code#14119,anc_port_group#14117] -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Optimization-tp26548p26553.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Spark SQL Optimization

2016-03-21 Thread Xiao Li
timized query and hence the >> query >> executes faster. All the tables are being sourced from parquet files >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Optimization-tp26548.h

Re: Spark SQL Optimization

2016-03-21 Thread Michael Armbrust
s faster. All the tables are being sourced from parquet files > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Optimization-tp26548.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > >

Spark SQL Optimization

2016-03-21 Thread gtinside
ng sourced from parquet files -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Optimization-tp26548.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To u