Re: Increase partitions reading Parquet File

2015-04-14 Thread Masf
)? --- Original Message --- From: Masf masfwo...@gmail.com Sent: April 9, 2015 11:45 PM To: user@spark.apache.org Subject: Increase partitions reading Parquet File Hi I have this statement: val file = SqlContext.parquetfile(hdfs://node1/user/hive/warehouse/file.parquet) This code

Re: Increase partitions reading Parquet File

2015-04-14 Thread Michael Armbrust
@spark.apache.org Subject: Increase partitions reading Parquet File Hi I have this statement: val file = SqlContext.parquetfile(hdfs://node1/user/hive/warehouse/file.parquet) This code generates as many partitions as files are. So, I want to increase the number of partitions. I've