I can't write on hadoopConfig in Java Le vendredi 8 avril 2016, Silvio Fiorito <silvio.fior...@granturing.com> a écrit :
> Have you tried: > > sc.hadoopConfiguration.setLong(parquet.hadoop.ParquetOutputFormat.BLOCK_SIZE, > N * 1024 * 1024) > > Not sure if it’d work or not, but since it’s getting it from the Hadoop > config it should do it. > > > From: nihed mbarek <nihe...@gmail.com > <javascript:_e(%7B%7D,'cvml','nihe...@gmail.com');>> > Date: Friday, April 8, 2016 at 12:01 PM > To: "User@spark.apache.org > <javascript:_e(%7B%7D,'cvml','User@spark.apache.org');>" < > User@spark.apache.org > <javascript:_e(%7B%7D,'cvml','User@spark.apache.org');>> > Subject: How to configure parquet.block.size on Spark 1.6 > > Hi > How to configure parquet.block.size on Spark 1.6 ? > > Thank you > Nihed MBAREK > > > -- > > M'BAREK Med Nihed, > Fedora Ambassador, TUNISIA, Northern Africa > http://www.nihed.com > > <http://tn.linkedin.com/in/nihed> > > > > > -- M'BAREK Med Nihed, Fedora Ambassador, TUNISIA, Northern Africa http://www.nihed.com <http://tn.linkedin.com/in/nihed>
