Re: Set the ORC file HDFS block size to 64MB

Hi OrcFile.createWriter() methods accepts WriterOptions where you can specify the block size to use using blockSize() method. Thanks Prasanth On Jul 29, 2015, at 5:22 PM, Ashish Shenoy mailto:ashe...@instartlogic.com>> wrote: Hi, I am using the OrcFile.createWriter() function to get an ORC w

Set the ORC file HDFS block size to 64MB

Hi, I am using the OrcFile.createWriter() function to get an ORC writer to write ORC files. However, upon inspecting the ORC files in HDFS, I notice that they have a block size of 256MB. Now, I would like to set it to 64MB instead. I digged around the net and tried a few options: - I set the "dfs