Hi, I am using the OrcFile.createWriter() function to get an ORC writer to write ORC files. However, upon inspecting the ORC files in HDFS, I notice that they have a block size of 256MB. Now, I would like to set it to 64MB instead.
I digged around the net and tried a few options: - I set the "dfs.block.size" config property to 64MB and passed it to the createWriter() call via OrcFile.writerOptions(config) - I set the "hive.exec.orc.default.block.size" to 64MB in hive-site.xml file via ambari and restarted hive. Neither of these approaches worked for me. I still see that my files have a block size of 256MB which corresponds to the default setting for the block size for ORC files. How can I set the block size of ORC files to 64MB ? Thanks, Ashish