I am not sure if this works, but SparkContext seems to have hadoopFile and hadoopRDD methods which can accept Hadoop Input formats. If you have an InputFormat with isSplittable false, maybe it works?
Best Regards, Sonal Nube Technologies <http://www.nubetech.co> <http://in.linkedin.com/in/sonalgoyal> On Sat, Oct 18, 2014 at 11:29 AM, Davies Liu <[email protected]> wrote: > You can call coalesce() to merge the small splits into bigger ones. > > Davies > > On Fri, Oct 17, 2014 at 5:35 PM, Larry Liu <[email protected]> wrote: > > Is it possible to disable input split if input is already small? > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
