Hi all I want to ask how exactly it differs while reading >1 tb file on standalone cluster vs yarn or mesos cluster ?
On Wednesday 6 January 2016, Gavin Yue <yue.yuany...@gmail.com> wrote: > I am trying to read json files following the example: > > val path = "examples/src/main/resources/jsonfile"val people = > sqlContext.read.json(path) > > I have 1 Tb size files in the path. It took 1.2 hours to finish the reading > to infer the schema. > > But I already know the schema. Could I make this process short? > > Thanks a lot. > > > > -- Regards, Vijay Gharge
