What is the environment ? YARN or Mesos or Standalone? It will be more helpful if you could show more loggings.
On Wed, Aug 6, 2014 at 7:25 PM, Avishek Saha <[email protected]> wrote: > Hi, > > I get a lot of executor lost error for "saveAsTextFile" with PySpark > and Hadoop 2.4. > > For small datasets this error occurs but since the dataset is small it > gets eventually written to the file. > For large datasets, it takes forever to write the final output. > > Any help is appreciated. > Avishek > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
