Tip: jump straight to 1.5.2; it has some key bug fixes. Sent from my phone
> On Nov 13, 2015, at 10:02 PM, AlexG <swift...@gmail.com> wrote: > > Never mind; when I switched to Spark 1.5.0, my code works as written and is > pretty fast! Looking at some Parquet related Spark jiras, it seems that > Parquet is known to have some memory issues with buffering and writing, and > that at least some were resolved in Spark 1.5.0. > > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/out-of-memory-error-with-Parquet-tp25381p25382.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
