Fwd: Spark 1.x - End of life

2017-10-24 Thread Ismaël Mejía
Thanks for your answer Matei. I agree that a more explicit maintenance policy is needed (even for the 2.x releases). I did not immediately find anything about this in the website, so I ended up assuming the information of the wikipedia article that says that the 1.6.x line is still maintained. I

Re: Spark 1.x - End of life

2017-10-19 Thread Matei Zaharia
Hi Ismael, It depends on what you mean by “support”. In general, there won’t be new feature releases for 1.X (e.g. Spark 1.7) because all the new features are being added to the master branch. However, there is always room for bug fix releases if there is a catastrophic bug, and committers can

Spark 1.x - End of life

2017-10-19 Thread Ismaël Mejía
Hello, I noticed that some of the (Big Data / Cloud Managed) Hadoop distributions are starting to (phase out / deprecate) Spark 1.x and I was wondering if the Spark community has already decided when will it end the support for Spark 1.x. I ask this also considering that the latest release in the