Hi, Currently, I have been using Spark 2.1.0 for ML and so far did not experience any critical issue. It's much stable compared to Spark 2.0.1/2.0.2 I would say.
Regards, _________________________________ *Md. Rezaul Karim*, BSc, MSc PhD Researcher, INSIGHT Centre for Data Analytics National University of Ireland, Galway IDA Business Park, Dangan, Galway, Ireland Web: http://www.reza-analytics.eu/index.html <http://139.59.184.114/index.html> On 9 January 2017 at 16:36, Ankur Jain <ankur.j...@yash.com> wrote: > > > Thanks Rezaul… > > > > Is Spark 2.1.0 still have any issues w.r.t. stability? > > > > Regards, > > Ankur > > > > *From:* Md. Rezaul Karim [mailto:rezaul.ka...@insight-centre.org] > *Sent:* Monday, January 09, 2017 5:02 PM > *To:* Ankur Jain <ankur.j...@yash.com> > *Cc:* user@spark.apache.org > *Subject:* Re: Machine Learning in Spark 1.6 vs Spark 2.0 > > > > Hello Jain, > > I would recommend using Spark MLlib > <http://spark.apache.org/docs/latest/ml-guide.html>(and ML) of *Spark > 2.1.0* with the following features: > > - ML Algorithms: common learning algorithms such as classification, > regression, clustering, and collaborative filtering > - Featurization: feature extraction, transformation, dimensionality > reduction, and selection > - Pipelines: tools for constructing, evaluating, and tuning ML > Pipelines > - Persistence: saving and load algorithms, models, and Pipelines > - Utilities: linear algebra, statistics, data handling, etc. > > These features will help make your machine learning scalable and easy too. > > > Regards, > _________________________________ > > *Md. Rezaul Karim*, BSc, MSc > PhD Researcher, INSIGHT Centre for Data Analytics > National University of Ireland, Galway > > IDA Business Park, Dangan, Galway, Ireland > > Web: http://www.reza-analytics.eu/index.html > <http://139.59.184.114/index.html> > > > > On 9 January 2017 at 10:19, Ankur Jain <ankur.j...@yash.com> wrote: > > Hi Team, > > > > I want to start a new project with ML. But wanted to know which version of > Spark is much stable and have more features w.r.t ML > > Please suggest your opinion… > > > > Thanks in Advance… > > > > [image: cid:image013.png@01D1AAE2.28F7BBF0] > > *Thanks & Regards* > > Ankur Jain > > Technical Architect – Big Data | IoT | Innovation Group > > Board: +91-731-663-6363 <+91%20731%20663%206363> > > Direct: +91-731-663-6125 <+91%20731%20663%206125> > > *www.yash.com <http://www.yash.com/>* > > Follow YASH: > > [image: cid:image002.png@01CF5E10.26C55CF0] > <http://www.linkedin.com/company/yash-technologies> > > [image: cid:image003.png@01CF5E10.26C55CF0] <http://twitter.com/YASH_Tech> > > [image: cid:image004.png@01CF5E10.26C55CF0] > <http://www.facebook.com/pages/YASH-Technologies/139932139377994> > > [image: cid:image005.png@01CF5E10.26C55CF0] > <https://plus.google.com/106560310768370862129/posts> > > [image: cid:image006.png@01CF5E10.26C55CF0] > <http://www.youtube.com/yashtechnologies> > > [image: Solutions-Architect-Associate] *[image: > cid:image010.png@01D1AD0C.4AFA3760]* *[image: GPTWF LOGO]* > > > > 'Information transmitted by this e-mail is proprietary to YASH > Technologies and/ or its Customers and is intended for use only by the > individual or entity to which it is addressed, and may contain information > that is privileged, confidential or exempt from disclosure under applicable > law. If you are not the intended recipient or it appears that this mail has > been forwarded to you without proper authority, you are notified that any > use or dissemination of this information in any manner is strictly > prohibited. In such cases, please notify us immediately at i...@yash.com > and delete this mail from your records. > > > 'Information transmitted by this e-mail is proprietary to YASH > Technologies and/ or its Customers and is intended for use only by the > individual or entity to which it is addressed, and may contain information > that is privileged, confidential or exempt from disclosure under applicable > law. If you are not the intended recipient or it appears that this mail has > been forwarded to you without proper authority, you are notified that any > use or dissemination of this information in any manner is strictly > prohibited. In such cases, please notify us immediately at i...@yash.com > and delete this mail from your records. >
