Thanks Rezaul… Is Spark 2.1.0 still have any issues w.r.t. stability?
Regards, Ankur From: Md. Rezaul Karim [mailto:rezaul.ka...@insight-centre.org] Sent: Monday, January 09, 2017 5:02 PM To: Ankur Jain <ankur.j...@yash.com> Cc: user@spark.apache.org Subject: Re: Machine Learning in Spark 1.6 vs Spark 2.0 Hello Jain, I would recommend using Spark MLlib <http://spark.apache.org/docs/latest/ml-guide.html> (and ML) of Spark 2.1.0 with the following features: * ML Algorithms: common learning algorithms such as classification, regression, clustering, and collaborative filtering * Featurization: feature extraction, transformation, dimensionality reduction, and selection * Pipelines: tools for constructing, evaluating, and tuning ML Pipelines * Persistence: saving and load algorithms, models, and Pipelines * Utilities: linear algebra, statistics, data handling, etc. These features will help make your machine learning scalable and easy too. Regards, _________________________________ Md. Rezaul Karim, BSc, MSc PhD Researcher, INSIGHT Centre for Data Analytics National University of Ireland, Galway IDA Business Park, Dangan, Galway, Ireland Web: http://www.reza-analytics.eu/index.html<http://139.59.184.114/index.html> On 9 January 2017 at 10:19, Ankur Jain <ankur.j...@yash.com<mailto:ankur.j...@yash.com>> wrote: Hi Team, I want to start a new project with ML. But wanted to know which version of Spark is much stable and have more features w.r.t ML Please suggest your opinion… Thanks in Advance… [cid:image013.png@01D1AAE2.28F7BBF0] Thanks & Regards Ankur Jain Technical Architect – Big Data | IoT | Innovation Group Board: +91-731-663-6363<tel:+91%20731%20663%206363> Direct: +91-731-663-6125<tel:+91%20731%20663%206125> www.yash.com<http://www.yash.com/> Follow YASH: [cid:image002.png@01CF5E10.26C55CF0]<http://www.linkedin.com/company/yash-technologies> [cid:image003.png@01CF5E10.26C55CF0]<http://twitter.com/YASH_Tech> [cid:image004.png@01CF5E10.26C55CF0]<http://www.facebook.com/pages/YASH-Technologies/139932139377994> [cid:image005.png@01CF5E10.26C55CF0]<https://plus.google.com/106560310768370862129/posts> [cid:image006.png@01CF5E10.26C55CF0]<http://www.youtube.com/yashtechnologies> [Solutions-Architect-Associate] [cid:image010.png@01D1AD0C.4AFA3760] [GPTWF LOGO] 'Information transmitted by this e-mail is proprietary to YASH Technologies and/ or its Customers and is intended for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please notify us immediately at i...@yash.com<mailto:i...@yash.com> and delete this mail from your records. 'Information transmitted by this e-mail is proprietary to YASH Technologies and/ or its Customers and is intended for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please notify us immediately at i...@yash.com and delete this mail from your records.
