Please help me get started on Apache Spark

2014-11-20 Thread Saurabh Agrawal
) that I could run on my Sales force data? I am currently using Collaborative filtering but that's essentially B2C. Thanks in advance!! Regards, Saurabh Agrawal This e-mail, including accompanying communications and attachments, is strictly confidential

Writing collection to file error

2014-11-24 Thread Saurabh Agrawal
import org.apache.spark.mllib.recommendation.ALS import org.apache.spark.mllib.recommendation.Rating // Load and parse the data val data = sc.textFile(/path/CFReady.txt) val ratings = data.map(_.split('\t') match { case Array(user, item, rate) = Rating(user.toInt, item.toInt, rate.toDouble)

RE: Writing collection to file error

2014-11-24 Thread Saurabh Agrawal
Thanks for your help Akhil, however, this is creating an output folder and storing the result sets in multiple files. Also the record count in the result set seems to have multiplied!! Is there any other way to achieve this? Thanks!! Regards, Saurabh Agrawal Vice President Markit Green

ALS train error

2014-11-25 Thread Saurabh Agrawal
) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Thanks!! Regards, Saurabh Agrawal This e-mail, including accompanying communications and attachments, is strictly confidential and only for the intended recipient. Any retention, use

Building Desktop application for ALS-MlLib/ Training ALS

2014-12-13 Thread Saurabh Agrawal
or any helper links to help me get started on this? Your help is greatly appreciated Thanks!! Regards, Saurabh Agrawal This e-mail, including accompanying communications and attachments, is strictly confidential and only for the intended recipient. Any

Building Desktop application for ALS-MlLib/ Training ALS

2014-12-13 Thread Saurabh Agrawal
or any helper links to help me get started on this? Your help is greatly appreciated Thanks!! Regards, Saurabh Agrawal This e-mail, including accompanying communications and attachments, is strictly confidential and only for the intended recipient. Any

Calling ALS-MlLib from desktop application/ Training ALS

2014-12-13 Thread Saurabh Agrawal
Requesting guidance on my queries in trail email. -Original Message- From: Saurabh Agrawal Sent: Saturday, December 13, 2014 07:06 PM GMT Standard Time To: user@spark.apache.org Subject: Building Desktop application for ALS-MlLib/ Training ALS Hi, I am a new bee in spark

Spark Trainings/ Professional certifications

2015-01-07 Thread Saurabh Agrawal
results!! A training that would leave us hands on to do our job effectively is what we are after. In addition to this, if this training could provide a firm ground for a professional certification, that would be an added advantage. Thanks for your inputs Regards, Saurabh Agrawal

RE: how to read lz4 compressed data using fileStream of spark streaming?

2015-05-14 Thread Saurabh Agrawal
How do I unsubscribe from this mailing list please? Thanks!! Regards, Saurabh Agrawal Vice President Markit Green Boulevard B-9A, Tower C 3rd Floor, Sector - 62, Noida 201301, India +91 120 611 8274 Office This e-mail, including accompanying communications

Re: Scala/Python or Java

2015-06-25 Thread Saurabh Agrawal
Greetings, Even I am a beginner and currently learning Spark. I found Python + Spark combination to be easiest to learn given my past experience with Python, but yes, it depends on the user. Here is some reference documentation: https://spark.apache.org/docs/latest/programming-guide.html

[Streaming (DStream) ] : Does Spark Streaming supports pause/resume consumption of message from Kafka?

2023-12-01 Thread Saurabh Agrawal (180813)
uide how this can be implemented with Spark. 4. Does Spark support Active-Active deployment. It will be great if you can reply on above queries please. -- Regards, Saurabh Agrawal Software Development Specialist, IPaaS R [A picture containing logoDescription automatically generated]