Re: Spark MLlib:Collaborative Filtering

2016-08-24 Thread Praveen Devarao
You could use the string indexer to convert your string userids and product ids numeric value. http://spark.apache.org/docs/latest/ml-features.html#stringindexer Thanking You - Praveen Devarao IBM India Software

Re: removing header from csv file

2016-04-26 Thread Praveen Devarao
- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again" From:

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
n it and decide how to make use of it. Thanking You --------- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage does

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
/www.scala-lang.org/files/archive/api/2.10.6/index.html#scala.collection.mutable.IndexedSeqView Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs

Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-25 Thread Praveen Devarao
Cool!! Thanks for the clarification Mike. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Co

Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-24 Thread Praveen Devarao
anking You ----- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again&quo

Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-24 Thread Praveen Devarao
invoke a Job, though they are transformations and not actions? I am on Spark 1.6 Thanking You --------- Praveen Devarao Spark Technology C

Re: How to know whether I'm in the first batch of spark streaming

2016-04-21 Thread Praveen Devarao
able to achieve your task. Thanking You --------- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar.

Re: How to know whether I'm in the first batch of spark streaming

2016-04-21 Thread Praveen Devarao
batch will start first though order of ending is not guaranteed with concurrentJobs set to more than 1)... Would be interesting to know your use case...could you share, if possible? Thanking You - Praveen De

Re: Spark structured streaming

2016-03-08 Thread Praveen Devarao
- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will

Spark structured streaming

2016-03-08 Thread Praveen Devarao
rom a consumability angle. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always

Re: Guidelines for writing SPARK packages

2016-02-02 Thread Praveen Devarao
share with me...else debugging through would be the way :-) Thanking You Praveen Devarao From: David Russell To: Praveen Devarao/India/IBM@IBMIN Cc: user Date: 01/02/2016 07:03 pm Subject:Re: Guidelines for writing SPARK packages Sent by:marchoffo...@gmail.com Hi

Guidelines for writing SPARK packages

2016-02-01 Thread Praveen Devarao
point to docs or links on the above? Thanking You Praveen Devarao