RE: removing header from csv file

You should be doing something like this: data = sc.textFile('file:///path1/path/test1.csv') header = data.first() #extract header #print header data = data.filter(lambda x:x !=header) #print data Hope it helps. Sincerely, Abhishek +91-7259028700 From: nihed mbarek [mailto:nihe...@gmail.com]

RE: LDA topic Modeling spark + python

Hello All, If someone has any leads on this please help me. Sincerely, Abhishek From: Mishra, Abhishek Sent: Wednesday, February 24, 2016 5:11 PM To: user@spark.apache.org Subject: LDA topic Modeling spark + python Hello All, I am doing a LDA model, please guide me with something. I

LDA topic Modeling spark + python

Hello All, I am doing a LDA model, please guide me with something. I have a csv file which has two column "user_id" and "status". I have to generate a word-topic distribution after aggregating the user_id. Meaning to say I need to model it for users on their grouped status. The topic

value from groubBy paired rdd

Hello All, I am new to spark and python, here is my doubt, please suggest... I have a csv file which has 2 column "user_id" and "status". I have read it into a rdd and then removed the header of the csv file. Then I split the record by "," (comma) and generate pair rdd. On that rdd I

RE: Sample project on Image Processing

...@gmail.com [mailto:ndj...@gmail.com] Sent: Monday, February 22, 2016 7:31 PM To: Sainath Palla Cc: Mishra, Abhishek; user@spark.apache.org Subject: Re: Sample project on Image Processing Hi folks, KeystoneML has some image processing features: http://keystone-ml.org/examples.html Cheers, Ardo

Sample project on Image Processing

Hello, I am working on image processing samples. Was wondering if anyone has worked on Image processing project in spark. Please let me know if any sample project or example is available. Please guide in this. Sincerely, Abhishek

MongoDB and Spark

Hello , Is there any way to query multiple collections from mongodb using spark and java. And i want to create only one Configuration Object. Please help if anyone has something regarding this. Thank You Abhishek

RE: MongoDB and Spark

Anything using Spark RDD’s ??? Abhishek From: Sandeep Giri [mailto:sand...@knowbigdata.com] Sent: Friday, September 11, 2015 3:19 PM To: Mishra, Abhishek; user@spark.apache.org; d...@spark.apache.org Subject: Re: MongoDB and Spark use map-reduce. On Fri, Sep 11, 2015, 14:32 Mishra, Abhishek

Spark Interview Questions

Hello, Please help me with links or some document for Apache Spark interview questions and answers. Also for the tools related to it ,for which questions could be asked. Thanking you all. Sincerely, Abhishek - To

RE: Spark Interview Questions

, 2015 8:22 PM To: Mishra, Abhishek Cc: User Subject: Re: Spark Interview Questions Hi Abhishek, Please learn spark ,there are no shortcuts for sucess. Regards, Vaquar khan On 29 Jul 2015 11:32, Mishra, Abhishek abhishek.mis...@xerox.commailto:abhishek.mis...@xerox.com wrote: Hello, Please

RE: Installation On Windows machine

, I am unable to debug the same. Please guide me. Thanks, Abhishek -Original Message- From: Matei Zaharia [mailto:matei.zaha...@gmail.com] Sent: Saturday, August 23, 2014 9:47 AM To: Mishra, Abhishek Cc: user@spark.apache.org Subject: Re: Installation On Windows machine You should

RE: Installation On Windows machine

I got it upright Matei, Thank you. I was giving wrong directory path. Thank you...!! Thanks, Abhishek Mishra -Original Message- From: Mishra, Abhishek [mailto:abhishek.mis...@xerox.com] Sent: Wednesday, August 27, 2014 4:38 PM To: Matei Zaharia Cc: user@spark.apache.org Subject: RE

Installation On Windows machine

Hello Team, I was just trying to install spark on my windows server 2012 machine and use it in my project; but unfortunately I do not find any documentation for the same. Please let me know if we have drafted anything for spark users on Windows. I am really in need of it as we are using