Hi 'I am looking how to load data in redshift .Thanks
On Wednesday, July 8, 2015 12:47 AM, shahab <shahab.mok...@gmail.com> wrote: Hi, I did some experiment with loading data from s3 into spark. I loaded data from s3 using sc.textFile(....). Have a look at the following code snippet: val csv = sc.textFile("s3n://mybucket/myfile.csv") val rdd = csv.map(line => line.split(",").map(elem => elem.trim)) // my data format is in CSV format, comma separated .map (r => MyIbject(r(3), r(4).toLong, r(5).toLong, r(6))) //just map it to the target object format hope this helps,best,/Shahab On Wed, Jul 8, 2015 at 12:57 AM, spark user <spark_u...@yahoo.com.invalid> wrote: Hi Can you help me how to load data from s3 bucket to redshift , if you gave sample code can you pls send me Thanks su