Re: Spark 1.6.0: substring on df.select

2016-05-12 Thread Sun Rui
t;)).show() > > Ewan > > > From: Bharathi Raja [mailto:raja...@yahoo.com.INVALID] > Sent: 12 May 2016 11:40 > To: Raghavendra Pandey <raghavendra.pan...@gmail.com>; Bharathi Raja > <raja...@yahoo.com.invalid> > Cc: User <user@spark.apache.org> > Subject: RE: Sp

RE: Spark 1.6.0: substring on df.select

2016-05-12 Thread Ewan Leith
mailto:raghavendra.pan...@gmail.com> Sent: 11 May 2016 09:04 PM To: Bharathi Raja<mailto:raja...@yahoo.com.invalid> Cc: User<mailto:user@spark.apache.org> Subject: Re: Spark 1.6.0: substring on df.select You can create a column with count of /. Then take max of it and create that man

RE: Spark 1.6.0: substring on df.select

2016-05-12 Thread Bharathi Raja
: Spark 1.6.0: substring on df.select You can create a column with count of /.  Then take max of it and create that many columns for every row with null fillers. Raghav On 11 May 2016 20:37, "Bharathi Raja" <raja...@yahoo.com.invalid> wrote: Hi,   I have a dataframe column

Re: Spark 1.6.0: substring on df.select

2016-05-11 Thread Raghavendra Pandey
You can create a column with count of /. Then take max of it and create that many columns for every row with null fillers. Raghav On 11 May 2016 20:37, "Bharathi Raja" wrote: Hi, I have a dataframe column col1 with values something like