RE: Split column with dynamic data

2017-10-30 Thread Aakash Basu
Hey buddy, Thanks a TON! Issue resolved. Thanks again, Aakash. On 30-Oct-2017 11:44 PM, "Hondros, Constantine (ELS-AMS)" < c.hond...@elsevier.com> wrote: > You should just use regexp_replace to remove all the leading number > information (assuming it ends with a full-stop, and catering for the

RE: Split column with dynamic data

2017-10-30 Thread Hondros, Constantine (ELS-AMS)
You should just use regexp_replace to remove all the leading number information (assuming it ends with a full-stop, and catering for the possibility of a capital letter). This is untested, but it shoud do the trick based on your examples so far: df.withColumn(“new_column”, regexp_replace($”Desc