Hi Vikas, He suggested to use the select() function after your withColumn function.
val ds1 = ds.select("Col1", "Col3").withColumn("Col2", lit("sample”)).select(“Col1”, “Col2”, “Col3") Thanks, Subash On Thu, Nov 12, 2020 at 9:19 PM Vikas Garg <sperry...@gmail.com> wrote: > I am deriving the col2 using with colunn which is why I cant use it like > you told me > > On Thu, Nov 12, 2020, 20:11 German Schiavon <gschiavonsp...@gmail.com> > wrote: > >> ds.select("Col1", "Col2", "Col3") >> >> On Thu, 12 Nov 2020 at 15:28, Vikas Garg <sperry...@gmail.com> wrote: >> >>> In Spark Datase, if we add additional column using >>> withColumn >>> then the column is added in the last. >>> >>> e.g. >>> val ds1 = ds.select("Col1", "Col3").withColumn("Col2", lit("sample")) >>> >>> the the order of columns is >> Col1 | Col3 | Col2 >>> >>> I want the order to be >> Col1 | Col2 | Col3 >>> >>> How can I achieve this? >>> >>