As mentioned in the comments on SO, can you provide a (masked) sample of the data? It will be easier to see what you are trying to do if you add the year column
Thanks, Sonal Nube Technologies <http://www.nubetech.co> <http://in.linkedin.com/in/sonalgoyal> On Thu, May 7, 2020 at 10:26 AM Aakash Basu <aakash.spark....@gmail.com> wrote: > Hi, > > I've described the problem in Stack Overflow with a lot of detailing, can > you kindly check and help if possible? > > https://stackoverflow.com/q/61643910/5536733 > > I'd be absolutely fine if someone solves it using Spark SQL APIs rather > than plain spark SQL query. > > Thanks, > Aakash. >