dataset.where(to_date(dataset.col("Date"),"MM-dd-yyyy").geq(to_date("02-03-2012", "MM-dd-yyyy"));
On Fri, 17 Jun 2022, 22:51 marc nicole, <mk1853...@gmail.com> wrote: > dataset = > dataset.where(to_date(dataset.col("Date"),"MM-dd-yyyy").geq("02-03-2012").cast("date")); > ? > This is returning an empty dataset. > > Le ven. 17 juin 2022 à 21:34, Stelios Philippou <stevo...@gmail.com> a > écrit : > >> You are already doing it once. >> to_date the second part and don't forget to cast it as well >> >> On Fri, 17 Jun 2022, 22:08 marc nicole, <mk1853...@gmail.com> wrote: >> >>> should i cast to date the target date then? for example maybe: >>> >>> dataset = >>>> dataset.where(to_date(dataset.col("Date"),"MM-dd-yyyy").geq("02-03-2012").cast("date")); >>>> ? >>> >>> How to to do that ? comparing with dates? >>> >>> >>> Le ven. 17 juin 2022 à 20:52, Sean Owen <sro...@gmail.com> a écrit : >>> >>>> Look at your query again. You are comparing dates to strings. The dates >>>> widen back to strings. >>>> >>>> On Fri, Jun 17, 2022, 1:39 PM marc nicole <mk1853...@gmail.com> wrote: >>>> >>>>> I also tried: >>>>> >>>>> dataset = >>>>>> dataset.where(to_date(dataset.col("Date"),"MM-dd-yyyy").geq("02-03-2012")); >>>>> >>>>> >>>>> But it returned an empty dataset. >>>>> >>>>> Le ven. 17 juin 2022 à 20:28, Sean Owen <sro...@gmail.com> a écrit : >>>>> >>>>>> Same answer as last time - those are strings, not dates. 02-02-2015 >>>>>> as a string is before 02-03-2012. >>>>>> You apply date function to dates, not strings. >>>>>> You have to parse the dates properly, which was the problem in your >>>>>> last email. >>>>>> >>>>>> On Fri, Jun 17, 2022 at 12:58 PM marc nicole <mk1853...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hello, >>>>>>> >>>>>>> I have a dataset containing a column of dates, which I want to use >>>>>>> for filtering. Nothing, from what I have tried, seems to return the >>>>>>> exact >>>>>>> right solution. >>>>>>> Here's my input: >>>>>>> >>>>>>> +------------ + >>>>>>> | Date | >>>>>>> +------------ + >>>>>>> | 02-08-2019 | >>>>>>> +------------ + >>>>>>> | 02-07-2019 | >>>>>>> +----------------+ >>>>>>> | 12-01-2019 | >>>>>>> +----------------+ >>>>>>> | 02-02-2015 | >>>>>>> +----------------+ >>>>>>> | 02-03-2012 | >>>>>>> +----------------+ >>>>>>> | 05-06-2018 | >>>>>>> +----------------+ >>>>>>> | 02-08-2022 | >>>>>>> +----------------+ >>>>>>> >>>>>>> The code that i have tried (always giving missing dates in the >>>>>>> result): >>>>>>> >>>>>>> dataset = dataset.filter( dataset.col("Date").geq("02-03-2012")); >>>>>>>> // not showing the date of *02-02-2015* >>>>>>> >>>>>>> >>>>>>> I tried to apply *date_trunc()* with the first parameter "day" but >>>>>>> nothing. >>>>>>> >>>>>>> I have also compared a converted column (using *to_date()*) with a >>>>>>> *literal *of the target date but always returning an empty dataset. >>>>>>> >>>>>>> How to do that in Java ? >>>>>>> >>>>>>>