RE: determine week of month from date in spark3

2022-02-11 Thread Appel, Kevin
Owen' Subject: RE: determine week of month from date in spark3 Thanks for the reply, that is looking to be along the lines of what is going on, and they mention in that item the W is banned which is what I saw in the error, however F is not giving the

Re: determine week of month from date in spark3

2022-02-11 Thread Sean Owen
Here is some back-story: https://issues.apache.org/jira/browse/SPARK-32683 I think the answer may be: use "F"? On Fri, Feb 11, 2022 at 12:43 PM Appel, Kevin wrote: > Previously in Spark2 we could use the spark function date_format with the > “W” flag and it will provide back the week of month of

determine week of month from date in spark3

2022-02-11 Thread Appel, Kevin
Previously in Spark2 we could use the spark function date_format with the "W" flag and it will provide back the week of month of that date. In Spark3 when trying this there is an error back: * org.apache.spark.SparkUpgradeException: You may get a different result due to the upgrading