I'm posting here so that if anyone else has similar problems, it might be
of help.
First problem:
I tried multiple different MySQL JDBC drivers to no avail, then I put Spark
into Uber-chatty mode (DEBUG) and looked at the Catalyst compiler and
started seeing datatime's being compared to NULL.
Hi folks,
1) First Problem:
I'm querying MySQL. I submit a query like this:
out = wam.select('message_id', 'business_id', 'info',
'entered_system_date', 'auto_update_time').filter("auto_update_time >=
'2020-04-01 05:27'").dropDuplicates(['message_id', 'auto_update_time'])
But what I see in the
