Thank you.
My main purpose is pass "MaxDop 1" to MSSQL to control the CPU usage. From the
offical doc, I guess the problem of my codes is spark wrap the query to
select * from (SELECT TOP 10 * FROM dbo.Demo with (nolock) WHERE Id = 1 option
(maxdop 1)) spark_gen_alias
Apparently, this
Hi Mich,
Thanks for your suggestions.
1) It currently runs on one server with plenty of resources assigned. But I
will keep it in mind to replace monotonically_increasing_id() with uuid() once
we scale up.
2) I have replaced the null values in origin with a string