Hello, I understand we need to specify the 'spark.kubernetes.driver.limit.cores' and 'spark.kubernetes.executor.limit.cores' config parameters while submitting spark on k8s namespace with resource quota applied.
There are also other config parameters 'spark.driver.cores' and 'spark.executor.cores' mentioned in documentation. What is the difference between 'spark.driver.cores' and 'spark.kubernetes.driver.limit.cores' please. Thanks! Best Regards, Lakshman B.
