depolying stage-level scheduling for Spark SQL and how to expose RDD code from Spark SQL?

[Chenghao Lyu]

Hi,

I am trying to deploy the stage-level scheduling for Spark SQL. Since the 
current stage-level scheduling only supports the RDD-APIs, I want to expose the 
RDD transformation code from my Spark SQL code (with SQL syntax).

Can you provide any pointers on how to do it?

Stage level scheduling: 
https://spark.apache.org/docs/latest/configuration.html#stage-level-scheduling-overview

Cheers,
Chenghao