Hi sparkers, I'm trying to use spark.sql.thriftserver.scheduler.pool for the first time (earlier I was stuck because of https://issues.apache.org/jira/browse/SPARK-4037)
I have two pools setup: [image: Inline image 1] and would like to issue a query against the "low priority" pool. I am doing this (tried both from beeline and a different JDBC client, output below is from beeline): SET spark.sql.thriftserver.scheduler.pool=CRON; +---------------------------------------------+ | | +---------------------------------------------+ | spark.sql.thriftserver.scheduler.pool=CRON | +---------------------------------------------+ 1 row selected (0.09 seconds) 1: jdbc:hive2://myip:10001> select count(*) from mytable; The query executes OK but does not execute against the CRON pool...Am I misusing this setting (my goal is to be able to allocate a large set of cores to Thriftserver but separate out to a "low-priority" pool some housekeeping tasks) Thanks for any tips.