Thanks for bringing this up, Boxiu.
The problem make sense to me. For me the concern is should we limit the priorities to 1-9 or not. I think it would be good to open a jira issue and have the discussion there. Thank you~ Xintong Song On Wed, Jul 31, 2019 at 12:22 PM tian boxiu <boswell....@gmail.com> wrote: > To: user@flink.apache.org > Title: Support priority of the Flink YARN application in Flink 1.9 > > Hello everyone, > > Many of our batch jobs have changed the execution engine from spark to > flink. The flink is deployed on the yarn cluster. In some scenarios, > high-priority core tasks need to be submitted on the preemptive queue. > Previously, when running in spark, users configured the spark.yarn.priority > to control the priority, ranging from 1 to 9. > > Currently, flink 1.9 does not support yarn priority submission. The > default priority of yarn submission jobs is 1. Based on this, we > implemented the submission of the priority range from 1 to 9(from low to > high priority). When the user does not configure the parameters, the > priority is still 1. After we push the new feature online in June, The > system has been tested to run properly. > > So I want to create an issue and push the improvement back to community. > Hope someone can review it, thanks~ > > Boxiu >
