[
https://issues.apache.org/jira/browse/HIVE-13696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15822285#comment-15822285
]
Siddharth Seth commented on HIVE-13696:
---------------------------------------
Can we revert the patch for now, since it is causing failures.
Also, monitoring the fair scheduler xml file will not work on most systems,
since this file is only needed on the YARN ResourceManager page. If HiveServer2
or the hive client is running on any other node - this file will not be
available, and the feature would be broken.
If this is really required, a connection to YARN, along with calls to it's
Queue APIs would be a lot more robust (I'm not absolutely sure on the status of
these APIs at the moment, but a question to yarn-users would solve that).
> Monitor fair-scheduler.xml and automatically update/validate jobs submitted
> to fair-scheduler
> ---------------------------------------------------------------------------------------------
>
> Key: HIVE-13696
> URL: https://issues.apache.org/jira/browse/HIVE-13696
> Project: Hive
> Issue Type: Improvement
> Reporter: Reuben Kuhnert
> Assignee: Reuben Kuhnert
> Fix For: 2.2.0
>
> Attachments: HIVE-13696.01.patch, HIVE-13696.02.patch,
> HIVE-13696.06.patch, HIVE-13696.08.patch, HIVE-13696.11.patch,
> HIVE-13696.13.patch, HIVE-13696.14.patch
>
>
> Ensure that jobs are placed into the correct queue according to
> {{fair-scheduler.xml}}. Jobs should be placed into the correct queue, and
> users should not be able to submit jobs to queues they do not have access to.
> This patch builds on the existing functionality in {{FairSchedulerShim}} to
> route jobs to user-specific queue based on {{fair-scheduler.xml}}
> configuration (leveraging the Yarn {{QueuePlacementPolicy}} class). In
> addition to configuring job routing at session connect (current behavior),
> the routing is validated per submission to yarn (when impersonation is off).
> A {{FileSystemWatcher}} class is included to monitor changes in the
> {{fair-scheduler.xml}} file (so updates are automatically reloaded when the
> file pointed to by {{yarn.scheduler.fair.allocation.file}} is changed).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
