Re: Yarn Application ID for Hive query

2016-07-18 Thread Gopal Vijayaraghavan
> be nice to have access to a command or API call in HiveServer2 similar >to MySQL¹s ³SHOW PROCESSLIST² (and equivalent commands in most other >databases). There is one - if you have the HiveServer2 UI (in 2.0), that can be seen. It would take 10-15 line JSP script to export that as a JSON

RE: Yarn Application ID for Hive query

2016-07-18 Thread Amit Bajpai
rn_app_id = log.substring(log.indexOf("App id") +7, log.length()-1); } } System.out.println("YARN Application ID: " + yarn_app_id); Now I am trying to find the Tez DAG ID for the query. From: Gerber, Bryan W [mailto:bryan.ger...@pnnl.gov] Sent: Monday, July 18, 2016 1:47 PM To

RE: Yarn Application ID for Hive query

2016-07-18 Thread Gerber, Bryan W
Making Hive look like a normal SQL database is the goal of libraries like this, so it make sense that that abstraction wouldn't leak a concept like application ID. Especially because not all Hive queries generate a YARN application. That said, we went through this with JDBC access to Hive a