[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319389#comment-16319389 ] Sergey Shelukhin commented on TEZ-3880: --- [~hagleitn] can you take a look at the updated patch? thanks > do not count rejected tasks as killed in vertex progress > > > Key: TEZ-3880 > URL: https://issues.apache.org/jira/browse/TEZ-3880 > Project: Apache Tez > Issue Type: Task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: TEZ-3880.01.patch, TEZ-3880.02.patch, TEZ-3880.patch > > > Tasks rejected from LLAP because the cluster is full are shown as killed > tasks in the commandline query UI (CLI and beeline). This shouldn't really > happen; killed tasks in the container case means something else, and this > scenario doesn't exist because AM doesn't continuously try to queue tasks. We > could change LLAP queue to use sort of a pull model (would also allow for > better duplicate scheduling), but for now we should fix the UI -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (TEZ-3885) Tez timeline server integration error
[
https://issues.apache.org/jira/browse/TEZ-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jerryjung updated TEZ-3885:
---
Description:
If I configure below, I've got an error about launch hive error. I think it's a
library problem, but I'm not sure how to fix it.
tez.lib.uris
hdfs:///apps/tez-0.9.0/tez-0.9.0-minimal.tar.gz
tez.use.cluster.hadoop-libs
true
Enable Tez to use the Timeline Server for History
Logging
tez.history.logging.service.class
org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
URL for where the Tez UI is hosted
tez.tez-ui.history-url.base
http://HOST:8081/tez-ui-0.9.0/
2018-01-09 17:47:55,484 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster
for applicationId=application_1515483495537_0016, attemptNum=1,
AMContainerId=container_e40_1515483495537_0016_01_01, jvmPid=127852,
userFromEnv=hadoop, cliSessionOption=true,
pwd=/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_01,
localDirs=/data1/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data2/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data3/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data4/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data6/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,
logDirs=/data1/yarn/logs/application_1515483495537_0016/container_e40_1515483495537_0016_01_01
2018-01-09 17:47:55,588 [INFO] [main] |Configuration.deprecation|:
yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead,
use yarn.system-metrics-publisher.enabled
2018-01-09 17:47:55,727 [INFO] [main] |security.SecurityUtil|: Updating
Configuration
2018-01-09 17:47:55,867 [INFO] [main] |app.DAGAppMaster|: Created DAGAppMaster
for application appattempt_1515483495537_0016_01, versionInfo=[
component=tez-dag, version=0.9.0, revision=${buildNumber},
SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git,
buildTime=2018-01-09T00:23:13Z ]
2018-01-09 17:47:55,897 [INFO] [main] |app.DAGAppMaster|:
/
[system properties]
os.name: Linux
os.version: 2.6.32-573.7.1.el6.x86_64
java.home: /usr/java/jdk1.8.0_121/jre
java.runtime.version: 1.8.0_121-b13
java.vendor: Oracle Corporation
java.version: 1.8.0_121
java.vm.name: Java HotSpot(TM) 64-Bit Server VM
java.class.path:
[jira] [Created] (TEZ-3885) Tez timeline server integration error
Jerryjung created TEZ-3885:
--
Summary: Tez timeline server integration error
Key: TEZ-3885
URL: https://issues.apache.org/jira/browse/TEZ-3885
Project: Apache Tez
Issue Type: Bug
Components: UI
Affects Versions: 0.9.0
Environment: apache hive version - 3.0.0-SNAPSHOT
apache hadoop version - 3.0.0
tez version - 0.9.0
Reporter: Jerryjung
Priority: Critical
If I configure below, If I configure below, I've got an error about launch hive
error. I think it's a library problem, but I'm not sure how to fix it.
tez.lib.uris
hdfs:///apps/tez-0.9.0/tez-0.9.0-minimal.tar.gz
tez.use.cluster.hadoop-libs
true
Enable Tez to use the Timeline Server for History
Logging
tez.history.logging.service.class
org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
URL for where the Tez UI is hosted
tez.tez-ui.history-url.base
http://HOST:8081/tez-ui-0.9.0/
2018-01-09 17:47:55,484 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster
for applicationId=application_1515483495537_0016, attemptNum=1,
AMContainerId=container_e40_1515483495537_0016_01_01, jvmPid=127852,
userFromEnv=hadoop, cliSessionOption=true,
pwd=/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_01,
localDirs=/data1/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data2/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data3/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data4/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data6/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,
logDirs=/data1/yarn/logs/application_1515483495537_0016/container_e40_1515483495537_0016_01_01
2018-01-09 17:47:55,588 [INFO] [main] |Configuration.deprecation|:
yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead,
use yarn.system-metrics-publisher.enabled
2018-01-09 17:47:55,727 [INFO] [main] |security.SecurityUtil|: Updating
Configuration
2018-01-09 17:47:55,867 [INFO] [main] |app.DAGAppMaster|: Created DAGAppMaster
for application appattempt_1515483495537_0016_01, versionInfo=[
component=tez-dag, version=0.9.0, revision=${buildNumber},
SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git,
buildTime=2018-01-09T00:23:13Z ]
2018-01-09 17:47:55,897 [INFO] [main] |app.DAGAppMaster|:
/
[system properties]
os.name: Linux
os.version: 2.6.32-573.7.1.el6.x86_64
java.home: /usr/java/jdk1.8.0_121/jre
java.runtime.version: 1.8.0_121-b13
java.vendor: Oracle Corporation
java.version: 1.8.0_121
java.vm.name: Java HotSpot(TM) 64-Bit Server VM
java.class.path:
