Ali Anwar created TWILL-201:
-------------------------------
Summary: ApplicationMaster (container...001) stdout doesn't have
date stamps.
Key: TWILL-201
URL: https://issues.apache.org/jira/browse/TWILL-201
Project: Apache Twill
Issue Type: Improvement
Reporter: Ali Anwar
The stderr has timestamp including date. The stdout only has timestamp, but no
indication of what the date is.
{noformat}
[root@<HOSTNAME> container_1482179744462_0008_01_000001]# tail std*
==> stderr <==
16/12/22 22:03:58 WARN token.Token: Cannot find class for token kind
HIVE_DELEGATION_TOKEN
16/12/22 22:03:58 WARN token.Token: Cannot find class for token kind
MR_DELEGATION_TOKEN
16/12/22 22:03:58 INFO impl.ContainerManagementProtocolProxy: Opening proxy :
<HOSTNAME>:40050
16/12/22 22:04:05 INFO network.Processor: Closing socket connection to
/10.128.0.40.
16/12/22 22:06:57 INFO network.Processor: Closing socket connection to
/10.128.0.40.
16/12/22 22:06:59 WARN token.Token: Cannot find class for token kind
HBASE_AUTH_TOKEN
16/12/22 22:06:59 WARN token.Token: Cannot find class for token kind
HIVE_DELEGATION_TOKEN
16/12/22 22:06:59 WARN token.Token: Cannot find class for token kind
MR_DELEGATION_TOKEN
16/12/22 22:06:59 INFO impl.ContainerManagementProtocolProxy: Opening proxy :
<HOSTNAME>:40050
16/12/22 22:07:04 INFO network.Processor: Closing socket connection to
/10.128.0.40.
==> stdout <==
22:06:59.832 [ApplicationMasterService] INFO
o.a.t.i.y.AbstractYarnProcessLauncher - Launch with delegation token Kind:
HDFS_DELEGATION_TOKEN, Service: 10.128.0.40:8020, Ident: (HDFS_DELEGATION_TOKEN
token 583 for cdap)
22:06:59.832 [ApplicationMasterService] INFO o.a.t.i.a.RunnableProcessLauncher
- Launching in container container_1482179744462_0008_01_000247 at
<HOSTNAME>:40050, [$JAVA_HOME/bin/java -Djava.io.tmpdir=tmp
-Dyarn.container=$YARN_CONTAINER_ID
-Dtwill.runnable=$TWILL_APP_NAME.$TWILL_RUNNABLE_NAME -cp
launcher.jar:$HADOOP_CONF_DIR -Xmx180m -XX:MaxPermSize=128M -verbose:gc
-Xloggc:<LOG_DIR>/gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M
-Dhdp.version=2.3.4.7-4
-Dspark.yarn.am.extraJavaOptions=-Dhdp.version=2.3.4.7-4
org.apache.twill.launcher.TwillLauncher container.jar
org.apache.twill.internal.container.TwillContainerMain true 1><LOG_DIR>/stdout
2><LOG_DIR>/stderr]
22:06:59.839 [ApplicationMasterService] INFO
o.a.t.i.a.ApplicationMasterService - Runnable streams fully provisioned with 1
instances.
22:07:00.843 [ApplicationMasterService] INFO
o.a.t.i.a.ApplicationMasterService - Got container
container_1482179744462_0008_01_000248
22:07:00.844 [ApplicationMasterService] INFO o.a.t.i.yarn.AbstractYarnAMClient
- Nothing to run in container, releasing it: Container: [ContainerId:
container_1482179744462_0008_01_000248, NodeId: <HOSTNAME>:40050,
NodeHttpAddress: <HOSTNAME>:8042, Resource: <memory:256, vCores:1>, Priority:
0, Token: Token { kind: ContainerToken, service: 10.128.0.40:40050 }, ]
22:07:01.847 [ApplicationMasterService] INFO
o.a.t.i.a.ApplicationMasterService - Got container
container_1482179744462_0008_01_000249
22:07:01.848 [ApplicationMasterService] INFO o.a.t.i.yarn.AbstractYarnAMClient
- Nothing to run in container, releasing it: Container: [ContainerId:
container_1482179744462_0008_01_000249, NodeId: <HOST>:40050, NodeHttpAddress:
<HOSTNAME>:8042, Resource: <memory:256, vCores:1>, Priority: 0, Token: Token {
kind: ContainerToken, service: 10.128.0.40:40050 }, ]
22:07:01.848 [ApplicationMasterService] INFO
o.a.t.i.a.ApplicationMasterService - Container
container_1482179744462_0008_01_000248 completed with COMPLETE:Container
released by application.
22:07:02.851 [ApplicationMasterService] INFO
o.a.t.i.a.ApplicationMasterService - Container
container_1482179744462_0008_01_000249 completed with COMPLETE:Container
released by application.
22:07:03.318 [zk-client-EventThread] INFO o.a.t.i.TwillContainerLauncher -
Container LiveNodeData updated:
{"data":{"containerId":"container_1482179744462_0008_01_000247","host":"<HOSTNAME>","debugPort":null,"logLevels":{"ROOT":"INFO"}}}
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
