[jira] [Comment Edited] (YARN-10153) Problems of offline analysis with showSimulationTrace.html

2020-02-20 Thread YingmingWang (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443
 ] 

YingmingWang edited comment on YARN-10153 at 2/21/20 7:34 AM:
--

OK, I describe my question again. The web service you mentioned  is real time 
service, http:host:port/simulate. The offline analysis is that open the 
showSimulationTrace.html, then, choose the realtimetrack.json to generate. 
There are two ways. I know your meaning that I can see the many charts and the 
data changing when my SLS is running. If I just see the real time website, 
http:host:port/simulate, it is ok. After the running of SLS example, it 
generate realtimetrack.json and jobruntime.csv to record the information of 
this simulation. Then, I choose the realtimetrack.json in 
showSimulationTrace.html  but it cannot generate offinle analysis outcome. It 
has no response and change. The problem is that why I just can see the real 
time website but I cannot open the  offline analysis. I am afraid that my SLS 
configuration has problem, it leads to problems in offline analysis and even 
simulation results.  Another question is whether my INFO is ok even if it has ' 
resource-types.xml not found' ? 

If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: 
JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of 
the JSON data.

I place more files as rar in attachment.

Thank for your help!


was (Author: lmy777):
OK, I describe my question again. I know your meaning that I can see the many 
charts and the data changing when my SLS is running. If I just see the real 
time website, http:host:port/simulate, it is ok. After the running of SLS 
example, it generate realtimetrack.json and jobruntime.csv to record the 
information of this simulation. Then, I choose the realtimetrack.json in 
showSimulationTrace.html  but it cannot generate offinle analysis outcome. It 
has no response and change. The problem is that why I just can see the real 
time website but I cannot open the  offline analysis. I am afraid that my SLS 
configuration has problem, it leads to problems in offline analysis and even 
simulation results.  Another question is whether my INFO is ok even if it has ' 
resource-types.xml not found' ? 

If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: 
JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of 
the JSON data.

I place more files as rar in attachment.

Thank for your help!

> Problems of offline analysis with showSimulationTrace.html
> --
>
> Key: YARN-10153
> URL: https://issues.apache.org/jira/browse/YARN-10153
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: scheduler-load-simulator
>Affects Versions: 3.2.1
> Environment: Ubuntu18.04
> JAVA 1.8.0_241
> Hadoop-3.2.1
>Reporter: YingmingWang
>Priority: Major
> Fix For: 3.2.1
>
> Attachments: INFO.txt, sls_file.rar
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I 
> run the example in sample-data. It doesn't have WARNING or ERROR. I can see 
> the chart and data changing in real time by host:port/simulate but I can not 
> analyse the realtimetrack.json file by showSimulationTrace.html after the 
> run.  I modified my file with the improvement of YARN-9836 but it still can't 
> analyze trace.  The whole INFO file is placed in .txt.
> {code:java}
> // code placeholder
> # Begining
> INFO conf.Configuration: resource-types.xml not found
> INFO resource.ResourceUtils:Unable to find 'resource-types.xml'.
> # Finally
> 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down.
> 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: 
> appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=  vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 
> vcore-seconds,applicationTags=
> {code}
> I want to know how to solve it or a more correct configuration process. Thank 
> you very much.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
Fo

[jira] [Comment Edited] (YARN-10153) Problems of offline analysis with showSimulationTrace.html

2020-02-20 Thread YingmingWang (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443
 ] 

YingmingWang edited comment on YARN-10153 at 2/21/20 7:29 AM:
--

OK, I describe my question again. I know your meaning that I can see the many 
charts and the data changing when my SLS is running. If I just see the real 
time website, http:host:port/simulate, it is ok. After the running of SLS 
example, it generate realtimetrack.json and jobruntime.csv to record the 
information of this simulation. Then, I choose the realtimetrack.json in 
showSimulationTrace.html  but it cannot generate offinle analysis outcome. It 
has no response and change. The problem is that why I just can see the real 
time website but I cannot open the  offline analysis. I am afraid that my SLS 
configuration has problem, it leads to problems in offline analysis and even 
simulation results.  Another question is whether my INFO is ok even if it has ' 
resource-types.xml not found' ? 

If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: 
JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of 
the JSON data.

I place more files as rar in attachment.

Thank for your help!


was (Author: lmy777):
OK, I describe my question again. I know your meaning that I can see the many 
charts and the data changing when my SLS is running. If I just see the real 
time websitte, http:host:port/simulate, it is ok. After the running of SLS 
example, it generate realtimetrack.json and jobruntime.csv to record the 
information of this simulation.Then, I choose the realtimetrack.json in 
showSimulationTrace.html  but it cannot generate offinle analysis outcome. It 
has no response and change. The problem is that why I just see the real time 
website but I cannot see offline analysis. I am afraid that my SLS 
configuration has problem, it leads to problems in offline analysis and even 
simulation results.  Another question is whether my INFO is ok even if it has ' 
resource-types.xml not found' ? 

If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: 
JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of 
the JSON data.

I place more files as rar in attachment.

Thank for your help!

> Problems of offline analysis with showSimulationTrace.html
> --
>
> Key: YARN-10153
> URL: https://issues.apache.org/jira/browse/YARN-10153
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: scheduler-load-simulator
>Affects Versions: 3.2.1
> Environment: Ubuntu18.04
> JAVA 1.8.0_241
> Hadoop-3.2.1
>Reporter: YingmingWang
>Priority: Major
> Fix For: 3.2.1
>
> Attachments: INFO.txt, sls_file.rar
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I 
> run the example in sample-data. It doesn't have WARNING or ERROR. I can see 
> the chart and data changing in real time by host:port/simulate but I can not 
> analyse the realtimetrack.json file by showSimulationTrace.html after the 
> run.  I modified my file with the improvement of YARN-9836 but it still can't 
> analyze trace.  The whole INFO file is placed in .txt.
> {code:java}
> // code placeholder
> # Begining
> INFO conf.Configuration: resource-types.xml not found
> INFO resource.ResourceUtils:Unable to find 'resource-types.xml'.
> # Finally
> 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down.
> 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: 
> appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=  vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 
> vcore-seconds,applicationTags=
> {code}
> I want to know how to solve it or a more correct configuration process. Thank 
> you very much.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Comment Edited] (YARN-10153) Problems of offline analysis with showSimulationTrace.html

2020-02-20 Thread YingmingWang (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443
 ] 

YingmingWang edited comment on YARN-10153 at 2/21/20 2:03 AM:
--

OK, I describe my question again. I know your meaning that I can see the many 
charts and the data changing when my SLS is running. If I just see the real 
time websitte, http:host:port/simulate, it is ok. After the running of SLS 
example, it generate realtimetrack.json and jobruntime.csv to record the 
information of this simulation.Then, I choose the realtimetrack.json in 
showSimulationTrace.html  but it cannot generate offinle analysis outcome. It 
has no response and change. The problem is that why I just see the real time 
website but I cannot see offline analysis. I am afraid that my SLS 
configuration has problem, it leads to problems in offline analysis and even 
simulation results.  Another question is whether my INFO is ok even if it has ' 
resource-types.xml not found' ? 

If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: 
JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of 
the JSON data.

I place more files as rar in attachment.

Thank for your help!


was (Author: lmy777):
OK, I describe my question again. I know your meaning that I can see the many 
charts and the data changing when my SLS is running. If I just see the real 
time websitte, http:host:port/simulate, it is ok. After the running of SLS 
example, it generate realtimetrack.json and jobruntime.csv to record the 
information of this simulation.Then, I choose the realtimetrack.json in 
showSimulationTrace.html  but it cannot generate offinle analysis outcome. It 
has no response and change. The problem is that why I just see the real time 
website but I cannot see offline analysis. I am afraid that my SLS 
configuration has problem, it leads to problems in offline analysis and even 
simulation results.  Another question is whether my INFO is ok even if it has ' 
resource-types.xml not found' ? 

If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: 
JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of 
the JSON data.

I place more files as zip in attachment.

Thank for your help.

> Problems of offline analysis with showSimulationTrace.html
> --
>
> Key: YARN-10153
> URL: https://issues.apache.org/jira/browse/YARN-10153
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: scheduler-load-simulator
>Affects Versions: 3.2.1
> Environment: Ubuntu18.04
> JAVA 1.8.0_241
> Hadoop-3.2.1
>Reporter: YingmingWang
>Priority: Major
> Fix For: 3.2.1
>
> Attachments: INFO.txt, sls_file.rar
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I 
> run the example in sample-data. It doesn't have WARNING or ERROR. I can see 
> the chart and data changing in real time by host:port/simulate but I can not 
> analyse the realtimetrack.json file by showSimulationTrace.html after the 
> run.  I modified my file with the improvement of YARN-9836 but it still can't 
> analyze trace.  The whole INFO file is placed in .txt.
> {code:java}
> // code placeholder
> # Begining
> INFO conf.Configuration: resource-types.xml not found
> INFO resource.ResourceUtils:Unable to find 'resource-types.xml'.
> # Finally
> 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down.
> 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: 
> appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=  vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 
> vcore-seconds,applicationTags=
> {code}
> I want to know how to solve it or a more correct configuration process. Thank 
> you very much.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-10153) Problems of offline analysis with showSimulationTrace.html

2020-02-20 Thread YingmingWang (Jira)


 [ 
https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

YingmingWang updated YARN-10153:

Attachment: sls_file.rar

> Problems of offline analysis with showSimulationTrace.html
> --
>
> Key: YARN-10153
> URL: https://issues.apache.org/jira/browse/YARN-10153
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: scheduler-load-simulator
>Affects Versions: 3.2.1
> Environment: Ubuntu18.04
> JAVA 1.8.0_241
> Hadoop-3.2.1
>Reporter: YingmingWang
>Priority: Major
> Fix For: 3.2.1
>
> Attachments: INFO.txt, sls_file.rar
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I 
> run the example in sample-data. It doesn't have WARNING or ERROR. I can see 
> the chart and data changing in real time by host:port/simulate but I can not 
> analyse the realtimetrack.json file by showSimulationTrace.html after the 
> run.  I modified my file with the improvement of YARN-9836 but it still can't 
> analyze trace.  The whole INFO file is placed in .txt.
> {code:java}
> // code placeholder
> # Begining
> INFO conf.Configuration: resource-types.xml not found
> INFO resource.ResourceUtils:Unable to find 'resource-types.xml'.
> # Finally
> 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down.
> 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: 
> appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=  vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 
> vcore-seconds,applicationTags=
> {code}
> I want to know how to solve it or a more correct configuration process. Thank 
> you very much.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-10153) Problems of offline analysis with showSimulationTrace.html

2020-02-20 Thread YingmingWang (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443
 ] 

YingmingWang commented on YARN-10153:
-

OK, I describe my question again. I know your meaning that I can see the many 
charts and the data changing when my SLS is running. If I just see the real 
time websitte, http:host:port/simulate, it is ok. After the running of SLS 
example, it generate realtimetrack.json and jobruntime.csv to record the 
information of this simulation.Then, I choose the realtimetrack.json in 
showSimulationTrace.html  but it cannot generate offinle analysis outcome. It 
has no response and change. The problem is that why I just see the real time 
website but I cannot see offline analysis. I am afraid that my SLS 
configuration has problem, it leads to problems in offline analysis and even 
simulation results.  Another question is whether my INFO is ok even if it has ' 
resource-types.xml not found' ? 

If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: 
JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of 
the JSON data.

I place more files as zip in attachment.

Thank for your help.

> Problems of offline analysis with showSimulationTrace.html
> --
>
> Key: YARN-10153
> URL: https://issues.apache.org/jira/browse/YARN-10153
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: scheduler-load-simulator
>Affects Versions: 3.2.1
> Environment: Ubuntu18.04
> JAVA 1.8.0_241
> Hadoop-3.2.1
>Reporter: YingmingWang
>Priority: Major
> Fix For: 3.2.1
>
> Attachments: INFO.txt
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I 
> run the example in sample-data. It doesn't have WARNING or ERROR. I can see 
> the chart and data changing in real time by host:port/simulate but I can not 
> analyse the realtimetrack.json file by showSimulationTrace.html after the 
> run.  I modified my file with the improvement of YARN-9836 but it still can't 
> analyze trace.  The whole INFO file is placed in .txt.
> {code:java}
> // code placeholder
> # Begining
> INFO conf.Configuration: resource-types.xml not found
> INFO resource.ResourceUtils:Unable to find 'resource-types.xml'.
> # Finally
> 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down.
> 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: 
> appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=  vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 
> vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 
> vcore-seconds,applicationTags=
> {code}
> I want to know how to solve it or a more correct configuration process. Thank 
> you very much.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Created] (YARN-10153) Problems of offline analysis with showSimulationTrace.html

2020-02-20 Thread YingmingWang (Jira)
YingmingWang created YARN-10153:
---

 Summary: Problems of offline analysis with showSimulationTrace.html
 Key: YARN-10153
 URL: https://issues.apache.org/jira/browse/YARN-10153
 Project: Hadoop YARN
  Issue Type: Bug
  Components: scheduler-load-simulator
Affects Versions: 3.2.1
 Environment: Ubuntu18.04
JAVA 1.8.0_241
Hadoop-3.2.1
Reporter: YingmingWang
 Fix For: 3.2.1
 Attachments: INFO.txt

I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I 
run the example in sample-data. It doesn't have WARNING or ERROR. I can see the 
chart and data changing in real time by host:port/simulate but I can not 
analyse the realtimetrack.json file by showSimulationTrace.html after the run.  
I modified my file with the improvement of YARN-9836 but it still can't analyze 
trace.  The whole INFO file is placed in .txt.
{code:java}
// code placeholder
# Begining
INFO conf.Configuration: resource-types.xml not found
INFO resource.ResourceUtils:Unable to find 'resource-types.xml'.
# Finally
2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down.
2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: 
appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 
vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 
vcore-seconds,applicationTags=


{code}
I want to know how to solve it or a more correct configuration process. Thank 
you very much.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org