[jira] [Comment Edited] (YARN-10153) Problems of offline analysis with showSimulationTrace.html
[ https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443 ] YingmingWang edited comment on YARN-10153 at 2/21/20 7:34 AM: -- OK, I describe my question again. The web service you mentioned is real time service, http:host:port/simulate. The offline analysis is that open the showSimulationTrace.html, then, choose the realtimetrack.json to generate. There are two ways. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time website, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation. Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just can see the real time website but I cannot open the offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ? If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data. I place more files as rar in attachment. Thank for your help! was (Author: lmy777): OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time website, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation. Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just can see the real time website but I cannot open the offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ? If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data. I place more files as rar in attachment. Thank for your help! > Problems of offline analysis with showSimulationTrace.html > -- > > Key: YARN-10153 > URL: https://issues.apache.org/jira/browse/YARN-10153 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler-load-simulator >Affects Versions: 3.2.1 > Environment: Ubuntu18.04 > JAVA 1.8.0_241 > Hadoop-3.2.1 >Reporter: YingmingWang >Priority: Major > Fix For: 3.2.1 > > Attachments: INFO.txt, sls_file.rar > > Original Estimate: 1h > Remaining Estimate: 1h > > I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I > run the example in sample-data. It doesn't have WARNING or ERROR. I can see > the chart and data changing in real time by host:port/simulate but I can not > analyse the realtimetrack.json file by showSimulationTrace.html after the > run. I modified my file with the improvement of YARN-9836 but it still can't > analyze trace. The whole INFO file is placed in .txt. > {code:java} > // code placeholder > # Begining > INFO conf.Configuration: resource-types.xml not found > INFO resource.ResourceUtils:Unable to find 'resource-types.xml'. > # Finally > 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down. > 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: > appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 > vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 > vcore-seconds,applicationTags= > {code} > I want to know how to solve it or a more correct configuration process. Thank > you very much. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org Fo
[jira] [Comment Edited] (YARN-10153) Problems of offline analysis with showSimulationTrace.html
[ https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443 ] YingmingWang edited comment on YARN-10153 at 2/21/20 7:29 AM: -- OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time website, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation. Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just can see the real time website but I cannot open the offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ? If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data. I place more files as rar in attachment. Thank for your help! was (Author: lmy777): OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time websitte, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation.Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just see the real time website but I cannot see offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ? If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data. I place more files as rar in attachment. Thank for your help! > Problems of offline analysis with showSimulationTrace.html > -- > > Key: YARN-10153 > URL: https://issues.apache.org/jira/browse/YARN-10153 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler-load-simulator >Affects Versions: 3.2.1 > Environment: Ubuntu18.04 > JAVA 1.8.0_241 > Hadoop-3.2.1 >Reporter: YingmingWang >Priority: Major > Fix For: 3.2.1 > > Attachments: INFO.txt, sls_file.rar > > Original Estimate: 1h > Remaining Estimate: 1h > > I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I > run the example in sample-data. It doesn't have WARNING or ERROR. I can see > the chart and data changing in real time by host:port/simulate but I can not > analyse the realtimetrack.json file by showSimulationTrace.html after the > run. I modified my file with the improvement of YARN-9836 but it still can't > analyze trace. The whole INFO file is placed in .txt. > {code:java} > // code placeholder > # Begining > INFO conf.Configuration: resource-types.xml not found > INFO resource.ResourceUtils:Unable to find 'resource-types.xml'. > # Finally > 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down. > 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: > appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 > vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 > vcore-seconds,applicationTags= > {code} > I want to know how to solve it or a more correct configuration process. Thank > you very much. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-10153) Problems of offline analysis with showSimulationTrace.html
[ https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443 ] YingmingWang edited comment on YARN-10153 at 2/21/20 2:03 AM: -- OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time websitte, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation.Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just see the real time website but I cannot see offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ? If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data. I place more files as rar in attachment. Thank for your help! was (Author: lmy777): OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time websitte, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation.Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just see the real time website but I cannot see offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ? If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data. I place more files as zip in attachment. Thank for your help. > Problems of offline analysis with showSimulationTrace.html > -- > > Key: YARN-10153 > URL: https://issues.apache.org/jira/browse/YARN-10153 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler-load-simulator >Affects Versions: 3.2.1 > Environment: Ubuntu18.04 > JAVA 1.8.0_241 > Hadoop-3.2.1 >Reporter: YingmingWang >Priority: Major > Fix For: 3.2.1 > > Attachments: INFO.txt, sls_file.rar > > Original Estimate: 1h > Remaining Estimate: 1h > > I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I > run the example in sample-data. It doesn't have WARNING or ERROR. I can see > the chart and data changing in real time by host:port/simulate but I can not > analyse the realtimetrack.json file by showSimulationTrace.html after the > run. I modified my file with the improvement of YARN-9836 but it still can't > analyze trace. The whole INFO file is placed in .txt. > {code:java} > // code placeholder > # Begining > INFO conf.Configuration: resource-types.xml not found > INFO resource.ResourceUtils:Unable to find 'resource-types.xml'. > # Finally > 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down. > 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: > appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 > vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 > vcore-seconds,applicationTags= > {code} > I want to know how to solve it or a more correct configuration process. Thank > you very much. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-10153) Problems of offline analysis with showSimulationTrace.html
[ https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YingmingWang updated YARN-10153: Attachment: sls_file.rar > Problems of offline analysis with showSimulationTrace.html > -- > > Key: YARN-10153 > URL: https://issues.apache.org/jira/browse/YARN-10153 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler-load-simulator >Affects Versions: 3.2.1 > Environment: Ubuntu18.04 > JAVA 1.8.0_241 > Hadoop-3.2.1 >Reporter: YingmingWang >Priority: Major > Fix For: 3.2.1 > > Attachments: INFO.txt, sls_file.rar > > Original Estimate: 1h > Remaining Estimate: 1h > > I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I > run the example in sample-data. It doesn't have WARNING or ERROR. I can see > the chart and data changing in real time by host:port/simulate but I can not > analyse the realtimetrack.json file by showSimulationTrace.html after the > run. I modified my file with the improvement of YARN-9836 but it still can't > analyze trace. The whole INFO file is placed in .txt. > {code:java} > // code placeholder > # Begining > INFO conf.Configuration: resource-types.xml not found > INFO resource.ResourceUtils:Unable to find 'resource-types.xml'. > # Finally > 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down. > 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: > appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 > vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 > vcore-seconds,applicationTags= > {code} > I want to know how to solve it or a more correct configuration process. Thank > you very much. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10153) Problems of offline analysis with showSimulationTrace.html
[ https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443 ] YingmingWang commented on YARN-10153: - OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time websitte, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation.Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just see the real time website but I cannot see offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ? If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data. I place more files as zip in attachment. Thank for your help. > Problems of offline analysis with showSimulationTrace.html > -- > > Key: YARN-10153 > URL: https://issues.apache.org/jira/browse/YARN-10153 > Project: Hadoop YARN > Issue Type: Bug > Components: scheduler-load-simulator >Affects Versions: 3.2.1 > Environment: Ubuntu18.04 > JAVA 1.8.0_241 > Hadoop-3.2.1 >Reporter: YingmingWang >Priority: Major > Fix For: 3.2.1 > > Attachments: INFO.txt > > Original Estimate: 1h > Remaining Estimate: 1h > > I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I > run the example in sample-data. It doesn't have WARNING or ERROR. I can see > the chart and data changing in real time by host:port/simulate but I can not > analyse the realtimetrack.json file by showSimulationTrace.html after the > run. I modified my file with the improvement of YARN-9836 but it still can't > analyze trace. The whole INFO file is placed in .txt. > {code:java} > // code placeholder > # Begining > INFO conf.Configuration: resource-types.xml not found > INFO resource.ResourceUtils:Unable to find 'resource-types.xml'. > # Finally > 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down. > 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: > appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources= vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 > vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 > vcore-seconds,applicationTags= > {code} > I want to know how to solve it or a more correct configuration process. Thank > you very much. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Created] (YARN-10153) Problems of offline analysis with showSimulationTrace.html
YingmingWang created YARN-10153: --- Summary: Problems of offline analysis with showSimulationTrace.html Key: YARN-10153 URL: https://issues.apache.org/jira/browse/YARN-10153 Project: Hadoop YARN Issue Type: Bug Components: scheduler-load-simulator Affects Versions: 3.2.1 Environment: Ubuntu18.04 JAVA 1.8.0_241 Hadoop-3.2.1 Reporter: YingmingWang Fix For: 3.2.1 Attachments: INFO.txt I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I run the example in sample-data. It doesn't have WARNING or ERROR. I can see the chart and data changing in real time by host:port/simulate but I can not analyse the realtimetrack.json file by showSimulationTrace.html after the run. I modified my file with the improvement of YARN-9836 but it still can't analyze trace. The whole INFO file is placed in .txt. {code:java} // code placeholder # Begining INFO conf.Configuration: resource-types.xml not found INFO resource.ResourceUtils:Unable to find 'resource-types.xml'. # Finally 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down. 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds,applicationTags= {code} I want to know how to solve it or a more correct configuration process. Thank you very much. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org