[
https://issues.apache.org/jira/browse/YARN-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831542#comment-16831542
]
Prabhu Joseph commented on YARN-9524:
-------------------------------------
YARN-6929 has caused two issues:
1. Test Case Failure of {{TestLogsCLI}} - this is due to wrong paths in
testcase, have changed paths from older to new app log dir structure.
2. Test Case Failure of {{TestAHSWebServices}}. This is a regression which
affects ATS (both 1.5 and 2) {{LogWebService}} and {{AHSWebServices}} rest api
while fetching the logs from older app log dir.
{code:java}
[yarn@yarn-ats-1 ~]$ curl -s
"http://yarn-ats-1:8198/ws/v2/applicationlog/containers/container_1556376250086_0006_01_000001/logs";
{"exception":"WebApplicationException","message":"java.io.IOException: Can not
create a Path from a null string\nCan not find remote application directory for
the
application:application_1556376250086_0006\n","javaClassName":"javax.ws.rs.WebApplicationException"}[yarn@yarn-ats-1
~]$
{code}
When the Rest Api does not pass the appOwner, the {{LogAggregationUtils}} has
to guess the job user by setting * in Path which have missed in YARN-6929 for
Older app log dir structure. Have fixed the same.
{code:java}
[yarn@yarn-ats-3 ~]$ curl -s
"http://yarn-ats-1:8198/ws/v2/applicationlog/containers/container_1556376250086_0006_01_000001/logs";
[{"containerLogInfo":[{"fileName":"AppMaster.stderr","fileSize":"4158","lastModifiedTime":"Thu
May 02 09:54:58 +0000
2019"},{"fileName":"AppMaster.stdout","fileSize":"0","lastModifiedTime":"Thu
May 02 09:54:58 +0000
2019"},{"fileName":"directory.info","fileSize":"2125","lastModifiedTime":"Thu
May 02 09:54:58 +0000
2019"},{"fileName":"launch_container.sh","fileSize":"4767","lastModifiedTime":"Thu
May 02 09:54:58 +0000
2019"},{"fileName":"prelaunch.err","fileSize":"0","lastModifiedTime":"Thu May
02 09:54:58 +0000
2019"},{"fileName":"prelaunch.out","fileSize":"100","lastModifiedTime":"Thu May
02 09:54:58 +0000
2019"}],"logAggregationType":"AGGREGATED","containerId":"container_1556376250086_0006_01_000001","nodeId":"yarn-ats-2_45454"}]
{code}
Verified all testcases related to LogAggregation and functionality - Log
Aggregation, Deletion, Yarn Logs Cli, HistoryServer, ATS Logs Web Service.
> TestAHSWebServices and TestLogsCLI test case failures
> -----------------------------------------------------
>
> Key: YARN-9524
> URL: https://issues.apache.org/jira/browse/YARN-9524
> Project: Hadoop YARN
> Issue Type: Bug
> Components: log-aggregation, test
> Affects Versions: 3.3.0
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
>
> {{TestAHSWebServices}} and {{TestLogsCLI}} test case failures after YARN-6929.
> {code:java}
> [ERROR] Failures:
> [ERROR] TestLogsCLI.testFetchApplictionLogsAsAnotherUser:1014
> [ERROR] Errors:
> [ERROR]
> TestLogsCLI.testFetchFinishedApplictionLogs:420->uploadEmptyContainerLogIntoRemoteDir:1543
> » NullPointer
> [INFO]
> [ERROR] Tests run: 339, Failures: 1, Errors: 1, Skipped: 1
> [ERROR] Failures:
> [ERROR] TestAHSWebServices.testContainerLogsForFinishedApps:624
> [ERROR] TestAHSWebServices.testContainerLogsForFinishedApps:624
> [ERROR] Errors:
> [ERROR] TestAHSWebServices.testContainerLogsMetaForFinishedApps:942 »
> WebApplication j...
> [ERROR] TestAHSWebServices.testContainerLogsMetaForFinishedApps:942 »
> WebApplication j...{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
