vinoyang created FLINK-11782:
--------------------------------

             Summary: Enhance TaskManager log visualization by listing all log 
files for Flink web UI
                 Key: FLINK-11782
                 URL: https://issues.apache.org/jira/browse/FLINK-11782
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Web Frontend
            Reporter: vinoyang
            Assignee: vinoyang
         Attachments: flink-web-ui-taskmanager-log-files.png, 
yarn-container-log-files.png

Currently, there are some features to be enhanced when Flink web UI displays 
TaskManager logs:

1) Flink web UI can only display the log of task manager and stdout;
2) Flink web UI can only display the latest one log file;

In the log folder of a Task Manager, we usually have more files, including GC 
log files, multiple files generated based on the rolling rules of the logging 
framework (time or log file size), user's business log files (We internally 
implemented the separation of Flink from the user log). For these files, the 
current Flink web UI cannot be displayed.

I personally suggest that we can refer to the way YARN displays the container's 
log (see attachment 1), first list all the log files (see attachment 2), and 
then click to display the files of these logs.

 

This feature can be independent or part of the log separation (see FLINK-11202).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to