Noritaka Sekiyama created SPARK-28069:
-----------------------------------------

             Summary: Switch log directory from Spark UI without restarting 
history server
                 Key: SPARK-28069
                 URL: https://issues.apache.org/jira/browse/SPARK-28069
             Project: Spark
          Issue Type: Improvement
          Components: Web UI
    Affects Versions: 2.4.3
            Reporter: Noritaka Sekiyama


History server polls the directory specified in spark.history.fs.logDirectory, 
and displays the event logs based on the data included in the directory.

In the Cloud, event logs might be written into different directories from 
different clusters.
Currently it is not so easy to launch history server for multiple clusters 
because there is no ways to switch log directory after starting the history 
server.
If users can switch log directory from Spark UI without restarting history 
server, it would be beneficial for users who wants to use Cloud storage for 
event log directory.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to