GitHub user gengliangwang opened a pull request:

    https://github.com/apache/spark/pull/22699

    [SPARK-25711][Core] Allow history server to show usage

    ## What changes were proposed in this pull request?
    
    Currently, if we try run
    ```
    ./start-history-server.sh -h
    ```
    We will get such error
    ```
    java.io.FileNotFoundException: File -h does not exist
    ```
    
    This is not user friendly. 
    After fix, we can get following output:
    ```
    Usage: ./sbin/start-history-server.sh [options]
    
    Options:
    DIR Deprecated; set spark.history.fs.logDirectory directly
    --dir DIR (-d DIR) Deprecated; set spark.history.fs.logDirectory directly
    --properties-file FILE Path to a custom Spark properties file.
    Default is conf/spark-defaults.conf.
    
    Configuration options can be set by setting the corresponding JVM system 
property.
    History Server options are always available; additional options depend on 
the provider.
    
    History Server options:
    
    spark.history.ui.port Port where server will listen for connections
    (default 18080)
    spark.history.acls.enable Whether to enable view acls for all applications
    (default false)
    spark.history.provider Name of history provider class (defaults to
    file system-based provider)
    spark.history.retainedApplications Max number of application UIs to keep 
loaded in memory
    (default 50)
    FsHistoryProvider options:
    
    spark.history.fs.logDirectory Directory where app logs are stored
    (default: file:/tmp/spark-events)
    spark.history.fs.updateInterval How often to reload log data from storage
    (in seconds, default: 10)
    ```
    
    ## How was this patch tested?
    
    Manual test

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gengliangwang/spark refactorSHSUsage

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/22699.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #22699
    
----
commit e91f611d57ca97308a7f5aecca42255c4b69066f
Author: Gengliang Wang <gengliang.wang@...>
Date:   2018-10-11T15:27:30Z

    Allow history server to show usage

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to