[
https://issues.apache.org/jira/browse/SPARK-26255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720340#comment-16720340
]
ASF GitHub Bot commented on SPARK-26255:
----------------------------------------
chakravarthiT opened a new pull request #23312: [SPARK-26255]Custom
error/exception is not thrown for the SQL tab when UI filters are added in
spark-sql launch
URL: https://github.com/apache/spark/pull/23312
## What changes were proposed in this pull request?
User specified filters are not applied to SQL tab in yarn mode, as it is
overridden by the yarn AmIp filter.
So we need to append user provided filters (spark.ui.filters) with yarn
filter.
## How was this patch tested?
【Test step】：
1) Launch spark sql with authentication filter as below:
2) spark-sql --master yarn --conf
spark.ui.filters=org.apache.hadoop.security.authentication.server.AuthenticationFilter
--conf
spark.org.apache.hadoop.security.authentication.server.AuthenticationFilter.params="type=simple"
3) Go to Yarn application list UI link
4) Launch the application master for the Spark-SQL app ID and access all the
tabs by appending tab name.
5) It will display an error for all tabs including SQL tab.(before able to
access SQL tab,as Authentication filter is not applied for SQL tab)
6) Also can be verified with info logs,that Authentication filter applied to
SQL tab.(before it is not applied).
I have attached the behaviour below in following order..
1) Command used
2) Before fix (logs and UI)
3) After fix (logs and UI)
**1) COMMAND USED**:
launching spark-sql with authentication filter.
**2) BEFORE FIX:**
**UI result:**
able to access SQL tab.
**logs**:
authentication filter not applied to SQL tab.
**3) AFTER FIX:**
**UI result**:
Not able to access SQL tab.
**in logs**:
Both yarn filter and Authentication filter applied to SQL tab.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Custom error/exception is not thrown for the SQL tab when UI filters are
> added in spark-sql launch
> --------------------------------------------------------------------------------------------------
>
> Key: SPARK-26255
> URL: https://issues.apache.org/jira/browse/SPARK-26255
> Project: Spark
> Issue Type: Bug
> Components: SQL, Web UI
> Affects Versions: 2.3.2
> Environment: 【Test Environment】：
> Server OS :-SUSE
> No. of Cluster Node:-3
> Spark Version:- 2.3.2
> Hadoop Version:-3.1
> Reporter: Sushanta Sen
> Priority: Major
>
> 【Detailed description】：Custom error is not thrown for the SQL tab when UI
> filters are added in spark-sql launch
> 【Precondition】：
> 1.Cluster is up and running【Test step】：
> 1. Launch spark sql as below:
> [spark-sql --master yarn --conf
> spark.ui.filters=org.apache.hadoop.security.authentication.server.AuthenticationFilter
> --conf
> spark.org.apache.hadoop.security.authentication.server.AuthenticationFilter.params="type=simple"]
> 2. Go to Yarn application list UI link
> 3. Launch the application master for the Spark-SQL app ID
> 4. It will display an error
> 5. Append /executors, /stages, /jobs, /environment, /SQL
> 【Expect Output】：An error should be displayed "An error has occurred. Please
> check for all the TABS
> 【Actual Output】：The error message is displayed for all the tabs except SQL
> tab .
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
