thierry accart created SPARK-30224: -------------------------------------- Summary: Configurable field and record separators for filters Key: SPARK-30224 URL: https://issues.apache.org/jira/browse/SPARK-30224 Project: Spark Issue Type: Improvement Components: Web UI Affects Versions: 2.4.4 Reporter: thierry accart
The method addfilter of JettyUtils is parsing sparkConf using strict field and record separator: at this time, it's not possible to have = or , signs in a parameter value. This brings impossibility to configure for exampe Hadoop's LDAP authenticator filter, as some of its parameters contain comma and equal signs. To fix this problem, there are two solutions: either we allow spark.<filter>.params.<key>=<value> in sparkConf or we allow spark.<filter>.params.rs=<record separator char> and spark.<filter>.params.fs=<field separator char> -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org