Gera Shegalov created SPARK-25221:
-------------------------------------
Summary: [DEPLOY] Consistent trailing whitespace treatment of conf
values
Key: SPARK-25221
URL: https://issues.apache.org/jira/browse/SPARK-25221
Project: Spark
Issue Type: Bug
Components: Deploy
Affects Versions: 2.3.1
Reporter: Gera Shegalov
When you use a custom line delimiter
{{spark.hadoop.textinputformat.record.delimiter}} that has a leading or a
trailing whitespace character it's only possible when specified via {{--conf}}
. Our pipeline consists of a highly customized generated jobs. Storing all the
config in a properities file is not only better for readability but even
necessary to avoid dealing with {{ARGS_MAX}} on different OS. Spark should
uniformly avoid trimming conf values in both cases.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
