[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16705045#comment-16705045 ]
Marcelo Vanzin commented on SPARK-26043: ---------------------------------------- It would be better if you can show what you mean with an example. In general, it's good to avoid having this kind of logic in executors; and if needed, have the driver provide the needed info. (e.g. by broadcasting the config, which is done internally by Spark). > Make SparkHadoopUtil private to Spark > ------------------------------------- > > Key: SPARK-26043 > URL: https://issues.apache.org/jira/browse/SPARK-26043 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 3.0.0 > Reporter: Marcelo Vanzin > Assignee: Sean Owen > Priority: Minor > Labels: release-notes > Fix For: 3.0.0 > > > This API contains a few small helper methods used internally by Spark, mostly > related to Hadoop configs and kerberos. > It's been historically marked as "DeveloperApi". But in reality it's not very > useful for others, and changes a lot to be considered a stable API. Better to > just make it private to Spark. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org