[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511033#comment-16511033 ]
Sina Madani commented on SPARK-650: ----------------------------------- I too have this problem. It seems that Apache Flink solves this quite nicely by having "RichFunction" variants for operations like map, filter, reduce etc. A RichFunction, such as RichMapFunction, provides open(Configuration parameters) and close() methods which can be used to run setup and teardown code once per worker and also initialise the worker from primitive key-value pairs. > Add a "setup hook" API for running initialization code on each executor > ----------------------------------------------------------------------- > > Key: SPARK-650 > URL: https://issues.apache.org/jira/browse/SPARK-650 > Project: Spark > Issue Type: New Feature > Components: Spark Core > Reporter: Matei Zaharia > Priority: Minor > > Would be useful to configure things like reporting libraries -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org