[ https://issues.apache.org/jira/browse/SPARK-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161585#comment-14161585 ]
Apache Spark commented on SPARK-3270: ------------------------------------- User 'mmalohlava' has created a pull request for this issue: https://github.com/apache/spark/pull/2691 > Spark API for Application Extensions > ------------------------------------ > > Key: SPARK-3270 > URL: https://issues.apache.org/jira/browse/SPARK-3270 > Project: Spark > Issue Type: New Feature > Components: Spark Core > Reporter: Michal Malohlava > > Any application should be able to enrich spark infrastructure by services > which are not available by default. > Hence, to support such application extensions (aka "extesions"/"plugins") > Spark platform should provide: > - an API to register an extension > - an API to register a "service" (meaning provided functionality) > - well-defined points in Spark infrastructure which can be enriched/hooked > by extension > - a way of deploying extension (for example, simply putting the extension > on classpath and using Java service interface) > - a way to access extension from application > Overall proposal is available here: > https://docs.google.com/document/d/1dHF9zi7GzFbYnbV2PwaOQ2eLPoTeiN9IogUe4PAOtrQ/edit?usp=sharing > Note: In this context, I do not mean reinventing OSGi (or another plugin > platform) but it can serve as a good starting point. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org