Yinan Li created SPARK-22839:
--------------------------------

             Summary: Refactor Kubernetes code for configuring driver/executor 
pods to use consistent and cleaner abstraction
                 Key: SPARK-22839
                 URL: https://issues.apache.org/jira/browse/SPARK-22839
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 2.3.0
            Reporter: Yinan Li


As discussed in https://github.com/apache/spark/pull/19954, the current code 
for configuring the driver pod vs the code for configuring the executor pods 
are using the same abstraction. Besides that, the current code leaves a lot to 
be desired in terms of the level and cleaness of abstraction. For example, the 
current code is passing around many pieces of information around different 
class hierarchies, which makes code review and maintenance challenging. We need 
some thorough refactoring of the current code to achieve better, cleaner, and 
consistent abstraction.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to