[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-11-16 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-728652093 Yes ! This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-11-16 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727831428 @dongjoon-hyun Thanks a lot, for reviewing and helping this move forward. :) This is an automated message fr

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-11-07 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-723458969 >Do we need to rename SecretVolumeUtils.scala to K8sVolumeTestUtils? Actually, the code is still using SecretVolumeUtils.podHasVolume because we didn't change the class name.

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-11-06 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-723021479 Thank you @dongjoon-hyun , for taking another look ! This is an automated message from the Apache Git Servic

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-11-04 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-721731930 Hi @dongjoon-hyun , rebased to include the latest changes and incorporated the feedback. Thanks a lot for taking a look.

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-11-03 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-721070338 Hi @holdenk and @dongjoon-hyun, Hope you are doing good ! Do you have a view around this one way or the other? Thanks !

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-10-12 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-706940103 Jenkins, retest this please. This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-10-09 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-705387986 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-10-08 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-705428013 So, now the test is flaky and not failing. As it passed the second time. For my own exploration, later preserving the failed instance log: ``` KubernetesSuite:

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-10-08 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-705387986 Jenkins, retest this please. This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-10-07 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-704883727 @holdenk I have tried to rebase, but looks like is ran into the same test failure. This is an automated mess

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-09-18 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-694821682 Thanks @dongjoon-hyun , I have opened up an issue https://issues.apache.org/jira/browse/SPARK-32937, will do the root cause analysis soon. -

[GitHub] [spark] ScrapCodes commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-09-17 Thread GitBox
ScrapCodes commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-694127711 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a