[jira] [Updated] (SPARK-27061) Expose Driver UI port on driver service to access UI using service
[ https://issues.apache.org/jira/browse/SPARK-27061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandu Kavar updated SPARK-27061: - Summary: Expose Driver UI port on driver service to access UI using service (was: Expose 4040 port on driver service to access logs using service) > Expose Driver UI port on driver service to access UI using service > -- > > Key: SPARK-27061 > URL: https://issues.apache.org/jira/browse/SPARK-27061 > Project: Spark > Issue Type: Task > Components: Kubernetes >Affects Versions: 2.4.0 >Reporter: Chandu Kavar >Priority: Minor > Labels: Kubernetes > Original Estimate: 24h > Remaining Estimate: 24h > > Currently, we can access the driver logs using > {{kubectl port-forward 4040:4040}} > mentioned in > [https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui] > We have users who submit spark jobs to Kubernetes, but they don't have access > to the cluster. so, they can't user kubectl port-forward command. > If we can expose 4040 port on driver service, we can easily relay these logs > to UI using driver service and Nginx reverse proxy. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27061) Expose Driver UI port on driver service to access UI using service
[ https://issues.apache.org/jira/browse/SPARK-27061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785724#comment-16785724 ] Chandu Kavar commented on SPARK-27061: -- I started working on it. > Expose Driver UI port on driver service to access UI using service > -- > > Key: SPARK-27061 > URL: https://issues.apache.org/jira/browse/SPARK-27061 > Project: Spark > Issue Type: Task > Components: Kubernetes >Affects Versions: 2.4.0 >Reporter: Chandu Kavar >Priority: Minor > Labels: Kubernetes > Original Estimate: 24h > Remaining Estimate: 24h > > Currently, we can access the driver logs using > {{kubectl port-forward 4040:4040}} > mentioned in > [https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui] > We have users who submit spark jobs to Kubernetes, but they don't have access > to the cluster. so, they can't user kubectl port-forward command. > If we can expose 4040 port on driver service, we can easily relay these logs > to UI using driver service and Nginx reverse proxy. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-27061) Expose 4040 port on driver service to access logs using service
Chandu Kavar created SPARK-27061: Summary: Expose 4040 port on driver service to access logs using service Key: SPARK-27061 URL: https://issues.apache.org/jira/browse/SPARK-27061 Project: Spark Issue Type: Task Components: Kubernetes Affects Versions: 2.4.0 Reporter: Chandu Kavar Currently, we can access the driver logs using {{kubectl port-forward 4040:4040}} mentioned in [https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui] We have users who submit spark jobs to Kubernetes, but they don't have access to the cluster. so, they can't user kubectl port-forward command. If we can expose 4040 port on driver service, we can easily relay these logs to UI using driver service and Nginx reverse proxy. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org