[jira] [Updated] (SPARK-27061) Expose Driver UI port on driver service to access UI using service

2019-03-06 Thread Chandu Kavar (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-27061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chandu Kavar updated SPARK-27061:
-
Summary: Expose Driver UI port on driver service to access UI using service 
 (was: Expose 4040 port on driver service to access logs using service)

> Expose Driver UI port on driver service to access UI using service
> --
>
> Key: SPARK-27061
> URL: https://issues.apache.org/jira/browse/SPARK-27061
> Project: Spark
>  Issue Type: Task
>  Components: Kubernetes
>Affects Versions: 2.4.0
>Reporter: Chandu Kavar
>Priority: Minor
>  Labels: Kubernetes
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Currently, we can access the driver logs using 
> {{kubectl port-forward  4040:4040}}
> mentioned in 
> [https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui]
> We have users who submit spark jobs to Kubernetes, but they don't have access 
> to the cluster. so, they can't user kubectl port-forward command.
> If we can expose 4040 port on driver service, we can easily relay these logs 
> to UI using driver service and Nginx reverse proxy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-27061) Expose Driver UI port on driver service to access UI using service

2019-03-06 Thread Chandu Kavar (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-27061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785724#comment-16785724
 ] 

Chandu Kavar commented on SPARK-27061:
--

I started working on it. 

> Expose Driver UI port on driver service to access UI using service
> --
>
> Key: SPARK-27061
> URL: https://issues.apache.org/jira/browse/SPARK-27061
> Project: Spark
>  Issue Type: Task
>  Components: Kubernetes
>Affects Versions: 2.4.0
>Reporter: Chandu Kavar
>Priority: Minor
>  Labels: Kubernetes
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Currently, we can access the driver logs using 
> {{kubectl port-forward  4040:4040}}
> mentioned in 
> [https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui]
> We have users who submit spark jobs to Kubernetes, but they don't have access 
> to the cluster. so, they can't user kubectl port-forward command.
> If we can expose 4040 port on driver service, we can easily relay these logs 
> to UI using driver service and Nginx reverse proxy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-27061) Expose 4040 port on driver service to access logs using service

2019-03-05 Thread Chandu Kavar (JIRA)
Chandu Kavar created SPARK-27061:


 Summary: Expose 4040 port on driver service to access logs using 
service
 Key: SPARK-27061
 URL: https://issues.apache.org/jira/browse/SPARK-27061
 Project: Spark
  Issue Type: Task
  Components: Kubernetes
Affects Versions: 2.4.0
Reporter: Chandu Kavar


Currently, we can access the driver logs using 

{{kubectl port-forward  4040:4040}}

mentioned in 
[https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui]

We have users who submit spark jobs to Kubernetes, but they don't have access 
to the cluster. so, they can't user kubectl port-forward command.

If we can expose 4040 port on driver service, we can easily relay these logs to 
UI using driver service and Nginx reverse proxy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org