flink web ui authentication

2018-03-13 Thread Sampath Bhat
Hello I would like to know if flink supports any user level authentication like username/password for flink web ui. Regards Sampath S

Flink on Kubernetes issue

2018-03-18 Thread Sampath Bhat
Hi In the apache flink documentation https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/deployment/kubernetes.html The order of creating the deployment and services are incorrect. It is mentioned in the order as follows- kubectl create -f jobmanager-deployment.yaml kubectl create -f

Re: Flink on Kubernetes issue

2018-03-18 Thread Sampath Bhat
Adding on, it would be great if this is updated. If given the permission then I can change it myself. On Mon, Mar 19, 2018 at 12:26 PM, Sampath Bhat wrote: > Hi > > In the apache flink documentation > https://ci.apache.org/projects/flink/flink-docs- > release-1.4/ops/deployment/

Flink on kubernetes flink-conf.yaml

2018-03-19 Thread Sampath Bhat
Hello In the official documentation of flink https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/deployment/kubernetes.html The task manager yaml exposes ports such as task manager rpc port /data port and all. So for these ports to take effect on flink the same has to be mentioned in

Re: Flink on Kubernetes issue

2018-03-19 Thread Sampath Bhat
rnetes.md. Feel > free to apply the change and open a PR against Flink's repository. > > Cheers, > Till > > On Mon, Mar 19, 2018 at 7:57 AM, Sampath Bhat > wrote: > > > Adding on, it would be great if this is updated. If given the permission > > then I can chang

Job manager - Zookeeper HA

2018-03-19 Thread Sampath Bhat
Hello I'm configuring flink cluster with Zookeeper for high availability for Job managers. These are the HA related configurations- high-availability: zookeeper high-availability.cluster-id: flink high-availability.zookeeper.quorum: localhost:2181 high-availability.zookeeper.storageDir: file:///h

Re: [jira] [Created] (FLINK-9148) when deploying flink on kubernetes, the taskmanager report "java.net.UnknownHostException: flink-jobmanager: Temporary failure in name resolution"

2018-04-17 Thread Sampath Bhat
You'll have create the job manager service like mentioned in the link. http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Flink-on-Kubernetes-issue-tp21664.html You should create job manager service before deploying the task manager. http://apache-flink-mailing-list-archive.1008284.n3.

Assign JIRA issue permission

2018-04-27 Thread Sampath Bhat
Hello I would like to know the procedure for assigning the jira issue. How can I assign it to myself? Thanks

Clarity on Flink 1.5 Rescale mechanism

2018-06-12 Thread Sampath Bhat
Hello In flink 1.5 release notes - https://flink.apache.org/news/2018/05/25/release-1.5.0.html#release-notes Various Other Features and Improvements: Applications can be rescaled without manually triggering a savepoint. Under the hood, Flink will still take a savepoint, stop the application, and r

Breakage in Flink CLI in 1.5.0

2018-06-19 Thread Sampath Bhat
Hello I'm using Flink 1.5.0 version and Flink CLI to submit jar to flink cluster. In flink 1.4.2 only job manager rpc address and job manager rpc port were sufficient for flink client to connect to job manager and submit the job. But in flink 1.5.0 the flink client additionally requires the rest

Re: Breakage in Flink CLI in 1.5.0

2018-06-19 Thread Sampath Bhat
ssary anymore, the rpc > address is still *required *due to some technical implementations; it may > be that you can set this to some arbitrary value however. > > As a result the REST API (i.e. the web server) must be running in order to > submit jobs. > > > On 19.06.2018 14:1

Re: Breakage in Flink CLI in 1.5.0

2018-06-19 Thread Sampath Bhat
, 2018 at 11:18 AM, Sampath Bhat wrote: > Hi Chesnay > > If REST API (i.e. the web server) is mandatory for submitting jobs then > why is there an option to set rest.port to -1? I think it should be > mandatory to set some valid port for rest.port and make sure flink job > manag

Re: Breakage in Flink CLI in 1.5.0

2018-06-20 Thread Sampath Bhat
va:1192) >>> > at java.net.InetAddress.getAllByName(InetAddress.java:1126) >>> > at java.net.InetAddress.getByName(InetAddress.java:1076) >>> > at >>> > org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils. >>> getRpcUrl(AkkaRpcServiceUtils.java:171) >&

Re: Breakage in Flink CLI in 1.5.0

2018-06-21 Thread Sampath Bhat
will fall > back to use the jobmanager.rpc.address. Currently, the rest server endpoint > runs in the same JVM as the cluster entrypoint and all JobMasters. > > Cheers, > Till > > On Thu, Jun 21, 2018 at 8:46 AM Sampath Bhat > wrote: > >> Hello Till >> >&g

Fwd: Flink CLI properties with HA

2018-07-16 Thread Sampath Bhat
-- Forwarded message -- From: Sampath Bhat Date: Fri, Jul 13, 2018 at 3:18 PM Subject: Flink CLI properties with HA To: user Hello When HA is enabled in the flink cluster and if I've to submit job via flink CLI then in the flink-conf.yaml of flink CLI should contain

Re: Flink CLI properties with HA

2018-07-17 Thread Sampath Bhat
vailability.storageDir* is storage > (Job graph, checkpoint and so on). Actually, the real data is stored under > this path which used to recover purpose, zookeeper just store a state > handle. > > --- > Thanks. > vino. > > > 2018-07-16 15:28 GMT+08:00 Sampath Bhat :

Re: Flink CLI properties with HA

2018-07-18 Thread Sampath Bhat
wrote: > >> Hi Sampath, >> >> It seems Flink CLI for standalone would not access >> *high-availability.storageDir.* >> >> What's the exception stack trace in your environment? >> >> Thanks, vino. >> >> 2018-07-17 15:

Permission for contributor status

2018-08-03 Thread Sampath Bhat
Hello flink dev team I would like to know what is the procedure for obtaining contributor permission for flink. Thanks Sampath

Re: Permission for contributor status

2018-08-03 Thread Sampath Bhat
ssions is to assign JIRA issues to > yourself. If you want to do this, then let us know your JIRA account name > and we will add you to the list of contributors in JIRA. > > Cheers, > Till > > On Fri, Aug 3, 2018 at 9:04 AM Sampath Bhat > wrote: > > > Hello flink dev