[jira] [Created] (FLINK-21414) javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown
Bhagi created FLINK-21414: - Summary: javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown Key: FLINK-21414 URL: https://issues.apache.org/jira/browse/FLINK-21414 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: flink@flink-jobmanager-5d9594b76c-t6cc8:~$ cat /etc/os-release PRETTY_NAME="Debian GNU/Linux 10 (buster)" NAME="Debian GNU/Linux" VERSION_ID="10" VERSION="10 (buster)" VERSION_CODENAME=buster ID=debian Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-02-19-12-26-27-296.png Enabled High availability for FLink with kubernetes API with Leader election and retirieval mechanism,After configuring HA parameters with Leader election and Leader retrival ..I started getting this error in job manager logs. +error logs in job manager logs:+ at org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler$SslEngineType$3.unwrap(SslHandler.java:282) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1372) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1267) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1314) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:501) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:440) ~[flink-dist_2.11-1.12.0.jar:1.12.0] ... 16 more 2021-02-19 06:11:04,358 WARN org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Unhandled exception org.apache.flink.shaded.netty4.io.netty.handler.codec.DecoderException: javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown at org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:471) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) ~[flink-dist_2.11-1.12.0.jar:1.12.0] at org +UI is throwing error:+ {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]}[link title|[http://example.com]|http://example.com]/] !image-2021-02-19-12-26-27-296.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21432) Web UI -- Error - {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]}
Bhagi created FLINK-21432: - Summary: Web UI -- Error - {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]} Key: FLINK-21432 URL: https://issues.apache.org/jira/browse/FLINK-21432 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: debian Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-02-22-10-39-06-180.png Web UI – throwing this Error {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]} Please find Job Manager logs. !image-2021-02-22-10-39-06-180.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21588) unable to create catalogs for postgresql
Bhagi created FLINK-21588: - Summary: unable to create catalogs for postgresql Key: FLINK-21588 URL: https://issues.apache.org/jira/browse/FLINK-21588 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: debian,kubernetes environment Reporter: Bhagi Fix For: 1.12.0 Attachments: psql catalog error.PNG i want to read the data from postgreSQL database. hence I am trying to catalogs for postgres as mentioned in Flink document. but getting this error. i have copied jar files into this path /opt/flink/lib/ -rw-r- 1 flink flink 1005078 Mar 3 16:53 postgresql-42.2.19.jar -rw-r- 1 flink flink 196416 Mar 3 16:53 flink-connector-jdbc_2.11-1.12.0.jar Please can you suggest how to fix this issue !psql catalog error.PNG! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21594) Flink - {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]}
Bhagi created FLINK-21594: - Summary: Flink - {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]} Key: FLINK-21594 URL: https://issues.apache.org/jira/browse/FLINK-21594 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: debian kubernetes Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-03-04-11-59-24-095.png, image-2021-03-04-12-06-12-504.png Hi Team, I deployed standalone Flink session cluster on kubernetes.. i have created the HA with 3 job managers. But Flink Web UI is throwing an error saying "\{"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]}". Please help to fix the issue with UI and HA. Logs are showing with the Leader election and updated to the all configmaps.. below configmaps are created in the same namespace where flink cluster is running. 111-dispatcher-leader 111-resourcemanager-leader 111-restserver-leader but i have one doubt on configmap created, when i described above configmaps showing type as flink-native-kubernetes.. But i created cluster with flink standalone kubernetes. configmap-type: high-availability type: flink-native-kubernetes 2) Let me know how to confirm the whether flink is running on native kubernetes or standalone kubernetes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21601) observing errors in jobmanager - after created prometheus metric reporter
Bhagi created FLINK-21601: - Summary: observing errors in jobmanager - after created prometheus metric reporter Key: FLINK-21601 URL: https://issues.apache.org/jira/browse/FLINK-21601 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-03-04-14-23-35-915.png Hi Team, I created the prometheus metric reporter for monitoring flink parameters. After necessary configuration done for reporter and flink job managers can send data to prometheus. but i am able to see Error information reg the Prometheus end point connection. I have attached the logs please look into it. metrics.reporters: prom metrics.reporter.prom.class: org.apache.flink.metrics.prometheus.PrometheusReporter metrics.reporter.prom.port: 9090 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21749) unable to use scala Shell
Bhagi created FLINK-21749: - Summary: unable to use scala Shell Key: FLINK-21749 URL: https://issues.apache.org/jira/browse/FLINK-21749 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: Debian - kubernetes Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-03-12-19-14-13-122.png unable to access scala shell..observing exceptions in scala shell. I have attached the image. please look into this ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21786) sample Job execution failed
Bhagi created FLINK-21786: - Summary: sample Job execution failed Key: FLINK-21786 URL: https://issues.apache.org/jira/browse/FLINK-21786 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: kubernetes debian container Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-03-15-10-40-49-263.png, image-2021-03-15-10-42-00-269.png Hi Team, i am trying to test sample word count job , but job execution is failing. unable to understand what exactly the issue is. Attached job execution info.. !image-2021-03-15-10-40-49-263.png! !image-2021-03-15-10-42-00-269.png! ./bin/flink run ./examples/streaming/WordCount.jar --input file:///persistent/flinkData/test.txt --output file:///persistent/flinkData/wordcount_out -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21812) How to read data from kafka and sink to Postgresql Database
Bhagi created FLINK-21812: - Summary: How to read data from kafka and sink to Postgresql Database Key: FLINK-21812 URL: https://issues.apache.org/jira/browse/FLINK-21812 Project: Flink Issue Type: Task Components: Deployment / Kubernetes Affects Versions: 1.12.0 Reporter: Bhagi Fix For: 1.12.0 Hi Team, I am new to this streaming process Flink, Can you please provide complete documentation on 1)How to read data from kafka with kafka producer & consumer 2)How to SInk data(which is taken from kafka to flink) to Postgresql. 3)How authentication will takes place between kafka -->Flink & Flink -->Postgresql. Please need your early support..As information provided in Flink is not clear to the beginners. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22044) running job from Flink client(cli) from outside Flink jobmanager pod
Bhagi created FLINK-22044: - Summary: running job from Flink client(cli) from outside Flink jobmanager pod Key: FLINK-22044 URL: https://issues.apache.org/jira/browse/FLINK-22044 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: debian in kubernetes pod Reporter: Bhagi I am using this ./bin/flink client from outside Flink cluster pods.. i want to submit flink jobs from outside flink jobmanager pod through Loadbalancer.. but job execution is not working throwing exceptions. [josuha@hostdev flink-1.12.0]$ kubectl get po -n pg-op|grep manager flink-jobmanager-7fcf6d7fb6-xpphr 1/1 Running 0 3h flink-taskmanager-5756b9d5c7-887d8 1/1 Running 26 3h flink-taskmanager-5756b9d5c7-q7lrb 1/1 Running 26 3h [embahar@estlp1mgmt1 ~]$ Can you please look into this. [josuha@hostdev flink-1.12.0]$./bin/flink run ./examples/streaming/WordCount.jar -m 100.101.121.31:6123 --input test.txt Printing result to stdout. Use --output to specify output path. The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Failed to execute job 'Streaming WordCount'. at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:330) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198) at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:743) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:242) at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:971) at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1047) at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1047) Caused by: org.apache.flink.util.FlinkException: Failed to execute job 'Streaming WordCount'. at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1951) at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:128) at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822) at org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:316) ... 8 more Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph. at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$7(RestClusterClient.java:366) at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884) at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:375) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$1(RestClient.java:342) at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577) at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570) at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPr
[jira] [Created] (FLINK-22057) Flink client submitting Flink job remotely to Flink cluster through Loadbalancer rest service
Bhagi created FLINK-22057: - Summary: Flink client submitting Flink job remotely to Flink cluster through Loadbalancer rest service Key: FLINK-22057 URL: https://issues.apache.org/jira/browse/FLINK-22057 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: kubernetes - Flink Standalone Cluster !image-2021-03-31-11-00-37-633.png! HA Enabled - with 3 Job Managers & 2 Task Managers Pods -- Debian os Reporter: Bhagi [josua@worker5 flink-1.12.0]$ ./bin/flink run -m LB IP:8081 ./examples/streaming/WordCount.jar Executing WordCount example with default input data set. Use --input to specify file input. Printing result to stdout. Use --output to specify output path. Job has been submitted with JobID 3f15382e54d46002a84938414cd961f6 The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 3f15382e54d46002a84938414cd961f6) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:330) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198) at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:743) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:242) at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:971) at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1047) at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1047) Caused by: java.util.concurrent.ExecutionException: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 3f15382e54d46002a84938414cd961f6) at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) at org.apache.flink.client.program.StreamContextEnvironment.getJobExecutionResult(StreamContextEnvironment.java:116) at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:80) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822) at org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:316) ... 8 more Caused by: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 3f15382e54d46002a84938414cd961f6) at org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:119) at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$22(RestClusterClient.java:602) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:379) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575) at java.util.concurrent.CompletableFuture$Un
[jira] [Created] (FLINK-22139) Flink Jobmanager & Task Manger logs are not writing to the logs files
Bhagi created FLINK-22139: - Summary: Flink Jobmanager & Task Manger logs are not writing to the logs files Key: FLINK-22139 URL: https://issues.apache.org/jira/browse/FLINK-22139 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.2 Environment: on kubernetes flink standalone deployment with jobmanager HA is enabled. Reporter: Bhagi Hi Team, I am submitting the jobs and restarting the job manager and task manager pods.. Log files are generating with the name task manager and job manager. but job manager & task manager log file size is '0', i am not sure any configuration missed..why logs are not writing to their log files.. # Task Manager pod### flink@flink-taskmanager-85b6585b7-hhgl7:~$ ls -lart log/ total 0 -rw-r--r-- 1 flink flink 0 Apr 7 09:35 flink--taskexecutor-0-flink-taskmanager-85b6585b7-hhgl7.log flink@flink-taskmanager-85b6585b7-hhgl7:~$ ### Jobmanager pod Logs # flink@flink-jobmanager-f6db89b7f-lq4ps:~$ -rw-r--r-- 1 7148739 flink 0 Apr 7 06:36 flink--standalonesession-0-flink-jobmanager-f6db89b7f-gtkx5.log -rw-r--r-- 1 7148739 flink 0 Apr 7 06:36 flink--standalonesession-0-flink-jobmanager-f6db89b7f-wnrfm.log -rw-r--r-- 1 7148739 flink 0 Apr 7 06:37 flink--standalonesession-0-flink-jobmanager-f6db89b7f-2b2fs.log -rw-r--r-- 1 7148739 flink 0 Apr 7 06:37 flink--standalonesession-0-flink-jobmanager-f6db89b7f-7kdhh.log -rw-r--r-- 1 7148739 flink 0 Apr 7 09:35 flink--standalonesession-0-flink-jobmanager-f6db89b7f-twhkt.log drwxrwxrwx 2 7148739 flink35 Apr 7 09:35 . -rw-r--r-- 1 7148739 flink 0 Apr 7 09:35 flink--standalonesession-0-flink-jobmanager-f6db89b7f-lq4ps.log flink@flink-jobmanager-f6db89b7f-lq4ps:~$ I configured log4j.properties for flink log4j.properties: |+ monitorInterval=30 rootLogger.level = INFO rootLogger.appenderRef.file.ref = MainAppender logger.flink.name = org.apache.flink logger.flink.level = INFO logger.akka.name = akka logger.akka.level = INFO appender.main.name = MainAppender appender.main.type = RollingFile appender.main.append = true appender.main.fileName = ${sys:log.file} appender.main.filePattern = ${sys:log.file}.%i appender.main.layout.type = PatternLayout appender.main.layout.pattern = %d{-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n appender.main.policies.type = Policies appender.main.policies.size.type = SizeBasedTriggeringPolicy appender.main.policies.size.size = 100MB appender.main.policies.startup.type = OnStartupTriggeringPolicy appender.main.strategy.type = DefaultRolloverStrategy appender.main.strategy.max = ${env:MAX_LOG_FILE_NUMBER:-10} logger.netty.name = org.apache.flink.shaded.akka.org.jboss.netty.channel.DefaultChannelPipeline logger.netty.level = OFF -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22421) Does flink support multi cluster deployment with HA on multi kubernetes clusters
Bhagi created FLINK-22421: - Summary: Does flink support multi cluster deployment with HA on multi kubernetes clusters Key: FLINK-22421 URL: https://issues.apache.org/jira/browse/FLINK-22421 Project: Flink Issue Type: New Feature Components: Deployment / Kubernetes Affects Versions: 1.12.2 Environment: kubernetes Reporter: Bhagi Hi Team, i want to deploy flink in multi cluster mode on kubernetes with HA.. Please let us know, whether is this possible ?? or any solution is provided to have flink in multi cluster mode with HA .. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22503) getting eroor on select query in flink sql
Bhagi created FLINK-22503: - Summary: getting eroor on select query in flink sql Key: FLINK-22503 URL: https://issues.apache.org/jira/browse/FLINK-22503 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.2 Environment: Hi Team, I added source table *orders* with filesystem connector using csv file. when i am running the select * from orders, its throwing error. even i chaged the mode also not working. !image-2021-04-28-13-33-36-784.png! [ERROR] Could not execute SQL statement. Reason: org.apache.flink.table.client.gateway.SqlExecutionException: Results of batch queries can only be served in table or tableau mode 2) I used sink as Elasticsearch , but not able to see the data in elasticsearch index.. Can you please check and help me two issues !image-2021-04-28-13-40-42-375.png! !image-2021-04-28-13-43-00-455.png! Reporter: Bhagi Attachments: image-2021-04-28-13-33-36-784.png, image-2021-04-28-13-40-42-375.png, image-2021-04-28-13-43-00-455.png -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22549) Flink HA with Zk in kubernetes standalone mode deployment is not working
Bhagi created FLINK-22549: - Summary: Flink HA with Zk in kubernetes standalone mode deployment is not working Key: FLINK-22549 URL: https://issues.apache.org/jira/browse/FLINK-22549 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.2 Environment: kubernetes standalone deployment Reporter: Bhagi Attachments: jobmanager.log, taskmanager.log Hi Team, I deployed kubernetes standalone deployment flink cluster with ZK HA, but facing some issues, i have attached taskmanager and job manger logs. Can you please see the logs and help me solve this issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22583) Flink UI is not showing completed jobs once JM Leader is deleted
Bhagi created FLINK-22583: - Summary: Flink UI is not showing completed jobs once JM Leader is deleted Key: FLINK-22583 URL: https://issues.apache.org/jira/browse/FLINK-22583 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.2 Reporter: Bhagi Hi Team, when i was testing Flink HA with zk , i executed few jobs from WebUI, completed jobs were showing under completed jobs section. As part of Leader election testing, i killed the current leader JM , and lost the jobs from Web UI also. I have enabled following configuration already. jobstore.expiration-time=86400 jobstore.max-capacity=200 jobmanager.archive.fs.dir: file:///persistent/flinkData2/completed-jobs historyserver.archive.fs.refresh-interval: 1 historyserver.archive.fs.dir: file:///persistent/flinkData2/completed-jobs Any other configuration is need to store the jobs irrespective of jobmanager Leader. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22938) Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
Bhagi created FLINK-22938: - Summary: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout Key: FLINK-22938 URL: https://issues.apache.org/jira/browse/FLINK-22938 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.4 Reporter: Bhagi Hi team, I tested cluster upgrade from Flink Version 1.12.4 to 1.13.1 ,due to 1 job issues latest version cluster went into crashloopbackoff with error. hence i degraded to old cluster version. from latest upgraded version 1.13.1 to 1.12.4 it was successful. But all job executions are failed state. with following error."Slot request bulk is not fulfillable! Could not allocate the required slot within slot request ".please find the log. # FLink config file ## flink@flink-jobmanager-657cb5d847-5b579:~$ cat conf/flink-conf.yaml taskmanager.numberOfTaskSlots: 2 jobmanager.rpc.address: flink-jobmanager blob.server.port: 6124 jobmanager.rpc.port: 6123 taskmanager.rpc.port: 6122 queryable-state.proxy.ports: 6125 jobmanager.memory.process.size: 1600m taskmanager.memory.process.size: 1728m parallelism.default: 2 rest.connection-timeout: 25000 web.log.path: /opt/flink/log/output.log taskmanager.log.path: /opt/flink/log/output.log state.backend: rocksdb state.checkpoints.dir: file:///persistent/flinkData/checkpoints state.backend.rocksdb.log.dir: /persistent/flinkData/rocksdb/logging/ state.savepoints.dir: file:///persistent/flinkData/savepoints state.backend.incremental: true state.checkpoints.num-retained: 1 web.upload.dir: /persistent/flinkData classloader.resolve-order: parent-first kubernetes.cluster-id: 222 kubernetes.namespace: flink-mcd high-availability: org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory high-availability.storageDir: file:///persistent/flinkData/checkpoints jobmanager.archive.fs.dir: file:///persistent/flinkData/completed-jobs historyserver.archive.fs.refresh-interval: 1 historyserver.archive.fs.dir: file:///persistent/flinkData/completed-jobs metrics.reporters: prom metrics.reporter.prom.class: org.apache.flink.metrics.prometheus.PrometheusReporter metrics.reporter.prom.port: 9090 akka.framesize: 10485760b flink@flink-jobmanager-657cb5d847-5b579:~$ Logs from job manager## flink@flink-jobmanager-6d644dc78b-6r627:~$ ./bin/flink run ./examples/streaming/WordCount.jar Executing WordCount example with default input data set. Use --input to specify file input. Printing result to stdout. Use --output to specify output path. WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.flink.api.java.ClosureCleaner (file:/opt/flink/lib/flink-dist_2.11-1.12.2.jar) to field java.lang.String.value WARNING: Please consider reporting this to the maintainers of org.apache.flink.api.java.ClosureCleaner WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2021-06-09 04:59:40,098 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='111-restserver-leader'}. 2021-06-09 04:59:40,099 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing. Job has been submitted with JobID d36a0b99601dc6af696d213da2f8c159 2021-06-09 05:04:37,877 INFO org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver [] - Stopping KubernetesLeaderRetrievalDriver{configMapName='111-restserver-leader'}. 2021-06-09 05:04:37,879 INFO org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher [] - The watcher is closing. The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: d36a0b99601dc6af696d213da2f8c159) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:366) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:219) at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246) at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054) at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132) at org.apache.flink.runtime.security.contexts.NoOpSecuri
[jira] [Created] (FLINK-22965) Association with remote system has failed, address is now gated
Bhagi created FLINK-22965: - Summary: Association with remote system has failed, address is now gated Key: FLINK-22965 URL: https://issues.apache.org/jira/browse/FLINK-22965 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Reporter: Bhagi Attachments: flink-jobmanager-755584f4c-vx7w2.log, flink-taskmanager-bcfdf9d99-dls4r.log Hi Team, I deployed flink session cluster on stand alone k8s, i am observing issues in Flink jobmanager and Tasks manager.I have attached JM & TM logs.. Please help. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22978) Flink Maintenance activities Documentation and Testcases for maintainance
Bhagi created FLINK-22978: - Summary: Flink Maintenance activities Documentation and Testcases for maintainance Key: FLINK-22978 URL: https://issues.apache.org/jira/browse/FLINK-22978 Project: Flink Issue Type: New Feature Components: Deployment / Kubernetes Affects Versions: 1.13.1 Environment: Session cluster with 3 jobmanagers & 3 tasks managers [ HA with k8s HA service]. Reporter: Bhagi HI Team, i want to know the maiatainance activities for Flink to be considered before production use. I searched for flink maintenance docs did not find anything on maintainance. Please share the documentation and test cases. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22995) Failed to acquire lease 'ConfigMapLock: .... retrying...
Bhagi created FLINK-22995: - Summary: Failed to acquire lease 'ConfigMapLock: retrying... Key: FLINK-22995 URL: https://issues.apache.org/jira/browse/FLINK-22995 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.13.1 Reporter: Bhagi Attachments: jobamanger.log Hi Team, I have deployed Flink session cluster on standalone k8s with Jobmanager HA (k8s HA service). when i am submitting the jobs all jobs are failed. due to jobmanager leader election issue. attaching the logs. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23006) issue in configuring History server
Bhagi created FLINK-23006: - Summary: issue in configuring History server Key: FLINK-23006 URL: https://issues.apache.org/jira/browse/FLINK-23006 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.13.1 Reporter: Bhagi Attachments: flink-history-server-7fb6f9b66-bkhfm.log, history-server-deployment.yaml Dear Team, I have flink session cluster with HA on standalone kubernetes. I want to configure History server for this flink cluster.. to configure the history server, in the Flink cluster name space i created 1 more deployment for history server by passing args: ["history-server"], but pod is in carshloopBackoff. can you see the logs of this and help me to configure history server. kubectl get po -n flink-load-test NAME READY STATUS RESTARTS AGE flink-history-server-7fb6f9b66-bkhfm 0/1 CrashLoopBackOff 10 29m flink-jobmanager-7df744b455-f575q 1/1 Running0 18h flink-jobmanager-7df744b455-qm6wf 1/1 Running0 18h flink-jobmanager-7df744b455-t7zm5 1/1 Running1 18h flink-taskmanager-7945f6b856-89mr5 1/1 Running7 18h flink-taskmanager-7945f6b856-mz2hz 1/1 Running7 18h -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23488) Please unsubscribe/remove me from jira user emails
Bhagi created FLINK-23488: - Summary: Please unsubscribe/remove me from jira user emails Key: FLINK-23488 URL: https://issues.apache.org/jira/browse/FLINK-23488 Project: Flink Issue Type: Bug Reporter: Bhagi Hi Team, I am receiving many user emails from flink jira.I sent emails for unsubscribe, but as per the replies for unsubscribe is my email is not available... not sure what’s wrong...but I am receiving every user email and hitting my mail box.. -- This message was sent by Atlassian Jira (v8.3.4#803005)