[jira] [Created] (FLINK-21414) javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown
Bhagi created FLINK-21414:
-
Summary: javax.net.ssl.SSLHandshakeException: Received fatal
alert: certificate_unknown
Key: FLINK-21414
URL: https://issues.apache.org/jira/browse/FLINK-21414
Project: Flink
Issue Type: Bug
Components: Deployment / Kubernetes
Affects Versions: 1.12.0
Environment: flink@flink-jobmanager-5d9594b76c-t6cc8:~$ cat
/etc/os-release
PRETTY_NAME="Debian GNU/Linux 10 (buster)"
NAME="Debian GNU/Linux"
VERSION_ID="10"
VERSION="10 (buster)"
VERSION_CODENAME=buster
ID=debian
Reporter: Bhagi
Fix For: 1.12.0
Attachments: image-2021-02-19-12-26-27-296.png
Enabled High availability for FLink with kubernetes API with Leader election
and retirieval mechanism,After configuring HA parameters with Leader election
and Leader retrival ..I started getting this error in job manager logs.
+error logs in job manager logs:+
at
org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler$SslEngineType$3.unwrap(SslHandler.java:282)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
at
org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1372)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
at
org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1267)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
at
org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1314)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
at
org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:501)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
at
org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:440)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
... 16 more
2021-02-19 06:11:04,358 WARN
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Unhandled
exception
org.apache.flink.shaded.netty4.io.netty.handler.codec.DecoderException:
javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown
at
org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:471)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
at
org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
~[flink-dist_2.11-1.12.0.jar:1.12.0]
at org
+UI is throwing error:+
{"errors":["Service temporarily unavailable due to an ongoing leader election.
Please refresh."]}[link title|[http://example.com]|http://example.com]/]
!image-2021-02-19-12-26-27-296.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-21432) Web UI -- Error - {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]}
Bhagi created FLINK-21432:
-
Summary: Web UI -- Error - {"errors":["Service temporarily
unavailable due to an ongoing leader election. Please refresh."]}
Key: FLINK-21432
URL: https://issues.apache.org/jira/browse/FLINK-21432
Project: Flink
Issue Type: Bug
Components: Deployment / Kubernetes
Affects Versions: 1.12.0
Environment: debian
Reporter: Bhagi
Fix For: 1.12.0
Attachments: image-2021-02-22-10-39-06-180.png
Web UI – throwing this Error
{"errors":["Service temporarily unavailable due to an ongoing leader election.
Please refresh."]}
Please find Job Manager logs.
!image-2021-02-22-10-39-06-180.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-21588) unable to create catalogs for postgresql
Bhagi created FLINK-21588: - Summary: unable to create catalogs for postgresql Key: FLINK-21588 URL: https://issues.apache.org/jira/browse/FLINK-21588 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: debian,kubernetes environment Reporter: Bhagi Fix For: 1.12.0 Attachments: psql catalog error.PNG i want to read the data from postgreSQL database. hence I am trying to catalogs for postgres as mentioned in Flink document. but getting this error. i have copied jar files into this path /opt/flink/lib/ -rw-r- 1 flink flink 1005078 Mar 3 16:53 postgresql-42.2.19.jar -rw-r- 1 flink flink 196416 Mar 3 16:53 flink-connector-jdbc_2.11-1.12.0.jar Please can you suggest how to fix this issue !psql catalog error.PNG! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21594) Flink - {"errors":["Service temporarily unavailable due to an ongoing leader election. Please refresh."]}
Bhagi created FLINK-21594:
-
Summary: Flink - {"errors":["Service temporarily unavailable due
to an ongoing leader election. Please refresh."]}
Key: FLINK-21594
URL: https://issues.apache.org/jira/browse/FLINK-21594
Project: Flink
Issue Type: Bug
Components: Deployment / Kubernetes
Affects Versions: 1.12.0
Environment: debian kubernetes
Reporter: Bhagi
Fix For: 1.12.0
Attachments: image-2021-03-04-11-59-24-095.png,
image-2021-03-04-12-06-12-504.png
Hi Team,
I deployed standalone Flink session cluster on kubernetes.. i have created the
HA with 3 job managers. But Flink Web UI is throwing an error saying
"\{"errors":["Service temporarily unavailable due to an ongoing leader
election. Please refresh."]}".
Please help to fix the issue with UI and HA.
Logs are showing with the Leader election and updated to the all configmaps..
below configmaps are created in the same namespace where flink cluster is
running.
111-dispatcher-leader
111-resourcemanager-leader
111-restserver-leader
but i have one doubt on configmap created, when i described above configmaps
showing type as flink-native-kubernetes.. But i created cluster with flink
standalone kubernetes.
configmap-type: high-availability
type: flink-native-kubernetes
2) Let me know how to confirm the whether flink is running on native kubernetes
or standalone kubernetes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-21601) observing errors in jobmanager - after created prometheus metric reporter
Bhagi created FLINK-21601: - Summary: observing errors in jobmanager - after created prometheus metric reporter Key: FLINK-21601 URL: https://issues.apache.org/jira/browse/FLINK-21601 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-03-04-14-23-35-915.png Hi Team, I created the prometheus metric reporter for monitoring flink parameters. After necessary configuration done for reporter and flink job managers can send data to prometheus. but i am able to see Error information reg the Prometheus end point connection. I have attached the logs please look into it. metrics.reporters: prom metrics.reporter.prom.class: org.apache.flink.metrics.prometheus.PrometheusReporter metrics.reporter.prom.port: 9090 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21749) unable to use scala Shell
Bhagi created FLINK-21749: - Summary: unable to use scala Shell Key: FLINK-21749 URL: https://issues.apache.org/jira/browse/FLINK-21749 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: Debian - kubernetes Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-03-12-19-14-13-122.png unable to access scala shell..observing exceptions in scala shell. I have attached the image. please look into this ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21786) sample Job execution failed
Bhagi created FLINK-21786: - Summary: sample Job execution failed Key: FLINK-21786 URL: https://issues.apache.org/jira/browse/FLINK-21786 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: kubernetes debian container Reporter: Bhagi Fix For: 1.12.0 Attachments: image-2021-03-15-10-40-49-263.png, image-2021-03-15-10-42-00-269.png Hi Team, i am trying to test sample word count job , but job execution is failing. unable to understand what exactly the issue is. Attached job execution info.. !image-2021-03-15-10-40-49-263.png! !image-2021-03-15-10-42-00-269.png! ./bin/flink run ./examples/streaming/WordCount.jar --input file:///persistent/flinkData/test.txt --output file:///persistent/flinkData/wordcount_out -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-21812) How to read data from kafka and sink to Postgresql Database
Bhagi created FLINK-21812: - Summary: How to read data from kafka and sink to Postgresql Database Key: FLINK-21812 URL: https://issues.apache.org/jira/browse/FLINK-21812 Project: Flink Issue Type: Task Components: Deployment / Kubernetes Affects Versions: 1.12.0 Reporter: Bhagi Fix For: 1.12.0 Hi Team, I am new to this streaming process Flink, Can you please provide complete documentation on 1)How to read data from kafka with kafka producer & consumer 2)How to SInk data(which is taken from kafka to flink) to Postgresql. 3)How authentication will takes place between kafka -->Flink & Flink -->Postgresql. Please need your early support..As information provided in Flink is not clear to the beginners. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22044) running job from Flink client(cli) from outside Flink jobmanager pod
Bhagi created FLINK-22044: - Summary: running job from Flink client(cli) from outside Flink jobmanager pod Key: FLINK-22044 URL: https://issues.apache.org/jira/browse/FLINK-22044 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: debian in kubernetes pod Reporter: Bhagi I am using this ./bin/flink client from outside Flink cluster pods.. i want to submit flink jobs from outside flink jobmanager pod through Loadbalancer.. but job execution is not working throwing exceptions. [josuha@hostdev flink-1.12.0]$ kubectl get po -n pg-op|grep manager flink-jobmanager-7fcf6d7fb6-xpphr 1/1 Running 0 3h flink-taskmanager-5756b9d5c7-887d8 1/1 Running 26 3h flink-taskmanager-5756b9d5c7-q7lrb 1/1 Running 26 3h [embahar@estlp1mgmt1 ~]$ Can you please look into this. [josuha@hostdev flink-1.12.0]$./bin/flink run ./examples/streaming/WordCount.jar -m 100.101.121.31:6123 --input test.txt Printing result to stdout. Use --output to specify output path. The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Failed to execute job 'Streaming WordCount'. at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:330) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198) at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:743) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:242) at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:971) at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1047) at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1047) Caused by: org.apache.flink.util.FlinkException: Failed to execute job 'Streaming WordCount'. at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1951) at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:128) at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:76) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822) at org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:316) ... 8 more Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph. at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$7(RestClusterClient.java:366) at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884) at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:375) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$1(RestClient.java:342) at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577) at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570) at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPr
[jira] [Created] (FLINK-22057) Flink client submitting Flink job remotely to Flink cluster through Loadbalancer rest service
Bhagi created FLINK-22057: - Summary: Flink client submitting Flink job remotely to Flink cluster through Loadbalancer rest service Key: FLINK-22057 URL: https://issues.apache.org/jira/browse/FLINK-22057 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Environment: kubernetes - Flink Standalone Cluster !image-2021-03-31-11-00-37-633.png! HA Enabled - with 3 Job Managers & 2 Task Managers Pods -- Debian os Reporter: Bhagi [josua@worker5 flink-1.12.0]$ ./bin/flink run -m LB IP:8081 ./examples/streaming/WordCount.jar Executing WordCount example with default input data set. Use --input to specify file input. Printing result to stdout. Use --output to specify output path. Job has been submitted with JobID 3f15382e54d46002a84938414cd961f6 The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 3f15382e54d46002a84938414cd961f6) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:330) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198) at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:743) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:242) at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:971) at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1047) at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1047) Caused by: java.util.concurrent.ExecutionException: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 3f15382e54d46002a84938414cd961f6) at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) at org.apache.flink.client.program.StreamContextEnvironment.getJobExecutionResult(StreamContextEnvironment.java:116) at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:80) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822) at org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:96) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:316) ... 8 more Caused by: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 3f15382e54d46002a84938414cd961f6) at org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:119) at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$22(RestClusterClient.java:602) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:379) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575) at java.util.concurrent.CompletableFuture$Un
[jira] [Created] (FLINK-22139) Flink Jobmanager & Task Manger logs are not writing to the logs files
Bhagi created FLINK-22139:
-
Summary: Flink Jobmanager & Task Manger logs are not writing to
the logs files
Key: FLINK-22139
URL: https://issues.apache.org/jira/browse/FLINK-22139
Project: Flink
Issue Type: Bug
Components: Deployment / Kubernetes
Affects Versions: 1.12.2
Environment: on kubernetes flink standalone deployment with jobmanager
HA is enabled.
Reporter: Bhagi
Hi Team,
I am submitting the jobs and restarting the job manager and task manager pods..
Log files are generating with the name task manager and job manager.
but job manager & task manager log file size is '0', i am not sure any
configuration missed..why logs are not writing to their log files..
# Task Manager pod###
flink@flink-taskmanager-85b6585b7-hhgl7:~$ ls -lart log/
total 0
-rw-r--r-- 1 flink flink 0 Apr 7 09:35
flink--taskexecutor-0-flink-taskmanager-85b6585b7-hhgl7.log
flink@flink-taskmanager-85b6585b7-hhgl7:~$
### Jobmanager pod Logs #
flink@flink-jobmanager-f6db89b7f-lq4ps:~$
-rw-r--r-- 1 7148739 flink 0 Apr 7 06:36
flink--standalonesession-0-flink-jobmanager-f6db89b7f-gtkx5.log
-rw-r--r-- 1 7148739 flink 0 Apr 7 06:36
flink--standalonesession-0-flink-jobmanager-f6db89b7f-wnrfm.log
-rw-r--r-- 1 7148739 flink 0 Apr 7 06:37
flink--standalonesession-0-flink-jobmanager-f6db89b7f-2b2fs.log
-rw-r--r-- 1 7148739 flink 0 Apr 7 06:37
flink--standalonesession-0-flink-jobmanager-f6db89b7f-7kdhh.log
-rw-r--r-- 1 7148739 flink 0 Apr 7 09:35
flink--standalonesession-0-flink-jobmanager-f6db89b7f-twhkt.log
drwxrwxrwx 2 7148739 flink35 Apr 7 09:35 .
-rw-r--r-- 1 7148739 flink 0 Apr 7 09:35
flink--standalonesession-0-flink-jobmanager-f6db89b7f-lq4ps.log
flink@flink-jobmanager-f6db89b7f-lq4ps:~$
I configured log4j.properties for flink
log4j.properties: |+
monitorInterval=30
rootLogger.level = INFO
rootLogger.appenderRef.file.ref = MainAppender
logger.flink.name = org.apache.flink
logger.flink.level = INFO
logger.akka.name = akka
logger.akka.level = INFO
appender.main.name = MainAppender
appender.main.type = RollingFile
appender.main.append = true
appender.main.fileName = ${sys:log.file}
appender.main.filePattern = ${sys:log.file}.%i
appender.main.layout.type = PatternLayout
appender.main.layout.pattern = %d{-MM-dd HH:mm:ss,SSS} %-5p %-60c %x -
%m%n
appender.main.policies.type = Policies
appender.main.policies.size.type = SizeBasedTriggeringPolicy
appender.main.policies.size.size = 100MB
appender.main.policies.startup.type = OnStartupTriggeringPolicy
appender.main.strategy.type = DefaultRolloverStrategy
appender.main.strategy.max = ${env:MAX_LOG_FILE_NUMBER:-10}
logger.netty.name =
org.apache.flink.shaded.akka.org.jboss.netty.channel.DefaultChannelPipeline
logger.netty.level = OFF
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-22421) Does flink support multi cluster deployment with HA on multi kubernetes clusters
Bhagi created FLINK-22421: - Summary: Does flink support multi cluster deployment with HA on multi kubernetes clusters Key: FLINK-22421 URL: https://issues.apache.org/jira/browse/FLINK-22421 Project: Flink Issue Type: New Feature Components: Deployment / Kubernetes Affects Versions: 1.12.2 Environment: kubernetes Reporter: Bhagi Hi Team, i want to deploy flink in multi cluster mode on kubernetes with HA.. Please let us know, whether is this possible ?? or any solution is provided to have flink in multi cluster mode with HA .. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22503) getting eroor on select query in flink sql
Bhagi created FLINK-22503: - Summary: getting eroor on select query in flink sql Key: FLINK-22503 URL: https://issues.apache.org/jira/browse/FLINK-22503 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.2 Environment: Hi Team, I added source table *orders* with filesystem connector using csv file. when i am running the select * from orders, its throwing error. even i chaged the mode also not working. !image-2021-04-28-13-33-36-784.png! [ERROR] Could not execute SQL statement. Reason: org.apache.flink.table.client.gateway.SqlExecutionException: Results of batch queries can only be served in table or tableau mode 2) I used sink as Elasticsearch , but not able to see the data in elasticsearch index.. Can you please check and help me two issues !image-2021-04-28-13-40-42-375.png! !image-2021-04-28-13-43-00-455.png! Reporter: Bhagi Attachments: image-2021-04-28-13-33-36-784.png, image-2021-04-28-13-40-42-375.png, image-2021-04-28-13-43-00-455.png -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22549) Flink HA with Zk in kubernetes standalone mode deployment is not working
Bhagi created FLINK-22549: - Summary: Flink HA with Zk in kubernetes standalone mode deployment is not working Key: FLINK-22549 URL: https://issues.apache.org/jira/browse/FLINK-22549 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.2 Environment: kubernetes standalone deployment Reporter: Bhagi Attachments: jobmanager.log, taskmanager.log Hi Team, I deployed kubernetes standalone deployment flink cluster with ZK HA, but facing some issues, i have attached taskmanager and job manger logs. Can you please see the logs and help me solve this issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22583) Flink UI is not showing completed jobs once JM Leader is deleted
Bhagi created FLINK-22583: - Summary: Flink UI is not showing completed jobs once JM Leader is deleted Key: FLINK-22583 URL: https://issues.apache.org/jira/browse/FLINK-22583 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.2 Reporter: Bhagi Hi Team, when i was testing Flink HA with zk , i executed few jobs from WebUI, completed jobs were showing under completed jobs section. As part of Leader election testing, i killed the current leader JM , and lost the jobs from Web UI also. I have enabled following configuration already. jobstore.expiration-time=86400 jobstore.max-capacity=200 jobmanager.archive.fs.dir: file:///persistent/flinkData2/completed-jobs historyserver.archive.fs.refresh-interval: 1 historyserver.archive.fs.dir: file:///persistent/flinkData2/completed-jobs Any other configuration is need to store the jobs irrespective of jobmanager Leader. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22938) Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
Bhagi created FLINK-22938:
-
Summary: Slot request bulk is not fulfillable! Could not allocate
the required slot within slot request timeout
Key: FLINK-22938
URL: https://issues.apache.org/jira/browse/FLINK-22938
Project: Flink
Issue Type: Bug
Components: Deployment / Kubernetes
Affects Versions: 1.12.4
Reporter: Bhagi
Hi team,
I tested cluster upgrade from Flink Version 1.12.4 to 1.13.1 ,due to 1 job
issues latest version cluster went into crashloopbackoff with error. hence i
degraded to old cluster version. from latest upgraded version 1.13.1 to 1.12.4
it was successful. But all job executions are failed state.
with following error."Slot request bulk is not fulfillable! Could not allocate
the required slot within slot request ".please find the log.
# FLink config file ##
flink@flink-jobmanager-657cb5d847-5b579:~$ cat conf/flink-conf.yaml
taskmanager.numberOfTaskSlots: 2
jobmanager.rpc.address: flink-jobmanager
blob.server.port: 6124
jobmanager.rpc.port: 6123
taskmanager.rpc.port: 6122
queryable-state.proxy.ports: 6125
jobmanager.memory.process.size: 1600m
taskmanager.memory.process.size: 1728m
parallelism.default: 2
rest.connection-timeout: 25000
web.log.path: /opt/flink/log/output.log
taskmanager.log.path: /opt/flink/log/output.log
state.backend: rocksdb
state.checkpoints.dir: file:///persistent/flinkData/checkpoints
state.backend.rocksdb.log.dir: /persistent/flinkData/rocksdb/logging/
state.savepoints.dir: file:///persistent/flinkData/savepoints
state.backend.incremental: true
state.checkpoints.num-retained: 1
web.upload.dir: /persistent/flinkData
classloader.resolve-order: parent-first
kubernetes.cluster-id: 222
kubernetes.namespace: flink-mcd
high-availability:
org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
high-availability.storageDir: file:///persistent/flinkData/checkpoints
jobmanager.archive.fs.dir: file:///persistent/flinkData/completed-jobs
historyserver.archive.fs.refresh-interval: 1
historyserver.archive.fs.dir: file:///persistent/flinkData/completed-jobs
metrics.reporters: prom
metrics.reporter.prom.class:
org.apache.flink.metrics.prometheus.PrometheusReporter
metrics.reporter.prom.port: 9090
akka.framesize: 10485760b
flink@flink-jobmanager-657cb5d847-5b579:~$
Logs from job manager##
flink@flink-jobmanager-6d644dc78b-6r627:~$ ./bin/flink run
./examples/streaming/WordCount.jar
Executing WordCount example with default input data set.
Use --input to specify file input.
Printing result to stdout. Use --output to specify output path.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.flink.api.java.ClosureCleaner
(file:/opt/flink/lib/flink-dist_2.11-1.12.2.jar) to field java.lang.String.value
WARNING: Please consider reporting this to the maintainers of
org.apache.flink.api.java.ClosureCleaner
WARNING: Use --illegal-access=warn to enable warnings of further illegal
reflective access operations
WARNING: All illegal access operations will be denied in a future release
2021-06-09 04:59:40,098 INFO
org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver []
- Stopping
KubernetesLeaderRetrievalDriver{configMapName='111-restserver-leader'}.
2021-06-09 04:59:40,099 INFO
org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher []
- The watcher is closing.
Job has been submitted with JobID d36a0b99601dc6af696d213da2f8c159
2021-06-09 05:04:37,877 INFO
org.apache.flink.kubernetes.highavailability.KubernetesLeaderRetrievalDriver []
- Stopping
KubernetesLeaderRetrievalDriver{configMapName='111-restserver-leader'}.
2021-06-09 05:04:37,879 INFO
org.apache.flink.kubernetes.kubeclient.resources.KubernetesConfigMapWatcher []
- The watcher is closing.
The program finished with the following exception:
org.apache.flink.client.program.ProgramInvocationException: The main method
caused an error: org.apache.flink.client.program.ProgramInvocationException:
Job failed (JobID: d36a0b99601dc6af696d213da2f8c159)
at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:366)
at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:219)
at
org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
at
org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246)
at
org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054)
at
org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132)
at
org.apache.flink.runtime.security.contexts.NoOpSecuri
[jira] [Created] (FLINK-22965) Association with remote system has failed, address is now gated
Bhagi created FLINK-22965: - Summary: Association with remote system has failed, address is now gated Key: FLINK-22965 URL: https://issues.apache.org/jira/browse/FLINK-22965 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.12.0 Reporter: Bhagi Attachments: flink-jobmanager-755584f4c-vx7w2.log, flink-taskmanager-bcfdf9d99-dls4r.log Hi Team, I deployed flink session cluster on stand alone k8s, i am observing issues in Flink jobmanager and Tasks manager.I have attached JM & TM logs.. Please help. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22978) Flink Maintenance activities Documentation and Testcases for maintainance
Bhagi created FLINK-22978: - Summary: Flink Maintenance activities Documentation and Testcases for maintainance Key: FLINK-22978 URL: https://issues.apache.org/jira/browse/FLINK-22978 Project: Flink Issue Type: New Feature Components: Deployment / Kubernetes Affects Versions: 1.13.1 Environment: Session cluster with 3 jobmanagers & 3 tasks managers [ HA with k8s HA service]. Reporter: Bhagi HI Team, i want to know the maiatainance activities for Flink to be considered before production use. I searched for flink maintenance docs did not find anything on maintainance. Please share the documentation and test cases. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22995) Failed to acquire lease 'ConfigMapLock: .... retrying...
Bhagi created FLINK-22995: - Summary: Failed to acquire lease 'ConfigMapLock: retrying... Key: FLINK-22995 URL: https://issues.apache.org/jira/browse/FLINK-22995 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.13.1 Reporter: Bhagi Attachments: jobamanger.log Hi Team, I have deployed Flink session cluster on standalone k8s with Jobmanager HA (k8s HA service). when i am submitting the jobs all jobs are failed. due to jobmanager leader election issue. attaching the logs. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23006) issue in configuring History server
Bhagi created FLINK-23006: - Summary: issue in configuring History server Key: FLINK-23006 URL: https://issues.apache.org/jira/browse/FLINK-23006 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes Affects Versions: 1.13.1 Reporter: Bhagi Attachments: flink-history-server-7fb6f9b66-bkhfm.log, history-server-deployment.yaml Dear Team, I have flink session cluster with HA on standalone kubernetes. I want to configure History server for this flink cluster.. to configure the history server, in the Flink cluster name space i created 1 more deployment for history server by passing args: ["history-server"], but pod is in carshloopBackoff. can you see the logs of this and help me to configure history server. kubectl get po -n flink-load-test NAME READY STATUS RESTARTS AGE flink-history-server-7fb6f9b66-bkhfm 0/1 CrashLoopBackOff 10 29m flink-jobmanager-7df744b455-f575q 1/1 Running0 18h flink-jobmanager-7df744b455-qm6wf 1/1 Running0 18h flink-jobmanager-7df744b455-t7zm5 1/1 Running1 18h flink-taskmanager-7945f6b856-89mr5 1/1 Running7 18h flink-taskmanager-7945f6b856-mz2hz 1/1 Running7 18h -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23488) Please unsubscribe/remove me from jira user emails
Bhagi created FLINK-23488: - Summary: Please unsubscribe/remove me from jira user emails Key: FLINK-23488 URL: https://issues.apache.org/jira/browse/FLINK-23488 Project: Flink Issue Type: Bug Reporter: Bhagi Hi Team, I am receiving many user emails from flink jira.I sent emails for unsubscribe, but as per the replies for unsubscribe is my email is not available... not sure what’s wrong...but I am receiving every user email and hitting my mail box.. -- This message was sent by Atlassian Jira (v8.3.4#803005)
