[GitHub] [flink] flinkbot edited a comment on pull request #18735: [FLINK-26079][state/changelog] Disallow recovery from non-changelog checkpoints
flinkbot edited a comment on pull request #18735: URL: https://github.com/apache/flink/pull/18735#issuecomment-1036580667 ## CI report: * 9c5c022b5ef270db063777daa0ecb7064e3292e0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31296) * cbd30159cadaf7bc419879e16755661800ec UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18735: [FLINK-26079][state/changelog] Disallow recovery from non-changelog checkpoints
flinkbot edited a comment on pull request #18735: URL: https://github.com/apache/flink/pull/18735#issuecomment-1036580667 ## CI report: * 9c5c022b5ef270db063777daa0ecb7064e3292e0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31296) * cbd30159cadaf7bc419879e16755661800ec Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31313) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-25495) Client support attach mode when using the deployment of application mode
[ https://issues.apache.org/jira/browse/FLINK-25495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491294#comment-17491294 ] Junfan Zhang commented on FLINK-25495: -- Thanks for your suggestions. I have drafted, if u have time, could you help review it? [~wangyang0918] > Client support attach mode when using the deployment of application mode > > > Key: FLINK-25495 > URL: https://issues.apache.org/jira/browse/FLINK-25495 > Project: Flink > Issue Type: Improvement > Components: Client / Job Submission >Reporter: Junfan Zhang >Priority: Major > Labels: pull-request-available > > h2. Why > In our internal data platform, we support flink batch and streaming job > submission. To reduce the submission worker overload, we use the Flink > application mode to submit flink job. It's a nice feature! > However, on batch mode, we hope flink client couldn't exit until the batch > application finished (No need to get job result, just wait). Now the flink > lack this feature, and it is not stated in the document that Application Mode > does not support attach. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18603: [FLINK-25610][connector/firehose] Adding table api base for kinesis firehose
flinkbot edited a comment on pull request #18603: URL: https://github.com/apache/flink/pull/18603#issuecomment-1027853740 ## CI report: * 1db47ab3b61a44252f62417c4d02f6b81623223a Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31300) * c956514f026499ce605f71dda169ae5ed3bb9c90 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31306) * 2e70fc3b8b927fac132516b7d122cbf6481d4668 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18603: [FLINK-25610][connector/firehose] Adding table api base for kinesis firehose
flinkbot edited a comment on pull request #18603: URL: https://github.com/apache/flink/pull/18603#issuecomment-1027853740 ## CI report: * 1db47ab3b61a44252f62417c4d02f6b81623223a Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31300) * c956514f026499ce605f71dda169ae5ed3bb9c90 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31306) * 2e70fc3b8b927fac132516b7d122cbf6481d4668 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31315) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-17444) StreamingFileSink Azure HadoopRecoverableWriter class missing.
[
https://issues.apache.org/jira/browse/FLINK-17444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491296#comment-17491296
]
Monika Hristova commented on FLINK-17444:
-
I get the same exception in flink 1.13.5
FAILED with failure cause: java.lang.NoClassDefFoundError:
org/apache/flink/fs/azure/common/hadoop/HadoopRecoverableWriter
at
org.apache.flink.fs.azure.common.hadoop.HadoopFileSystem.createRecoverableWriter(HadoopFileSystem.java:215)
at
org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:134)
at
org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:70)
at
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$RowFormatBuilder.createBucketWriter(StreamingFileSink.java:288)
at
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$RowFormatBuilder.createBuckets(StreamingFileSink.java:298)
at
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:469)
at
org.apache.flink.streaming.util.functions.StreamingFunctionUtils.tryRestoreFunction(StreamingFunctionUtils.java:189)
at
org.apache.flink.streaming.util.functions.StreamingFunctionUtils.restoreFunctionState(StreamingFunctionUtils.java:171)
at
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.initializeState(AbstractUdfStreamOperator.java:96)
at
org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:118)
at
org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:290)
at
org.apache.flink.streaming.runtime.tasks.OperatorChain.initializeStateAndOpenOperators(OperatorChain.java:441)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:585)
at
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.executeRestore(StreamTask.java:565)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:650)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:540)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:759)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
at java.lang.Thread.run(Thread.java:748)
> StreamingFileSink Azure HadoopRecoverableWriter class missing.
> --
>
> Key: FLINK-17444
> URL: https://issues.apache.org/jira/browse/FLINK-17444
> Project: Flink
> Issue Type: New Feature
> Components: FileSystems
>Reporter: Kasia
>Priority: Not a Priority
>
> Hello, I was recently attempting to use the Streaming File Sink to store data
> to Azure and get an exception error that it is missing the
> HadoopRecoverableWriter. When I searched if anyone else had the issue I came
> across this post here on [Stack Overflow
> |[https://stackoverflow.com/questions/61246683/flink-streamingfilesink-on-azure-blob-storage]].
> Seeing no one responded, I asked about it on the mailing list and was told
> to submit the issue here.
> This is exception message they posted below but the stack overflow post goes
> into more details of where they believe the issue comes from.
> {code:java}
> java.lang.NoClassDefFoundError:
> org/apache/flink/fs/azure/common/hadoop/HadoopRecoverableWriter
>
> at
> org.apache.flink.fs.azure.common.hadoop.HadoopFileSystem.createRecoverableWriter(HadoopFileSystem.java:202)
>
> at
> org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:129)
>
> at
> org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:69)
>
> at
> org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.(Buckets.java:117)
>
> at
> org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$RowFormatBuilder.createBuckets(StreamingFileSink.java:288)
>
> at
> org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:402)
>
> at
> org.apache.flink.streaming.util.functions.StreamingFunctionUtils.tryRestoreFunction(StreamingFunctionUtils.java:178)
>
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] dannycranmer commented on a change in pull request #18733: [FLINK-26064][connectors/firehose,kinesis] Using own event loop group…
dannycranmer commented on a change in pull request #18733:
URL: https://github.com/apache/flink/pull/18733#discussion_r805143370
##
File path:
flink-connectors/flink-connector-aws-base/src/main/java/org/apache/flink/connector/aws/util/AWSGeneralUtil.java
##
@@ -274,6 +275,7 @@ public static SdkAsyncHttpClient createAsyncHttpClient(
public static SdkAsyncHttpClient createAsyncHttpClient(
final AttributeMap config, final NettyNioAsyncHttpClient.Builder
httpClientBuilder) {
httpClientBuilder
+.eventLoopGroupBuilder(SdkEventLoopGroup.builder())
Review comment:
Thanks for adding a test to verify this too 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18603: [FLINK-25610][connector/firehose] Adding table api base for kinesis firehose
flinkbot edited a comment on pull request #18603: URL: https://github.com/apache/flink/pull/18603#issuecomment-1027853740 ## CI report: * c956514f026499ce605f71dda169ae5ed3bb9c90 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31306) * 2e70fc3b8b927fac132516b7d122cbf6481d4668 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31315) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18730: [FLINK-25495] The deployment of application-mode support client attach
flinkbot edited a comment on pull request #18730: URL: https://github.com/apache/flink/pull/18730#issuecomment-1036229614 ## CI report: * ae5f0ba235e28f68bd7fc23106be9b8c1edb7012 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31307) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * e07496c3522be15e47be43c8dae3b17e08745e72 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=25989) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31310) * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31316) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] rkhachatryan commented on a change in pull request #18391: [FLINK-25478][chaneglog] Correct the state register logic of ChangelogStateBackendHandle
rkhachatryan commented on a change in pull request #18391:
URL: https://github.com/apache/flink/pull/18391#discussion_r805145681
##
File path:
flink-runtime/src/main/java/org/apache/flink/runtime/state/changelog/ChangelogStateBackendHandle.java
##
@@ -154,14 +177,51 @@ public String toString() {
keyGroupRange, materialized.size(),
nonMaterialized.size());
}
-private static Closeable asCloseable(KeyedStateHandle h) {
-return () -> {
-try {
-h.discardState();
-} catch (Exception e) {
-ExceptionUtils.rethrowIOException(e);
+private static class StreamStateHandleWrapper implements
StreamStateHandle {
+private static final long serialVersionUID = 1L;
+
+private final KeyedStateHandle keyedStateHandle;
+
+StreamStateHandleWrapper(KeyedStateHandle keyedStateHandle) {
+this.keyedStateHandle = keyedStateHandle;
+}
+
+@Override
+public void discardState() throws Exception {
+keyedStateHandle.discardState();
+}
+
+@Override
+public long getStateSize() {
+return keyedStateHandle.getStateSize();
+}
+
+@Override
+public FSDataInputStream openInputStream() throws IOException {
+throw new UnsupportedOperationException("Should not call
here.");
+}
+
+@Override
+public Optional asBytesIfInMemory() {
+throw new UnsupportedOperationException("Should not call
here.");
+}
+
+@Override
+public boolean equals(Object o) {
Review comment:
Actually, we DO need these methods because `SharedStateRegistry` uses
`equals` to find duplicates.
Sorry for a misleading comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Updated] (FLINK-21835) RocksDBStateBackendReaderKeyedStateITCase fail
[
https://issues.apache.org/jira/browse/FLINK-21835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21835:
---
Labels: auto-deprioritized-major auto-deprioritized-minor test-stability
(was: auto-deprioritized-major stale-minor test-stability)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> RocksDBStateBackendReaderKeyedStateITCase fail
> --
>
> Key: FLINK-21835
> URL: https://issues.apache.org/jira/browse/FLINK-21835
> Project: Flink
> Issue Type: Bug
> Components: Runtime / State Backends
>Affects Versions: 1.12.2, 1.13.1
>Reporter: Guowei Ma
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=14847&view=logs&j=b2f046ab-ae17-5406-acdc-240be7e870e4&t=93e5ae06-d194-513d-ba8d-150ef6da1d7c&l=8873
> {code:java}
> at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
> at
> java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
> at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
> at
> java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
> Caused by: akka.pattern.AskTimeoutException: Ask timed out on
> [Actor[akka://flink/user/rpc/dispatcher_2#-390401339]] after [1 ms].
> Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A
> typical reason for `AskTimeoutException` is that the recipient actor didn't
> send a reply.
> at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
> at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
> at
> akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
> at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
> at
> scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
> at
> scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
> at
> scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
> at
> akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:235)
> at java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"
[
https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-20950:
---
Labels: stale-assigned test-stability (was: test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issue is assigned but has not
received an update in 30 days, so it has been labeled "stale-assigned".
If you are still working on the issue, please remove the label and add a
comment updating the community on your progress. If this issue is waiting on
feedback, please consider this a reminder to the committer/reviewer. Flink is a
very active project, and so we appreciate your patience.
If you are no longer working on the issue, please unassign yourself so someone
else may work on it.
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with
> "AssertionError"
> ---
>
> Key: FLINK-20950
> URL: https://issues.apache.org/jira/browse/FLINK-20950
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
>Affects Versions: 1.12.2, 1.13.0, 1.14.0, 1.15.0
>Reporter: Huang Xingbo
>Assignee: Arvid Heise
>Priority: Major
> Labels: stale-assigned, test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11940&view=logs&j=34f41360-6c0d-54d3-11a1-0292a2def1d9&t=2d56e022-1ace-542f-bf1a-b37dd63243f2]
> {code:java}
> 2021-01-12T16:47:00.7579536Z [ERROR] Failures:
> 2021-01-12T16:47:00.7580061Z [ERROR]
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode:218
> 2021-01-12T16:47:00.7587186Z Expected: iterable over
> ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)",
> "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)",
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)",
> "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)",
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)",
> "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)",
> "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)",
> "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)",
> "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)",
> "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)",
> "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)",
> "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)",
> "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)",
> "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)",
> "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)",
> "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)",
> "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)",
> "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)",
> "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)",
> "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any
> order
> 2021-01-12T16:47:00.7591663Z but: Not matched: "end of input"
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-22870) Grouping sets + case when + constant string throws AssertionError
[
https://issues.apache.org/jira/browse/FLINK-22870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-22870:
---
Labels: auto-deprioritized-major auto-deprioritized-minor (was:
auto-deprioritized-major stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Grouping sets + case when + constant string throws AssertionError
> -
>
> Key: FLINK-22870
> URL: https://issues.apache.org/jira/browse/FLINK-22870
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.14.0, 1.13.2
>Reporter: Caizhi Weng
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Add the following case to
> {{org.apache.flink.table.api.TableEnvironmentITCase}} to reproduce this issue.
> {code:scala}
> @Test
> def myTest2(): Unit = {
> tEnv.executeSql(
> """
> |create temporary table my_source(
> | a INT
> |) WITH (
> | 'connector' = 'values'
> |)
> |""".stripMargin)
> tEnv.executeSql(
> """
> |create temporary view my_view as select a, 'test' as b from my_source
> |""".stripMargin)
> tEnv.executeSql(
> """
> |create temporary view my_view2 as select
> | a,
> | case when GROUPING(b) = 1 then 'test2' else b end as b
> |from my_view
> |group by grouping sets(
> | (),
> | (a),
> | (b),
> | (a, b)
> |)
> |""".stripMargin)
> System.out.println(tEnv.explainSql(
> """
> |select a, b from my_view2
> |""".stripMargin))
> }
> {code}
> The exception stack is
> {code}
> java.lang.AssertionError: Conversion to relational algebra failed to preserve
> datatypes:
> validated type:
> RecordType(INTEGER a, VARCHAR(5) CHARACTER SET "UTF-16LE" NOT NULL b) NOT NULL
> converted type:
> RecordType(INTEGER a, VARCHAR(5) CHARACTER SET "UTF-16LE" b) NOT NULL
> rel:
> LogicalProject(a=[$0], b=[CASE(=($2, 1), _UTF-16LE'test2':VARCHAR(5)
> CHARACTER SET "UTF-16LE", CAST($1):VARCHAR(5) CHARACTER SET "UTF-16LE")])
> LogicalAggregate(group=[{0, 1}], groups=[[{0, 1}, {0}, {1}, {}]],
> agg#0=[GROUPING($1)])
> LogicalProject(a=[$0], b=[_UTF-16LE'test'])
> LogicalTableScan(table=[[default_catalog, default_database, my_source]])
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.checkConvertedType(SqlToRelConverter.java:467)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:582)
> at
> org.apache.flink.table.planner.calcite.FlinkPlannerImpl.org$apache$flink$table$planner$calcite$FlinkPlannerImpl$$rel(FlinkPlannerImpl.scala:177)
> at
> org.apache.flink.table.planner.calcite.FlinkPlannerImpl.rel(FlinkPlannerImpl.scala:169)
> at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.toQueryOperation(SqlToOperationConverter.java:1048)
> at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.convertViewQuery(SqlToOperationConverter.java:897)
> at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.convertCreateView(SqlToOperationConverter.java:864)
> at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.convert(SqlToOperationConverter.java:259)
> at
> org.apache.flink.table.planner.delegation.ParserImpl.parse(ParserImpl.java:101)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:730)
> at
> org.apache.flink.table.api.TableEnvironmentITCase.myTest2(TableEnvironmentITCase.scala:148)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-22872) Remove usages of legacy planner test utilities in Python
[
https://issues.apache.org/jira/browse/FLINK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-22872:
---
Labels: auto-deprioritized-major auto-deprioritized-minor (was:
auto-deprioritized-major stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Remove usages of legacy planner test utilities in Python
>
>
> Key: FLINK-22872
> URL: https://issues.apache.org/jira/browse/FLINK-22872
> Project: Flink
> Issue Type: Technical Debt
> Components: API / Python
>Reporter: Timo Walther
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> The tests of the Python module rely on a couple of testing classes from the
> legacy {{flink-table-planner}} test jar. We should remove references to:
> {code}
> org.apache.flink.table.utils.TableFunc1
> org.apache.flink.table.descriptors.RowtimeTest$CustomExtractor
> org.apache.flink.table.descriptors.RowtimeTest$CustomAssigner
> org.apache.flink.table.functions.aggfunctions.ByteMaxAggFunction
> org.apache.flink.table.expressions.utils.RichFunc0
> org.apache.flink.table.runtime.stream.table.TestAppendSink
> org.apache.flink.table.runtime.stream.table.TestRetractSink
> org.apache.flink.table.runtime.stream.table.TestUpsertSink
> org.apache.flink.table.runtime.stream.table.RowCollector
> TestCollectionTableFactory
> {code}
> A temporary fix will be provided in FLINK-22849.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-20432) SQLClientSchemaRegistryITCase hangs
[
https://issues.apache.org/jira/browse/FLINK-20432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-20432:
---
Labels: auto-deprioritized-critical auto-deprioritized-major
auto-deprioritized-minor pull-request-available test-stability (was:
auto-deprioritized-critical auto-deprioritized-major pull-request-available
stale-minor test-stability)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> SQLClientSchemaRegistryITCase hangs
> ---
>
> Key: FLINK-20432
> URL: https://issues.apache.org/jira/browse/FLINK-20432
> Project: Flink
> Issue Type: Bug
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>Affects Versions: 1.13.0, 1.12.3
>Reporter: Dian Fu
>Priority: Not a Priority
> Labels: auto-deprioritized-critical, auto-deprioritized-major,
> auto-deprioritized-minor, pull-request-available, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10351&view=logs&j=739e6eac-8312-5d31-d437-294c4d26fced&t=a68b8d89-50e9-5977-4500-f4fde4f57f9b
> {code}
> 2020-12-01T01:07:29.6516521Z Dec 01 01:07:29 [INFO]
> ---
> 2020-12-01T01:07:30.5779942Z Dec 01 01:07:30 [INFO] Running
> org.apache.flink.tests.util.kafka.SQLClientKafkaITCase
> 2020-12-01T01:08:24.8896937Z Dec 01 01:08:24 [INFO] Tests run: 1, Failures:
> 0, Errors: 0, Skipped: 0, Time elapsed: 54.305 s - in
> org.apache.flink.tests.util.kafka.SQLClientKafkaITCase
> 2020-12-01T01:08:24.8900917Z Dec 01 01:08:24 [INFO] Running
> org.apache.flink.tests.util.kafka.StreamingKafkaITCase
> 2020-12-01T01:09:09.0799444Z Dec 01 01:09:09 [INFO] Tests run: 1, Failures:
> 0, Errors: 0, Skipped: 0, Time elapsed: 44.184 s - in
> org.apache.flink.tests.util.kafka.StreamingKafkaITCase
> 2020-12-01T01:09:09.0825540Z Dec 01 01:09:09 [INFO] Running
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase
> 2020-12-01T01:41:06.5542739Z
> ==
> 2020-12-01T01:41:06.5544689Z === WARNING: This E2E Run will time out in the
> next few minutes. Starting to upload the log output ===
> 2020-12-01T01:41:06.5549107Z
> ==
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-24838) Add BaseAlgoImpl class to support link() and linkFrom() (FlinkML)
[ https://issues.apache.org/jira/browse/FLINK-24838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-24838: --- Labels: auto-deprioritized-major pull-request-available (was: pull-request-available stale-major) Priority: Minor (was: Major) This issue was labeled "stale-major" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Add BaseAlgoImpl class to support link() and linkFrom() (FlinkML) > - > > Key: FLINK-24838 > URL: https://issues.apache.org/jira/browse/FLINK-24838 > Project: Flink > Issue Type: New Feature > Components: Library / Machine Learning >Reporter: Zhipeng Zhang >Priority: Minor > Labels: auto-deprioritized-major, pull-request-available > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-20765) ScalarOperatorGens doesn't set proper nullability for result type of generated expressions
[
https://issues.apache.org/jira/browse/FLINK-20765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-20765:
---
Labels: auto-deprioritized-major auto-deprioritized-minor (was:
auto-deprioritized-major stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> ScalarOperatorGens doesn't set proper nullability for result type of
> generated expressions
> --
>
> Key: FLINK-20765
> URL: https://issues.apache.org/jira/browse/FLINK-20765
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
>Reporter: Rui Li
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Suppose we have a function that takes a BOOLEAN NOT NULL parameter:
> {code}
> /**
>* A function that takes BOOLEAN NOT NULL.
>*/
> public static class BoolEcho extends ScalarFunction {
> public Boolean eval(@DataTypeHint("BOOLEAN NOT NULL") Boolean
> b) {
> return b;
> }
> }
> {code}
> Then the following test case will fail:
> {code}
> CREATE TABLE SourceTable(x INT NOT NULL,y INT) WITH ('connector' =
> 'COLLECTION');
> SELECT BoolEcho(x=1 and y is null) FROM SourceTable;
> {code}
> with exception:
> {noformat}
> org.apache.flink.table.planner.codegen.CodeGenException: Mismatch of
> function's argument data type 'BOOLEAN NOT NULL' and actual argument type
> 'BOOLEAN'.
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$$anonfun$verifyArgumentTypes$1.apply(BridgingFunctionGenUtil.scala:323)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$$anonfun$verifyArgumentTypes$1.apply(BridgingFunctionGenUtil.scala:320)
> at
> scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
> at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$.verifyArgumentTypes(BridgingFunctionGenUtil.scala:320)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$.generateFunctionAwareCallWithDataType(BridgingFunctionGenUtil.scala:95)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$.generateFunctionAwareCall(BridgingFunctionGenUtil.scala:65)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingSqlFunctionCallGen.generate(BridgingSqlFunctionCallGen.scala:62)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.generateCallExpression(ExprCodeGenerator.scala:832)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.visitCall(ExprCodeGenerator.scala:529)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.visitCall(ExprCodeGenerator.scala:56)
> at org.apache.calcite.rex.RexCall.accept(RexCall.java:174)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.generateExpression(ExprCodeGenerator.scala:155)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-18892) Upgrade Guava to version 28.2-jre
[ https://issues.apache.org/jira/browse/FLINK-18892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18892: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Upgrade Guava to version 28.2-jre > - > > Key: FLINK-18892 > URL: https://issues.apache.org/jira/browse/FLINK-18892 > Project: Flink > Issue Type: Improvement >Affects Versions: 1.11.1 >Reporter: Igor Dvorzhak >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > Attachments: FLINK-18892.patch > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-25116) Fabric8FlinkKubeClientITCase hangs on Azure
[
https://issues.apache.org/jira/browse/FLINK-25116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-25116:
---
Labels: auto-deprioritized-major test-stability (was: stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Fabric8FlinkKubeClientITCase hangs on Azure
> ---
>
> Key: FLINK-25116
> URL: https://issues.apache.org/jira/browse/FLINK-25116
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Kubernetes, Tests
>Reporter: Yun Tang
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
>
> Instance:
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27208&view=logs&j=bea52777-eaf8-5663-8482-18fbc3630e81&t=b2642e3a-5b86-574d-4c8a-f7e2842bfb14]
>
> {code:java}
> 2021-11-29T13:18:56.6420610Z Nov 29 13:18:56 Invoking mvn with
> '/home/vsts/maven_cache/apache-maven-3.2.5/bin/mvn
> -Dmaven.repo.local=/home/vsts/work/1/.m2/repository
> -Dmaven.wagon.http.pool=false -Dorg.slf4j.simpleLogger.showDateTime=true
> -Dorg.slf4j.simpleLogger.dateTimeFormat=HH:mm:ss.SSS
> -Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn
> --no-snapshot-updates -B -Dhadoop.version=2.8.3 -Dinclude_hadoop_aws
> -Dscala-2.12 --settings
> /home/vsts/work/1/s/tools/ci/google-mirror-settings.xml test
> -Dlog.dir=/home/vsts/work/_temp/debug_files
> -Dlog4j.configurationFile=file:///home/vsts/work/1/s/flink-end-to-end-tests/../tools/ci/log4j.properties
> -Dtest=org.apache.flink.kubernetes.kubeclient.Fabric8FlinkKubeClientITCase'
> 2021-11-29T13:19:16.0638794Z Nov 29 13:19:16 [INFO] ---
> maven-surefire-plugin:3.0.0-M5:test (default-test) @ flink-kubernetes ---
> 2021-11-29T17:10:39.7133994Z
> ==
> 2021-11-29T17:10:39.7134714Z === WARNING: This task took already 95% of the
> available time budget of 282 minutes === {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-25030) Unexpected record in KafkaSourceITCase$IntegrationTests.testMultipleSplits
[
https://issues.apache.org/jira/browse/FLINK-25030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-25030:
---
Labels: auto-deprioritized-major test-stability (was: stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Unexpected record in KafkaSourceITCase$IntegrationTests.testMultipleSplits
> --
>
> Key: FLINK-25030
> URL: https://issues.apache.org/jira/browse/FLINK-25030
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.14.1
>Reporter: Matthias Pohl
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
> Attachments: logs-ci_build-test_ci_build_kafka_gelly-1637699602.zip
>
>
> We experienced a test failure in
> {{KafkaSourceITCase$IntegrationTests.testMultipleSplits}} in our Flink fork
> for 1.14 due to an unexpected record:
> {code}
> [...]
> Nov 23 21:10:19 [ERROR]
> org.apache.flink.connector.kafka.source.KafkaSourceITCase$IntegrationTests.testMultipleSplits{TestEnvironment,
> ExternalContext}[1]
> Nov 23 21:10:19 [ERROR] Run 1:
> KafkaSourceITCase$IntegrationTests>SourceTestSuiteBase.testMultipleSplits:160
> Nov 23 21:10:19 Expected: Records consumed by Flink should be identical to
> test data and preserve the order in multiple splits
> Nov 23 21:10:19 but: Unexpected record
> '2-13N3fae7bfL1iEMF3I0TaWGC57vrflv' at position 367
> Nov 23 21:10:19 Current progress of multiple split test data validation:
> Nov 23 21:10:19 Split 0 (115/115):
> Nov 23 21:10:19 0-C7bHGoulUrqjQqGM8PiVI6BS9B3Okq2PJdf3EBas3G
> Nov 23 21:10:19 0-GRt5T5YYDsgq1t0UBt3cUjvnktIbz
> [...]
> {code}
> I verified that we do not touch kafka-related in the Fork (by going through
> the patches with {{grep -i 'kafka\|source'}}). I added the pipeline build
> artifacts to this ticket.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-21834) org.apache.flink.core.fs.AbstractRecoverableWriterTest.testResumeWithWrongOffset fail
[
https://issues.apache.org/jira/browse/FLINK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21834:
---
Labels: auto-deprioritized-critical test-stability (was: stale-critical
test-stability)
Priority: Major (was: Critical)
This issue was labeled "stale-critical" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Critical,
please raise the priority and ask a committer to assign you the issue or revive
the public discussion.
> org.apache.flink.core.fs.AbstractRecoverableWriterTest.testResumeWithWrongOffset
> fail
> -
>
> Key: FLINK-21834
> URL: https://issues.apache.org/jira/browse/FLINK-21834
> Project: Flink
> Issue Type: Bug
> Components: FileSystems
>Affects Versions: 1.12.2, 1.13.2, 1.15.0
>Reporter: Guowei Ma
>Priority: Major
> Labels: auto-deprioritized-critical, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=14847&view=logs&j=3d12d40f-c62d-5ec4-6acc-0efe94cc3e89&t=5d6e4255-0ea8-5e2a-f52c-c881b7872361&l=10893
> Maybe we need print what the exception is when `recover` is called.
> {code:java}
> java.lang.AssertionError
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.fail(Assert.java:95)
> at
> org.apache.flink.core.fs.AbstractRecoverableWriterTest.testResumeWithWrongOffset(AbstractRecoverableWriterTest.java:381)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-22836) OffsetsInitializerTest.testTimestampOffsetsInitializer fails on azure
[
https://issues.apache.org/jira/browse/FLINK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-22836:
---
Labels: auto-deprioritized-major auto-deprioritized-minor test-stability
(was: auto-deprioritized-major stale-minor test-stability)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> OffsetsInitializerTest.testTimestampOffsetsInitializer fails on azure
> -
>
> Key: FLINK-22836
> URL: https://issues.apache.org/jira/browse/FLINK-22836
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18510&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5&l=6503
> {code:java}
> Jun 01 13:51:03 java.lang.AssertionError: expected:<9> but was:<10>
> Jun 01 13:51:03 at org.junit.Assert.fail(Assert.java:88)
> Jun 01 13:51:03 at org.junit.Assert.failNotEquals(Assert.java:834)
> Jun 01 13:51:03 at org.junit.Assert.assertEquals(Assert.java:645)
> Jun 01 13:51:03 at org.junit.Assert.assertEquals(Assert.java:631)
> Jun 01 13:51:03 at
> org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializerTest.lambda$testTimestampOffsetsInitializer$1(OffsetsInitializerTest.java:110)
> Jun 01 13:51:03 at java.util.HashMap.forEach(HashMap.java:1289)
> Jun 01 13:51:03 at
> org.apache.flink.connector.kafka.source.enumerator.initializer.OffsetsInitializerTest.testTimestampOffsetsInitializer(OffsetsInitializerTest.java:107)
> Jun 01 13:51:03 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> Jun 01 13:51:03 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jun 01 13:51:03 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jun 01 13:51:03 at java.lang.reflect.Method.invoke(Method.java:498)
> Jun 01 13:51:03 at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jun 01 13:51:03 at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jun 01 13:51:03 at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jun 01 13:51:03 at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jun 01 13:51:03 at
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> Jun 01 13:51:03 at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> Jun 01 13:51:03 at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> Jun 01 13:51:03 at
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> Jun 01 13:51:03 at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> Jun 01 13:51:03 at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> Jun 01 13:51:03 at
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> Jun 01 13:51:03 at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> Jun 01 13:51:03 at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jun 01 13:51:03 at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jun 01 13:51:03 at
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> Jun 01 13:51:03 at
> org.apache.maven.surefire.booter.ForkedBoote
[jira] [Updated] (FLINK-24555) Incorrectly put empty list to flink configuration
[
https://issues.apache.org/jira/browse/FLINK-24555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-24555:
---
Labels: pull-request-available stale-major (was: pull-request-available)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Major but is unassigned and neither itself nor its Sub-Tasks have been updated
for 60 days. I have gone ahead and added a "stale-major" to the issue". If this
ticket is a Major, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> Incorrectly put empty list to flink configuration
> -
>
> Key: FLINK-24555
> URL: https://issues.apache.org/jira/browse/FLINK-24555
> Project: Flink
> Issue Type: Bug
>Reporter: Junfan Zhang
>Priority: Major
> Labels: pull-request-available, stale-major
>
> h2. Why
> As I found some warn logs in our production flink jobs, like as follows(the
> detail logs attached at the end). Besides we dont set the
> {{pipeline.classpaths}} param conf.
> {code:java}
> 2021-10-14 17:46:41 WARN - [main] -
> org.apache.flink.configuration.GlobalConfiguration(186) - Error while trying
> to split key and value in configuration file
> /data8/yarn/local/usercache/pizza/appcache/application_1633896099002_1043646/container_e429_1633896099002_1043646_01_01/flink-conf.yaml:11:
> "pipeline.classpaths: "
> {code}
> I dig the flink code and found it put the empty list into configuration by
> {{ConfigUtils.encodeCollectionToConfig}}.
> h2. How
> So it's better to ignore the empty collection to put in the configuration.
> Because these configuration will be written to the flink-conf.yaml and Flink
> jobmanager will read but fail to read the corresponding key's value as the
> warn log described.
> h2. Appendix
> {code:java}
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: internal.jobgraph-path, job.graph
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property:
> restart-strategy.failure-rate.max-failures-per-interval, 3
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: jobmanager.execution.failover-strategy, region
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: high-availability.cluster-id,
> application_1633896099002_1043646
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: jobmanager.rpc.address, localhost
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: execution.runtime-mode, AUTOMATIC
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: security.kerberos.fetch.delegation-token, false
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: execution.savepoint.ignore-unclaimed-state, false
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: parallelism.default, 2
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2021-10-14 17:46:41 WARN - [main] -
> org.apache.flink.configuration.GlobalConfiguration(186) - Error while trying
> to split key and value in configuration file
> /data8/yarn/local/usercache/pizza/appcache/application_1633896099002_1043646/container_e429_1633896099002_1043646_01_01/flink-conf.yaml:11:
> "pipeline.classpaths: "
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: restart-strategy.failure-rate.failure-rate-interval,
> 1 d
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: yarn.application.name,
> app_StreamEngine_Prod_jiandan_beat_rec_test_all
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: yarn.application.queue, talos.job_streaming
> 2021-10-14 17:46:41 INFO - [main] -
> org.apache.flink.configuration.GlobalConfiguration(213) - Loading
> configuration property: taskmanager.memory.process.size, 1728m
>
[jira] [Updated] (FLINK-24917) YARNSessionFIFOSecuredITCase hangs on azure
[
https://issues.apache.org/jira/browse/FLINK-24917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-24917:
---
Labels: auto-deprioritized-major test-stability (was: stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> YARNSessionFIFOSecuredITCase hangs on azure
> ---
>
> Key: FLINK-24917
> URL: https://issues.apache.org/jira/browse/FLINK-24917
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
>Affects Versions: 1.14.0
>Reporter: Yun Gao
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
>
> {code:java}
> Nov 15 23:50:37 [INFO] Running
> org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
> [Fatal Error] yarn-site.xml:1:1: Premature end of file.
> Exception in thread "Thread-208" java.lang.RuntimeException:
> org.xml.sax.SAXParseException; systemId:
> file:/__w/1/s/flink-yarn-tests/target/test-classes/yarn-site.xml; lineNumber:
> 1; columnNumber: 1; Premature end of file.
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2338)
> at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
> at
> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:1068)
> at
> org.apache.hadoop.security.authorize.ServiceAuthorizationManager.refreshWithLoadedConfiguration(ServiceAuthorizationManager.java:139)
> at
> org.apache.hadoop.security.authorize.ServiceAuthorizationManager.refresh(ServiceAuthorizationManager.java:126)
> at org.apache.hadoop.ipc.Server.refreshServiceAcl(Server.java:454)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.createServer(ResourceLocalizationService.java:290)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:261)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:295)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:197)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.MiniYARNCluster$NodeManagerWrapper$1.run(MiniYARNCluster.java:561)
> Caused by: org.xml.sax.SAXParseException; systemId:
> file:/__w/1/s/flink-yarn-tests/target/test-classes/yarn-site.xml; lineNumber:
> 1; columnNumber: 1; Premature end of file.
> at
> com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:257)
> at
> com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:339)
> at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2173)
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2161)
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2232)
> ... 16 more
> Nov 15, 2021 11:50:58 PM com.google.inject.servlet.GuiceFilter setPipeline
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26571&view=logs&j=f450c1a5-64b1-5955-e215-49cb1ad5ec88&t=cc452273-9efa-565d-9db8-ef62a38a0c10&l=29706
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-24968) "Flink over NAT end-to-end test" failed on azure
[
https://issues.apache.org/jira/browse/FLINK-24968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-24968:
---
Labels: auto-deprioritized-major test-stability (was: stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> "Flink over NAT end-to-end test" failed on azure
>
>
> Key: FLINK-24968
> URL: https://issues.apache.org/jira/browse/FLINK-24968
> Project: Flink
> Issue Type: Bug
> Components: Build System / Azure Pipelines
>Affects Versions: 1.13.3
>Reporter: Yun Gao
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
>
> {code:java}
> Nov 19 23:57:14 + dpkg --print-architecture
> Nov 19 23:57:14 + wget -nv -O /usr/local/bin/gosu
> https://github.com/tianon/gosu/releases/download/1.11/gosu-amd64
> Nov 19 23:57:14
> https://github.com/tianon/gosu/releases/download/1.11/gosu-amd64:
> Nov 19 23:57:14 2021-11-19 23:57:14 ERROR 503: Service Unavailable.
> The command '/bin/sh -c set -ex; wget -nv -O /usr/local/bin/gosu
> "https://github.com/tianon/gosu/releases/download/$GOSU_VERSION/gosu-$(dpkg
> --print-architecture)"; wget -nv -O /usr/local/bin/gosu.asc "
> Nov 19 23:57:14 ~/work/1/s
> /home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/test_nat.sh: line 64:
> popd: directory stack empty
> Nov 19 23:57:18 No stopped containers
> sort: cannot read:
> '/home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/temp-test-directory-52007836763/out/docker_wc_out/*':
> No such file or directory
> Nov 19 23:57:18 FAIL WordCount: Output hash mismatch. Got
> d41d8cd98f00b204e9800998ecf8427e, expected 72a690412be8928ba239c2da967328a5.
> Nov 19 23:57:18 head hexdump of actual:
> head: cannot open
> '/home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/temp-test-directory-52007836763/out/docker_wc_out/*'
> for reading: No such file or directory
> Nov 19 23:57:18 Stopping job timeout watchdog (with pid=208730)
> Nov 19 23:57:18 [FAIL] Test script contains errors.
> Nov 19 23:57:18 Checking of logs skipped.
> Nov 19 23:57:18
> Nov 19 23:57:18 [FAIL] 'Running Flink over NAT end-to-end test' failed after
> 0 minutes and 26 seconds! Test exited with exit code 1
> Nov 19 23:57:19
> 23:57:19 ##[group]Environment Information
> Nov 19 23:57:19 Searching for .dump, .dumpstream and related files in
> '/home/vsts/work/1/s'
> dmesg: read kernel buffer failed: Operation not permitted
> Nov 19 23:57:20 No taskexecutor daemon to stop on host fv-az209-470.
> Nov 19 23:57:20 No standalonesession daemon to stop on host fv-az209-470.
> ==
> === WARNING: This task took already 95% of the available time budget of 283
> minutes ===
> {code}
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26776&view=logs&j=91bf6583-3fb2-592f-e4d4-d79d79c3230a&t=3425d8ba-5f03-540a-c64b-51b8481bf7d6&l=3365]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-17860) Recursively remove channel state directories
[ https://issues.apache.org/jira/browse/FLINK-17860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-17860: --- Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned (was: auto-deprioritized-major auto-unassigned stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Recursively remove channel state directories > > > Key: FLINK-17860 > URL: https://issues.apache.org/jira/browse/FLINK-17860 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor, > auto-unassigned > > With a high degree of parallelism, we end up with n*s number of files in each > checkpoint (n = parallelism, s = stages). Writing them if fast (from many > subtasks), removing them is slow (from JM). > This can't be mitigated by state.backend.fs.memory-threshold because most > states are ten to hundreds Mb. > > Instead of going through them 1 by 1, we could remove the directory > recursively. > > The easiest way is to remove channelStateHandle.discard() calls and use > isRecursive=true in > FsCompletedCheckpointStorageLocation.disposeStorageLocation. > Note: with the current isRecursive=false there will be an exception if there > are any files left under that folder. > > This can be extended to other state handles in future as well. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-25675) UnalignedCheckpointCompatibilityITCase.test hangs on AZP
[
https://issues.apache.org/jira/browse/FLINK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-25675:
---
Labels: auto-deprioritized-critical test-stability (was: stale-critical
test-stability)
Priority: Major (was: Critical)
This issue was labeled "stale-critical" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Critical,
please raise the priority and ask a committer to assign you the issue or revive
the public discussion.
> UnalignedCheckpointCompatibilityITCase.test hangs on AZP
>
>
> Key: FLINK-25675
> URL: https://issues.apache.org/jira/browse/FLINK-25675
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.13.5
>Reporter: Till Rohrmann
>Priority: Major
> Labels: auto-deprioritized-critical, test-stability
>
> The test {{UnalignedCheckpointCompatibilityITCase.test}} hangs on AZP.
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=29511&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=a99e99c7-21cd-5a1f-7274-585e62b72f56&l=6048
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-23580) Cannot handle such jdbc url
[
https://issues.apache.org/jira/browse/FLINK-23580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-23580:
---
Labels: auto-deprioritized-major pull-request-available (was:
pull-request-available stale-major)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Cannot handle such jdbc url
> ---
>
> Key: FLINK-23580
> URL: https://issues.apache.org/jira/browse/FLINK-23580
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC
>Affects Versions: 1.12.0
>Reporter: chenpeng
>Priority: Minor
> Labels: auto-deprioritized-major, pull-request-available
> Attachments: image-2021-08-02-16-02-21-897.png
>
>
>
> Caused by: java.lang.IllegalStateException: Cannot handle such jdbc url:
> jdbc:clickhouse://xx:8123/dict
> {code:java}
> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".SLF4J: Failed
> to load class "org.slf4j.impl.StaticLoggerBinder".SLF4J: Defaulting to
> no-operation (NOP) logger implementationSLF4J: See
> http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
> org.apache.flink.table.api.ValidationException: Unable to create a source for
> reading table 'default_catalog.default_database.sink_table'.
> Table options are:
> 'connector'='jdbc''driver'='ru.yandex.clickhouse.ClickHouseDriver''password'='''table-name'='tbl3_dict''url'='jdbc:clickhouse://xxx:8123/dict''username'='default'
> at
> org.apache.flink.table.factories.FactoryUtil.createTableSource(FactoryUtil.java:125)
> at
> org.apache.flink.table.planner.plan.schema.CatalogSourceTable.createDynamicTableSource(CatalogSourceTable.java:265)
> at
> org.apache.flink.table.planner.plan.schema.CatalogSourceTable.toRel(CatalogSourceTable.java:100)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.toRel(SqlToRelConverter.java:3585)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertIdentifier(SqlToRelConverter.java:2507)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertFrom(SqlToRelConverter.java:2144)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertFrom(SqlToRelConverter.java:2093)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertFrom(SqlToRelConverter.java:2050)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertSelectImpl(SqlToRelConverter.java:663)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertSelect(SqlToRelConverter.java:644)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertQueryRecursive(SqlToRelConverter.java:3438)
> at
> org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:570)
> at
> org.apache.flink.table.planner.calcite.FlinkPlannerImpl.org$apache$flink$table$planner$calcite$FlinkPlannerImpl$$rel(FlinkPlannerImpl.scala:165)
> at
> org.apache.flink.table.planner.calcite.FlinkPlannerImpl.rel(FlinkPlannerImpl.scala:157)
> at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.toQueryOperation(SqlToOperationConverter.java:823)
> at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.convertSqlQuery(SqlToOperationConverter.java:795)
> at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.convert(SqlToOperationConverter.java:250)
> at
> org.apache.flink.table.planner.delegation.ParserImpl.parse(ParserImpl.java:78)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.sqlQuery(TableEnvironmentImpl.java:639)
> at FlinkStreamSql.test7(FlinkStreamSql.java:212) at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> at org.junit.runners.Pa
[jira] [Updated] (FLINK-25100) RMQSourceITCase failed on azure due to java.io.EOFException
[
https://issues.apache.org/jira/browse/FLINK-25100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-25100:
---
Labels: auto-deprioritized-major test-stability (was: stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> RMQSourceITCase failed on azure due to java.io.EOFException
> ---
>
> Key: FLINK-25100
> URL: https://issues.apache.org/jira/browse/FLINK-25100
> Project: Flink
> Issue Type: Bug
> Components: Connectors/ RabbitMQ
>Affects Versions: 1.14.1
>Reporter: Yun Gao
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
>
> {code:java}
> Nov 29 12:02:05 at
> org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
> Nov 29 12:02:05 at
> org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
> Nov 29 12:02:05 at
> org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
> Nov 29 12:02:05 at
> org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
> Nov 29 12:02:05 at
> org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
> Nov 29 12:02:05 at
> org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
> Nov 29 12:02:05 at
> org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
> Nov 29 12:02:05 at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> Nov 29 12:02:05 at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> Nov 29 12:02:05 at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> Nov 29 12:02:05 at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> Nov 29 12:02:05 Caused by: com.rabbitmq.client.AlreadyClosedException:
> connection is already closed due to connection error; cause:
> java.io.EOFException
> Nov 29 12:02:05 at
> com.rabbitmq.client.impl.AMQChannel.ensureIsOpen(AMQChannel.java:258)
> Nov 29 12:02:05 at
> com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:341)
> Nov 29 12:02:05 at
> com.rabbitmq.client.impl.AMQChannel.privateRpc(AMQChannel.java:327)
> Nov 29 12:02:05 at
> com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:275)
> Nov 29 12:02:05 at
> com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:373)
> Nov 29 12:02:05 ... 59 more
> Nov 29 12:02:05
> Nov 29 12:02:06 [INFO]
> Nov 29 12:02:06 [INFO] Results:
> Nov 29 12:02:06 [INFO]
> Nov 29 12:02:06 [ERROR] Errors:
> Nov 29 12:02:06 [ERROR] RMQSourceITCase.setUp:96->getRMQConnection:201 »
> PossibleAuthenticationFailure
> Nov 29 12:02:06 [INFO]
> Nov 29 12:02:06 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0
> {code}
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27205&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=13941]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-22631) Metrics are incorrect when task finished
[ https://issues.apache.org/jira/browse/FLINK-22631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-22631: --- Labels: auto-deprioritized-major (was: auto-deprioritized-major stale-major) Priority: Minor (was: Major) This issue was labeled "stale-major" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Metrics are incorrect when task finished > > > Key: FLINK-22631 > URL: https://issues.apache.org/jira/browse/FLINK-22631 > Project: Flink > Issue Type: Improvement > Components: Runtime / Metrics >Reporter: Li >Priority: Minor > Labels: auto-deprioritized-major > Attachments: image-2021-05-11-20-13-25-886.png, > image-2021-05-11-20-14-29-290.png, image-2021-05-19-10-10-29-765.png, > image-2021-05-19-10-11-02-764.png > > > MetricReporters are reported periodically, default 10 seconds. The > final metrics may not be reported to metric system like pushgateway when task > finished. This makes users unable to obtain the correct metrics。 > > Maybe metricReporters should be reported once manually before closed. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-19916) Hadoop3 ShutdownHookManager visit closed ClassLoader
[
https://issues.apache.org/jira/browse/FLINK-19916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-19916:
---
Labels: auto-deprioritized-major auto-deprioritized-minor (was:
auto-deprioritized-major stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Hadoop3 ShutdownHookManager visit closed ClassLoader
>
>
> Key: FLINK-19916
> URL: https://issues.apache.org/jira/browse/FLINK-19916
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hadoop Compatibility
>Affects Versions: 1.12.2
>Reporter: Jingsong Lee
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> {code:java}
> Exception in thread "Thread-10" java.lang.IllegalStateException: Trying to
> access closed classloader. Please check if you store classloaders directly or
> indirectly in static fields. If the stacktrace suggests that the leak occurs
> in a third party library and cannot be fixed immediately, you can disable
> this check with the configuration 'classloader.check-leaked-classloader'.
> at
> org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$SafetyNetWrapperClassLoader.ensureInner(FlinkUserCodeClassLoaders.java:161)
> at
> org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$SafetyNetWrapperClassLoader.getResource(FlinkUserCodeClassLoaders.java:179)
> at
> org.apache.hadoop.conf.Configuration.getResource(Configuration.java:2780)
> at
> org.apache.hadoop.conf.Configuration.getStreamReader(Configuration.java:3036)
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2995)
> at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2968)
> at
> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2848)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200)
> at
> org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1812)
> at
> org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1789)
> at
> org.apache.hadoop.util.ShutdownHookManager.getShutdownTimeout(ShutdownHookManager.java:183)
> at
> org.apache.hadoop.util.ShutdownHookManager.shutdownExecutor(ShutdownHookManager.java:145)
> at
> org.apache.hadoop.util.ShutdownHookManager.access$300(ShutdownHookManager.java:65)
> at
> org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:102)
> {code}
> This is because Hadoop 3 starts asynchronous threads to execute some shutdown
> hooks.
> These hooks are run after the job is executed, as a result, the classloader
> has been released, but in hooks, configuration still holds the released
> classloader, so it will fail to throw an exception in this asynchronous
> thread.
> Now it doesn't affect our function, it just prints the exception stack on the
> console.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-15819) Add more StateFun Kafka ingress features that are already available in FlinkKafkaConsumer
[
https://issues.apache.org/jira/browse/FLINK-15819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-15819:
---
Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned
(was: auto-deprioritized-major auto-unassigned stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Add more StateFun Kafka ingress features that are already available in
> FlinkKafkaConsumer
> -
>
> Key: FLINK-15819
> URL: https://issues.apache.org/jira/browse/FLINK-15819
> Project: Flink
> Issue Type: New Feature
> Components: Stateful Functions
>Affects Versions: statefun-2.0.0
>Reporter: Tzu-Li (Gordon) Tai
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> auto-unassigned
>
> This is an umbrella JIRA to list all pending {{FlinkKafkaConsumer}} features
> that are reasonable to expose through Stateful Function's Kafka ingress.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-20969) Update Scala 2.12 version to 2.12.13
[ https://issues.apache.org/jira/browse/FLINK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-20969: --- Labels: auto-deprioritized-major pull-request-available (was: pull-request-available stale-major) Priority: Minor (was: Major) This issue was labeled "stale-major" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Update Scala 2.12 version to 2.12.13 > > > Key: FLINK-20969 > URL: https://issues.apache.org/jira/browse/FLINK-20969 > Project: Flink > Issue Type: Improvement > Components: API / Scala >Reporter: Erwan Loisant >Priority: Minor > Labels: auto-deprioritized-major, pull-request-available > > Flink is compiled with Scala 2.12.7, that was released in 2018. > The latest version of the 2.12 series is 2.12.13, and upgrading will bring > build performance improvements as well as improving compatibility for > projects using more recent versions of Scala. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-24820) Examples in documentation for value1 IS DISTINCT FROM value2 are wrong
[
https://issues.apache.org/jira/browse/FLINK-24820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-24820:
---
Labels: auto-deprioritized-major pull-request-available (was:
pull-request-available stale-major)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Examples in documentation for value1 IS DISTINCT FROM value2 are wrong
> --
>
> Key: FLINK-24820
> URL: https://issues.apache.org/jira/browse/FLINK-24820
> Project: Flink
> Issue Type: Bug
> Components: Documentation, Table SQL / API
>Affects Versions: 1.14.0, 1.13.3
>Reporter: Sergey Nuyanzin
>Priority: Minor
> Labels: auto-deprioritized-major, pull-request-available
>
> Currently it is stated in docs for {{value1 IS DISTINCT FROM value2}}
> {quote}
> E.g., 1 IS NOT DISTINCT FROM NULL returns TRUE; NULL IS NOT DISTINCT FROM
> NULL returns FALSE.
> {quote}
> In fact they return opposite values.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18737: [FLINK-26077][runtime] Support operators send request to Coordinator and return a response
flinkbot edited a comment on pull request #18737: URL: https://github.com/apache/flink/pull/18737#issuecomment-1036982251 ## CI report: * 1d6f803339034ca3bfd7aa50d04d11c997d870e8 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31309) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-16956) Git fetch failed with exit code 128
[
https://issues.apache.org/jira/browse/FLINK-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-16956:
---
Labels: auto-deprioritized-major test-stability (was: stale-major
test-stability)
Priority: Minor (was: Major)
This issue was labeled "stale-major" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Major, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Git fetch failed with exit code 128
> ---
>
> Key: FLINK-16956
> URL: https://issues.apache.org/jira/browse/FLINK-16956
> Project: Flink
> Issue Type: Bug
> Components: Build System / Azure Pipelines
>Affects Versions: 1.14.0, 1.15.0
>Reporter: Piotr Nowojski
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
>
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=7003&view=logs&j=16ccbdb7-2a3e-53da-36eb-fb718edc424a&t=5321d2cb-5c30-5320-9c0c-312babc023c8
> {noformat}
> fatal: could not read Username for 'https://github.com': terminal prompts
> disabled
> ##[warning]Git fetch failed with exit code 128, back off 8.691 seconds before
> retry.
> git -c http.extraheader="AUTHORIZATION: basic ***" fetch --tags --prune
> --progress --no-recurse-submodules origin
> fatal: could not read Username for 'https://github.com': terminal prompts
> disabled
> ##[warning]Git fetch failed with exit code 128, back off 3.711 seconds before
> retry.
> git -c http.extraheader="AUTHORIZATION: basic ***" fetch --tags --prune
> --progress --no-recurse-submodules origin
> fatal: could not read Username for 'https://github.com': terminal prompts
> disabled
> ##[error]Git fetch failed with exit code: 128
> Finishing: Checkout flink-ci/flink-mirror@master to s
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] wuchong commented on pull request #18737: [FLINK-26077][runtime] Support operators send request to Coordinator and return a response
wuchong commented on pull request #18737: URL: https://github.com/apache/flink/pull/18737#issuecomment-1037167714 @gaoyunhaii could you help to review this? when you are available. very appreciated it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (FLINK-25867) [ZH] Add ChangelogBackend documentation
[ https://issues.apache.org/jira/browse/FLINK-25867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan reassigned FLINK-25867: - Assignee: (was: Roman Khachatryan) > [ZH] Add ChangelogBackend documentation > --- > > Key: FLINK-25867 > URL: https://issues.apache.org/jira/browse/FLINK-25867 > Project: Flink > Issue Type: Sub-task > Components: Documentation >Reporter: Roman Khachatryan >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0 > > > In FLINK-25024, documentation for Changelog was added. > Chinese version is a copy of English one and needs translation. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18603: [FLINK-25610][connector/firehose] Adding table api base for kinesis firehose
flinkbot edited a comment on pull request #18603: URL: https://github.com/apache/flink/pull/18603#issuecomment-1027853740 ## CI report: * 2e70fc3b8b927fac132516b7d122cbf6481d4668 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31315) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18735: [FLINK-26079][state/changelog] Disallow recovery from non-changelog checkpoints
flinkbot edited a comment on pull request #18735: URL: https://github.com/apache/flink/pull/18735#issuecomment-1036580667 ## CI report: * cbd30159cadaf7bc419879e16755661800ec Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31313) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * 27339aae1937b71503fb8435f250597722e8265f Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31314) * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31316) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (FLINK-25288) Add savepoint and metric cases in DataStream source suite of connector testing framework
[ https://issues.apache.org/jira/browse/FLINK-25288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-25288: -- Assignee: ruanhang1993 > Add savepoint and metric cases in DataStream source suite of connector > testing framework > > > Key: FLINK-25288 > URL: https://issues.apache.org/jira/browse/FLINK-25288 > Project: Flink > Issue Type: Sub-task > Components: Test Infrastructure >Reporter: Qingsheng Ren >Assignee: ruanhang1993 >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Assigned] (FLINK-25840) Add semantic test support in the connector testframe
[ https://issues.apache.org/jira/browse/FLINK-25840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-25840: -- Assignee: ruanhang1993 > Add semantic test support in the connector testframe > > > Key: FLINK-25840 > URL: https://issues.apache.org/jira/browse/FLINK-25840 > Project: Flink > Issue Type: Sub-task > Components: Tests >Affects Versions: 1.15.0 >Reporter: Hang Ruan >Assignee: ruanhang1993 >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] leonardBang commented on a change in pull request #18547: [FLINK-25840][tests] add semantic test support for the connector testframe
leonardBang commented on a change in pull request #18547:
URL: https://github.com/apache/flink/pull/18547#discussion_r805161181
##
File path:
flink-test-utils-parent/flink-connector-test-utils/src/main/java/org/apache/flink/connector/testframe/testsuites/SourceTestSuiteBase.java
##
@@ -86,6 +92,8 @@
public abstract class SourceTestSuiteBase {
private static final Logger LOG =
LoggerFactory.getLogger(SourceTestSuiteBase.class);
+static ExecutorService executorService =
+
Executors.newFixedThreadPool(Runtime.getRuntime().availableProcessors() * 2);
Review comment:
The number for fixed threads is too expensive for tests.
##
File path:
flink-test-utils-parent/flink-connector-test-utils/src/test/java/org/apache/flink/connector/testframe/utils/CollectIteratorAssertTest.java
##
@@ -0,0 +1,144 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.connector.testframe.utils;
+
+import org.apache.flink.streaming.api.CheckpointingMode;
+
+import org.assertj.core.api.Assertions;
+import org.junit.jupiter.api.Nested;
+import org.junit.jupiter.api.Test;
+
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.List;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
+
+import static
org.apache.flink.connector.testframe.utils.CollectIteratorAssertions.assertThat;
+
+/** Unit test for {@link CollectIteratorAssertTest}. */
Review comment:
```suggestion
/** Unit tests for {@link CollectIteratorAssertTest}. */
```
##
File path:
flink-test-utils-parent/flink-connector-test-utils/src/main/java/org/apache/flink/connector/testframe/testsuites/SourceTestSuiteBase.java
##
@@ -400,6 +413,37 @@ protected JobClient submitJob(StreamExecutionEnvironment
env, String jobName) th
stream.getExecutionEnvironment().getCheckpointConfig());
}
+/**
+ * Compare the test data with the result.
+ *
+ * If the source is bounded, limit should be null.
+ *
+ * @param resultIterator the data read from the job
+ * @param testData the test data
+ * @param semantic the supported semantic, see {@link CheckpointingMode}
+ * @param limit expected number of the data to read from the job
+ */
+private void checkResultBySemantic(
Review comment:
```suggestion
private void checkResultWithSemantic(
```
##
File path:
flink-test-utils-parent/flink-connector-test-utils/src/main/java/org/apache/flink/connector/testframe/utils/CollectIteratorAssert.java
##
@@ -0,0 +1,257 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.connector.testframe.utils;
+
+import org.apache.flink.streaming.api.CheckpointingMode;
+
+import org.assertj.core.api.AbstractAssert;
+
+import java.util.ArrayList;
+import java.util.Iterator;
+import java.util.LinkedList;
+import java.util.List;
+
+/** @param */
Review comment:
Please add reasonable java document
##
File path:
flink-test-utils-parent/flink-connector-test-utils/src/main/java/org/apache/flink/connector/testframe/utils/CollectIteratorAssert.java
##
@@ -0,0 +1,257 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for add
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * b752ed092ae1f0720773d67ac3bf5c1d98caf3b5 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31316) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18707: [FLINK-25995][table-planner] Make implicit assumption of SQL local hash explicit
flinkbot edited a comment on pull request #18707: URL: https://github.com/apache/flink/pull/18707#issuecomment-1034994010 ## CI report: * 3e53478b4af82a7055018379d3ca938b6d231523 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31275) * f1d2773515b98c1599e3e1ebe457598453347ec1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18707: [FLINK-25995][table-planner] Make implicit assumption of SQL local hash explicit
flinkbot edited a comment on pull request #18707: URL: https://github.com/apache/flink/pull/18707#issuecomment-1034994010 ## CI report: * 3e53478b4af82a7055018379d3ca938b6d231523 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31275) * f1d2773515b98c1599e3e1ebe457598453347ec1 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31317) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (FLINK-26097) Kafka tombstone messages not working
Maik created FLINK-26097: Summary: Kafka tombstone messages not working Key: FLINK-26097 URL: https://issues.apache.org/jira/browse/FLINK-26097 Project: Flink Issue Type: Bug Components: Stateful Functions Reporter: Maik java.lang.NullPointerException at com.google.protobuf.ByteString$LiteralByteString.(ByteString.java:1282) at com.google.protobuf.ByteString.wrap(ByteString.java:382) at com.google.protobuf.MoreByteStrings.wrap(MoreByteStrings.java:25) at org.apache.flink.statefun.flink.io.kafka.binders.ingress.v1.RoutableKafkaIngressDeserializer.deserialize(RoutableKafkaIngressDeserializer.java:59) at org.apache.flink.statefun.flink.io.kafka.binders.ingress.v1.RoutableKafkaIngressDeserializer.deserialize(RoutableKafkaIngressDeserializer.java:29) at org.apache.flink.statefun.flink.io.kafka.KafkaDeserializationSchemaDelegate.deserialize(KafkaDeserializationSchemaDelegate.java:46) at org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema.deserialize(KafkaDeserializationSchema.java:79) at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.partitionConsumerRecordsHandler(KafkaFetcher.java:179) at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.runFetchLoop(KafkaFetcher.java:142) at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:826) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:67) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:323) -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] godfreyhe commented on a change in pull request #18363: [Flink-25600][table-planner] Support new statement set syntax in sql client and update docs
godfreyhe commented on a change in pull request #18363:
URL: https://github.com/apache/flink/pull/18363#discussion_r805167560
##
File path: docs/content/docs/dev/table/sql/insert.md
##
@@ -271,4 +276,37 @@ INSERT INTO students
```
+## Insert into multiple tables
+The `STATEMENT SET` can be used to insert data into multiple tables in a
statement.
+
+### Syntax
+
+```sql
+EXECUTE STATEMENT SET
+BEGIN
+insert_spec;
+...
+insert_spec;
+END;
+
+insert_spec:
+ {insert_from_select}|{insert_from_values}
Review comment:
I do not see the variable definition
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] godfreyhe commented on a change in pull request #18363: [Flink-25600][table-planner] Support new statement set syntax in sql client and update docs
godfreyhe commented on a change in pull request #18363:
URL: https://github.com/apache/flink/pull/18363#discussion_r805167560
##
File path: docs/content/docs/dev/table/sql/insert.md
##
@@ -271,4 +276,37 @@ INSERT INTO students
```
+## Insert into multiple tables
+The `STATEMENT SET` can be used to insert data into multiple tables in a
statement.
+
+### Syntax
+
+```sql
+EXECUTE STATEMENT SET
+BEGIN
+insert_spec;
+...
+insert_spec;
+END;
+
+insert_spec:
+ {insert_from_select}|{insert_from_values}
Review comment:
We should keep the same style, use `<>` instead of `{}`, see with.md or
explain.md
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] godfreyhe commented on a change in pull request #18363: [Flink-25600][table-planner] Support new statement set syntax in sql client and update docs
godfreyhe commented on a change in pull request #18363:
URL: https://github.com/apache/flink/pull/18363#discussion_r805169048
##
File path: docs/content/docs/dev/table/sql/explain.md
##
@@ -288,4 +288,4 @@ EXPLAIN [([ExplainDetail[, ExplainDetail]*]) | PLAN FOR]
}}) page.
-For INSERT, please refer to [INSERT]({{< ref "docs/dev/table/sql/insert" >}})
page.
+For INSERT, the statement can be either a single insert or a statement set,
please refer to [INSERT]({{< ref "docs/dev/table/sql/insert" >}}) page.
Review comment:
Although read the document of `insert.md`, users may do not know the
syntax of `explain statement set begin ... end`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (FLINK-20454) Allow to read metadata for debezium-avro-confluent format
[ https://issues.apache.org/jira/browse/FLINK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491362#comment-17491362 ] li mo commented on FLINK-20454: --- [~MartijnVisser] [~jark] can you help re-assign this ticket to me? > Allow to read metadata for debezium-avro-confluent format > - > > Key: FLINK-20454 > URL: https://issues.apache.org/jira/browse/FLINK-20454 > Project: Flink > Issue Type: Sub-task > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table > SQL / Ecosystem >Reporter: Jark Wu >Assignee: CaoZhen >Priority: Major > Labels: auto-unassigned, stale-assigned > Attachments: image-2022-02-09-17-29-22-551.png, > image-2022-02-09-17-30-37-910.png > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] godfreyhe commented on a change in pull request #18363: [Flink-25600][table-planner] Support new statement set syntax in sql client and update docs
godfreyhe commented on a change in pull request #18363: URL: https://github.com/apache/flink/pull/18363#discussion_r805170428 ## File path: flink-table/flink-sql-client/src/test/resources/sql/set.q ## @@ -48,6 +48,7 @@ set; 'pipeline.jars' = '' 'rest.port' = '$VAR_REST_PORT' 'table.exec.sink.legacy-cast-behaviour' = 'DISABLED' +'table.optimizer.allow-partial-parse' = 'true' Review comment: I do not think we should support it now because table env api does not support parsing multiple line now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] RocMarshal commented on a change in pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
RocMarshal commented on a change in pull request #18718:
URL: https://github.com/apache/flink/pull/18718#discussion_r805168082
##
File path: docs/content.zh/docs/connectors/datastream/filesystem.md
##
@@ -28,39 +28,34 @@ specific language governing permissions and limitations
under the License.
-->
-# FileSystem
+# 文件系统
-This connector provides a unified Source and Sink for `BATCH` and `STREAMING`
that reads or writes (partitioned) files to file systems
-supported by the [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}). This filesystem
-connector provides the same guarantees for both `BATCH` and `STREAMING` and is
designed to provide exactly-once semantics for `STREAMING` execution.
+连接器提供了统一的 Source 和 Sink 在 `BATCH` 和 `STREAMING` 两种模式下，连接文件系统对文件进行读或写（包含分区文件）
+由 [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}) 提供支持。文件系统连接器同时为 `BATCH` 和
`STREAMING` 模式提供了相同的保证，并且被设计的执行过程为 `STREAMING` 模式提供了精确一次（exactly-once）语义。
Review comment:
```suggestion
文件系统连接器为 `BATCH` 和 `STREAMING` 模式提供了相同的保证，而且对 `STREAMING`
模式执行提供了精确一次（exactly-once）语义保证。
```
##
File path: docs/content.zh/docs/connectors/datastream/filesystem.md
##
@@ -28,39 +28,34 @@ specific language governing permissions and limitations
under the License.
-->
-# FileSystem
+# 文件系统
-This connector provides a unified Source and Sink for `BATCH` and `STREAMING`
that reads or writes (partitioned) files to file systems
-supported by the [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}). This filesystem
-connector provides the same guarantees for both `BATCH` and `STREAMING` and is
designed to provide exactly-once semantics for `STREAMING` execution.
+连接器提供了统一的 Source 和 Sink 在 `BATCH` 和 `STREAMING` 两种模式下，连接文件系统对文件进行读或写（包含分区文件）
Review comment:
```
连接器提供了 `BATCH` 模式和 `STREAMING` 模式统一的 Source 和 Sink。[Flink `FileSystem`
abstraction]({{< ref "docs/deployment/filesystems/overview" >}})
支持连接器对文件系统进行（分区）文件读写。
```
A minor comment. Maybe you would translate it in a better way.
##
File path: docs/content.zh/docs/connectors/datastream/filesystem.md
##
@@ -28,39 +28,34 @@ specific language governing permissions and limitations
under the License.
-->
-# FileSystem
+# 文件系统
-This connector provides a unified Source and Sink for `BATCH` and `STREAMING`
that reads or writes (partitioned) files to file systems
-supported by the [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}). This filesystem
-connector provides the same guarantees for both `BATCH` and `STREAMING` and is
designed to provide exactly-once semantics for `STREAMING` execution.
+连接器提供了统一的 Source 和 Sink 在 `BATCH` 和 `STREAMING` 两种模式下，连接文件系统对文件进行读或写（包含分区文件）
+由 [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}) 提供支持。文件系统连接器同时为 `BATCH` 和
`STREAMING` 模式提供了相同的保证，并且被设计的执行过程为 `STREAMING` 模式提供了精确一次（exactly-once）语义。
-The connector supports reading and writing a set of files from any
(distributed) file system (e.g. POSIX, S3, HDFS)
-with a [format]({{< ref "docs/connectors/datastream/formats/overview" >}})
(e.g., Avro, CSV, Parquet),
-and produces a stream or records.
+连接器支持从任何文件系统（包括分布式的，例如，POSIX、 S3、 HDFS）通过某种数据格式 [format]({{< ref
"docs/connectors/datastream/formats/overview" >}}) (例如，Avro、 CSV、 Parquet)
生成一个流或者多个记录，然后对文件进行读取或写入。
Review comment:
```suggestion
连接器支持对任意（分布式的）文件系统（例如，POSIX、 S3、 HDFS）以某种数据格式 [format]({{< ref
"docs/connectors/datastream/formats/overview" >}}) (例如，Avro、 CSV、 Parquet)
对文件进行写入，或者读取后生成数据流或一组记录。
```
##
File path: docs/content.zh/docs/connectors/datastream/filesystem.md
##
@@ -28,39 +28,34 @@ specific language governing permissions and limitations
under the License.
-->
-# FileSystem
+# 文件系统
-This connector provides a unified Source and Sink for `BATCH` and `STREAMING`
that reads or writes (partitioned) files to file systems
-supported by the [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}). This filesystem
-connector provides the same guarantees for both `BATCH` and `STREAMING` and is
designed to provide exactly-once semantics for `STREAMING` execution.
+连接器提供了统一的 Source 和 Sink 在 `BATCH` 和 `STREAMING` 两种模式下，连接文件系统对文件进行读或写（包含分区文件）
+由 [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}) 提供支持。文件系统连接器同时为 `BATCH` 和
`STREAMING` 模式提供了相同的保证，并且被设计的执行过程为 `STREAMING` 模式提供了精确一次（exactly-once）语义。
-The connector supports reading and writing a set of files from any
(distributed) file system (e.g. POSIX, S3, HDFS)
-with a [format]({{< ref "docs/connectors/datastream/formats/overview" >}})
(e.g., Avro, CSV, Parquet),
-and produces a stream or records.
+连接器支持从任何文件系统（包括分布式的，例如，POSIX、 S3、 HDFS）通过某种数据格式 [format]({{< ref
"docs/connectors/datastream/formats/overview" >}}) (例如，Avro、 CSV、 Parquet)
生成一个流或者多个记录，然后对文件进行读取或写入。
-##
[GitHub] [flink] RocMarshal commented on pull request #18480: [FLINK-25789][docs-zh] Translate the formats/hadoop page into Chinese.
RocMarshal commented on pull request #18480: URL: https://github.com/apache/flink/pull/18480#issuecomment-1037264660 @leonardBang Could you help me to merge it if there's nothing Inappropriate？ Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18653: [FLINK-25825][connector-jdbc] MySqlCatalogITCase fails on azure
flinkbot edited a comment on pull request #18653: URL: https://github.com/apache/flink/pull/18653#issuecomment-1032212433 ## CI report: * 1950517b6aab421fbd331d1261ab3464179a2d7d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31196) * 66ed23d8cb6f29ca7188fd4bd39060329cd74f61 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18653: [FLINK-25825][connector-jdbc] MySqlCatalogITCase fails on azure
flinkbot edited a comment on pull request #18653: URL: https://github.com/apache/flink/pull/18653#issuecomment-1032212433 ## CI report: * 1950517b6aab421fbd331d1261ab3464179a2d7d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31196) * b9a8fa888bc2d9eac0de1136b01e792120da78da UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18653: [FLINK-25825][connector-jdbc] MySqlCatalogITCase fails on azure
flinkbot edited a comment on pull request #18653: URL: https://github.com/apache/flink/pull/18653#issuecomment-1032212433 ## CI report: * 1950517b6aab421fbd331d1261ab3464179a2d7d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31196) * b9a8fa888bc2d9eac0de1136b01e792120da78da Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31318) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] RocMarshal commented on a change in pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
RocMarshal commented on a change in pull request #18718:
URL: https://github.com/apache/flink/pull/18718#discussion_r805173884
##
File path: docs/content.zh/docs/connectors/datastream/filesystem.md
##
@@ -94,33 +88,29 @@ final FileSource source =
{{< /tab >}}
{{< /tabs >}}
-### Format Types
+### 格式化类型
-The reading of each file happens through file readers defined by file formats.
-These define the parsing logic for the contents of the file. There are
multiple classes that the source supports.
-The interfaces are a tradeoff between simplicity of implementation and
flexibility/efficiency.
+每个文件的读取都是通过定义了某种文件格式的文件阅读器进行读取的。
+它们定义了解析和读取文件内容的逻辑。数据源支持多个解析类。
+这些接口是实现简单性和灵活性/效率之间的折衷。
-* A `StreamFormat` reads the contents of a file from a file stream. It is the
simplest format to implement,
- and provides many features out-of-the-box (like checkpointing logic) but is
limited in the optimizations it can apply
- (such as object reuse, batching, etc.).
+* `StreamFormat` 从文件流中读取文件内容。它是最简单的格式实现，
+ 并且提供了许多现成的功能（如检查点逻辑），但是在可应用的优化方面受到限制（例如对象重用，批处理，等等）。
-* A `BulkFormat` reads batches of records from a file at a time.
- It is the most "low level" format to implement, but offers the greatest
flexibility to optimize the implementation.
+* `BulkFormat` 从文件中一次读取一批记录。
+ 它是最 "低层次" 的格式实现，但是它提供了最大的灵活性来实现优化。
Review comment:
nit:
```
它虽然是最 "底层" 的格式实现，但是提供了优化实现的最大灵活性。
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18707: [FLINK-25995][table-planner] Make implicit assumption of SQL local hash explicit
flinkbot edited a comment on pull request #18707: URL: https://github.com/apache/flink/pull/18707#issuecomment-1034994010 ## CI report: * f1d2773515b98c1599e3e1ebe457598453347ec1 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31317) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] RocMarshal commented on a change in pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
RocMarshal commented on a change in pull request #18718:
URL: https://github.com/apache/flink/pull/18718#discussion_r805170553
##
File path: docs/content.zh/docs/connectors/datastream/filesystem.md
##
@@ -28,39 +28,34 @@ specific language governing permissions and limitations
under the License.
-->
-# FileSystem
+# 文件系统
-This connector provides a unified Source and Sink for `BATCH` and `STREAMING`
that reads or writes (partitioned) files to file systems
-supported by the [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}). This filesystem
-connector provides the same guarantees for both `BATCH` and `STREAMING` and is
designed to provide exactly-once semantics for `STREAMING` execution.
+连接器提供了统一的 Source 和 Sink 在 `BATCH` 和 `STREAMING` 两种模式下，连接文件系统对文件进行读或写（包含分区文件）
+由 [Flink `FileSystem` abstraction]({{< ref
"docs/deployment/filesystems/overview" >}}) 提供支持。文件系统连接器同时为 `BATCH` 和
`STREAMING` 模式提供了相同的保证，并且被设计的执行过程为 `STREAMING` 模式提供了精确一次（exactly-once）语义。
-The connector supports reading and writing a set of files from any
(distributed) file system (e.g. POSIX, S3, HDFS)
-with a [format]({{< ref "docs/connectors/datastream/formats/overview" >}})
(e.g., Avro, CSV, Parquet),
-and produces a stream or records.
+连接器支持从任何文件系统（包括分布式的，例如，POSIX、 S3、 HDFS）通过某种数据格式 [format]({{< ref
"docs/connectors/datastream/formats/overview" >}}) (例如，Avro、 CSV、 Parquet)
生成一个流或者多个记录，然后对文件进行读取或写入。
-## File Source
+## 文件数据源
-The `File Source` is based on the [Source API]({{< ref
"docs/dev/datastream/sources" >}}#the-data-source-api),
-a unified data source that reads files - both in batch and in streaming mode.
-It is divided into the following two parts: `SplitEnumerator` and
`SourceReader`.
+ `File Source` 是基于 [Source API]({{< ref "docs/dev/datastream/sources"
>}}#the-data-source-api) 的，一种读取文件的统一数据源 - 同时支持批和流两种模式。
+可以分为以下两个部分：`SplitEnumerator` 和 `SourceReader`。
-* `SplitEnumerator` is responsible for discovering and identifying the files
to read and assigns them to the `SourceReader`.
-* `SourceReader` requests the files it needs to process and reads the file
from the filesystem.
+* `SplitEnumerator` 负责发现和识别要读取的文件，并且指派这些文件给 `SourceReader`。
+* `SourceReader` 请求需要处理的文件，并从文件系统中读取该文件。
-You will need to combine the File Source with a [format]({{< ref
"docs/connectors/datastream/formats/overview" >}}), which allows you to
-parse CSV, decode AVRO, or read Parquet columnar files.
+你可能需要使用某个格式 [format]({{< ref "docs/connectors/datastream/formats/overview"
>}}) 合并文件源，允许你读取 CSV、 AVRO、 Parquet 数据格式文件。
Review comment:
nit:
```suggestion
你可能需要指定某种 [format]({{< ref "docs/connectors/datastream/formats/overview"
>}}) 与 `File Source` 联合进行解析 CSV、解码AVRO、或者读取 Parquet 列式文件。
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink-statefun-playground] tillrohrmann opened a new pull request #25: [WIP][FLINK-XXXX] Add Playground ingress/egress that allows to ingest and consume messages via curl
tillrohrmann opened a new pull request #25: URL: https://github.com/apache/flink-statefun-playground/pull/25 The PlaygroundIngress and PlaygroundIngress spin up a web server that allows to ingest and consume messages that are kept in memory via curl. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18653: [FLINK-25825][connector-jdbc] MySqlCatalogITCase fails on azure
flinkbot edited a comment on pull request #18653: URL: https://github.com/apache/flink/pull/18653#issuecomment-1032212433 ## CI report: * b9a8fa888bc2d9eac0de1136b01e792120da78da Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31318) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) * 3a33bd0507df0e6aece7dd976318d1d81c04ce84 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) * f54d567b9a8557f54b3ffac7dc59eb91c8e1f02e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) * f54d567b9a8557f54b3ffac7dc59eb91c8e1f02e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) * f54d567b9a8557f54b3ffac7dc59eb91c8e1f02e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) * f54d567b9a8557f54b3ffac7dc59eb91c8e1f02e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * 128e9b4a394963cb6189259fb3bc9caa23c540f0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31293) * f54d567b9a8557f54b3ffac7dc59eb91c8e1f02e Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31319) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (FLINK-26098) TableAPI does not forward idleness configuration from DataStream
Till Rohrmann created FLINK-26098:
-
Summary: TableAPI does not forward idleness configuration from
DataStream
Key: FLINK-26098
URL: https://issues.apache.org/jira/browse/FLINK-26098
Project: Flink
Issue Type: Bug
Components: Table SQL / API
Affects Versions: 1.14.3, 1.15.0
Reporter: Till Rohrmann
The TableAPI does not forward the idleness configuration from a DataStream
source. That can lead to the halt of processing if all sources are idle because
{{WatermarkAssignerOperator}} [1] will never set a channel to active again. The
only way to mitigate the problem is to explicitly configure the idleness for
table sources via {{table.exec.source.idle-timeout}}. Configuring this value is
actually not easy because creating a {{StreamExecutionEnvironment}} via
{{create(StreamExecutionEnvironment, TableConfig)}} is deprecated.
[1]
https://github.com/apache/flink/blob/master/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/operators/wmassigners/WatermarkAssignerOperator.java#L103
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] JingGe commented on pull request #18681: [FLINK-26032][streaming] check explicit env allowed on StreamExecutionEnvironment own.
JingGe commented on pull request #18681: URL: https://github.com/apache/flink/pull/18681#issuecomment-1037439484 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18681: [FLINK-26032][streaming] check explicit env allowed on StreamExecutionEnvironment own.
flinkbot edited a comment on pull request #18681: URL: https://github.com/apache/flink/pull/18681#issuecomment-1033535247 ## CI report: * 77e43dbd211dc9274041996d5a9d24607dc9f953 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31299) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] dannycranmer merged pull request #18603: [FLINK-25610][connector/firehose] Adding table api base for kinesis firehose
dannycranmer merged pull request #18603: URL: https://github.com/apache/flink/pull/18603 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18681: [FLINK-26032][streaming] check explicit env allowed on StreamExecutionEnvironment own.
flinkbot edited a comment on pull request #18681: URL: https://github.com/apache/flink/pull/18681#issuecomment-1033535247 ## CI report: * 77e43dbd211dc9274041996d5a9d24607dc9f953 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31299) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (FLINK-25610) [FLIP-171] Kinesis Firehose implementation of Async Sink Table API
[
https://issues.apache.org/jira/browse/FLINK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Cranmer resolved FLINK-25610.
---
Resolution: Fixed
Merged
https://github.com/apache/flink/commit/5c9d0d699b31f76180308f165a7fcba4f01ef963,
https://github.com/apache/flink/commit/e8d06c6e7faf69290a6c21fa4bcd17fe42f4e754,
https://github.com/apache/flink/commit/675931d2eae9715dffd8c518a4c0ce434d14c0c1
> [FLIP-171] Kinesis Firehose implementation of Async Sink Table API
> --
>
> Key: FLINK-25610
> URL: https://issues.apache.org/jira/browse/FLINK-25610
> Project: Flink
> Issue Type: New Feature
> Components: Connectors / Kinesis
>Reporter: Ahmed Hamdy
>Assignee: Ahmed Hamdy
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.15.0
>
>
> h2. Motivation
> *User stories:*
> As a Flink user, I’d like to use the Table API for the new Kinesis Firehose
> async sink.
> *Scope:*
> * Add a new module for {{flink-connector-kinesis-data-firehose-table}}.
> * Implement a new {{KinesisFirehoseDynamicTableSink}} that uses
> {{KinesisDataFirehoseSink}} Async Implementation and implements
> {{{}AsyncDynamicTableSink{}}}.
> * The implementation introduces Async Sink configurations as optional
> options in the table definition, with default values derived from the
> {{KinesisDataFirehose}} default values.
> * Unit/Integration testing. modify KinesisTableAPI tests for the new
> implementation, add unit tests for {{AsyncDynamicTableSink}} and
> {{KinesisDynamicTableSink}} and {{{}KinesisDynamicTableSinkFactory{}}}.
> * Java / code-level docs.
> * Add documentations for Table Api connector for Kinesis data firehose.
> h2. References
> More details to be found
> [https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18681: [FLINK-26032][streaming] check explicit env allowed on StreamExecutionEnvironment own.
flinkbot edited a comment on pull request #18681: URL: https://github.com/apache/flink/pull/18681#issuecomment-1033535247 ## CI report: * 77e43dbd211dc9274041996d5a9d24607dc9f953 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31299) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18553: [FLINK-25846][FLINK-25848] Async Sink does not gracefully shutdown on Cancel, KDS Sink does not fast fail when invalid configuration
flinkbot edited a comment on pull request #18553: URL: https://github.com/apache/flink/pull/18553#issuecomment-1024127153 ## CI report: * eae81dc84402215df5d19aa0687ae2f4a0e376fd UNKNOWN * f54d567b9a8557f54b3ffac7dc59eb91c8e1f02e Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31319) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
