[GitHub] [flink-statefun-playground] tillrohrmann commented on pull request #25: [FLINK-26155] Add Playground ingress/egress that allows to ingest and consume messages via curl
tillrohrmann commented on pull request #25: URL: https://github.com/apache/flink-statefun-playground/pull/25#issuecomment-1041213981 Merging this PR now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-26151) inprogressfileRecoverable not be clean up after restoring the bucket
[ https://issues.apache.org/jira/browse/FLINK-26151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493046#comment-17493046 ] Yun Gao commented on FLINK-26151: - Thanks [~lovewin99] for reporting the issue! I'll have a look very soon~ > inprogressfileRecoverable not be clean up after restoring the bucket > > > Key: FLINK-26151 > URL: https://issues.apache.org/jira/browse/FLINK-26151 > Project: Flink > Issue Type: Bug > Components: FileSystems >Affects Versions: 1.15.0 >Reporter: WangXiaoyong >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0 > > > In order to clear the previous inProgressFileRecoverable when the checkpoint > is successful, inProgressFileRecoverable will be added to > inProgressFileRecoverablesPerCheckpoint when the checkpoint is started, but > when the bucket is recovered from bucketState, > inProgressFileRecoverablesPerCheckpoint does not record > inProgressFileRecoverable, resulting in inProgressFileRecoverable not be > clean up. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18786: [hotfix][test] add support for field assignability
flinkbot edited a comment on pull request #18786: URL: https://github.com/apache/flink/pull/18786#issuecomment-1040539589 ## CI report: * 6fa8c290984d253ef7408abb6d23d49370c0f4b8 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31580) * 199d94fca6df52f120633c8202b40409e1d7e794 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31615) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (FLINK-25290) Add table source and sink test suite in connector testing framework
[ https://issues.apache.org/jira/browse/FLINK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493045#comment-17493045 ] Hang Ruan edited comment on FLINK-25290 at 2/16/22, 7:57 AM: - [~syhily] The feature about the dataStream sink test suite has already been merged. Please take a look. This ticket still have some details to discuss and will not be contained in the release 1.15. The RP only contains some easy sql tests now, and it is not enough. was (Author: ruanhang1993): [~syhily] The feature about the dataStream sink test suite has already been merged. Please take a look. This ticket still have some details to discuss and will not be contained in the release 1.15. The RP only contains some easy sql test now, and it is not enough. > Add table source and sink test suite in connector testing framework > --- > > Key: FLINK-25290 > URL: https://issues.apache.org/jira/browse/FLINK-25290 > Project: Flink > Issue Type: Improvement >Reporter: Qingsheng Ren >Assignee: Hang Ruan >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18749: [FLINK-26117] Adds GloballyCleanableResource to JobManagerMetricGroup
flinkbot edited a comment on pull request #18749: URL: https://github.com/apache/flink/pull/18749#issuecomment-1038986916 ## CI report: * 75d766a6e13db2b93605a3d7f13fee0abb56aca8 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31556) * 42898fa2dffbc27643dcf3935cfeba219da793a4 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-25290) Add table source and sink test suite in connector testing framework
[ https://issues.apache.org/jira/browse/FLINK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493045#comment-17493045 ] Hang Ruan commented on FLINK-25290: --- [~syhily] The feature about the dataStream sink test suite has already been merged. Please take a look. This ticket still have some details to discuss and will not be contained in the release 1.15. The RP only contains some easy sql test now, and it is not enough. > Add table source and sink test suite in connector testing framework > --- > > Key: FLINK-25290 > URL: https://issues.apache.org/jira/browse/FLINK-25290 > Project: Flink > Issue Type: Improvement >Reporter: Qingsheng Ren >Assignee: Hang Ruan >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18680: [FLINK-25583] Support compacting small files for FileSink.
flinkbot edited a comment on pull request #18680: URL: https://github.com/apache/flink/pull/18680#issuecomment-1033512635 ## CI report: * Unknown: [CANCELED](TBD) * 2ffd741d316346745bd8fe754bb02a73cbf0d0ba Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31614) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-26174) KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
[
https://issues.apache.org/jira/browse/FLINK-26174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Ge updated FLINK-26174:
Affects Version/s: (was: 1.15.0)
> KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
> -
>
> Key: FLINK-26174
> URL: https://issues.apache.org/jira/browse/FLINK-26174
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kinesis
>Reporter: Yun Gao
>Assignee: Jing Ge
>Priority: Blocker
> Labels: test-stability
>
> {code:java}
> Feb 15 19:28:44 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0,
> Time elapsed: 38.14 s <<< FAILURE! - in
> org.apache.flink.architecture.rules.ApiAnnotationRules
> Feb 15 19:28:44 [ERROR]
> ApiAnnotationRules.PUBLIC_EVOLVING_API_METHODS_USE_ONLY_PUBLIC_EVOLVING_API_TYPES
> Time elapsed: 0.391 s <<< FAILURE!
> Feb 15 19:28:44 java.lang.AssertionError:
> Feb 15 19:28:44 Architecture Violation [Priority: MEDIUM] - Rule 'Return and
> argument types of methods annotated with @PublicEvolving must be annotated
> with @Public(Evolving).' was violated (2 times):
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Argument leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Returned leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.assertNoViolation(ArchRule.java:94)
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.check(ArchRule.java:82)
> Feb 15 19:28:44 at
> com.tngtech.archunit.library.freeze.FreezingArchRule.check(FreezingArchRule.java:96)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:159)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:142)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95)
> Feb 15 19:28:44 at java.util.ArrayList.forEach(ArrayList.java:1259)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
>
[jira] [Updated] (FLINK-26174) KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
[
https://issues.apache.org/jira/browse/FLINK-26174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Ge updated FLINK-26174:
Affects Version/s: 1.15.0
> KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
> -
>
> Key: FLINK-26174
> URL: https://issues.apache.org/jira/browse/FLINK-26174
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kinesis
>Affects Versions: 1.15.0
>Reporter: Yun Gao
>Assignee: Jing Ge
>Priority: Blocker
> Labels: test-stability
>
> {code:java}
> Feb 15 19:28:44 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0,
> Time elapsed: 38.14 s <<< FAILURE! - in
> org.apache.flink.architecture.rules.ApiAnnotationRules
> Feb 15 19:28:44 [ERROR]
> ApiAnnotationRules.PUBLIC_EVOLVING_API_METHODS_USE_ONLY_PUBLIC_EVOLVING_API_TYPES
> Time elapsed: 0.391 s <<< FAILURE!
> Feb 15 19:28:44 java.lang.AssertionError:
> Feb 15 19:28:44 Architecture Violation [Priority: MEDIUM] - Rule 'Return and
> argument types of methods annotated with @PublicEvolving must be annotated
> with @Public(Evolving).' was violated (2 times):
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Argument leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Returned leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.assertNoViolation(ArchRule.java:94)
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.check(ArchRule.java:82)
> Feb 15 19:28:44 at
> com.tngtech.archunit.library.freeze.FreezingArchRule.check(FreezingArchRule.java:96)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:159)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:142)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95)
> Feb 15 19:28:44 at java.util.ArrayList.forEach(ArrayList.java:1259)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44
[GitHub] [flink] XComp commented on a change in pull request #18749: [FLINK-26117] Adds GloballyCleanableResource to JobManagerMetricGroup
XComp commented on a change in pull request #18749:
URL: https://github.com/apache/flink/pull/18749#discussion_r807639403
##
File path:
flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/cleanup/LocallyCleanableResource.java
##
@@ -24,12 +24,11 @@
import java.util.concurrent.Executor;
/**
- * {@code LocallyCleanableResource} is supposed to be used by any class that
provides artifacts for
- * a given job that can be cleaned up locally. Artifacts considered to be
local are located on the
- * JobManager instance itself and won't survive a failover scenario. These
artifacts are, in
- * contrast to {@link GloballyCleanableResource} artifacts, going to be
cleaned up even after the
- * job reaches a locally-terminated state.
+ * {@code LocallyCleanableResource} is supposed to be implemented by any class
that provides
+ * artifacts for a given job that need to be cleaned up after the job reached
a local terminal
Review comment:
I created FLINK-26175 to cover the refactoring. Looking at the code of
the `StateHandleStore` implementations, we can actually separate it without
problems. I updated the JavaDoc once more mentioning the workaround in
`DispatcherResourceCleanerFactory` and pointing to this ticket as well. PTAL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] XComp commented on a change in pull request #18749: [FLINK-26117] Adds GloballyCleanableResource to JobManagerMetricGroup
XComp commented on a change in pull request #18749:
URL: https://github.com/apache/flink/pull/18749#discussion_r807639403
##
File path:
flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/cleanup/LocallyCleanableResource.java
##
@@ -24,12 +24,11 @@
import java.util.concurrent.Executor;
/**
- * {@code LocallyCleanableResource} is supposed to be used by any class that
provides artifacts for
- * a given job that can be cleaned up locally. Artifacts considered to be
local are located on the
- * JobManager instance itself and won't survive a failover scenario. These
artifacts are, in
- * contrast to {@link GloballyCleanableResource} artifacts, going to be
cleaned up even after the
- * job reaches a locally-terminated state.
+ * {@code LocallyCleanableResource} is supposed to be implemented by any class
that provides
+ * artifacts for a given job that need to be cleaned up after the job reached
a local terminal
Review comment:
I created FLINK-26175 to cover the refactoring. Looking at the code of
the `StateHandleStore` implementations, we can actually separate it without
problems. I updated the JavaDoc once more mentioning the workaround in
`DispatcherResourceCleanerFactory` and pointing to this ticket as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Assigned] (FLINK-26174) KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
[
https://issues.apache.org/jira/browse/FLINK-26174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Ge reassigned FLINK-26174:
---
Assignee: Jing Ge
> KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
> -
>
> Key: FLINK-26174
> URL: https://issues.apache.org/jira/browse/FLINK-26174
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kinesis
>Affects Versions: 1.15.0
>Reporter: Yun Gao
>Assignee: Jing Ge
>Priority: Blocker
> Labels: test-stability
>
> {code:java}
> Feb 15 19:28:44 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0,
> Time elapsed: 38.14 s <<< FAILURE! - in
> org.apache.flink.architecture.rules.ApiAnnotationRules
> Feb 15 19:28:44 [ERROR]
> ApiAnnotationRules.PUBLIC_EVOLVING_API_METHODS_USE_ONLY_PUBLIC_EVOLVING_API_TYPES
> Time elapsed: 0.391 s <<< FAILURE!
> Feb 15 19:28:44 java.lang.AssertionError:
> Feb 15 19:28:44 Architecture Violation [Priority: MEDIUM] - Rule 'Return and
> argument types of methods annotated with @PublicEvolving must be annotated
> with @Public(Evolving).' was violated (2 times):
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Argument leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Returned leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.assertNoViolation(ArchRule.java:94)
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.check(ArchRule.java:82)
> Feb 15 19:28:44 at
> com.tngtech.archunit.library.freeze.FreezingArchRule.check(FreezingArchRule.java:96)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:159)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:142)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95)
> Feb 15 19:28:44 at java.util.ArrayList.forEach(ArrayList.java:1259)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44
[GitHub] [flink] ruanhang1993 commented on pull request #18496: [FLINK-25289][tests] add sink test suite in connector testframe
ruanhang1993 commented on pull request #18496: URL: https://github.com/apache/flink/pull/18496#issuecomment-1041208998 > This is closed in the commit https://github.com/apache/flink/commit/57e3f03ccd719ed772c983ba335517d95f8f3e6a. You could find it in the events at this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18786: [hotfix][test] add support for field assignability
flinkbot edited a comment on pull request #18786: URL: https://github.com/apache/flink/pull/18786#issuecomment-1040539589 ## CI report: * 6fa8c290984d253ef7408abb6d23d49370c0f4b8 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31580) * 199d94fca6df52f120633c8202b40409e1d7e794 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18680: [FLINK-25583] Support compacting small files for FileSink.
flinkbot edited a comment on pull request #18680: URL: https://github.com/apache/flink/pull/18680#issuecomment-1033512635 ## CI report: * 1e885d354bb156b1598601a9fa6d06cb7972e15c Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31602) * Unknown: [CANCELED](TBD) * 2ffd741d316346745bd8fe754bb02a73cbf0d0ba UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18497: [FLINK-25290][tests] add table tests for connector testframe
flinkbot edited a comment on pull request #18497: URL: https://github.com/apache/flink/pull/18497#issuecomment-1020875715 ## CI report: * 62fe6e2dd02a8d41517588b4fe302678d7875ec2 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=30472) * fffee92067f382df56510083fdbc713008faf0b4 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31613) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (FLINK-26166) flink-runtime-web fails to compile if newline is cr lf
[
https://issues.apache.org/jira/browse/FLINK-26166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi reassigned FLINK-26166:
-
Assignee: Gabor Somogyi
> flink-runtime-web fails to compile if newline is cr lf
> --
>
> Key: FLINK-26166
> URL: https://issues.apache.org/jira/browse/FLINK-26166
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Web Frontend
>Affects Versions: 1.16.0
>Reporter: Gabor Somogyi
>Assignee: Gabor Somogyi
>Priority: Minor
>
> Normally I'm developing on linux based system but sometimes reviewing on
> Windows based machines. Compile blows up in the following way:
> {code:java}
> [INFO]
> d:\projects\flink\flink-runtime-web\web-dashboard\src\@types\d3-flame-graph\index.d.ts
> [INFO]1:3 error Delete `â??` prettier/prettier
> ...
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] JingGe commented on pull request #18774: [FLINK-25701][kafka] Add Flink API annotation to all connector classes based on the new Source/Sink design
JingGe commented on pull request #18774: URL: https://github.com/apache/flink/pull/18774#issuecomment-1041207940 @fapaul would you like to merge this PR? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] pltbkd commented on pull request #18680: [FLINK-25583] Support compacting small files for FileSink.
pltbkd commented on pull request #18680: URL: https://github.com/apache/flink/pull/18680#issuecomment-1041207282 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-26175) Make local cleanup being called in global cleanup situations
[
https://issues.apache.org/jira/browse/FLINK-26175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Pohl updated FLINK-26175:
--
Description:
We introduce new interfaces for local cleanup and global cleanup in
FLINK-25432. The initial plan was to call them independently of each other. The
motivation behind it was to allow independent cleanup logic (e.g. in the
{{DefaultJobGraphStore}} for releasing and deleting the data from the
{{StateHandleStore}}).
This can be improved by adding an order to cleanup and calling the local
cleanup on each resource before calling the corresponding global cleanup in the
Dispatcher.
This works under the assumption that it's ok to keep the resource in an
inconsistent state during cleanup (i.e. it's ok for the resource to be in a
state were the local artifacts are already cleaned but the global artifacts are
not). That holds true because of how the {{Dispatcher}} interacts with the
{{JobResultStore}}. It functions as a transaction manager for the cleanup here.
was:
We introduce new interfaces for local cleanup and global cleanup in
FLINK-25432. The initial plan was to call them independently of each other. The
motivation behind it was to allow independent cleanup logic (e.g. in the
`DefaultJobGraphStore` for releasing and deleting the data from the
`StateHandleStore`).
This can be improved by adding an order to cleanup and calling the local
cleanup on each resource before calling the corresponding global cleanup in the
Dispatcher.
This works under the assumption that it's ok to keep the resource in an
inconsistent state during cleanup (i.e. it's ok for the resource to be in a
state were the local artifacts are already cleaned but the global artifacts are
not). That holds true because of how the {{Dispatcher}} interacts with the
{{JobResultStore}}. It functions as a transaction manager for the cleanup here.
> Make local cleanup being called in global cleanup situations
>
>
> Key: FLINK-26175
> URL: https://issues.apache.org/jira/browse/FLINK-26175
> Project: Flink
> Issue Type: Technical Debt
> Components: Runtime / Coordination
>Affects Versions: 1.16.0
>Reporter: Matthias Pohl
>Priority: Major
>
> We introduce new interfaces for local cleanup and global cleanup in
> FLINK-25432. The initial plan was to call them independently of each other.
> The motivation behind it was to allow independent cleanup logic (e.g. in the
> {{DefaultJobGraphStore}} for releasing and deleting the data from the
> {{StateHandleStore}}).
> This can be improved by adding an order to cleanup and calling the local
> cleanup on each resource before calling the corresponding global cleanup in
> the Dispatcher.
> This works under the assumption that it's ok to keep the resource in an
> inconsistent state during cleanup (i.e. it's ok for the resource to be in a
> state were the local artifacts are already cleaned but the global artifacts
> are not). That holds true because of how the {{Dispatcher}} interacts with
> the {{JobResultStore}}. It functions as a transaction manager for the cleanup
> here.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Created] (FLINK-26175) Make local cleanup being called in global cleanup situations
Matthias Pohl created FLINK-26175:
-
Summary: Make local cleanup being called in global cleanup
situations
Key: FLINK-26175
URL: https://issues.apache.org/jira/browse/FLINK-26175
Project: Flink
Issue Type: Technical Debt
Components: Runtime / Coordination
Affects Versions: 1.16.0
Reporter: Matthias Pohl
We introduce new interfaces for local cleanup and global cleanup in
FLINK-25432. The initial plan was to call them independently of each other. The
motivation behind it was to allow independent cleanup logic (e.g. in the
`DefaultJobGraphStore` for releasing and deleting the data from the
`StateHandleStore`).
This can be improved by adding an order to cleanup and calling the local
cleanup on each resource before calling the corresponding global cleanup in the
Dispatcher.
This works under the assumption that it's ok to keep the resource in an
inconsistent state during cleanup (i.e. it's ok for the resource to be in a
state were the local artifacts are already cleaned but the global artifacts are
not). That holds true because of how the {{Dispatcher}} interacts with the
{{JobResultStore}}. It functions as a transaction manager for the cleanup here.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18790: [FLINK-26018][connector/common] Create per-split output on split addition in SourceOperator
flinkbot edited a comment on pull request #18790: URL: https://github.com/apache/flink/pull/18790#issuecomment-1041025841 ## CI report: * f11bc4e5c50b90d5410db10c4ae532ca888a3a48 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31590) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18497: [FLINK-25290][tests] add table tests for connector testframe
flinkbot edited a comment on pull request #18497: URL: https://github.com/apache/flink/pull/18497#issuecomment-1020875715 ## CI report: * 62fe6e2dd02a8d41517588b4fe302678d7875ec2 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=30472) * fffee92067f382df56510083fdbc713008faf0b4 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-26033) In KafkaConnector, when 'sink.partitioner' is configured as 'round-robin', it does not take effect
[
https://issues.apache.org/jira/browse/FLINK-26033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martijn Visser updated FLINK-26033:
---
Affects Version/s: 1.12.7
1.11.6
> In KafkaConnector, when 'sink.partitioner' is configured as 'round-robin', it
> does not take effect
> --
>
> Key: FLINK-26033
> URL: https://issues.apache.org/jira/browse/FLINK-26033
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.13.3, 1.11.6, 1.12.7, 1.14.3
>Reporter: shizhengchao
>Priority: Major
>
> In KafkaConnector, when 'sink.partitioner' is configured as 'round-robin', it
> does not take effect. Flink treats 'default' and 'round-robin' as the same
> strategy.
> {code:java}
> //代码占位符
> public static Optional>
> getFlinkKafkaPartitioner(
> ReadableConfig tableOptions, ClassLoader classLoader) {
> return tableOptions
> .getOptional(SINK_PARTITIONER)
> .flatMap(
> (String partitioner) -> {
> switch (partitioner) {
> case SINK_PARTITIONER_VALUE_FIXED:
> return Optional.of(new
> FlinkFixedPartitioner<>());
> case SINK_PARTITIONER_VALUE_DEFAULT:
> case SINK_PARTITIONER_VALUE_ROUND_ROBIN:
> return Optional.empty();
> // Default fallback to full class name of the
> partitioner.
> default:
> return Optional.of(
> initializePartitioner(partitioner,
> classLoader));
> }
> });
> } {code}
> They both use kafka's default partitioner, but the actual There are two
> scenarios for the partition on DefaultPartitioner:
> 1. Random when there is no key
> 2. When there is a key, take the modulo according to the key
> {code:java}
> // org.apache.kafka.clients.producer.internals.DefaultPartitioner
> public int partition(String topic, Object key, byte[] keyBytes, Object value,
> byte[] valueBytes, Cluster cluster) {
> if (keyBytes == null) {
> // Random when there is no key
> return stickyPartitionCache.partition(topic, cluster);
> }
> List partitions = cluster.partitionsForTopic(topic);
> int numPartitions = partitions.size();
> // hash the keyBytes to choose a partition
> return Utils.toPositive(Utils.murmur2(keyBytes)) % numPartitions;
> } {code}
> Therefore, KafkaConnector does not have a round-robin strategy.But we can
> borrow from kafka's RoundRobinPartitioner
> {code:java}
> //代码占位符
> public class RoundRobinPartitioner implements Partitioner {
> private final ConcurrentMap topicCounterMap = new
> ConcurrentHashMap<>();
> public void configure(Map configs) {}
> /**
> * Compute the partition for the given record.
> *
> * @param topic The topic name
> * @param key The key to partition on (or null if no key)
> * @param keyBytes serialized key to partition on (or null if no key)
> * @param value The value to partition on or null
> * @param valueBytes serialized value to partition on or null
> * @param cluster The current cluster metadata
> */
> @Override
> public int partition(String topic, Object key, byte[] keyBytes, Object
> value, byte[] valueBytes, Cluster cluster) {
> List partitions = cluster.partitionsForTopic(topic);
> int numPartitions = partitions.size();
> int nextValue = nextValue(topic);
> List availablePartitions =
> cluster.availablePartitionsForTopic(topic);
> if (!availablePartitions.isEmpty()) {
> int part = Utils.toPositive(nextValue) %
> availablePartitions.size();
> return availablePartitions.get(part).partition();
> } else {
> // no partitions are available, give a non-available partition
> return Utils.toPositive(nextValue) % numPartitions;
> }
> }
> private int nextValue(String topic) {
> AtomicInteger counter = topicCounterMap.computeIfAbsent(topic, k -> {
> return new AtomicInteger(0);
> });
> return counter.getAndIncrement();
> }
> public void close() {}
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18790: [FLINK-26018][connector/common] Create per-split output on split addition in SourceOperator
flinkbot edited a comment on pull request #18790: URL: https://github.com/apache/flink/pull/18790#issuecomment-1041025841 ## CI report: * f11bc4e5c50b90d5410db10c4ae532ca888a3a48 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31590) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] MartijnVisser commented on pull request #18790: [FLINK-26018][connector/common] Create per-split output on split addition in SourceOperator
MartijnVisser commented on pull request #18790: URL: https://github.com/apache/flink/pull/18790#issuecomment-1041200353 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (FLINK-26015) FileSystemJobResultStore fails to access Minio
[
https://issues.apache.org/jira/browse/FLINK-26015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Pohl resolved FLINK-26015.
---
Fix Version/s: 1.15.0
Resolution: Fixed
master:
*
[d62be2e4465f93a21d077acc34972358db961f40|https://github.com/apache/flink/commit/d62be2e4465f93a21d077acc34972358db961f40]
*
[0d0a3acede9f1d5790368860ad5bdb330f9b8155|https://github.com/apache/flink/commit/0d0a3acede9f1d5790368860ad5bdb330f9b8155]
*
[23db91f93e14f7dfa00715d38356cac3dab5fdfd|https://github.com/apache/flink/commit/23db91f93e14f7dfa00715d38356cac3dab5fdfd]
> FileSystemJobResultStore fails to access Minio
> --
>
> Key: FLINK-26015
> URL: https://issues.apache.org/jira/browse/FLINK-26015
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Affects Versions: 1.15.0
>Reporter: Matthias Pohl
>Assignee: Matthias Pohl
>Priority: Critical
> Labels: pull-request-available
> Fix For: 1.15.0
>
> Attachments: failure.log.gz
>
>
> We're experiencing issues with accessing Minio-backed filesystems (probably
> s3 object stores in general). The base directory appears to be not created.
> {code:java}
> 2022-02-08 13:13:31,682 ERROR
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint[] - Fatal error
> occurred in the cluster entrypoint.
> java.util.concurrent.CompletionException:
> org.apache.flink.util.FlinkRuntimeException: Could not retrieve JobResults of
> globally-terminated jobs from JobResultStore
> at
> java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
> ~[?:1.8.0_322]
> at
> java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
> [?:1.8.0_322]
> at
> java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)
> [?:1.8.0_322]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_322]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_322]
> at java.lang.Thread.run(Thread.java:750) [?:1.8.0_322]
> Caused by: org.apache.flink.util.FlinkRuntimeException: Could not retrieve
> JobResults of globally-terminated jobs from JobResultStore
> at
> org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess.getDirtyJobResults(SessionDispatcherLeaderProcess.java:186)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
> org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess.supplyUnsynchronizedIfRunning(AbstractDispatcherLeaderProcess.java:198)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
> org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess.getDirtyJobResultsIfRunning(SessionDispatcherLeaderProcess.java:178)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
> java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
> ~[?:1.8.0_322]
> ... 3 more
> Caused by: java.io.FileNotFoundException: No such file or directory:
> s3://store/myorg/myscope/3aa35e65-df86-4b16-8cc7-7c75af879317-test-job-name-a/ha/job-result-store/default
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2344)
> ~[?:?]
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2226)
> ~[?:?]
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2160)
> ~[?:?]
> at
> org.apache.flink.fs.s3hadoop.common.HadoopFileSystem.getFileStatus(HadoopFileSystem.java:85)
> ~[?:?]
> at
> org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.getFileStatus(PluginFileSystemFactory.java:105)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
> org.apache.flink.runtime.highavailability.FileSystemJobResultStore.getDirtyResultsInternal(FileSystemJobResultStore.java:158)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
> org.apache.flink.runtime.highavailability.AbstractThreadsafeJobResultStore.withReadLock(AbstractThreadsafeJobResultStore.java:118)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
> org.apache.flink.runtime.highavailability.AbstractThreadsafeJobResultStore.getDirtyResults(AbstractThreadsafeJobResultStore.java:100)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
> org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess.getDirtyJobResults(SessionDispatcherLeaderProcess.java:184)
> ~[flink-dist-flink-nightly.jar:flink-nightly]
> at
>
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31611) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] XComp merged pull request #18692: [FLINK-26015] Fixes object store bug
XComp merged pull request #18692: URL: https://github.com/apache/flink/pull/18692 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18794: [hotfix] Refactor the name of builder method
flinkbot edited a comment on pull request #18794: URL: https://github.com/apache/flink/pull/18794#issuecomment-1041190242 ## CI report: * a2c7b54f6037934901e399450cb2b71d1bf82175 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31610) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #18794: [hotfix] Refactor the name of builder method
flinkbot commented on pull request #18794: URL: https://github.com/apache/flink/pull/18794#issuecomment-1041190232 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-25537) [JUnit5 Migration] Module: flink-core
[ https://issues.apache.org/jira/browse/FLINK-25537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493033#comment-17493033 ] Aiden Gong commented on FLINK-25537: Hi,[~renqs] ,I am willing to resolve this.Can you assigne to me?Thank you. > [JUnit5 Migration] Module: flink-core > - > > Key: FLINK-25537 > URL: https://issues.apache.org/jira/browse/FLINK-25537 > Project: Flink > Issue Type: Sub-task > Components: API / Core >Reporter: Qingsheng Ren >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] leo65535 opened a new pull request #18794: [hotfix] Refactor the name of builder method
leo65535 opened a new pull request #18794: URL: https://github.com/apache/flink/pull/18794 ## What is the purpose of the change It's better use `build` in builder class. ## Verifying this change This change is a trivial rework / code cleanup without any test coverage. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (yes / no) - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (yes / no) - The serializers: (yes / no / don't know) - The runtime per-record code paths (performance sensitive): (yes / no / don't know) - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know) - The S3 file system connector: (yes / no / don't know) ## Documentation - Does this pull request introduce a new feature? (yes / no) - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink-ml] yunfengzhou-hub opened a new pull request #59: [hotfix] Fix version and branch info of docs in release 2.0
yunfengzhou-hub opened a new pull request #59: URL: https://github.com/apache/flink-ml/pull/59 ## What is the purpose of the change Fix version and branch info of docs in release 2.0 ## Brief change log - Change version number from `2.0.0` to `2.0` - Change references to Flink ML Github repo from master branch to branch `release-2.0` ## Verifying this change N/A ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (no) - The public API, i.e., is any changed class annotated with @Public(Evolving): (no) ## Documentation - Does this pull request introduce a new feature? (no) - If yes, how is the feature documented? (N/A) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18721: [FLINK-24474] Bind Jobmanager and Taskmanager RPC host addresses to localhost by default
flinkbot edited a comment on pull request #18721: URL: https://github.com/apache/flink/pull/18721#issuecomment-1035971992 ## CI report: * 16573d2282376f1f4049a18d285fbece4569683b Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31579) * 6c4559d8d6fd5c183f30f89a74d0e457a8f46128 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31609) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18785: [FLINK-26167][table-planner] Explicitly set the partitioner for the sql operators whose shuffle and sort are removed
flinkbot edited a comment on pull request #18785: URL: https://github.com/apache/flink/pull/18785#issuecomment-1040524147 ## CI report: * 896383d69cc23dc38fa73e124538644de4db15aa Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31589) * 50789f74f16c2bd3e42a61754f426877a3376056 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31608) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18721: [FLINK-24474] Bind Jobmanager and Taskmanager RPC host addresses to localhost by default
flinkbot edited a comment on pull request #18721: URL: https://github.com/apache/flink/pull/18721#issuecomment-1035971992 ## CI report: * 16573d2282376f1f4049a18d285fbece4569683b Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31579) * 6c4559d8d6fd5c183f30f89a74d0e457a8f46128 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18785: [FLINK-26167][table-planner] Explicitly set the partitioner for the sql operators whose shuffle and sort are removed
flinkbot edited a comment on pull request #18785: URL: https://github.com/apache/flink/pull/18785#issuecomment-1040524147 ## CI report: * 9282d2538dc9e9bfb0be8ab81b7928fc4230f924 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31574) * 896383d69cc23dc38fa73e124538644de4db15aa Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31589) * 50789f74f16c2bd3e42a61754f426877a3376056 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] wangyang0918 merged pull request #18450: [FLINK-25053][docs] Document how to use the usrlib to load code in the user code class loader
wangyang0918 merged pull request #18450: URL: https://github.com/apache/flink/pull/18450 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] wangyang0918 commented on pull request #18450: [FLINK-25053][docs] Document how to use the usrlib to load code in the user code class loader
wangyang0918 commented on pull request #18450: URL: https://github.com/apache/flink/pull/18450#issuecomment-1041180839 Merging this PR now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink-ml] yunfengzhou-hub opened a new pull request #58: [FLINK-26100][docs] Set up Flink ML Document Website
yunfengzhou-hub opened a new pull request #58: URL: https://github.com/apache/flink-ml/pull/58 ## What is the purpose of the change - Set up Flink ML Document Website ## Brief change log - Add `docs` folder containing all configurations needed to setup the framework for Flink ML's document website. - Add basic documentation about example operator, quick start and release announcement blog. - Add guidelines to build and start the website, as well as to contribute documents to `docs` folder in README. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (no) - The public API, i.e., is any changed class annotated with @public(Evolving): (no) - Does this pull request introduce a new feature? (no) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18789: [FLINK-26168][runtime] The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner
flinkbot edited a comment on pull request #18789: URL: https://github.com/apache/flink/pull/18789#issuecomment-1040944258 ## CI report: * cdab9f7d140989714263bc2a4e1a0908bb444a12 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31586) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18789: [FLINK-26168][runtime] The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner
flinkbot edited a comment on pull request #18789: URL: https://github.com/apache/flink/pull/18789#issuecomment-1040944258 ## CI report: * cdab9f7d140989714263bc2a4e1a0908bb444a12 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31586) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] wanglijie95 commented on pull request #18789: [FLINK-26168][runtime] The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner
wanglijie95 commented on pull request #18789: URL: https://github.com/apache/flink/pull/18789#issuecomment-1041174285 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18789: [FLINK-26168][runtime] The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner
flinkbot edited a comment on pull request #18789: URL: https://github.com/apache/flink/pull/18789#issuecomment-1040944258 ## CI report: * cdab9f7d140989714263bc2a4e1a0908bb444a12 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31586) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] imaffe commented on pull request #18496: [FLINK-25289][tests] add sink test suite in connector testframe
imaffe commented on pull request #18496: URL: https://github.com/apache/flink/pull/18496#issuecomment-1041169942 Curious is this merged ? I saw the status is closed but not merged, did it get merged in somewhere else @leonardBang ? Thanks~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] MrWhiteSike commented on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
MrWhiteSike commented on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1041169110 [@RocMarshal](https://github.com/RocMarshal) Thanks for the suggestions. All comments so far are resolved and keep other original contents. Please review it again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18778: [FLINK-26150][connector/pulsar] enable requestTimeoutMs configuration.
flinkbot edited a comment on pull request #18778: URL: https://github.com/apache/flink/pull/18778#issuecomment-1040181291 ## CI report: * ec04c584781c49959082f49aadaa447ae0313b9d Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31550) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 7a1348562f2d0b0c83f0cb7a3cb9931987ad24e1 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31478) * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) * 8dbb8256563d48a7bdb13489d6670ae6215eebe1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-26174) KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
[
https://issues.apache.org/jira/browse/FLINK-26174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493028#comment-17493028
]
Yun Gao commented on FLINK-26174:
-
cc [~fpaul]
> KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
> -
>
> Key: FLINK-26174
> URL: https://issues.apache.org/jira/browse/FLINK-26174
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kinesis
>Affects Versions: 1.15.0
>Reporter: Yun Gao
>Priority: Blocker
> Labels: test-stability
>
> {code:java}
> Feb 15 19:28:44 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0,
> Time elapsed: 38.14 s <<< FAILURE! - in
> org.apache.flink.architecture.rules.ApiAnnotationRules
> Feb 15 19:28:44 [ERROR]
> ApiAnnotationRules.PUBLIC_EVOLVING_API_METHODS_USE_ONLY_PUBLIC_EVOLVING_API_TYPES
> Time elapsed: 0.391 s <<< FAILURE!
> Feb 15 19:28:44 java.lang.AssertionError:
> Feb 15 19:28:44 Architecture Violation [Priority: MEDIUM] - Rule 'Return and
> argument types of methods annotated with @PublicEvolving must be annotated
> with @Public(Evolving).' was violated (2 times):
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Argument leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44
> org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
> java.util.Collection): Returned leaf type
> org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
> does not satisfy: reside outside of package 'org.apache.flink..' or
> annotated with @Public or annotated with @PublicEvolving or annotated with
> @Deprecated
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.assertNoViolation(ArchRule.java:94)
> Feb 15 19:28:44 at
> com.tngtech.archunit.lang.ArchRule$Assertions.check(ArchRule.java:82)
> Feb 15 19:28:44 at
> com.tngtech.archunit.library.freeze.FreezingArchRule.check(FreezingArchRule.java:96)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:159)
> Feb 15 19:28:44 at
> com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:142)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95)
> Feb 15 19:28:44 at java.util.ArrayList.forEach(ArrayList.java:1259)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
> Feb 15 19:28:44 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Feb 15 19:28:44 at
>
[jira] [Created] (FLINK-26174) KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation
Yun Gao created FLINK-26174:
---
Summary: KinesisDataStreamsSink.restoreWriter failed due to
Architecture Violation
Key: FLINK-26174
URL: https://issues.apache.org/jira/browse/FLINK-26174
Project: Flink
Issue Type: Bug
Components: Connectors / Kinesis
Affects Versions: 1.15.0
Reporter: Yun Gao
{code:java}
Feb 15 19:28:44 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time
elapsed: 38.14 s <<< FAILURE! - in
org.apache.flink.architecture.rules.ApiAnnotationRules
Feb 15 19:28:44 [ERROR]
ApiAnnotationRules.PUBLIC_EVOLVING_API_METHODS_USE_ONLY_PUBLIC_EVOLVING_API_TYPES
Time elapsed: 0.391 s <<< FAILURE!
Feb 15 19:28:44 java.lang.AssertionError:
Feb 15 19:28:44 Architecture Violation [Priority: MEDIUM] - Rule 'Return and
argument types of methods annotated with @PublicEvolving must be annotated with
@Public(Evolving).' was violated (2 times):
Feb 15 19:28:44
org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
java.util.Collection): Argument leaf type
org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
does not satisfy: reside outside of package 'org.apache.flink..' or annotated
with @Public or annotated with @PublicEvolving or annotated with @Deprecated
Feb 15 19:28:44
org.apache.flink.connector.kinesis.sink.KinesisDataStreamsSink.restoreWriter(org.apache.flink.api.connector.sink2.Sink$InitContext,
java.util.Collection): Returned leaf type
org.apache.flink.kinesis.shaded.software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry
does not satisfy: reside outside of package 'org.apache.flink..' or annotated
with @Public or annotated with @PublicEvolving or annotated with @Deprecated
Feb 15 19:28:44 at
com.tngtech.archunit.lang.ArchRule$Assertions.assertNoViolation(ArchRule.java:94)
Feb 15 19:28:44 at
com.tngtech.archunit.lang.ArchRule$Assertions.check(ArchRule.java:82)
Feb 15 19:28:44 at
com.tngtech.archunit.library.freeze.FreezingArchRule.check(FreezingArchRule.java:96)
Feb 15 19:28:44 at
com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:159)
Feb 15 19:28:44 at
com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:142)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95)
Feb 15 19:28:44 at java.util.ArrayList.forEach(ArrayList.java:1259)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138)
Feb 15 19:28:44 at
org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95)
Feb 15 19:28:44 at java.util.ArrayList.forEach(ArrayList.java:1259)
{code}
[GitHub] [flink] pltbkd commented on pull request #18680: [FLINK-25583] Support compacting small files for FileSink.
pltbkd commented on pull request #18680: URL: https://github.com/apache/flink/pull/18680#issuecomment-1041157963 > Thanks @pltbkd for the update! I try to fixed some tests. Also, could you have a look that if the two `*StateHandle` needs `snapshotState` ? Cleaning up of the state is added when the remaining state is drained in the handlers. Nothing special is necessary while snapshotting the state. I suppose we don't need to implement a customized `snapshotState`. I have added some comments to explain this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31606) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 7a1348562f2d0b0c83f0cb7a3cb9931987ad24e1 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31478) * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31605) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] GOODBOY008 commented on pull request #18778: [FLINK-26150][connector/pulsar] enable requestTimeoutMs configuration.
GOODBOY008 commented on pull request #18778: URL: https://github.com/apache/flink/pull/18778#issuecomment-1041156008 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18792: [FLINK-26172][docs] sql doc improvements
flinkbot edited a comment on pull request #18792: URL: https://github.com/apache/flink/pull/18792#issuecomment-1041051783 ## CI report: * 7eae7b10d497d3f007e9fd142c0419e28b040b85 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31593) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18718: [FLINK-25782] [docs] Translate datastream filesystem.md page into Chi…
flinkbot edited a comment on pull request #18718: URL: https://github.com/apache/flink/pull/18718#issuecomment-1035898573 ## CI report: * 7a1348562f2d0b0c83f0cb7a3cb9931987ad24e1 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31478) * 1ee0663ffc935ad0e96f39b7adb98216eb560fb1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (FLINK-26152) Translate the page of SQL/queries/WITH clause
[ https://issues.apache.org/jira/browse/FLINK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-26152: --- Assignee: wenyibo > Translate the page of SQL/queries/WITH clause > - > > Key: FLINK-26152 > URL: https://issues.apache.org/jira/browse/FLINK-26152 > Project: Flink > Issue Type: Improvement > Components: chinese-translation >Affects Versions: 1.14.0 >Reporter: wenyibo >Assignee: wenyibo >Priority: Major > Fix For: 1.14.0 > > > The page url of "SQL/queries/WITH clause" is > [https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/sql/queries/with/] > The markdown file can be found in > flink/docs/content.zh/docs/dev/table/sql/queries/with.md in English. > h4. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18450: [FLINK-25053][docs] Document how to use the usrlib to load code in the user code class loader
flinkbot edited a comment on pull request #18450: URL: https://github.com/apache/flink/pull/18450#issuecomment-1019472598 ## CI report: * cddbb308222430731528284ee045e25f19966563 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31591) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-18652) JDBCAppendTableSink to ClickHouse (data always repeating)
[
https://issues.apache.org/jira/browse/FLINK-18652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493019#comment-17493019
]
Jark Wu commented on FLINK-18652:
-
[~afedulov], I closed this issue. [~mzz_q] please reopen it if the problem
still exist in the latest Flink version.
> JDBCAppendTableSink to ClickHouse (data always repeating)
> --
>
> Key: FLINK-18652
> URL: https://issues.apache.org/jira/browse/FLINK-18652
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC, Table SQL / Ecosystem
>Affects Versions: 1.10.0
>Reporter: mzz
>Priority: Not a Priority
> Labels: auto-deprioritized-critical, auto-deprioritized-major,
> auto-deprioritized-minor
> Attachments: FLINK-UI.png, checkpoint-failed.png
>
>
> Hi all,
>data stream is : kafka->flinkSQL->clickhouse。
>The window is 15 min,but,15 minutes after the first time, the data
> kepping repeat sink to ClickHouse, plz help me ,thx。
> {code:java}
> *// data source from kafka
> * streamTableEnvironment.sqlUpdate(createTableSql)
> LOG.info("kafka source table has created !")
> val groupTable = streamTableEnvironment.sqlQuery(tempSql)
> streamTableEnvironment.createTemporaryView("aggs_temp_table", groupTable)
> *// this is window sql ,use ProcessingTime
> *val re_table = streamTableEnvironment.sqlQuery(windowSql)
> re_table.printSchema()
> //groupTable.printSchema()
> val rr = streamTableEnvironment.toAppendStream[Result](re_table)
> * // The data here is printed normally
> *rr.print()
> streamTableEnvironment.createTemporaryView("result_table", rr)
> val s = streamTableEnvironment.sqlQuery(sql)
> *// sink to clickhouse*
> val sink: JDBCAppendTableSink = JDBCAppendTableSink.builder()
> .setDrivername("ru.yandex.clickhouse.ClickHouseDriver")
> .setDBUrl(URL)
> .setQuery(insertCKSql)
> .setUsername(USERNAME)
> .setPassword(PASSWORD)
> .setBatchSize(1)
> .setParameterTypes(
> Types.LONG, Types.LONG, Types.STRING, Types.STRING, Types.STRING,
> Types.STRING,
> Types.STRING, Types.STRING, Types.STRING, Types.LONG, Types.LONG,
> Types.FLOAT,
> Types.LONG, Types.FLOAT, Types.LONG, Types.FLOAT, Types.FLOAT,
> Types.FLOAT, Types.LONG()
> )
> .build()
> streamTableEnvironment.registerTableSink("ckResult",
> Array[String]("data_date", "point", "platform", "page_name",
> "component_name", "booth_name", "position1", "advertiser",
> "adv_code", "request_num", "return_num", "fill_rate", "expose_num",
> "expose_rate", "click_num", "click_rate", "ecpm", "income", "created_at"),
> Array[TypeInformation[_]](Types.LONG, Types.LONG, Types.STRING,
> Types.STRING, Types.STRING, Types.STRING, Types.STRING, Types.STRING,
> Types.STRING, Types.LONG, Types.LONG, Types.FLOAT, Types.LONG, Types.FLOAT,
> Types.LONG, Types.FLOAT, Types.FLOAT, Types.FLOAT, Types.LONG()),
> sink)
> // insert into TableSink
> s.insertInto("ckResult")
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Closed] (FLINK-18652) JDBCAppendTableSink to ClickHouse (data always repeating)
[
https://issues.apache.org/jira/browse/FLINK-18652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu closed FLINK-18652.
---
Resolution: Not A Problem
> JDBCAppendTableSink to ClickHouse (data always repeating)
> --
>
> Key: FLINK-18652
> URL: https://issues.apache.org/jira/browse/FLINK-18652
> Project: Flink
> Issue Type: Bug
> Components: Connectors / JDBC, Table SQL / Ecosystem
>Affects Versions: 1.10.0
>Reporter: mzz
>Priority: Not a Priority
> Labels: auto-deprioritized-critical, auto-deprioritized-major,
> auto-deprioritized-minor
> Attachments: FLINK-UI.png, checkpoint-failed.png
>
>
> Hi all,
>data stream is : kafka->flinkSQL->clickhouse。
>The window is 15 min,but,15 minutes after the first time, the data
> kepping repeat sink to ClickHouse, plz help me ,thx。
> {code:java}
> *// data source from kafka
> * streamTableEnvironment.sqlUpdate(createTableSql)
> LOG.info("kafka source table has created !")
> val groupTable = streamTableEnvironment.sqlQuery(tempSql)
> streamTableEnvironment.createTemporaryView("aggs_temp_table", groupTable)
> *// this is window sql ,use ProcessingTime
> *val re_table = streamTableEnvironment.sqlQuery(windowSql)
> re_table.printSchema()
> //groupTable.printSchema()
> val rr = streamTableEnvironment.toAppendStream[Result](re_table)
> * // The data here is printed normally
> *rr.print()
> streamTableEnvironment.createTemporaryView("result_table", rr)
> val s = streamTableEnvironment.sqlQuery(sql)
> *// sink to clickhouse*
> val sink: JDBCAppendTableSink = JDBCAppendTableSink.builder()
> .setDrivername("ru.yandex.clickhouse.ClickHouseDriver")
> .setDBUrl(URL)
> .setQuery(insertCKSql)
> .setUsername(USERNAME)
> .setPassword(PASSWORD)
> .setBatchSize(1)
> .setParameterTypes(
> Types.LONG, Types.LONG, Types.STRING, Types.STRING, Types.STRING,
> Types.STRING,
> Types.STRING, Types.STRING, Types.STRING, Types.LONG, Types.LONG,
> Types.FLOAT,
> Types.LONG, Types.FLOAT, Types.LONG, Types.FLOAT, Types.FLOAT,
> Types.FLOAT, Types.LONG()
> )
> .build()
> streamTableEnvironment.registerTableSink("ckResult",
> Array[String]("data_date", "point", "platform", "page_name",
> "component_name", "booth_name", "position1", "advertiser",
> "adv_code", "request_num", "return_num", "fill_rate", "expose_num",
> "expose_rate", "click_num", "click_rate", "ecpm", "income", "created_at"),
> Array[TypeInformation[_]](Types.LONG, Types.LONG, Types.STRING,
> Types.STRING, Types.STRING, Types.STRING, Types.STRING, Types.STRING,
> Types.STRING, Types.LONG, Types.LONG, Types.FLOAT, Types.LONG, Types.FLOAT,
> Types.LONG, Types.FLOAT, Types.FLOAT, Types.FLOAT, Types.LONG()),
> sink)
> // insert into TableSink
> s.insertInto("ckResult")
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Closed] (FLINK-15455) Enable TCP connection reuse across multiple jobs.
[ https://issues.apache.org/jira/browse/FLINK-15455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yangze Guo closed FLINK-15455. -- Resolution: Fixed > Enable TCP connection reuse across multiple jobs. > - > > Key: FLINK-15455 > URL: https://issues.apache.org/jira/browse/FLINK-15455 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Network >Reporter: Yingjie Cao >Assignee: Yangze Guo >Priority: Major > Labels: pull-request-available > > Currently, tcp connections can be only reuse by tasks residing in the same > TaskManager and consumes the same IntermediateResult. And after job finish or > failover, the TCP connections are closed and new connections must be setup > latter. > As an improvement, we can make tcp connections a cluster level resource which > can be reused by multi jobs. The advantages are as follows: > # Reduce the number of TCP connections so we can save some resources. > # Reduce the overhead of connection setup and close so restarted jobs after > failover and latter jobs submitted to the same session cluster can reuse the > previous connections. > We use Flink session cluster as a service for ad-hoc queries and the users > can produce some statistics or create some statements and reports at any > time. Most of the queries finish in 2s and we find tcp connection reuse help > a lot to reduce the average execution time which means more queries can be > processed using the same resource and time with even better user experience. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-15455) Enable TCP connection reuse across multiple jobs.
[ https://issues.apache.org/jira/browse/FLINK-15455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493018#comment-17493018 ] Yangze Guo commented on FLINK-15455: master: c0cca2e16430758950627068306c7bf6056c98c9 5be7d480dd3a54c17ef34d76b82b9f6a80ba8bf0 > Enable TCP connection reuse across multiple jobs. > - > > Key: FLINK-15455 > URL: https://issues.apache.org/jira/browse/FLINK-15455 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Network >Reporter: Yingjie Cao >Assignee: Yangze Guo >Priority: Major > Labels: pull-request-available > > Currently, tcp connections can be only reuse by tasks residing in the same > TaskManager and consumes the same IntermediateResult. And after job finish or > failover, the TCP connections are closed and new connections must be setup > latter. > As an improvement, we can make tcp connections a cluster level resource which > can be reused by multi jobs. The advantages are as follows: > # Reduce the number of TCP connections so we can save some resources. > # Reduce the overhead of connection setup and close so restarted jobs after > failover and latter jobs submitted to the same session cluster can reuse the > previous connections. > We use Flink session cluster as a service for ad-hoc queries and the users > can produce some statistics or create some statements and reports at any > time. Most of the queries finish in 2s and we find tcp connection reuse help > a lot to reduce the average execution time which means more queries can be > processed using the same resource and time with even better user experience. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-25670) StateFun: Unable to handle oversize HTTP message if state size is large
[ https://issues.apache.org/jira/browse/FLINK-25670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493017#comment-17493017 ] Kyle commented on FLINK-25670: -- Hi Igal, with increasing "client_max_size", the memory size of task heap should be also enlarged accordingly. After that the large state can be generated and updated by remote function and sent back to StateFun cluster. Thank you very much for suggestion and support! Another question for my case is whether large data is allowed to be sent from ingress to StateFun cluster and then to remote function. Currently I don't have a chance to try this case but per your expertise do you have any idea? > StateFun: Unable to handle oversize HTTP message if state size is large > --- > > Key: FLINK-25670 > URL: https://issues.apache.org/jira/browse/FLINK-25670 > Project: Flink > Issue Type: Bug > Components: Stateful Functions >Affects Versions: statefun-3.1.1 >Reporter: Kyle >Priority: Major > Attachments: 00-module.yaml, functions.py > > > Per requirement we need to handle state which is about 500MB large (72MB > state allocated in commented code as attached). However the HTTP message > limit disallows us to send back large state to StateFun cluster after saving > state in Stateful Function. > Another question is whether large data is allowed to send to Stateful > Function from ingress. > > 2022-01-17 07:57:18,416 WARN > org.apache.flink.statefun.flink.core.nettyclient.NettyRequest [] - Exception > caught while trying to deliver a message: (attempt > #10)ToFunctionRequestSummary(address=Address(example, hello, ), > batchSize=1, totalSizeInBytes=80, numberOfStates=2) > org.apache.flink.shaded.netty4.io.netty.handler.codec.TooLongFrameException: > Response entity too large: DefaultHttpResponse(decodeResult: success, > version: HTTP/1.1) > HTTP/1.1 200 OK > Content-Type: application/octet-stream > Content-Length: 40579630 > Date: Mon, 17 Jan 2022 07:57:18 GMT > Server: Python/3.9 aiohttp/3.8.1 > at > org.apache.flink.shaded.netty4.io.netty.handler.codec.http.HttpObjectAggregator.handleOversizedMessage(HttpObjectAggregator.java:276) > ~[statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.handler.codec.http.HttpObjectAggregator.handleOversizedMessage(HttpObjectAggregator.java:87) > ~[statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.handler.codec.MessageAggregator.invokeHandleOversizedMessage(MessageAggregator.java:404) > ~[statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.handler.codec.MessageAggregator.decode(MessageAggregator.java:254) > ~[statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) > ~[statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) > [statefun-flink-distribution.jar:3.1.1] > at > org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) > [statefun-flink-distribution.jar:3.1.1] > at >
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] KarmaGYZ closed pull request #18417: [FLINK-15455][network] Enabled tcp connection reuse across multi jobs.
KarmaGYZ closed pull request #18417: URL: https://github.com/apache/flink/pull/18417 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * 15943be65b1842a4f6568133435196081e01ce9d Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31588) * f10d91bd29528f616398e33a60a9cbb3e0b670c2 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31603) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18680: [FLINK-25583] Support compacting small files for FileSink.
flinkbot edited a comment on pull request #18680: URL: https://github.com/apache/flink/pull/18680#issuecomment-1033512635 ## CI report: * 2ceef38711255737eba93cdb7803b41fcf87c49a Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31598) * 1e885d354bb156b1598601a9fa6d06cb7972e15c Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31602) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18738: [FLINK-24745][format][json] Add support for Oracle OGG JSON format parser
flinkbot edited a comment on pull request #18738: URL: https://github.com/apache/flink/pull/18738#issuecomment-1037051889 ## CI report: * 15943be65b1842a4f6568133435196081e01ce9d Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31588) * f10d91bd29528f616398e33a60a9cbb3e0b670c2 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18680: [FLINK-25583] Support compacting small files for FileSink.
flinkbot edited a comment on pull request #18680: URL: https://github.com/apache/flink/pull/18680#issuecomment-1033512635 ## CI report: * d6511df39e333c9f57e2dee94504d7769c66a1a8 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31578) * 2ceef38711255737eba93cdb7803b41fcf87c49a Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31598) * 1e885d354bb156b1598601a9fa6d06cb7972e15c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17452: [FLINK-20732][connector/pulsar] Introduction of Pulsar Sink
flinkbot edited a comment on pull request #17452: URL: https://github.com/apache/flink/pull/17452#issuecomment-940136217 ## CI report: * 05023f3a4797bc482c773722fab5d90b4fc4d102 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31597) * a24b9c4537e17aac170568bbbc4f8dc5b2c794df Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31601) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17452: [FLINK-20732][connector/pulsar] Introduction of Pulsar Sink
flinkbot edited a comment on pull request #17452: URL: https://github.com/apache/flink/pull/17452#issuecomment-940136217 ## CI report: * 38e9475b405df3004c00b216fe2edf552cb8c029 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31569) * 05023f3a4797bc482c773722fab5d90b4fc4d102 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31597) * a24b9c4537e17aac170568bbbc4f8dc5b2c794df UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-26142) Integrate flink-kubernetes-operator repo with CI/CD
[ https://issues.apache.org/jira/browse/FLINK-26142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493009#comment-17493009 ] Yang Wang commented on FLINK-26142: --- I would like to enable the github actions and add an e2e test to guard the current behavior. > Integrate flink-kubernetes-operator repo with CI/CD > --- > > Key: FLINK-26142 > URL: https://issues.apache.org/jira/browse/FLINK-26142 > Project: Flink > Issue Type: Sub-task > Components: Deployment / Kubernetes >Reporter: Gyula Fora >Priority: Major > > We should be able to run the unit/integration tests on the existing Flink CI > infra and publish docker images for new builds to dockerhub -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][coordination] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * ebf17a50343fe5cd13cfddb1154428753b4d29b3 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31592) * 3e49b45d560685de73d09b81154065515f9e15ca Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31600) * 5abd99fbc044163e5ca8b4ddfb6c33e55df06b44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18791: [FLINK-26169][runtime] There is a typo in the annotation for the WatermarkAlignmentParams class
flinkbot edited a comment on pull request #18791: URL: https://github.com/apache/flink/pull/18791#issuecomment-1041038528 ## CI report: * ebf17a50343fe5cd13cfddb1154428753b4d29b3 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=31592) * 3e49b45d560685de73d09b81154065515f9e15ca UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-26171) pyFlink -py options has issue with path that starts with //
[
https://issues.apache.org/jira/browse/FLINK-26171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493008#comment-17493008
]
Xuannan Su commented on FLINK-26171:
After some research, I found that the leading two slashes are not necessarily
equal to a single slash, according to
[here|https://unix.stackexchange.com/a/1919].
> pyFlink -py options has issue with path that starts with //
> ---
>
> Key: FLINK-26171
> URL: https://issues.apache.org/jira/browse/FLINK-26171
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.14.3
>Reporter: Xuannan Su
>Assignee: Huang Xingbo
>Priority: Major
>
> It seems that when submitting a pyFlink job with the `flink run` command, the
> -py option has issues with a path that start with double slash "//".
> You can reproduce the problem with the wordcount python example.
> {code:bash}
> # Job successfully submitted
> ./bin/flink run -py "${PWD}"/examples/python/datastream/word_count.py
> Job has been submitted with JobID 54ab79a32b4e441ee80bda92be7cb547
> # Fail to submit the job if the path start with double slash
> ./bin/flink run -py /"${PWD}"/examples/python/datastream/word_count.py
> org.apache.flink.client.program.ProgramAbortException:
> java.nio.file.NoSuchFileException:
> /var/folders/j4/td7bvghd1tg4tb7ty_7lk6z0gp/T/pyflink/1bba3878-9ed4-4d4e-a5ed-1208c1ee9425/c9ece3de-8ff2-40dc-8436-e3377e540baf/word_count.py
> at
> org.apache.flink.client.python.PythonDriver.main(PythonDriver.java:140)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
> at
> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
> at
> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246)
> at
> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054)
> at
> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132)
> at
> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1132)
> Caused by: java.nio.file.NoSuchFileException:
> /var/folders/j4/td7bvghd1tg4tb7ty_7lk6z0gp/T/pyflink/1bba3878-9ed4-4d4e-a5ed-1208c1ee9425/c9ece3de-8ff2-40dc-8436-e3377e540baf/word_count.py
> at
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> at sun.nio.fs.UnixPath.toRealPath(UnixPath.java:837)
> at
> org.apache.flink.client.python.PythonEnvUtils.addToPythonPath(PythonEnvUtils.java:278)
> at
> org.apache.flink.client.python.PythonEnvUtils.preparePythonEnvironment(PythonEnvUtils.java:195)
> at
> org.apache.flink.client.python.PythonEnvUtils.launchPy4jPythonClient(PythonEnvUtils.java:456)
> at
> org.apache.flink.client.python.PythonDriver.main(PythonDriver.java:92)
> ... 13 more
> # Job successfully submitted if path starts with three slash
> ./bin/flink run -py //"${PWD}"/examples/python/datastream/word_count.py
> Job has been submitted with JobID 270d07407b297b566c6903c451a834cb
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Assigned] (FLINK-26171) pyFlink -py options has issue with path that starts with //
[
https://issues.apache.org/jira/browse/FLINK-26171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dong Lin reassigned FLINK-26171:
Assignee: Huang Xingbo
> pyFlink -py options has issue with path that starts with //
> ---
>
> Key: FLINK-26171
> URL: https://issues.apache.org/jira/browse/FLINK-26171
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.14.3
>Reporter: Xuannan Su
>Assignee: Huang Xingbo
>Priority: Major
>
> It seems that when submitting a pyFlink job with the `flink run` command, the
> -py option has issues with a path that start with double slash "//".
> You can reproduce the problem with the wordcount python example.
> {code:bash}
> # Job successfully submitted
> ./bin/flink run -py "${PWD}"/examples/python/datastream/word_count.py
> Job has been submitted with JobID 54ab79a32b4e441ee80bda92be7cb547
> # Fail to submit the job if the path start with double slash
> ./bin/flink run -py /"${PWD}"/examples/python/datastream/word_count.py
> org.apache.flink.client.program.ProgramAbortException:
> java.nio.file.NoSuchFileException:
> /var/folders/j4/td7bvghd1tg4tb7ty_7lk6z0gp/T/pyflink/1bba3878-9ed4-4d4e-a5ed-1208c1ee9425/c9ece3de-8ff2-40dc-8436-e3377e540baf/word_count.py
> at
> org.apache.flink.client.python.PythonDriver.main(PythonDriver.java:140)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
> at
> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
> at
> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246)
> at
> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054)
> at
> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132)
> at
> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1132)
> Caused by: java.nio.file.NoSuchFileException:
> /var/folders/j4/td7bvghd1tg4tb7ty_7lk6z0gp/T/pyflink/1bba3878-9ed4-4d4e-a5ed-1208c1ee9425/c9ece3de-8ff2-40dc-8436-e3377e540baf/word_count.py
> at
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> at sun.nio.fs.UnixPath.toRealPath(UnixPath.java:837)
> at
> org.apache.flink.client.python.PythonEnvUtils.addToPythonPath(PythonEnvUtils.java:278)
> at
> org.apache.flink.client.python.PythonEnvUtils.preparePythonEnvironment(PythonEnvUtils.java:195)
> at
> org.apache.flink.client.python.PythonEnvUtils.launchPy4jPythonClient(PythonEnvUtils.java:456)
> at
> org.apache.flink.client.python.PythonDriver.main(PythonDriver.java:92)
> ... 13 more
> # Job successfully submitted if path starts with three slash
> ./bin/flink run -py //"${PWD}"/examples/python/datastream/word_count.py
> Job has been submitted with JobID 270d07407b297b566c6903c451a834cb
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
