[jira] [Created] (FLINK-36360) Prepare release process and Scripts for the preview release
Xintong Song created FLINK-36360: Summary: Prepare release process and Scripts for the preview release Key: FLINK-36360 URL: https://issues.apache.org/jira/browse/FLINK-36360 Project: Flink Issue Type: New Feature Components: Release System Reporter: Xintong Song Assignee: Xintong Song Fix For: 2.0-preview -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-36261) Revisit all breaking changes before Flink 2.0 Preview
Xintong Song created FLINK-36261: Summary: Revisit all breaking changes before Flink 2.0 Preview Key: FLINK-36261 URL: https://issues.apache.org/jira/browse/FLINK-36261 Project: Flink Issue Type: Technical Debt Reporter: Xintong Song Fix For: 2.0-preview Japicmp for @Deprecated APIs is disabled in FLINK-36207. We need to check whether there's any unexpected breaking changes right before the Flink 2.0 Preview release, by re-enable the checking locally. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-36200) Breaking changes for Flink 3.0
Xintong Song created FLINK-36200: Summary: Breaking changes for Flink 3.0 Key: FLINK-36200 URL: https://issues.apache.org/jira/browse/FLINK-36200 Project: Flink Issue Type: Technical Debt Reporter: Xintong Song Fix For: 3.0.0 This is an umbrella for tracking planed breaking changes that are targeting for the next major version bump. Please be aware that, in order for the breaking changes to be included in the next major version bump, the following preparations need to be done in advance: * The old APIs need to be deprecated, 2 minor releases before the major version bump for @Public APIs, and 1 minor release for @PublicEvolving APIs * All internal usages of the deprecated APIs should be either migrated to replacing new APIs (if any) or deprecated / removed. This ensure that we can quickly remove the APIs during major version bump without need for extra migration efforts. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35331) Download links for binary releases are displayed as source releases on website
Xintong Song created FLINK-35331: Summary: Download links for binary releases are displayed as source releases on website Key: FLINK-35331 URL: https://issues.apache.org/jira/browse/FLINK-35331 Project: Flink Issue Type: Bug Components: Project Website Reporter: Xintong Song Take Pre-bundled Hadoop as examples. The content for downloading are binary releases, while the link is displayed as "Pre-bundled Hadoop 2.x.y Source Release (asc, sha512)". The problem is caused by misusing `source_release_[url|asc_url|sha512_url]` for binary contents in the corresponding [yaml file.|https://github.com/apache/flink-web/blob/asf-site/docs/data/additional_components.yml] There are many similar cases in the webpage. And a relevant issues is that, some source releases are displayed as "XXX Source Release Source Release", due to including "Source Release" in the `name` field of the corresponding yaml file. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-32560) Properly deprecate all Scala APIs
Xintong Song created FLINK-32560: Summary: Properly deprecate all Scala APIs Key: FLINK-32560 URL: https://issues.apache.org/jira/browse/FLINK-32560 Project: Flink Issue Type: Sub-task Components: API / Scala Reporter: Xintong Song Fix For: 1.18.0 We agreed to drop Scala API support in FLIP-265 [1], and have tried to deprecate them in FLINK-29740. Also, both user documentation and roadmap[2] shows that scala API supports are deprecated. However, none of the APIs in `flink-streaming-scala` are annotated with `@Deprecated` atm, and only `ExecutionEnvironment` and `package` are marked `@Deprecated` in `flink-scala`. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-265+Deprecate+and+remove+Scala+API+support [2] https://flink.apache.org/roadmap/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-32559) Deprecate Queryable State
Xintong Song created FLINK-32559: Summary: Deprecate Queryable State Key: FLINK-32559 URL: https://issues.apache.org/jira/browse/FLINK-32559 Project: Flink Issue Type: Sub-task Components: Runtime / Queryable State Reporter: Xintong Song Fix For: 1.18.0 Queryable State is described as approaching end-of-life in the roadmap [1], but is neither deprecated in codes nor in user documentation [2]. There're also more negative opinions than positive ones in the discussion about rescuing it [3]. [1] https://flink.apache.org/roadmap/ [2] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/datastream/fault-tolerance/queryable_state/ [3] https://lists.apache.org/thread/9hmwcjb3q5c24pk3qshjvybfqk62v17m -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-32558) Properly deprecate DataSet API
Xintong Song created FLINK-32558: Summary: Properly deprecate DataSet API Key: FLINK-32558 URL: https://issues.apache.org/jira/browse/FLINK-32558 Project: Flink Issue Type: Sub-task Components: API / DataSet Reporter: Xintong Song Fix For: 1.18.0 DataSet API is described as "legacy", "soft deprecated" in user documentation [1]. The required tasks for formally deprecating / removing it, according to FLIP-131 [2], are all completed. This task include marking all related API classes as `@Deprecated` and update the user documentation. [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/dataset/overview/ [2] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-32557) API deprecations in Flink 1.18
Xintong Song created FLINK-32557: Summary: API deprecations in Flink 1.18 Key: FLINK-32557 URL: https://issues.apache.org/jira/browse/FLINK-32557 Project: Flink Issue Type: Technical Debt Reporter: Xintong Song Fix For: 1.18.0 As discussed in [1], we are deprecating multiple APIs in release 1.18, in order to completely remove them in release 2.0. The listed APIs possibly should have been deprecated already, i.e., already (or won't) have replacements, but are somehow not yet. [1] https://lists.apache.org/thread/3dw4f8frlg8hzlv324ql7n2755bzs9hy -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-30629) ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat is unstable
Xintong Song created FLINK-30629: Summary: ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat is unstable Key: FLINK-30629 URL: https://issues.apache.org/jira/browse/FLINK-30629 Project: Flink Issue Type: Bug Components: Client / Job Submission Affects Versions: 1.17.0 Reporter: Xintong Song Fix For: 1.17.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=44690&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33&t=125e07e7-8de0-5c6c-a541-a567415af3ef&l=10819 {code:java} Jan 11 04:32:39 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 21.02 s <<< FAILURE! - in org.apache.flink.client.ClientHeartbeatTest Jan 11 04:32:39 [ERROR] org.apache.flink.client.ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat Time elapsed: 9.157 s <<< ERROR! Jan 11 04:32:39 java.lang.IllegalStateException: MiniCluster is not yet running or has already been shut down. Jan 11 04:32:39 at org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) Jan 11 04:32:39 at org.apache.flink.runtime.minicluster.MiniCluster.getDispatcherGatewayFuture(MiniCluster.java:1044) Jan 11 04:32:39 at org.apache.flink.runtime.minicluster.MiniCluster.runDispatcherCommand(MiniCluster.java:917) Jan 11 04:32:39 at org.apache.flink.runtime.minicluster.MiniCluster.getJobStatus(MiniCluster.java:841) Jan 11 04:32:39 at org.apache.flink.runtime.minicluster.MiniClusterJobClient.getJobStatus(MiniClusterJobClient.java:91) Jan 11 04:32:39 at org.apache.flink.client.ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat(ClientHeartbeatTest.java:79) {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-29344) Make Adaptive Scheduler supports Fine-Grained Resource Management
Xintong Song created FLINK-29344: Summary: Make Adaptive Scheduler supports Fine-Grained Resource Management Key: FLINK-29344 URL: https://issues.apache.org/jira/browse/FLINK-29344 Project: Flink Issue Type: Improvement Components: Runtime / Coordination Reporter: Xintong Song This ticket is a reflection of the following Slack discussion: {quote} Donatien Schmitz Adaptive Scheduler thread: Hey all, it seems like the Adaptive Scheduler does not support fine grain resource management. I have fixed it and would like to know if you would be interested in a PR or if it was purposely designed to not support Fine grain resource management. rmetzger @Donatien Schmitz: I’m concerned that we don’t have a lot of review capacity right now, and I’m now aware of any users asking for it. rmetzger I couldn’t find a ticket for adding this feature, did you find one? If not, can you add one? This will allow us to at least making this feature show up on google, and people might comment on it, if they need it. rmetzger If the change is fairly self-contained, is unlikely to cause instabilities, then we can also consider merging it rmetzger @Xintong Song what do you think? Xintong Song @rmetzger, thanks for involving me. @Donatien Schmitz, thanks for bringing this up, and for volunteering on fixing this. Could you explain a bit more about how do you plan to fix this? Fine-grained resource management is not yet supported by adaptive scheduler, because there’s an issue that we haven’t find a good solution for. Namely, if only part of the resource requirements can be fulfilled, how do we decide which requirements should be fulfilled. E.g., say the job declares it needs 10 slots with resource 1 for map tasks, and another 10 slots with resource 2 for reduce tasks. If there’s not enough resources (say only 10 slots can be allocated for simplicity), how many slots for map / reduce tasks should be allocated? Obviously, <10 map, 0 reduce> & <0 map, 10 reduce> would not work. For this example, a proportional scale-down (<5 map, 5 reduce>) seems reasonable. However, a proportional scale-down is not always easy (e.g., requirements is <100 map, 1 reduce>), and the issue grows more complicated if you take lots of stages and the differences of slot sizes into consideration. I’d like to see adaptive scheduler also supports fine-grained resource management. If there’s a good solution to the above issue, I’d love to help review the effort. Donatien Schmitz Dear Robert and Xintong, thanks for reading and reacting to my message! I'll reply tomorrow (GTM +1 time) if that's quite alright with you. Best, Donatien Schmitz Donatien Schmitz @Xintong Song * We are working on fine-grain scheduling for resource optimisation of long running or periodic jobs. One of the feature we are experiencing is a "rescheduling plan", a mapping of operators and Resource Profiles that can be dynamically applied to a running job. This rescheduling would be triggered by policies about some metrics (focus on RocksDB in our case). * While developing this new feature, we decided to implement it on the Adpative Scheduler instead of the Base Scheduler because the logic brought by the state machine already present made it more logical: transitions from states Executing -> Cancelling -> Rescheduling -> Waiting for Resources -> Creating -> Executing * In our case we are working on a POC and thus focusing on a real simple job with a // of 1. The issue you brought is indeed something we have faced while raising the // of the job. * If you create a Jira Ticket we can discuss it over there if you'd like! Donatien Schmitz @rmetzger The changes do not break the default resource management but does not fix the issue brought out by Xintong. {quote} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-28923) Release Testing: Verify flip-241 completed jobs information enhancement
Xintong Song created FLINK-28923: Summary: Release Testing: Verify flip-241 completed jobs information enhancement Key: FLINK-28923 URL: https://issues.apache.org/jira/browse/FLINK-28923 Project: Flink Issue Type: Sub-task Components: Runtime / Web Frontend Affects Versions: 1.16.0 Reporter: Xintong Song Fix For: 1.16.0 * Please refer to release note of FLINK-28307 for a list of changes to be verified * The changes should be verified for both JobManager and HistoryServer * I'd suggest to verify the history server functionality for various deployment modes. Previously, it didn't work with application mode (FLINK-19358). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-28558) HistoryServer log retrieval configuration improvement
Xintong Song created FLINK-28558: Summary: HistoryServer log retrieval configuration improvement Key: FLINK-28558 URL: https://issues.apache.org/jira/browse/FLINK-28558 Project: Flink Issue Type: Improvement Components: Runtime / Configuration, Runtime / REST Reporter: Xintong Song Fix For: 1.16.0 HistoryServer generates log retrieval urls base on the following configuration: - historyserver.log.jobmanager.url-pattern - historyserver.log.taskmanager.url-pattern The usability can be improved in two ways: - Explicitly explain in description that only http/https schemas are supported, and add sanity checks for it. - If the schema is not specified, add "http://"; by default. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-28555) Update history server documentation
Xintong Song created FLINK-28555: Summary: Update history server documentation Key: FLINK-28555 URL: https://issues.apache.org/jira/browse/FLINK-28555 Project: Flink Issue Type: Sub-task Components: Documentation Reporter: Xintong Song Assignee: Xintong Song Update the history server documentation, w.r.t the log-viewing integration and the supported rest apis. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-28125) Promote leadership changing logs to INFO level
Xintong Song created FLINK-28125: Summary: Promote leadership changing logs to INFO level Key: FLINK-28125 URL: https://issues.apache.org/jira/browse/FLINK-28125 Project: Flink Issue Type: Improvement Components: Runtime / Coordination Reporter: Xintong Song Currently, {{DefaultLeaderElectionService}} logs leadership changing events in DEBUG level, expecting the contender to log the changes in INFO level. This is fragile because there're many different {{LeaderContender}} implementations and not all of them print the logs properly. E.g., {{JobMasterServiceLeadershipRunner}} logs the leadership changes in TRACE level. I'd suggest to revisit the logging of leadership changing, printing the INFO logs from {{LeaderElectionService}}. That probably also means removing the contender side logs to avoid redundancy. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27848) ZooKeeperLeaderElectionDriver keeps writing leader information, using up zxid
Xintong Song created FLINK-27848: Summary: ZooKeeperLeaderElectionDriver keeps writing leader information, using up zxid Key: FLINK-27848 URL: https://issues.apache.org/jira/browse/FLINK-27848 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.14.4, 1.15.0 Reporter: Xintong Song Assignee: Weijie Guo Fix For: 1.14.5, 1.15.1 After a leadership change, the new leader may keeps writing its information (which is identical) to ZK, causing the zxid on ZK quickly used up. The problem is that, in {{ZooKeeperLeaderElectionDriver#retrieveLeaderInformationFromZooKeeper}}, {{leaderElectionEventHandler.onLeaderInformationChange(LeaderInformation.empty())}} is called no matter {{childData}} is {{null}} or not. In case of non-null, this will cause the driver keeps re-writing the leader information to ZK. The problem is introduced in FLINK-24038, and only affects the legacy {{ZooKeeperHaServices}}. Thus, only 1.14 / 1.15 are affected. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27731) Cannot build documentation with Hugo docker image
Xintong Song created FLINK-27731: Summary: Cannot build documentation with Hugo docker image Key: FLINK-27731 URL: https://issues.apache.org/jira/browse/FLINK-27731 Project: Flink Issue Type: Bug Components: Documentation Affects Versions: 1.16.0 Reporter: Xintong Song Flink provides 2 ways for building the documentation: 1) using a Hugo docker image, and 2) using a local Hugo installation. Currently, 1) is broken due to the `setup_docs.sh` script requires a local Hugo installation. This was introduced in FLINK-27394. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27723) Slack: revisit how this communication channel works
Xintong Song created FLINK-27723: Summary: Slack: revisit how this communication channel works Key: FLINK-27723 URL: https://issues.apache.org/jira/browse/FLINK-27723 Project: Flink Issue Type: Sub-task Reporter: Xintong Song -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27722) Slack: set up auto-updated invitation link
Xintong Song created FLINK-27722: Summary: Slack: set up auto-updated invitation link Key: FLINK-27722 URL: https://issues.apache.org/jira/browse/FLINK-27722 Project: Flink Issue Type: Sub-task Reporter: Xintong Song -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27721) Slack: set up archive
Xintong Song created FLINK-27721: Summary: Slack: set up archive Key: FLINK-27721 URL: https://issues.apache.org/jira/browse/FLINK-27721 Project: Flink Issue Type: Sub-task Reporter: Xintong Song -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27720) Slack: Update the project website regarding communication channels
Xintong Song created FLINK-27720: Summary: Slack: Update the project website regarding communication channels Key: FLINK-27720 URL: https://issues.apache.org/jira/browse/FLINK-27720 Project: Flink Issue Type: Sub-task Reporter: Xintong Song -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27719) Create Apache Flink slack workspace
Xintong Song created FLINK-27719: Summary: Create Apache Flink slack workspace Key: FLINK-27719 URL: https://issues.apache.org/jira/browse/FLINK-27719 Project: Flink Issue Type: Improvement Reporter: Xintong Song Assignee: Xintong Song This is an umbrella for tasks related to setting up the Apache Flink slack channel. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27514) Website links to up-to-date committer and PMC member lists
Xintong Song created FLINK-27514: Summary: Website links to up-to-date committer and PMC member lists Key: FLINK-27514 URL: https://issues.apache.org/jira/browse/FLINK-27514 Project: Flink Issue Type: Improvement Components: Project Website Reporter: Xintong Song Assignee: Xintong Song According to the [ML discussion|https://lists.apache.org/thread/679ds6lfqs8f4q8lnt7tnlofl58str4y], we are going to add a link to the up-to-date [committer and PMC member list|https://projects.apache.org/committee.html?flink] from the community page of our project website, as well as a notice about the current list could be outdated. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-25970) SerializedThrowable should record type of the original throwable.
Xintong Song created FLINK-25970: Summary: SerializedThrowable should record type of the original throwable. Key: FLINK-25970 URL: https://issues.apache.org/jira/browse/FLINK-25970 Project: Flink Issue Type: Improvement Components: API / Core Affects Versions: 1.14.3 Reporter: Xintong Song Currently, only the message and stack of the original throwable is preserved in {{{}SerializedThrowable{}}}, while the type of the original throwable is discarded. Sometimes, it would be helpful if message of {{SerializedThrowable}} can also include the full class name of the original throwable. E.g., in the following stack. {code:java} Caused by: org.apache.flink.util.SerializedThrowable at java.util.HashMap$HashIterator.nextNode(HashMap.java:1437) ~[?:1.8.0_102] at java.util.HashMap$EntryIterator.next(HashMap.java:1471) ~[?:1.8.0_102] at java.util.HashMap$EntryIterator.next(HashMap.java:1469) ~[?:1.8.0_102] ... {code} It's not that easy to understand what is wrong from this stack. JDK does not provide a message for the original exception. We have to look into the JDK source codes to find out what's going on. Sometimes it's even more annoying having to look for the JDK source codes of the exactly same version in order to match the line numbers. Turns out the original exception was a {{ConcurrentModificationException}}. I think it would be much more straightforward if we can have a stack like the following. {code} Caused by: org.apache.flink.util.SerializedThrowable: java.util.ConcurrentModificationException at java.util.HashMap$HashIterator.nextNode(HashMap.java:1437) ~[?:1.8.0_102] at java.util.HashMap$EntryIterator.next(HashMap.java:1471) ~[?:1.8.0_102] at java.util.HashMap$EntryIterator.next(HashMap.java:1469) ~[?:1.8.0_102] ... {code} -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25356) Add benchmarks for performance in OLAP scenarios
Xintong Song created FLINK-25356: Summary: Add benchmarks for performance in OLAP scenarios Key: FLINK-25356 URL: https://issues.apache.org/jira/browse/FLINK-25356 Project: Flink Issue Type: Sub-task Components: Benchmarks Reporter: Xintong Song As discussed in FLINK-25318, we would need a unified, public visible benchmark setups, for supporting OLAP performance improvements and investigations. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-24584) ClientTest.testRequestUnavailableHost fails on azure
Xintong Song created FLINK-24584: Summary: ClientTest.testRequestUnavailableHost fails on azure Key: FLINK-24584 URL: https://issues.apache.org/jira/browse/FLINK-24584 Project: Flink Issue Type: Bug Components: Runtime / Queryable State Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.1 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25194&view=logs&j=961f8f81-6b52-53df-09f6-7291a2e4af6a&t=f53023d8-92c3-5d78-ec7e-70c2bf37be20&l=15189 {code} Oct 19 00:31:59 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.597 s <<< FAILURE! - in org.apache.flink.queryablestate.network.ClientTest Oct 19 00:31:59 [ERROR] testRequestUnavailableHost Time elapsed: 0.025 s <<< FAILURE! Oct 19 00:31:59 java.lang.AssertionError: Did not throw expected ConnectException Oct 19 00:31:59 at org.junit.Assert.fail(Assert.java:89) Oct 19 00:31:59 at org.apache.flink.queryablestate.network.ClientTest.testRequestUnavailableHost(ClientTest.java:274) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24583) ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush timeout on azure
Xintong Song created FLINK-24583: Summary: ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush timeout on azure Key: FLINK-24583 URL: https://issues.apache.org/jira/browse/FLINK-24583 Project: Flink Issue Type: Bug Components: Connectors / ElasticSearch Affects Versions: 1.15.0 Environment: ElasticsearchWriterITCase Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25191&view=logs&j=961f8f81-6b52-53df-09f6-7291a2e4af6a&t=f53023d8-92c3-5d78-ec7e-70c2bf37be20&l=12452 {code} Oct 18 23:47:27 [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 22.228 s <<< FAILURE! - in org.apache.flink.connector.elasticsearch.sink.ElasticsearchWriterITCase Oct 18 23:47:27 [ERROR] testWriteOnBulkIntervalFlush Time elapsed: 2.032 s <<< ERROR! Oct 18 23:47:27 java.util.concurrent.TimeoutException: Condition was not met in given timeout. Oct 18 23:47:27 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:166) Oct 18 23:47:27 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:144) Oct 18 23:47:27 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:136) Oct 18 23:47:27 at org.apache.flink.connector.elasticsearch.sink.ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush(ElasticsearchWriterITCase.java:139) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24582) PrometheusReporterEndToEndITCase fails due to timeout
Xintong Song created FLINK-24582: Summary: PrometheusReporterEndToEndITCase fails due to timeout Key: FLINK-24582 URL: https://issues.apache.org/jira/browse/FLINK-24582 Project: Flink Issue Type: Bug Components: Runtime / Metrics Affects Versions: 1.15.0 Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25180&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=23451 {code} Oct 18 18:17:44 [ERROR] Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 9.138 s <<< FAILURE! - in org.apache.flink.metrics.prometheus.tests.PrometheusReporterEndToEndITCase Oct 18 18:17:44 [ERROR] testReporter[0: Jar in 'lib', instantiated via reflection] Time elapsed: 1.779 s <<< ERROR! Oct 18 18:17:44 java.io.IOException: Process ([wget, -q, -P, /home/vsts/work/1/e2e_cache/downloads/-1930370649, --timeout, 240, https://github.com/prometheus/prometheus/releases/download/v2.4.3/prometheus-2.4.3.linux-amd64.tar.gz]) exceeded timeout (60) or number of retries (3). Oct 18 18:17:44 at org.apache.flink.tests.util.AutoClosableProcess$AutoClosableProcessBuilder.runBlockingWithRetry(AutoClosableProcess.java:168) Oct 18 18:17:44 at org.apache.flink.tests.util.cache.AbstractDownloadCache.getOrDownload(AbstractDownloadCache.java:135) Oct 18 18:17:44 at org.apache.flink.tests.util.cache.PersistingDownloadCache.getOrDownload(PersistingDownloadCache.java:36) Oct 18 18:17:44 at org.apache.flink.metrics.prometheus.tests.PrometheusReporterEndToEndITCase.testReporter(PrometheusReporterEndToEndITCase.java:209) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24538) ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten fails with NPE
Xintong Song created FLINK-24538: Summary: ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten fails with NPE Key: FLINK-24538 URL: https://issues.apache.org/jira/browse/FLINK-24538 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.15.0, 1.14.1 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25020&view=logs&j=f2b08047-82c3-520f-51ee-a30fd6254285&t=3810d23d-4df2-586c-103c-ec14ede6af00&l=7573 {code} Oct 13 22:26:04 [ERROR] Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 12.355 s <<< FAILURE! - in org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionTest Oct 13 22:26:04 [ERROR] testLeaderShouldBeCorrectedWhenOverwritten Time elapsed: 1.138 s <<< ERROR! Oct 13 22:26:04 java.lang.NullPointerException Oct 13 22:26:04 at org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten(ZooKeeperLeaderElectionTest.java:434) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24502) Automate updating of `MigrationVersion` and migration tests.
Xintong Song created FLINK-24502: Summary: Automate updating of `MigrationVersion` and migration tests. Key: FLINK-24502 URL: https://issues.apache.org/jira/browse/FLINK-24502 Project: Flink Issue Type: Improvement Components: Release System Reporter: Xintong Song This ticket comes from this[ PR discussion|https://github.com/apache/flink/pull/17403#issuecomment-939739016]. Currently, to update the migration tests w.r.t. a new released version, we need to the followings: * Add new version to `MigrationVersion` * Find out the test cases where the `MigrationVersion` is used, and update the test to cover the new version * Generate required files (e.g., snapshot) for the new version, which is usually discovered by running into test failures. The problems are: * It requires too many manual efforts, which is more fragile. * It is too complicate for release managers to work on, who may not have the required knowledges of the migration/serialization. Potential improvements includes: * Introduce something like `MigrationVersion#versionListSince(MigrationVersion sinceVersion)`, so that most test cases can get an up-to-date list of versions without changing the codes. * Find a way to automate the regeneration of migration tests files. E.g., a script or maven profile that executes all test cases / methods with a specific annotation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24495) Python installdeps hangs
Xintong Song created FLINK-24495: Summary: Python installdeps hangs Key: FLINK-24495 URL: https://issues.apache.org/jira/browse/FLINK-24495 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24922&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=6bb545dd-772d-5d8c-f258-f5085fba3295&l=23587 {code} Oct 10 02:30:01 py38-cython create: /__w/1/s/flink-python/.tox/py38-cython Oct 10 02:30:04 py38-cython installdeps: pytest, apache-beam==2.27.0, cython==0.29.16, grpcio>=1.29.0,<2, grpcio-tools>=1.3.5,<=1.14.2, apache-flink-libraries Oct 10 02:45:22 == Oct 10 02:45:22 Process produced no output for 900 seconds. Oct 10 02:45:22 == {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24480) EqualiserCodeGeneratorTest fails on azure
Xintong Song created FLINK-24480: Summary: EqualiserCodeGeneratorTest fails on azure Key: FLINK-24480 URL: https://issues.apache.org/jira/browse/FLINK-24480 Project: Flink Issue Type: Bug Components: Table SQL / Legacy Planner Affects Versions: 1.13.2 Reporter: Xintong Song Fix For: 1.13.3 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24809&view=logs&j=955770d3-1fed-5a0a-3db6-0c7554c910cb&t=14447d61-56b4-5000-80c1-daa459247f6a&l=42615 {code} Oct 07 01:11:46 [ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.236 s <<< FAILURE! - in org.apache.flink.table.planner.codegen.EqualiserCodeGeneratorTest Oct 07 01:11:46 [ERROR] testManyFields(org.apache.flink.table.planner.codegen.EqualiserCodeGeneratorTest) Time elapsed: 8.21 s <<< FAILURE! Oct 07 01:11:46 java.lang.AssertionError: Expected compilation to succeed Oct 07 01:11:46 at org.junit.Assert.fail(Assert.java:88) Oct 07 01:11:46 at org.apache.flink.table.planner.codegen.EqualiserCodeGeneratorTest.testManyFields(EqualiserCodeGeneratorTest.java:102) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24405) KafkaWriterITCase.testLingeringTransaction fails on azure
Xintong Song created FLINK-24405: Summary: KafkaWriterITCase.testLingeringTransaction fails on azure Key: FLINK-24405 URL: https://issues.apache.org/jira/browse/FLINK-24405 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24595&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=e424005a-b16e-540f-196d-da062cc19bdf&l=7344 {code} Sep 28 22:36:05 [ERROR] Tests run: 13, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 35.773 s <<< FAILURE! - in org.apache.flink.connector.kafka.sink.KafkaWriterITCase Sep 28 22:36:05 [ERROR] testLingeringTransaction Time elapsed: 3.07 s <<< FAILURE! Sep 28 22:36:05 java.lang.AssertionError: Sep 28 22:36:05 Sep 28 22:36:05 Expected: a collection with size <1> Sep 28 22:36:05 but: collection size was <0> Sep 28 22:36:05 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) Sep 28 22:36:05 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) Sep 28 22:36:05 at org.apache.flink.connector.kafka.sink.KafkaWriterITCase.testLingeringTransaction(KafkaWriterITCase.java:213) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24390) Python 'build_wheels mac' fails on azure
Xintong Song created FLINK-24390: Summary: Python 'build_wheels mac' fails on azure Key: FLINK-24390 URL: https://issues.apache.org/jira/browse/FLINK-24390 Project: Flink Issue Type: Bug Components: API / Python, Build System Affects Versions: 1.12.5 Reporter: Xintong Song Fix For: 1.12.6 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24547&view=logs&j=33dd8067-7758-552f-a1cf-a8b8ff0e44cd&t=789348ee-cf3e-5c4b-7c78-355970e5f360&l=17982 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24377) TM resource may not be properly released after heartbeat timeout
Xintong Song created FLINK-24377: Summary: TM resource may not be properly released after heartbeat timeout Key: FLINK-24377 URL: https://issues.apache.org/jira/browse/FLINK-24377 Project: Flink Issue Type: Bug Components: Deployment / Kubernetes, Deployment / YARN, Runtime / Coordination Affects Versions: 1.13.2, 1.14.0 Reporter: Xintong Song Assignee: Xintong Song Fix For: 1.14.0, 1.13.3, 1.15.0 In native k8s and yarn deploy modes, RM disconnects a TM when its heartbeat times out. However, it does not actively release the pod / container of that TM. The releasing of pod / container relies on the TM to terminate itself after failing to re-register to the RM. In some rare conditions, the TM process may not terminate and hang out for long time. In such cases, k8s / yarn sees the process running, thus will not release the pod / container. Neither will Flink's resource manager. Consequently, the resource is leaked until the entire application is terminated. To fix this, we should make {{ActiveResourceManager}} to actively release the resource to K8s / Yarn after a TM heartbeat timeout. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24374) ManualCheckpointITCase.testTriggeringWhenPeriodicDisabled fails on azure
Xintong Song created FLINK-24374: Summary: ManualCheckpointITCase.testTriggeringWhenPeriodicDisabled fails on azure Key: FLINK-24374 URL: https://issues.apache.org/jira/browse/FLINK-24374 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24489&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=5037 {code} Sep 25 01:47:42 java.lang.AssertionError: Sep 25 01:47:42 Sep 25 01:47:42 Expected: <1L> Sep 25 01:47:42 but: was <0L> Sep 25 01:47:42 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) Sep 25 01:47:42 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) Sep 25 01:47:42 at org.apache.flink.test.checkpointing.ManualCheckpointITCase.testTriggeringWhenPeriodicDisabled(ManualCheckpointITCase.java:106) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24358) flink-avro-glue-schema-registry fails compiling with dependency convergence
Xintong Song created FLINK-24358: Summary: flink-avro-glue-schema-registry fails compiling with dependency convergence Key: FLINK-24358 URL: https://issues.apache.org/jira/browse/FLINK-24358 Project: Flink Issue Type: Bug Components: Build System Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24405&view=logs&j=ed6509f5-1153-558c-557a-5ee0afbcdf24&t=241b1e5e-1a8e-5e6a-469a-a9b8cad87065&l=13506 {code} [WARNING] Dependency convergence error for io.netty:netty-handler:4.1.63.Final paths to dependency are: +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-common:1.1.2 +-software.amazon.awssdk:glue:2.16.92 +-software.amazon.awssdk:netty-nio-client:2.16.92 +-io.netty:netty-codec-http:4.1.63.Final +-io.netty:netty-handler:4.1.63.Final and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-common:1.1.2 +-software.amazon.awssdk:glue:2.16.92 +-software.amazon.awssdk:netty-nio-client:2.16.92 +-io.netty:netty-codec-http2:4.1.63.Final +-io.netty:netty-handler:4.1.63.Final and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-common:1.1.2 +-software.amazon.awssdk:glue:2.16.92 +-software.amazon.awssdk:netty-nio-client:2.16.92 +-io.netty:netty-handler:4.1.63.Final and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-common:1.1.2 +-software.amazon.awssdk:glue:2.16.92 +-software.amazon.awssdk:netty-nio-client:2.16.92 +-com.typesafe.netty:netty-reactive-streams-http:2.0.5 +-com.typesafe.netty:netty-reactive-streams:2.0.5 +-io.netty:netty-handler:4.1.52.Final [WARNING] Dependency convergence error for org.jetbrains.kotlin:kotlin-stdlib:1.3.50 paths to dependency are: +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-serde:1.1.2 +-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39 +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-common:1.3.50 +-org.jetbrains.kotlin:kotlin-reflect:1.3.50 +-org.jetbrains.kotlin:kotlin-stdlib:1.3.50 and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-serde:1.1.2 +-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39 +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-common:1.3.50 +-org.jetbrains.kotlin:kotlin-stdlib:1.3.50 and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-serde:1.1.2 +-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39 +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-jvm:1.3.50 +-org.jetbrains.kotlin:kotlin-stdlib:1.3.50 and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-serde:1.1.2 +-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39 +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-stdlib:1.3.50 and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-serde:1.1.2 +-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39 +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50 +-org.jetbrains.kotlinx:kotlinx-coroutines-core:1.1.1 +-org.jetbrains.kotlin:kotlin-stdlib:1.3.20 and +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-serde:1.1.2 +-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39 +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50 +-org.jetbrains.kotlin:kotlin-stdlib:1.3.50 [WARNING] Dependency convergence error for io.netty:netty-codec-http:4.1.63.Final paths to dependency are: +-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT +-software.amazon.glue:schema-registry-common:1.1.2 +-soft
[jira] [Created] (FLINK-24353) Bash scripts do not respect dynamic configurations when calculating memory sizes
Xintong Song created FLINK-24353: Summary: Bash scripts do not respect dynamic configurations when calculating memory sizes Key: FLINK-24353 URL: https://issues.apache.org/jira/browse/FLINK-24353 Project: Flink Issue Type: Bug Components: Deployment / Scripts Affects Versions: 1.13.2, 1.14.0, 1.15.0 Reporter: Xintong Song Assignee: Xintong Song Dynamic configurations (the '-D' arguments) are lost due to changes in FLINK-21128. Consequently, dynamic configurations like the following commands will not take effect. ``` ./bin/taskmanager.sh start -D taskmanager.memory.task.off-heap.size=128m ``` -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24350) Resuming Savepoint (hashmap, sync, scale up) end-to-end test fails due to ask timeout
Xintong Song created FLINK-24350: Summary: Resuming Savepoint (hashmap, sync, scale up) end-to-end test fails due to ask timeout Key: FLINK-24350 URL: https://issues.apache.org/jira/browse/FLINK-24350 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24361&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=142119 {code} Sep 21 16:51:46 Caused by: org.apache.flink.util.SerializedThrowable: Invocation of [RemoteRpcInvocation(null.triggerCheckpoint(ExecutionAttemptID, long, long, CheckpointOptions))] at recipient [akka.tcp://flink@10.1.0.216:38779/user/rpc/taskmanager_0] timed out. Sep 21 16:51:46 at org.apache.flink.runtime.jobmaster.RpcTaskManagerGateway.triggerCheckpoint(RpcTaskManagerGateway.java:106) ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] Sep 21 16:51:46 at org.apache.flink.runtime.executiongraph.Execution.triggerCheckpointHelper(Execution.java:868) ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] Sep 21 16:51:46 at org.apache.flink.runtime.executiongraph.Execution.triggerSynchronousSavepoint(Execution.java:850) ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] Sep 21 16:51:46 at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.triggerTasks(CheckpointCoordinator.java:710) ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] Sep 21 16:51:46 at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.triggerCheckpointRequest(CheckpointCoordinator.java:653) ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] Sep 21 16:51:46 at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.lambda$startTriggeringCheckpoint$6(CheckpointCoordinator.java:620) ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT] Sep 21 16:51:46 at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_292] Sep 21 16:51:46 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_292] Sep 21 16:51:46 at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_292] Sep 21 16:51:46 Caused by: org.apache.flink.util.SerializedThrowable: Ask timed out on [Actor[akka.tcp://flink@10.1.0.216:38779/user/rpc/taskmanager_0#-1544322105]] after [1 ms]. Message of type [org.apache.flink.runtime.rpc.messages.RemoteRpcInvocation]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24333) StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredOnCheckpoint fails on azure
Xintong Song created FLINK-24333: Summary: StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredOnCheckpoint fails on azure Key: FLINK-24333 URL: https://issues.apache.org/jira/browse/FLINK-24333 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24290&view=logs&j=5cae8624-c7eb-5c51-92d3-4d2dacedd221&t=5acec1b4-945b-59ca-34f8-168928ce5199&l=29243 {code} Sep 18 03:47:19 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.304 s <<< FAILURE! - in org.apache.flink.table.runtime.operators.python.aggregate.arrow.stream.StreamArrowPythonGroupWindowAggregateFunctionOperatorTest Sep 18 03:47:19 [ERROR] testFinishBundleTriggeredOnCheckpoint Time elapsed: 0.059 s <<< FAILURE! Sep 18 03:47:19 java.lang.AssertionError: expected:<8> but was:<6> Sep 18 03:47:19 at org.junit.Assert.fail(Assert.java:89) Sep 18 03:47:19 at org.junit.Assert.failNotEquals(Assert.java:835) Sep 18 03:47:19 at org.junit.Assert.assertEquals(Assert.java:647) Sep 18 03:47:19 at org.junit.Assert.assertEquals(Assert.java:633) Sep 18 03:47:19 at org.apache.flink.table.runtime.util.RowDataHarnessAssertor.assertOutputEquals(RowDataHarnessAssertor.java:80) Sep 18 03:47:19 at org.apache.flink.table.runtime.util.RowDataHarnessAssertor.assertOutputEquals(RowDataHarnessAssertor.java:60) Sep 18 03:47:19 at org.apache.flink.table.runtime.operators.python.aggregate.arrow.ArrowPythonAggregateFunctionOperatorTestBase.assertOutputEquals(ArrowPythonAggregateFunctionOperatorTestBase.java:62) Sep 18 03:47:19 at org.apache.flink.table.runtime.operators.python.aggregate.arrow.stream.StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredOnCheckpoint(StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.java:238) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24331) PartiallyFinishedSourcesITCase fails with "No downstream received 0 from xxx;"
Xintong Song created FLINK-24331: Summary: PartiallyFinishedSourcesITCase fails with "No downstream received 0 from xxx;" Key: FLINK-24331 URL: https://issues.apache.org/jira/browse/FLINK-24331 Project: Flink Issue Type: Bug Components: API / DataStream Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24287&view=logs&j=4d4a0d10-fca2-5507-8eed-c07f0bdf4887&t=7b25afdf-cc6c-566f-5459-359dc2585798&l=10945 {code} Sep 18 02:21:08 [ERROR] Tests run: 12, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 224.44 s <<< FAILURE! - in org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase Sep 18 02:21:08 [ERROR] test[complex graph SINGLE_SUBTASK, failover: true, strategy: region] Time elapsed: 28.807 s <<< FAILURE! Sep 18 02:21:08 java.lang.AssertionError: No downstream received 0 from 0003[0]; received: {0=OperatorFinished 0007/0, 1=OperatorFinished 0007/1, 2=OperatorFinished 0007/2, 3=OperatorFinished 0007/3} Sep 18 02:21:08 at org.junit.Assert.fail(Assert.java:89) Sep 18 02:21:08 at org.junit.Assert.assertTrue(Assert.java:42) Sep 18 02:21:08 at org.apache.flink.runtime.operators.lifecycle.validation.TestJobDataFlowValidator.lambda$checkDataFlow$1(TestJobDataFlowValidator.java:96) Sep 18 02:21:08 at java.util.HashMap.forEach(HashMap.java:1289) Sep 18 02:21:08 at org.apache.flink.runtime.operators.lifecycle.validation.TestJobDataFlowValidator.checkDataFlow(TestJobDataFlowValidator.java:94) Sep 18 02:21:08 at org.apache.flink.runtime.operators.lifecycle.validation.TestJobDataFlowValidator.checkDataFlow(TestJobDataFlowValidator.java:62) Sep 18 02:21:08 at org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase.test(PartiallyFinishedSourcesITCase.java:139) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24330) HiveRunnerITCase JVM crash
Xintong Song created FLINK-24330: Summary: HiveRunnerITCase JVM crash Key: FLINK-24330 URL: https://issues.apache.org/jira/browse/FLINK-24330 Project: Flink Issue Type: Bug Components: Connectors / Hive Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24282&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=24092 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24329) PulsarSourceITCase fails due to port conflict
Xintong Song created FLINK-24329: Summary: PulsarSourceITCase fails due to port conflict Key: FLINK-24329 URL: https://issues.apache.org/jira/browse/FLINK-24329 Project: Flink Issue Type: Bug Components: Connectors / Pulsar Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24255&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=24666 {code} Sep 17 12:47:02 Caused by: org.apache.pulsar.broker.PulsarServerException: org.apache.pulsar.broker.PulsarServerException: java.io.IOException: Failed to bind to /0.0.0.0:6972 Sep 17 12:47:02 at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:821) Sep 17 12:47:02 at org.apache.flink.connector.pulsar.testutils.runtime.mock.PulsarMockRuntime.startUp(PulsarMockRuntime.java:59) Sep 17 12:47:02 ... 39 more Sep 17 12:47:02 Caused by: org.apache.pulsar.broker.PulsarServerException: java.io.IOException: Failed to bind to /0.0.0.0:6972 Sep 17 12:47:02 at org.apache.pulsar.broker.web.WebService.start(WebService.java:258) Sep 17 12:47:02 at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:723) Sep 17 12:47:02 ... 40 more Sep 17 12:47:02 Caused by: java.io.IOException: Failed to bind to /0.0.0.0:6972 Sep 17 12:47:02 at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:349) Sep 17 12:47:02 at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:310) Sep 17 12:47:02 at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80) Sep 17 12:47:02 at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:234) Sep 17 12:47:02 at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73) Sep 17 12:47:02 at org.eclipse.jetty.server.Server.doStart(Server.java:401) Sep 17 12:47:02 at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73) Sep 17 12:47:02 at org.apache.pulsar.broker.web.WebService.start(WebService.java:241) Sep 17 12:47:02 ... 41 more Sep 17 12:47:02 Caused by: java.net.BindException: Address already in use Sep 17 12:47:02 at sun.nio.ch.Net.bind0(Native Method) Sep 17 12:47:02 at sun.nio.ch.Net.bind(Net.java:461) Sep 17 12:47:02 at sun.nio.ch.Net.bind(Net.java:453) Sep 17 12:47:02 at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222) Sep 17 12:47:02 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85) Sep 17 12:47:02 at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:344) Sep 17 12:47:02 ... 48 more {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24313) JdbcCatalogFactoryTest fails due to "Gave up waiting for server to start after 10000ms"
Xintong Song created FLINK-24313: Summary: JdbcCatalogFactoryTest fails due to "Gave up waiting for server to start after 1ms" Key: FLINK-24313 URL: https://issues.apache.org/jira/browse/FLINK-24313 Project: Flink Issue Type: Bug Components: Connectors / JDBC Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24212&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=14018 {code} Sep 16 14:07:22 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 14.065 s <<< FAILURE! - in org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactoryTest Sep 16 14:07:22 [ERROR] org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactoryTest Time elapsed: 14.065 s <<< ERROR! Sep 16 14:07:22 java.io.IOException: Gave up waiting for server to start after 1ms Sep 16 14:07:22 at com.opentable.db.postgres.embedded.EmbeddedPostgres.waitForServerStartup(EmbeddedPostgres.java:308) Sep 16 14:07:22 at com.opentable.db.postgres.embedded.EmbeddedPostgres.startPostmaster(EmbeddedPostgres.java:257) Sep 16 14:07:22 at com.opentable.db.postgres.embedded.EmbeddedPostgres.(EmbeddedPostgres.java:146) Sep 16 14:07:22 at com.opentable.db.postgres.embedded.EmbeddedPostgres$Builder.start(EmbeddedPostgres.java:554) Sep 16 14:07:22 at com.opentable.db.postgres.junit.SingleInstancePostgresRule.pg(SingleInstancePostgresRule.java:46) Sep 16 14:07:22 at com.opentable.db.postgres.junit.SingleInstancePostgresRule.before(SingleInstancePostgresRule.java:39) Sep 16 14:07:22 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50) Sep 16 14:07:22 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Sep 16 14:07:22 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Sep 16 14:07:22 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Sep 16 14:07:22 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Sep 16 14:07:22 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Sep 16 14:07:22 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43) Sep 16 14:07:22 at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) Sep 16 14:07:22 at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) Sep 16 14:07:22 at java.util.Iterator.forEachRemaining(Iterator.java:116) Sep 16 14:07:22 at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801) Sep 16 14:07:22 at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) Sep 16 14:07:22 at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) Sep 16 14:07:22 at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) Sep 16 14:07:22 at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173) Sep 16 14:07:22 at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) Sep 16 14:07:22 at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485) Sep 16 14:07:22 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82) Sep 16 14:07:22 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73) Sep 16 14:07:22 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220) Sep 16 14:07:22 at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188) Sep 16 14:07:22 at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202) Sep 16 14:07:22 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181) Sep 16 14:07:22 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128) Sep 16 14:07:22 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150) Sep 16 14:07:22 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120) Sep 16 14:07:22 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) Sep 16 14:07:22 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) Sep 16 14:07:22 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) Sep 16 14:07:22 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) Sep 16 14:07:22 Caused by: java.sql.SQ
[jira] [Created] (FLINK-24312) 'New File Sink s3 end-to-end test' fails due to timeout
Xintong Song created FLINK-24312: Summary: 'New File Sink s3 end-to-end test' fails due to timeout Key: FLINK-24312 URL: https://issues.apache.org/jira/browse/FLINK-24312 Project: Flink Issue Type: Bug Components: API / DataStream, Connectors / FileSystem Affects Versions: 1.12.5 Reporter: Xintong Song Fix For: 1.12.6 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24194&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=ff888d9b-cd34-53cc-d90f-3e446d355529&l=12970 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24305) BatchPandasUDAFITTests.test_over_window_aggregate_function fails on azure
Xintong Song created FLINK-24305: Summary: BatchPandasUDAFITTests.test_over_window_aggregate_function fails on azure Key: FLINK-24305 URL: https://issues.apache.org/jira/browse/FLINK-24305 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24170&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=c67e71ed-6451-5d26-8920-5a8cf9651901&l=23011 {code} Sep 15 20:40:43 cls = Sep 15 20:40:43 actual = JavaObject id=o8666 Sep 15 20:40:43 expected = ['+I[1, 4.335, 13, 5.5, 3.0, 3.0, 4.335, 8.0, 5.0, 5.0]', '+I[1, 4.335, 5, 4.335, 3.0, 3.0, 2.5, 4.3330, 4.0, 2.0]', '+I[2, 2.0, 9, 2.0, 4.0, 4.0, 2.0, 2.0, 4.0, 4.0]', '+I[3, 2.0, 3, 2.0, 1.0, 1.0, 2.0, 2.0, 1.0, 1.0]'] Sep 15 20:40:43 Sep 15 20:40:43 @classmethod Sep 15 20:40:43 def assert_equals(cls, actual, expected): Sep 15 20:40:43 if isinstance(actual, JavaObject): Sep 15 20:40:43 actual_py_list = cls.to_py_list(actual) Sep 15 20:40:43 else: Sep 15 20:40:43 actual_py_list = actual Sep 15 20:40:43 actual_py_list.sort() Sep 15 20:40:43 expected.sort() Sep 15 20:40:43 assert len(actual_py_list) == len(expected) Sep 15 20:40:43 > assert all(x == y for x, y in zip(actual_py_list, expected)) Sep 15 20:40:43 E AssertionError: assert False Sep 15 20:40:43 E+ where False = all(. at 0x7f792d98b900>) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24304) ProcessFailureCancelingITCase.testCancelingOnProcessFailure fails due to leader retrieval timeout
Xintong Song created FLINK-24304: Summary: ProcessFailureCancelingITCase.testCancelingOnProcessFailure fails due to leader retrieval timeout Key: FLINK-24304 URL: https://issues.apache.org/jira/browse/FLINK-24304 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.12.5 Reporter: Xintong Song Fix For: 1.12.6 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24145&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=f508e270-48d6-5f1e-3138-42a17e0714f0&l=4153 {code} [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 26.597 s <<< FAILURE! - in org.apache.flink.test.recovery.ProcessFailureCancelingITCase [ERROR] testCancelingOnProcessFailure(org.apache.flink.test.recovery.ProcessFailureCancelingITCase) Time elapsed: 25.988 s <<< ERROR! org.apache.flink.runtime.leaderretrieval.LeaderRetrievalException: Could not retrieve the leader address and leader session ID. at org.apache.flink.runtime.util.LeaderRetrievalUtils.retrieveLeaderConnectionInfo(LeaderRetrievalUtils.java:63) at org.apache.flink.test.recovery.ProcessFailureCancelingITCase.retrieveDispatcherGateway(ProcessFailureCancelingITCase.java:283) at org.apache.flink.test.recovery.ProcessFailureCancelingITCase.testCancelingOnProcessFailure(ProcessFailureCancelingITCase.java:216) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) Caused by: java.util.concurrent.TimeoutException at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1784) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928) at org.apache.flink.runtime.util.LeaderRetrievalUtils.retrieveLeaderConnectionInfo(LeaderRetrievalUtils.java:61) ... 32 more {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24288) YARNITCase.testPerJobWithArchive fails on azure
Xintong Song created FLINK-24288: Summary: YARNITCase.testPerJobWithArchive fails on azure Key: FLINK-24288 URL: https://issues.apache.org/jira/browse/FLINK-24288 Project: Flink Issue Type: Bug Components: Deployment / YARN Affects Versions: 1.13.2 Reporter: Xintong Song Fix For: 1.13.3 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24110&view=logs&j=5cae8624-c7eb-5c51-92d3-4d2dacedd221&t=420bd9ec-164e-562e-8947-0dacde3cec91&l=28978 {code} Sep 15 03:56:13 [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 152.597 s <<< FAILURE! - in org.apache.flink.yarn.YARNITCase Sep 15 03:56:13 [ERROR] testPerJobWithArchive(org.apache.flink.yarn.YARNITCase) Time elapsed: 25.161 s <<< FAILURE! Sep 15 03:56:13 java.lang.AssertionError: The lib directory should be uploaded to staging directory. Sep 15 03:56:13 at org.junit.Assert.fail(Assert.java:88) Sep 15 03:56:13 at org.junit.Assert.assertTrue(Assert.java:41) Sep 15 03:56:13 at org.apache.flink.yarn.YARNITCase.checkStagingDirectory(YARNITCase.java:209) Sep 15 03:56:13 at org.apache.flink.yarn.YARNITCase.deployPerJob(YARNITCase.java:184) Sep 15 03:56:13 at org.apache.flink.yarn.YARNITCase.lambda$testPerJobWithArchive$4(YARNITCase.java:133) Sep 15 03:56:13 at org.apache.flink.yarn.YarnTestBase.runTest(YarnTestBase.java:288) Sep 15 03:56:13 at org.apache.flink.yarn.YARNITCase.testPerJobWithArchive(YARNITCase.java:133) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24268) Documentation for building PyFlink does not show correctly.
Xintong Song created FLINK-24268: Summary: Documentation for building PyFlink does not show correctly. Key: FLINK-24268 URL: https://issues.apache.org/jira/browse/FLINK-24268 Project: Flink Issue Type: Bug Components: API / Python, Documentation Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 Attachments: 截屏2021-09-13 下午2.53.41.png https://ci.apache.org/projects/flink/flink-docs-master/docs/flinkdev/building/#build-pyflink "The sdist package of xxx will be found under..." where xxx is not showing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24267) PyFlink Table API example from docs does not work.
Xintong Song created FLINK-24267: Summary: PyFlink Table API example from docs does not work. Key: FLINK-24267 URL: https://issues.apache.org/jira/browse/FLINK-24267 Project: Flink Issue Type: Bug Components: API / Python, Documentation Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 I followed the following documentation to build and install pyflink from sources. https://ci.apache.org/projects/flink/flink-docs-master/docs/flinkdev/building/#build-pyflink Then I tried the WordCount.py example from the following documentation. https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/python/table_api_tutorial/ This results in the following error. {code} $ python WordCount.py Traceback (most recent call last): File "WordCount.py", line 2, in from pyflink.table.descriptors import Schema, FileSystem ImportError: cannot import name 'FileSystem' from 'pyflink.table.descriptors' (/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pyflink/table/descriptors.py) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24265) Streaming File Sink s3 end-to-end test fails due to Output hash mismatch
Xintong Song created FLINK-24265: Summary: Streaming File Sink s3 end-to-end test fails due to Output hash mismatch Key: FLINK-24265 URL: https://issues.apache.org/jira/browse/FLINK-24265 Project: Flink Issue Type: Bug Components: API / DataStream Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23962&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=11428 {code} Sep 13 04:56:56 FAIL File Streaming Sink: Output hash mismatch. Got e700d1164e7deb36fbbd95c38ff62897, expected 6727342fdd3aae2129e61fc8f433fb6f. Sep 13 04:56:56 head hexdump of actual: Sep 13 04:56:56 000 E r r o r e x e c u t i n g Sep 13 04:56:56 010 a w s c o m m a n d : s 3 Sep 13 04:56:56 020 c p - - q u i e t s 3 : / / Sep 13 04:56:56 030 f l i n k - i n t e g r a t i o Sep 13 04:56:56 040 n - t e s t s / t e m p / t e s Sep 13 04:56:56 050 t _ f i l e _ s i n k - 6 8 4 6 Sep 13 04:56:56 060 c 8 2 1 - 3 b 5 8 - 4 c 6 6 - b Sep 13 04:56:56 070 0 e f - 3 2 0 3 2 a 7 3 4 4 1 3 Sep 13 04:56:56 080 / h o s t d i r / / t e m p - Sep 13 04:56:56 090 t e s t - d i r e c t o r y - 4 Sep 13 04:56:56 0a0 1 9 6 9 4 8 8 4 2 0 / t e m p / Sep 13 04:56:56 0b0 t e s t _ f i l e _ s i n k - 6 Sep 13 04:56:56 0c0 8 4 6 c 8 2 1 - 3 b 5 8 - 4 c 6 Sep 13 04:56:56 0d0 6 - b 0 e f - 3 2 0 3 2 a 7 3 4 Sep 13 04:56:56 0e0 4 1 3 - - e x c l u d e ' * Sep 13 04:56:56 0f0 ' - - i n c l u d e ' * / p Sep 13 04:56:56 100 a r t - [ ! / ] * ' - - r e c Sep 13 04:56:56 110 u r s i v e \n {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24263) PulsarSourceITCase.testMultipleSplits fails due to "Consumer not found"
Xintong Song created FLINK-24263: Summary: PulsarSourceITCase.testMultipleSplits fails due to "Consumer not found" Key: FLINK-24263 URL: https://issues.apache.org/jira/browse/FLINK-24263 Project: Flink Issue Type: Bug Components: Connectors / Pulsar Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23958&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=24936 {code} Sep 13 00:00:49 Caused by: org.apache.pulsar.client.api.PulsarClientException$BrokerMetadataException: Consumer not found Sep 13 00:00:49 at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:987) Sep 13 00:00:49 at org.apache.pulsar.client.impl.PulsarClientImpl.close(PulsarClientImpl.java:658) Sep 13 00:00:49 at org.apache.flink.connector.pulsar.source.reader.source.PulsarSourceReaderBase.close(PulsarSourceReaderBase.java:83) Sep 13 00:00:49 at org.apache.flink.connector.pulsar.source.reader.source.PulsarOrderedSourceReader.close(PulsarOrderedSourceReader.java:170) Sep 13 00:00:49 at org.apache.flink.streaming.api.operators.SourceOperator.close(SourceOperator.java:324) Sep 13 00:00:49 at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:141) Sep 13 00:00:49 at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:127) Sep 13 00:00:49 at org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1030) Sep 13 00:00:49 at org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:874) Sep 13 00:00:49 at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:762) Sep 13 00:00:49 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) Sep 13 00:00:49 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937) Sep 13 00:00:49 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) Sep 13 00:00:49 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) Sep 13 00:00:49 at java.lang.Thread.run(Thread.java:748){code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24261) KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"
Xintong Song created FLINK-24261: Summary: KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic" Key: FLINK-24261 URL: https://issues.apache.org/jira/browse/FLINK-24261 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23955&view=logs&j=b0097207-033c-5d9a-b48c-6d4796fbe60d&t=8338a7d2-16f7-52e5-f576-4b7b3071eb3d&l=7119 {code} Sep 13 01:14:27 [ERROR] Tests run: 12, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 180.412 s <<< FAILURE! - in org.apache.flink.connector.kafka.source.KafkaSourceITCase Sep 13 01:14:27 [ERROR] testMultipleSplits{TestEnvironment, ExternalContext}[1] Time elapsed: 120.244 s <<< ERROR! Sep 13 01:14:27 java.lang.RuntimeException: Cannot create topic 'kafka-single-topic-7245292146378659602' Sep 13 01:14:27 at org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createTopic(KafkaSingleTopicExternalContext.java:100) Sep 13 01:14:27 at org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createSourceSplitDataWriter(KafkaSingleTopicExternalContext.java:142) Sep 13 01:14:27 at org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.generateAndWriteTestData(SourceTestSuiteBase.java:301) Sep 13 01:14:27 at org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testMultipleSplits(SourceTestSuiteBase.java:142) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24260) py35-cython fails due to could not find requests>=2.26.0
Xintong Song created FLINK-24260: Summary: py35-cython fails due to could not find requests>=2.26.0 Key: FLINK-24260 URL: https://issues.apache.org/jira/browse/FLINK-24260 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.12.5 Reporter: Xintong Song Fix For: 1.12.6 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23942&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=8d78fe4f-d658-5c70-12f8-4921589024c3&l=21015 {code} Collecting requests>=2.26.0 (from apache-flink==1.12.dev0) Could not find a version that satisfies the requirement requests>=2.26.0 (from apache-flink==1.12.dev0) (from versions: 0.2.0, 0.2.1, 0.2.2, 0.2.3, 0.2.4, 0.3.0, 0.3.1, 0.3.2, 0.3.3, 0.3.4, 0.4.0, 0.4.1, 0.5.0, 0.5.1, 0.6.0, 0.6.1, 0.6.2, 0.6.3, 0.6.4, 0.6.5, 0.6.6, 0.7.0, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 0.7.5, 0.7.6, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.5, 0.8.6, 0.8.7, 0.8.8, 0.8.9, 0.9.0, 0.9.1, 0.9.2, 0.9.3, 0.10.0, 0.10.1, 0.10.2, 0.10.3, 0.10.4, 0.10.6, 0.10.7, 0.10.8, 0.11.1, 0.11.2, 0.12.0, 0.12.1, 0.13.0, 0.13.1, 0.13.2, 0.13.3, 0.13.4, 0.13.5, 0.13.6, 0.13.7, 0.13.8, 0.13.9, 0.14.0, 0.14.1, 0.14.2, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.1.0, 1.2.0, 1.2.1, 1.2.2, 1.2.3, 2.0.0, 2.0.1, 2.1.0, 2.2.0, 2.2.1, 2.3.0, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.5.0, 2.5.1, 2.5.2, 2.5.3, 2.6.0, 2.6.1, 2.6.2, 2.7.0, 2.8.0, 2.8.1, 2.9.0, 2.9.1, 2.9.2, 2.10.0, 2.11.0, 2.11.1, 2.12.0, 2.12.1, 2.12.2, 2.12.3, 2.12.4, 2.12.5, 2.13.0, 2.14.0, 2.14.1, 2.14.2, 2.15.1, 2.16.0, 2.16.1, 2.16.2, 2.16.3, 2.16.4, 2.16.5, 2.17.0, 2.17.1, 2.17.2, 2.17.3, 2.18.0, 2.18.1, 2.18.2, 2.18.3, 2.18.4, 2.19.0, 2.19.1, 2.20.0, 2.20.1, 2.21.0, 2.22.0, 2.23.0, 2.24.0, 2.25.0, 2.25.1) No matching distribution found for requests>=2.26.0 (from apache-flink==1.12.dev0) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24242) KafkaSinkITCase.testAbortTransactionsOfPendingCheckpointsAfterFailure fails due to NoSuchFileException
Xintong Song created FLINK-24242: Summary: KafkaSinkITCase.testAbortTransactionsOfPendingCheckpointsAfterFailure fails due to NoSuchFileException Key: FLINK-24242 URL: https://issues.apache.org/jira/browse/FLINK-24242 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23876&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=e424005a-b16e-540f-196d-da062cc19bdf&l=7335 {code} Sep 10 00:06:17 [ERROR] Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 79.401 s <<< FAILURE! - in org.apache.flink.connector.kafka.sink.KafkaSinkITCase Sep 10 00:06:17 [ERROR] testAbortTransactionsOfPendingCheckpointsAfterFailure Time elapsed: 2.358 s <<< ERROR! Sep 10 00:06:17 java.io.UncheckedIOException: java.nio.file.NoSuchFileException: /tmp/junit7927515964136749979/junit1325061264264479088/9554f057606834081bc37f12e8f298f5/chk-2 Sep 10 00:06:17 at java.nio.file.FileTreeIterator.fetchNextIfNeeded(FileTreeIterator.java:88) Sep 10 00:06:17 at java.nio.file.FileTreeIterator.hasNext(FileTreeIterator.java:104) Sep 10 00:06:17 at java.util.Iterator.forEachRemaining(Iterator.java:115) Sep 10 00:06:17 at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801) Sep 10 00:06:17 at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) Sep 10 00:06:17 at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) Sep 10 00:06:17 at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) Sep 10 00:06:17 at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) Sep 10 00:06:17 at java.util.stream.ReferencePipeline.reduce(ReferencePipeline.java:546) Sep 10 00:06:17 at java.util.stream.ReferencePipeline.max(ReferencePipeline.java:582) Sep 10 00:06:17 at org.apache.flink.test.util.TestUtils.getMostRecentCompletedCheckpoint(TestUtils.java:99) Sep 10 00:06:17 at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testAbortTransactionsOfPendingCheckpointsAfterFailure(KafkaSinkITCase.java:247) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24241) test_table_environment_api.py fail with NPE
Xintong Song created FLINK-24241: Summary: test_table_environment_api.py fail with NPE Key: FLINK-24241 URL: https://issues.apache.org/jira/browse/FLINK-24241 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23876&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=6bb545dd-772d-5d8c-f258-f5085fba3295&l=23263 {code} Sep 10 03:03:39 E py4j.protocol.Py4JJavaError: An error occurred while calling o16211.execute. Sep 10 03:03:39 E : java.lang.NullPointerException Sep 10 03:03:39 E at java.util.Objects.requireNonNull(Objects.java:203) Sep 10 03:03:39 E at org.apache.calcite.rel.metadata.RelMetadataQuery.(RelMetadataQuery.java:144) Sep 10 03:03:39 E at org.apache.calcite.rel.metadata.RelMetadataQuery.(RelMetadataQuery.java:108) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.metadata.FlinkRelMetadataQuery.(FlinkRelMetadataQuery.java:78) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.metadata.FlinkRelMetadataQuery.instance(FlinkRelMetadataQuery.java:59) Sep 10 03:03:39 E at org.apache.flink.table.planner.calcite.FlinkRelOptClusterFactory$$anon$1.get(FlinkRelOptClusterFactory.scala:39) Sep 10 03:03:39 E at org.apache.flink.table.planner.calcite.FlinkRelOptClusterFactory$$anon$1.get(FlinkRelOptClusterFactory.scala:38) Sep 10 03:03:39 E at org.apache.calcite.plan.RelOptCluster.getMetadataQuery(RelOptCluster.java:178) Sep 10 03:03:39 E at org.apache.calcite.rel.metadata.RelMdUtil.clearCache(RelMdUtil.java:965) Sep 10 03:03:39 E at org.apache.calcite.plan.hep.HepPlanner.buildFinalPlan(HepPlanner.java:942) Sep 10 03:03:39 E at org.apache.calcite.plan.hep.HepPlanner.buildFinalPlan(HepPlanner.java:939) Sep 10 03:03:39 E at org.apache.calcite.plan.hep.HepPlanner.findBestExp(HepPlanner.java:194) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.optimize.program.FlinkHepProgram.optimize(FlinkHepProgram.scala:69) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.optimize.program.FlinkHepRuleSetProgram.optimize(FlinkHepRuleSetProgram.scala:87) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1$$anonfun$apply$1.apply(FlinkGroupProgram.scala:63) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1$$anonfun$apply$1.apply(FlinkGroupProgram.scala:60) Sep 10 03:03:39 E at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) Sep 10 03:03:39 E at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) Sep 10 03:03:39 E at scala.collection.Iterator$class.foreach(Iterator.scala:891) Sep 10 03:03:39 E at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) Sep 10 03:03:39 E at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) Sep 10 03:03:39 E at scala.collection.AbstractIterable.foreach(Iterable.scala:54) Sep 10 03:03:39 E at scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157) Sep 10 03:03:39 E at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1.apply(FlinkGroupProgram.scala:60) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1.apply(FlinkGroupProgram.scala:55) Sep 10 03:03:39 E at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) Sep 10 03:03:39 E at scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157) Sep 10 03:03:39 E at scala.collection.immutable.Range.foreach(Range.scala:160) Sep 10 03:03:39 E at scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157) Sep 10 03:03:39 E at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104) Sep 10 03:03:39 E at org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram.optimize(FlinkGroupP
[jira] [Created] (FLINK-24205) AggregateReduceGroupingITCase hangs on azure
Xintong Song created FLINK-24205: Summary: AggregateReduceGroupingITCase hangs on azure Key: FLINK-24205 URL: https://issues.apache.org/jira/browse/FLINK-24205 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.13.2 Reporter: Xintong Song Fix For: 1.13.3 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23720&view=logs&j=955770d3-1fed-5a0a-3db6-0c7554c910cb&t=14447d61-56b4-5000-80c1-daa459247f6a&l=7574 {code} Sep 08 02:08:51 "main" #1 prio=5 os_prio=0 tid=0x7f02d400b800 nid=0x1471 waiting on condition [0x7f02dc62a000] Sep 08 02:08:51java.lang.Thread.State: WAITING (parking) Sep 08 02:08:51 at sun.misc.Unsafe.park(Native Method) Sep 08 02:08:51 - parking to wait for <0xd465c060> (a java.util.concurrent.CompletableFuture$Signaller) Sep 08 02:08:51 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) Sep 08 02:08:51 at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707) Sep 08 02:08:51 at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323) Sep 08 02:08:51 at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742) Sep 08 02:08:51 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) Sep 08 02:08:51 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sendRequest(CollectResultFetcher.java:163) Sep 08 02:08:51 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:128) Sep 08 02:08:51 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106) Sep 08 02:08:51 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80) Sep 08 02:08:51 at org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370) Sep 08 02:08:51 at java.util.Iterator.forEachRemaining(Iterator.java:115) Sep 08 02:08:51 at org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109) Sep 08 02:08:51 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.executeQuery(BatchTestBase.scala:300) Sep 08 02:08:51 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.check(BatchTestBase.scala:140) Sep 08 02:08:51 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.checkResult(BatchTestBase.scala:106) Sep 08 02:08:51 at org.apache.flink.table.planner.runtime.batch.sql.agg.AggregateReduceGroupingITCase.testAggOnWindow(AggregateReduceGroupingITCase.scala:282) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24203) AbstractServerTest fails due to port conflict
Xintong Song created FLINK-24203: Summary: AbstractServerTest fails due to port conflict Key: FLINK-24203 URL: https://issues.apache.org/jira/browse/FLINK-24203 Project: Flink Issue Type: Bug Components: Runtime / Queryable State Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23718&view=logs&j=c91190b6-40ae-57b2-5999-31b869b0a7c1&t=41463ccd-0694-5d4d-220d-8f771e7d098b&l=15081 {code} Sep 08 00:18:11 [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.19 s <<< FAILURE! - in org.apache.flink.queryablestate.network.AbstractServerTest Sep 08 00:18:11 [ERROR] testServerInitializationFailure Time elapsed: 0.026 s <<< FAILURE! Sep 08 00:18:11 java.lang.AssertionError: Sep 08 00:18:11 Sep 08 00:18:11 Expected: (an instance of org.apache.flink.util.FlinkRuntimeException and exception with message a string containing "Unable to start Test Server 2. All ports in provided range are occupied.") Sep 08 00:18:11 but: exception with message a string containing "Unable to start Test Server 2. All ports in provided range are occupied." message was "Unable to start Test Server 1. All ports in provided range are occupied." Sep 08 00:18:11 Stacktrace was: org.apache.flink.util.FlinkRuntimeException: Unable to start Test Server 1. All ports in provided range are occupied. Sep 08 00:18:11 at org.apache.flink.queryablestate.network.AbstractServerBase.start(AbstractServerBase.java:209) Sep 08 00:18:11 at org.apache.flink.queryablestate.network.AbstractServerTest.testServerInitializationFailure(AbstractServerTest.java:73) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24202) BoundedSourceITCase hangs on azure
Xintong Song created FLINK-24202: Summary: BoundedSourceITCase hangs on azure Key: FLINK-24202 URL: https://issues.apache.org/jira/browse/FLINK-24202 Project: Flink Issue Type: Bug Components: API / DataStream Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23718&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=5389 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24200) CheckpointBarrierTrackerTest.testTwoLastBarriersOneByOne fails on azure
Xintong Song created FLINK-24200: Summary: CheckpointBarrierTrackerTest.testTwoLastBarriersOneByOne fails on azure Key: FLINK-24200 URL: https://issues.apache.org/jira/browse/FLINK-24200 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.12.5 Reporter: Xintong Song Fix For: 1.12.6 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23719&view=logs&j=f0ac5c25-1168-55a5-07ff-0e88223afed9&t=0dbaca5d-7c38-52e6-f4fe-2fb69ccb3ada&l=8983 {code} [ERROR] Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.893 s <<< FAILURE! - in org.apache.flink.streaming.runtime.io.CheckpointBarrierTrackerTest [ERROR] testTwoLastBarriersOneByOne(org.apache.flink.streaming.runtime.io.CheckpointBarrierTrackerTest) Time elapsed: 0.093 s <<< FAILURE! java.lang.AssertionError: Expected: a value less than or equal to <30L> but: <33L> was greater than <30L> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) at org.junit.Assert.assertThat(Assert.java:956) at org.junit.Assert.assertThat(Assert.java:923) at org.apache.flink.streaming.runtime.io.CheckpointBarrierTrackerTest.testTwoLastBarriersOneByOne(CheckpointBarrierTrackerTest.java:616) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24188) flink-python NOTICE file contains unnecessary dependencies
Xintong Song created FLINK-24188: Summary: flink-python NOTICE file contains unnecessary dependencies Key: FLINK-24188 URL: https://issues.apache.org/jira/browse/FLINK-24188 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 The following items in the NOTICE file should not be needed. * com.github.jponge:lzma-java:1.3 * com.google.api.grpc:proto-google-common-protos:1.12.0 * com.google.auth:google-auth-library-credentials:0.18.0 * com.google.code.gson:gson:2.8.6 * com.google.guava:guava:26.0-jre * com.google.protobuf.nano:protobuf-javanano:3.0.0-alpha-5 * com.google.protobuf:protobuf-java-util:3.11.0 * com.google.protobuf:protobuf-java:3.11.0 * com.jcraft:jzlib:1.1.3 * com.ning:compress-lzf:1.0.3 * io.grpc:grpc-auth:1.26.0 * io.grpc:grpc-context:1.26.0 * io.grpc:grpc-core:1.26.0 * io.grpc:grpc-netty:1.26.0 * io.grpc:grpc-protobuf:1.26.0 * io.grpc:grpc-stub:1.26.0 * io.grpc:grpc-testing:1.26.0 * io.netty:netty-buffer:4.1.51.Final * io.netty:netty-codec-http2:4.1.51.Final * io.netty:netty-codec-http:4.1.51.Final * io.netty:netty-codec-socks:4.1.51.Final * io.netty:netty-codec:4.1.51.Final * io.netty:netty-common:4.1.51.Final * io.netty:netty-handler-proxy:4.1.51.Final * io.netty:netty-handler:4.1.51.Final * io.netty:netty-resolver:4.1.51.Final * io.netty:netty-tcnative-boringssl-static:2.0.33.Final * io.netty:netty-transport-native-epoll:4.1.51.Final * io.netty:netty-transport-native-unix-common:4.1.51.Final * io.netty:netty-transport:4.1.51.Final * io.opencensus:opencensus-api:0.24.0 * io.opencensus:opencensus-contrib-grpc-metrics:0.24.0 * io.perfmark:perfmark-api:0.19.0 * net.jpountz.lz4:lz4:1.3.0 * org.bouncycastle:bcpkix-jdk15on:1.54 * org.bouncycastle:bcprov-jdk15on:1.54 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24185) flink-s3-fs-presto bundled dependencies not listed in NOTICE file
Xintong Song created FLINK-24185: Summary: flink-s3-fs-presto bundled dependencies not listed in NOTICE file Key: FLINK-24185 URL: https://issues.apache.org/jira/browse/FLINK-24185 Project: Flink Issue Type: Bug Components: FileSystems Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 The following bundled dependencies missing in NOTICE file. * aopalliance:aopalliance:1.0 * com.facebook.airlift:configuration:0.201 * com.facebook.airlift:log:0.201 * com.facebook.airlift:stats:0.201 * com.facebook.presto.hadoop:hadoop-apache2:2.7.3-1 * com.facebook.presto:presto-common:0.257 * com.facebook.presto:presto-hive-common:0.257 * com.facebook.presto:presto-hive-metastore:0.257 * com.facebook.presto:presto-hive:0.257 * com.google.inject:guice:4.2.2 * dnsjava:dnsjava:2.1.7 * io.airlift:slice:0.38 * io.airlift:units:1.3 * org.alluxio:alluxio-shaded-client:2.5.0-3 * org.hdrhistogram:HdrHistogram:2.1.9 * org.weakref:jmxutils:1.19 The following bundled dependencies listed with incorrect version in NOTICE file. * com.google.guava:guava:26.0-jre The following should not be listed in NOTICE file * com.google.errorprone:error_prone_annotations:2.2.0 * com.google.guava:failureaccess:1.0 * com.google.guava:listenablefuture:.0-empty-to-avoid-conflict-with-guava * com.google.j2objc:j2objc-annotations:1.1 * commons-lang:commons-lang:2.6 * org.apache.hadoop.thirdparty:hadoop-shaded-guava:1.1.1 * org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:1.1.1 * org.wildfly.openssl:wildfly-openssl:1.0.7.Final -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24180) UnalignedCheckpointRescaleITCase fails due to direct OOM
Xintong Song created FLINK-24180: Summary: UnalignedCheckpointRescaleITCase fails due to direct OOM Key: FLINK-24180 URL: https://issues.apache.org/jira/browse/FLINK-24180 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23626&view=logs&j=b0a398c0-685b-599c-eb57-c8c2a771138e&t=747432ad-a576-5911-1e2a-68c6bedc248a&l=10707 {code} Sep 07 00:42:31 Caused by: java.lang.OutOfMemoryError: Direct buffer memory. The direct out-of-memory error has occurred. This can mean two things: either job(s) require(s) a larger size of JVM direct memory or there is a direct memory leak. The direct memory can be allocated by user code or some of its dependencies. In this case 'taskmanager.memory.task.off-heap.size' configuration option should be increased. Flink framework and its dependencies also consume the direct memory, mostly for network communication. The most of network memory is managed by Flink and should not result in out-of-memory error. In certain special cases, in particular for jobs with high parallelism, the framework may require more direct memory which is not managed by Flink. In this case 'taskmanager.memory.framework.off-heap.size' configuration option should be increased. If the error persists then there is probably a direct memory leak in user code or some of its dependencies which has to be investigated and fixed. The task executor has to be shutdown... Sep 07 00:42:31 at java.base/java.nio.Bits.reserveMemory(Bits.java:175) Sep 07 00:42:31 at java.base/java.nio.DirectByteBuffer.(DirectByteBuffer.java:118) Sep 07 00:42:31 at java.base/java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:317) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:632) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:607) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:202) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.tcacheAllocateSmall(PoolArena.java:172) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.allocate(PoolArena.java:134) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.allocate(PoolArena.java:126) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:395) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.channel.unix.PreferredDirectByteBufAllocator.ioBuffer(PreferredDirectByteBufAllocator.java:53) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollRecvByteAllocatorHandle.allocate(EpollRecvByteAllocatorHandle.java:75) Sep 07 00:42:31 at org.apache.flink.shaded.netty4.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:780) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24179) KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee fails on azure
Xintong Song created FLINK-24179: Summary: KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee fails on azure Key: FLINK-24179 URL: https://issues.apache.org/jira/browse/FLINK-24179 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23626&view=logs&j=ce8f3cc3-c1ea-5281-f5eb-df9ebd24947f&t=918e890f-5ed9-5212-a25e-962628fb4bc5&l=7339 {code} Sep 06 23:42:30 [ERROR] Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 59.927 s <<< FAILURE! - in org.apache.flink.connector.kafka.sink.KafkaSinkITCase Sep 06 23:42:30 [ERROR] testRecoveryWithExactlyOnceGuarantee Time elapsed: 10.505 s <<< FAILURE! Sep 06 23:42:30 java.lang.AssertionError: expected:<[1, 2, 3, 4, 5, 6]> but was:<[1, 2, 3, 4]> Sep 06 23:42:30 at org.junit.Assert.fail(Assert.java:89) Sep 06 23:42:30 at org.junit.Assert.failNotEquals(Assert.java:835) Sep 06 23:42:30 at org.junit.Assert.assertEquals(Assert.java:120) Sep 06 23:42:30 at org.junit.Assert.assertEquals(Assert.java:146) Sep 06 23:42:30 at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.lambda$testRecoveryWithExactlyOnceGuarantee$1(KafkaSinkITCase.java:201) Sep 06 23:42:30 at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testRecoveryWithAssertion(KafkaSinkITCase.java:320) Sep 06 23:42:30 at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee(KafkaSinkITCase.java:198) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24175) KafkaITCase.testConcurrentProducerConsumerTopology times out
Xintong Song created FLINK-24175: Summary: KafkaITCase.testConcurrentProducerConsumerTopology times out Key: FLINK-24175 URL: https://issues.apache.org/jira/browse/FLINK-24175 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.12.5 Reporter: Xintong Song Fix For: 1.12.6 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23627&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=c1d93a6a-ba91-515d-3196-2ee8019fbda7&l=6191 {code} [ERROR] Tests run: 23, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 214.45 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaITCase [ERROR] testConcurrentProducerConsumerTopology(org.apache.flink.streaming.connectors.kafka.KafkaITCase) Time elapsed: 60.013 s <<< ERROR! org.junit.runners.model.TestTimedOutException: test timed out after 6 milliseconds at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707) at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323) at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1802) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1782) at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.tryExecutePropagateExceptions(KafkaTestBase.java:194) at org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runSimpleConcurrentProducerConsumerTopology(KafkaConsumerTestBase.java:923) at org.apache.flink.streaming.connectors.kafka.KafkaITCase.testConcurrentProducerConsumerTopology(KafkaITCase.java:71) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24173) BatchFileSystemITCaseBase.testProjectPushDown hangs on azure
Xintong Song created FLINK-24173: Summary: BatchFileSystemITCaseBase.testProjectPushDown hangs on azure Key: FLINK-24173 URL: https://issues.apache.org/jira/browse/FLINK-24173 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23579&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=14779 {code} Sep 06 09:32:51 "main" #1 prio=5 os_prio=0 tid=0x7f4ae400b800 nid=0x75e9 waiting on condition [0x7f4aee144000] Sep 06 09:32:51java.lang.Thread.State: WAITING (parking) Sep 06 09:32:51 at sun.misc.Unsafe.park(Native Method) Sep 06 09:32:51 - parking to wait for <0x8ef18ae8> (a java.util.concurrent.CompletableFuture$Signaller) Sep 06 09:32:51 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) Sep 06 09:32:51 at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707) Sep 06 09:32:51 at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323) Sep 06 09:32:51 at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742) Sep 06 09:32:51 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) Sep 06 09:32:51 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sendRequest(CollectResultFetcher.java:163) Sep 06 09:32:51 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:128) Sep 06 09:32:51 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106) Sep 06 09:32:51 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80) Sep 06 09:32:51 at org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370) Sep 06 09:32:51 at java.util.Iterator.forEachRemaining(Iterator.java:115) Sep 06 09:32:51 at org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109) Sep 06 09:32:51 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.executeQuery(BatchTestBase.scala:300) Sep 06 09:32:51 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.check(BatchTestBase.scala:140) Sep 06 09:32:51 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.checkResult(BatchTestBase.scala:106) Sep 06 09:32:51 at org.apache.flink.table.planner.runtime.batch.sql.BatchFileSystemITCaseBase.check(BatchFileSystemITCaseBase.scala:46) Sep 06 09:32:51 at org.apache.flink.table.planner.runtime.FileSystemITCaseBase$class.testProjectPushDown(FileSystemITCaseBase.scala:251) Sep 06 09:32:51 at org.apache.flink.table.planner.runtime.batch.sql.BatchFileSystemITCaseBase.testProjectPushDown(BatchFileSystemITCaseBase.scala:33) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24163) PartiallyFinishedSourcesITCase fails due to timeout
Xintong Song created FLINK-24163: Summary: PartiallyFinishedSourcesITCase fails due to timeout Key: FLINK-24163 URL: https://issues.apache.org/jira/browse/FLINK-24163 Project: Flink Issue Type: Bug Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23529&view=logs&j=4d4a0d10-fca2-5507-8eed-c07f0bdf4887&t=7b25afdf-cc6c-566f-5459-359dc2585798&l=10996 {code} Sep 04 04:35:28 [ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 155.236 s <<< FAILURE! - in org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase Sep 04 04:35:28 [ERROR] test[complex graph ALL_SUBTASKS, failover: false] Time elapsed: 65.999 s <<< ERROR! Sep 04 04:35:28 java.util.concurrent.TimeoutException: Condition was not met in given timeout. Sep 04 04:35:28 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:164) Sep 04 04:35:28 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:142) Sep 04 04:35:28 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:134) Sep 04 04:35:28 at org.apache.flink.runtime.testutils.CommonTestUtils.waitForSubtasksToFinish(CommonTestUtils.java:297) Sep 04 04:35:28 at org.apache.flink.runtime.operators.lifecycle.TestJobExecutor.waitForSubtasksToFinish(TestJobExecutor.java:219) Sep 04 04:35:28 at org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase.test(PartiallyFinishedSourcesITCase.java:82) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24162) PartiallyFinishedSourcesITCase fails due to assertion error in DrainingValidator.validateOperatorLifecycle
Xintong Song created FLINK-24162: Summary: PartiallyFinishedSourcesITCase fails due to assertion error in DrainingValidator.validateOperatorLifecycle Key: FLINK-24162 URL: https://issues.apache.org/jira/browse/FLINK-24162 Project: Flink Issue Type: Bug Components: API / DataStream Affects Versions: 1.14.0, 1.15.0 Reporter: Xintong Song Fix For: 1.14.0, 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23526&view=logs&j=8fd9202e-fd17-5b26-353c-ac1ff76c8f28&t=ea7cf968-e585-52cb-e0fc-f48de023a7ca&l=4639 {code} Sep 03 23:17:11 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.233 s <<< FAILURE! - in org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase Sep 03 23:17:11 [ERROR] test[simple graph SINGLE_SUBTASK, failover: true] Time elapsed: 2.27 s <<< FAILURE! Sep 03 23:17:11 java.lang.AssertionError Sep 03 23:17:11 at org.junit.Assert.fail(Assert.java:87) Sep 03 23:17:11 at org.junit.Assert.assertTrue(Assert.java:42) Sep 03 23:17:11 at org.junit.Assert.assertFalse(Assert.java:65) Sep 03 23:17:11 at org.junit.Assert.assertFalse(Assert.java:75) Sep 03 23:17:11 at org.apache.flink.runtime.operators.lifecycle.validation.DrainingValidator.validateOperatorLifecycle(DrainingValidator.java:56) Sep 03 23:17:11 at org.apache.flink.runtime.operators.lifecycle.validation.TestOperatorLifecycleValidator.lambda$checkOperatorsLifecycle$1(TestOperatorLifecycleValidator.java:52) Sep 03 23:17:11 at java.util.HashMap.forEach(HashMap.java:1289) Sep 03 23:17:11 at org.apache.flink.runtime.operators.lifecycle.validation.TestOperatorLifecycleValidator.checkOperatorsLifecycle(TestOperatorLifecycleValidator.java:47) Sep 03 23:17:11 at org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase.test(PartiallyFinishedSourcesITCase.java:94) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24160) PartiallyFinishedSourcesITCase fails due to 'Size of the state is larger than the maximum permitted memory-backed state.'
Xintong Song created FLINK-24160: Summary: PartiallyFinishedSourcesITCase fails due to 'Size of the state is larger than the maximum permitted memory-backed state.' Key: FLINK-24160 URL: https://issues.apache.org/jira/browse/FLINK-24160 Project: Flink Issue Type: Bug Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23526&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=5526 {code} Sep 04 02:31:13 Caused by: java.io.IOException: Size of the state is larger than the maximum permitted memory-backed state. Size=6281708, maxSize=5242880. Consider using a different checkpoint storage, like the FileSystemCheckpointStorage. Sep 04 02:31:13 at org.apache.flink.runtime.state.memory.MemCheckpointStreamFactory.checkSize(MemCheckpointStreamFactory.java:63) Sep 04 02:31:13 at org.apache.flink.runtime.state.memory.MemCheckpointStreamFactory$MemoryCheckpointOutputStream.closeAndGetBytes(MemCheckpointStreamFactory.java:140) Sep 04 02:31:13 at org.apache.flink.runtime.state.memory.MemCheckpointStreamFactory$MemoryCheckpointOutputStream.closeAndGetHandle(MemCheckpointStreamFactory.java:120) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.finishWriteAndResult(ChannelStateCheckpointWriter.java:218) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.doComplete(ChannelStateCheckpointWriter.java:240) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.lambda$complete$5(ChannelStateCheckpointWriter.java:202) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.runWithChecks(ChannelStateCheckpointWriter.java:296) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.complete(ChannelStateCheckpointWriter.java:200) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.completeInput(ChannelStateCheckpointWriter.java:187) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.CheckpointInProgressRequest.execute(ChannelStateWriteRequest.java:212) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestDispatcherImpl.dispatchInternal(ChannelStateWriteRequestDispatcherImpl.java:85) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestDispatcherImpl.dispatch(ChannelStateWriteRequestDispatcherImpl.java:62) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestExecutorImpl.loop(ChannelStateWriteRequestExecutorImpl.java:96) Sep 04 02:31:13 at org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestExecutorImpl.run(ChannelStateWriteRequestExecutorImpl.java:75) Sep 04 02:31:13 ... 1 more {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24123) test_dependency.py fails due to 'Failed to close remote bundle'
Xintong Song created FLINK-24123: Summary: test_dependency.py fails due to 'Failed to close remote bundle' Key: FLINK-24123 URL: https://issues.apache.org/jira/browse/FLINK-24123 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.14.0, 1.15.0 Environment: test_dependency Reporter: Xintong Song Fix For: 1.14.0, 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23343&view=logs&j=bdd9ea51-4de2-506a-d4d9-f3930e4d2355&t=dd50312f-73b5-56b5-c172-4d81d03e2ef1&l=23922 {code} Caused by: java.lang.RuntimeException: Error while waiting for BeamPythonFunctionRunner flush Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.invokeFinishBundle(AbstractPythonFunctionOperator.java:361) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.checkInvokeFinishBundleByCount(AbstractPythonFunctionOperator.java:321) Sep 02 01:34:47 E at org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator.processElement(AbstractStatelessFunctionOperator.java:119) Sep 02 01:34:47 E at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:82) Sep 02 01:34:47 E at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57) Sep 02 01:34:47 E at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29) Sep 02 01:34:47 E at SourceConversion$38.processElement(Unknown Source) Sep 02 01:34:47 E at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:82) Sep 02 01:34:47 E at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57) Sep 02 01:34:47 E at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.StreamSourceContexts$ManualWatermarkContext.processAndCollect(StreamSourceContexts.java:418) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.StreamSourceContexts$WatermarkContext.collect(StreamSourceContexts.java:513) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.StreamSourceContexts$SwitchingOnClose.collect(StreamSourceContexts.java:103) Sep 02 01:34:47 E at org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:92) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:116) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:73) Sep 02 01:34:47 E at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:323) Sep 02 01:34:47 E Caused by: java.lang.RuntimeException: Failed to close remote bundle Sep 02 01:34:47 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.finishBundle(BeamPythonFunctionRunner.java:377) Sep 02 01:34:47 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.flush(BeamPythonFunctionRunner.java:361) Sep 02 01:34:47 E at org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.lambda$invokeFinishBundle$2(AbstractPythonFunctionOperator.java:340) Sep 02 01:34:47 E at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) Sep 02 01:34:47 E at java.util.concurrent.FutureTask.run(FutureTask.java:266) Sep 02 01:34:47 E at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) Sep 02 01:34:47 E at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe
[jira] [Created] (FLINK-24119) KafkaITCase.testTimestamps fails due to "Topic xxx already exist"
Xintong Song created FLINK-24119: Summary: KafkaITCase.testTimestamps fails due to "Topic xxx already exist" Key: FLINK-24119 URL: https://issues.apache.org/jira/browse/FLINK-24119 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23328&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7419 {code} Sep 01 15:53:20 [ERROR] Tests run: 23, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 162.65 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaITCase Sep 01 15:53:20 [ERROR] testTimestamps Time elapsed: 23.237 s <<< FAILURE! Sep 01 15:53:20 java.lang.AssertionError: Create test topic : tstopic failed, org.apache.kafka.common.errors.TopicExistsException: Topic 'tstopic' already exists. Sep 01 15:53:20 at org.junit.Assert.fail(Assert.java:89) Sep 01 15:53:20 at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:226) Sep 01 15:53:20 at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:112) Sep 01 15:53:20 at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:212) Sep 01 15:53:20 at org.apache.flink.streaming.connectors.kafka.KafkaITCase.testTimestamps(KafkaITCase.java:191) Sep 01 15:53:20 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Sep 01 15:53:20 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Sep 01 15:53:20 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Sep 01 15:53:20 at java.lang.reflect.Method.invoke(Method.java:498) Sep 01 15:53:20 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Sep 01 15:53:20 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Sep 01 15:53:20 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Sep 01 15:53:20 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Sep 01 15:53:20 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) Sep 01 15:53:20 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) Sep 01 15:53:20 at java.util.concurrent.FutureTask.run(FutureTask.java:266) Sep 01 15:53:20 at java.lang.Thread.run(Thread.java:748) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24100) test_connectors.py fails on azure
Xintong Song created FLINK-24100: Summary: test_connectors.py fails on azure Key: FLINK-24100 URL: https://issues.apache.org/jira/browse/FLINK-24100 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23253&view=logs&j=bdd9ea51-4de2-506a-d4d9-f3930e4d2355&t=dd50312f-73b5-56b5-c172-4d81d03e2ef1&l=22622 {code} Sep 01 02:26:21 E Caused by: java.lang.RuntimeException: Failed to create stage bundle factory! INFO:root:Initializing python harness: /__w/1/s/flink-python/pyflink/fn_execution/beam/beam_boot.py --id=1-1 --provision_endpoint=localhost:44544 Sep 01 02:26:21 E Sep 01 02:26:21 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:566) Sep 01 02:26:21 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.open(BeamPythonFunctionRunner.java:255) Sep 01 02:26:21 E at org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.open(AbstractPythonFunctionOperator.java:131) Sep 01 02:26:21 E at org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator.open(AbstractOneInputPythonFunctionOperator.java:116) Sep 01 02:26:21 E at org.apache.flink.streaming.api.operators.python.PythonProcessOperator.open(PythonProcessOperator.java:59) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:110) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:691) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:667) Sep 01 02:26:21 E at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:639) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) Sep 01 02:26:21 E at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) Sep 01 02:26:21 E at java.lang.Thread.run(Thread.java:748) Sep 01 02:26:21 E Caused by: org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: Process died with exit code 0 Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2050) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958) Sep 01 02:26:21 E at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.(DefaultJobBundleFactory.java:451) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.(DefaultJobBundleFactory.java:436) Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:303) Sep 01 02:26:21 E at org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:564) Sep 01 02:26:21 E ... 14 more Sep 01 02:26:21 E Caused by: java.lang.IllegalStateException: Process died with exit code 0 Sep 01 02:26:21 E at org.apache.beam.runners.fnexecution.environment.ProcessManager$RunningProcess.isAliveOrThrow(ProcessManager.java:75) Sep 01 02:26
[jira] [Created] (FLINK-24096) JoinITCase.testNullFullOuterJoin fails due to NPE
Xintong Song created FLINK-24096: Summary: JoinITCase.testNullFullOuterJoin fails due to NPE Key: FLINK-24096 URL: https://issues.apache.org/jira/browse/FLINK-24096 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23250&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=9417 {code} Sep 01 01:57:41 Caused by: java.lang.NullPointerException Sep 01 01:57:41 at org.apache.flink.table.planner.runtime.utils.FailingCollectionSource.notifyCheckpointComplete(FailingCollectionSource.java:242) Sep 01 01:57:41 at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.notifyCheckpointComplete(AbstractUdfStreamOperator.java:126) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.notifyCheckpointComplete(StreamOperatorWrapper.java:99) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.notifyCheckpointComplete(RegularOperatorChain.java:152) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.notifyCheckpointComplete(SubtaskCheckpointCoordinatorImpl.java:348) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.StreamTask.notifyCheckpointComplete(StreamTask.java:1397) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$notifyCheckpointAbortAsync$16(StreamTask.java:1355) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$notifyCheckpointOperation$17(StreamTask.java:1377) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$SynchronizedStreamTaskActionExecutor.runThrowing(StreamTaskActionExecutor.java:93) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.drain(MailboxProcessor.java:177) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:834) Sep 01 01:57:41 at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:747) Sep 01 01:57:41 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) Sep 01 01:57:41 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937) Sep 01 01:57:41 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) Sep 01 01:57:41 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) Sep 01 01:57:41 at java.lang.Thread.run(Thread.java:748) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24095) Elasticsearch7DynamicSinkITCase.testWritingDocuments fails due to socket timeout
Xintong Song created FLINK-24095: Summary: Elasticsearch7DynamicSinkITCase.testWritingDocuments fails due to socket timeout Key: FLINK-24095 URL: https://issues.apache.org/jira/browse/FLINK-24095 Project: Flink Issue Type: Bug Components: Connectors / ElasticSearch Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23250&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=12781 {code} Aug 31 23:06:22 Caused by: java.net.SocketTimeoutException: 30,000 milliseconds timeout on connection http-outgoing-3 [ACTIVE] Aug 31 23:06:22 at org.elasticsearch.client.RestClient.extractAndWrapCause(RestClient.java:808) Aug 31 23:06:22 at org.elasticsearch.client.RestClient.performRequest(RestClient.java:248) Aug 31 23:06:22 at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) Aug 31 23:06:22 at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1514) Aug 31 23:06:22 at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1499) Aug 31 23:06:22 at org.elasticsearch.client.RestHighLevelClient.ping(RestHighLevelClient.java:720) Aug 31 23:06:22 at org.apache.flink.streaming.connectors.elasticsearch7.Elasticsearch7ApiCallBridge.verifyClientConnection(Elasticsearch7ApiCallBridge.java:138) Aug 31 23:06:22 at org.apache.flink.streaming.connectors.elasticsearch7.Elasticsearch7ApiCallBridge.verifyClientConnection(Elasticsearch7ApiCallBridge.java:46) Aug 31 23:06:22 at org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.open(ElasticsearchSinkBase.java:318) Aug 31 23:06:22 at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:34) Aug 31 23:06:22 at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:100) Aug 31 23:06:22 at org.apache.flink.streaming.api.operators.StreamSink.open(StreamSink.java:46) Aug 31 23:06:22 at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:110) Aug 31 23:06:22 at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:691) Aug 31 23:06:22 at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) Aug 31 23:06:22 at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:667) Aug 31 23:06:22 at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:639) Aug 31 23:06:22 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) Aug 31 23:06:22 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) Aug 31 23:06:22 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) Aug 31 23:06:22 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) Aug 31 23:06:22 at java.lang.Thread.run(Thread.java:748) Aug 31 23:06:22 Caused by: java.net.SocketTimeoutException: 30,000 milliseconds timeout on connection http-outgoing-3 [ACTIVE] Aug 31 23:06:22 at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.timeout(HttpAsyncRequestExecutor.java:387) Aug 31 23:06:22 at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:92) Aug 31 23:06:22 at org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:39) Aug 31 23:06:22 at org.apache.http.impl.nio.reactor.AbstractIODispatch.timeout(AbstractIODispatch.java:175) Aug 31 23:06:22 at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionTimedOut(BaseIOReactor.java:261) Aug 31 23:06:22 at org.apache.http.impl.nio.reactor.AbstractIOReactor.timeoutCheck(AbstractIOReactor.java:502) Aug 31 23:06:22 at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:211) Aug 31 23:06:22 at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:280) Aug 31 23:06:22 at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) Aug 31 23:06:22 at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591) Aug 31 23:06:22 ... 1 more {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24092) OrcFsStreamingSinkITCase.testPart times out on azure
Xintong Song created FLINK-24092: Summary: OrcFsStreamingSinkITCase.testPart times out on azure Key: FLINK-24092 URL: https://issues.apache.org/jira/browse/FLINK-24092 Project: Flink Issue Type: Bug Components: Connectors / ORC Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23245&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=13074 {code} Aug 31 20:07:07 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 32.79 s <<< FAILURE! - in org.apache.flink.orc.OrcFsStreamingSinkITCase Aug 31 20:07:07 [ERROR] testPart Time elapsed: 20.322 s <<< ERROR! Aug 31 20:07:07 org.junit.runners.model.TestTimedOutException: test timed out after 20 seconds Aug 31 20:07:07 at java.lang.Thread.sleep(Native Method) Aug 31 20:07:07 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sleepBeforeRetry(CollectResultFetcher.java:237) Aug 31 20:07:07 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:113) Aug 31 20:07:07 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106) Aug 31 20:07:07 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80) Aug 31 20:07:07 at org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370) Aug 31 20:07:07 at java.util.Iterator.forEachRemaining(Iterator.java:115) Aug 31 20:07:07 at org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109) Aug 31 20:07:07 at org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.check(FsStreamingSinkITCaseBase.scala:133) Aug 31 20:07:07 at org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.test(FsStreamingSinkITCaseBase.scala:120) Aug 31 20:07:07 at org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.testPart(FsStreamingSinkITCaseBase.scala:84) Aug 31 20:07:07 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 31 20:07:07 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 31 20:07:07 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 31 20:07:07 at java.lang.reflect.Method.invoke(Method.java:498) Aug 31 20:07:07 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Aug 31 20:07:07 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 31 20:07:07 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Aug 31 20:07:07 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 31 20:07:07 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Aug 31 20:07:07 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Aug 31 20:07:07 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) Aug 31 20:07:07 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) Aug 31 20:07:07 at java.util.concurrent.FutureTask.run(FutureTask.java:266) Aug 31 20:07:07 at java.lang.Thread.run(Thread.java:748) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24091) TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure fails on azure
Xintong Song created FLINK-24091: Summary: TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure fails on azure Key: FLINK-24091 URL: https://issues.apache.org/jira/browse/FLINK-24091 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23187&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=6112 {code} Aug 31 10:04:21 [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 28.263 s <<< FAILURE! - in org.apache.flink.test.recovery.TaskManagerProcessFailureBatchRecoveryITCase Aug 31 10:04:21 [ERROR] testTaskManagerProcessFailure[0] Time elapsed: 16.147 s <<< FAILURE! Aug 31 10:04:21 java.lang.AssertionError: The program encountered a ProgramInvocationException : Job failed (JobID: c68654bb03c0ec88707ef7ada2239f62) Aug 31 10:04:21 at org.junit.Assert.fail(Assert.java:89) Aug 31 10:04:21 at org.apache.flink.test.recovery.AbstractTaskManagerProcessFailureRecoveryTest.testTaskManagerProcessFailure(AbstractTaskManagerProcessFailureRecoveryTest.java:204) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24077) HBaseConnectorITCase.testTableSink
Xintong Song created FLINK-24077: Summary: HBaseConnectorITCase.testTableSink Key: FLINK-24077 URL: https://issues.apache.org/jira/browse/FLINK-24077 Project: Flink Issue Type: Bug Components: Connectors / HBase Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23160&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=12962 {code} Aug 31 05:10:58 Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 73.758 sec <<< FAILURE! - in org.apache.flink.connector.hbase2.HBaseConnectorITCase Aug 31 05:10:58 testTableSink(org.apache.flink.connector.hbase2.HBaseConnectorITCase) Time elapsed: 6.516 sec <<< FAILURE! Aug 31 05:10:58 java.lang.AssertionError: Aug 31 05:10:58 Different elements in arrays: expected 8 elements and received 3 Aug 31 05:10:58 expected: [+I[1, 10, Hello-1, 100, 1.01, false, Welt-1], +I[2, 20, Hello-2, 200, 2.02, true, Welt-2], +I[3, 30, Hello-3, 300, 3.03, false, Welt-3], +I[4, 40, null, 400, 4.04, true, Welt-4], +I[5, 50, Hello-5, 500, 5.05, false, Welt-5], +I[6, 60, Hello-6, 600, 6.06, true, Welt-6], +I[7, 70, Hello-7, 700, 7.07, false, Welt-7], +I[8, 80, null, 800, 8.08, true, Welt-8]] Aug 31 05:10:58 received: [+I[1, 10, Hello-1, 100, 1.01, false, Welt-1], +I[2, 20, Hello-2, 200, 2.02, true, Welt-2], +I[3, 30, Hello-3, 300, 3.03, false, Welt-3]] expected:<8> but was:<3> Aug 31 05:10:58 at org.junit.Assert.fail(Assert.java:89) Aug 31 05:10:58 at org.junit.Assert.failNotEquals(Assert.java:835) Aug 31 05:10:58 at org.junit.Assert.assertEquals(Assert.java:647) Aug 31 05:10:58 at org.apache.flink.test.util.TestBaseUtils.compareResult(TestBaseUtils.java:395) Aug 31 05:10:58 at org.apache.flink.test.util.TestBaseUtils.compareResultAsText(TestBaseUtils.java:347) Aug 31 05:10:58 at org.apache.flink.connector.hbase2.HBaseConnectorITCase.testTableSink(HBaseConnectorITCase.java:284) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24074) Check 1.14 licensing
Xintong Song created FLINK-24074: Summary: Check 1.14 licensing Key: FLINK-24074 URL: https://issues.apache.org/jira/browse/FLINK-24074 Project: Flink Issue Type: Technical Debt Reporter: Xintong Song Assignee: Xintong Song Fix For: 1.14.0 Check the licensing of the 1.14 release. https://cwiki.apache.org/confluence/display/FLINK/Licensing -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24069) IgnoreInFlightDataITCase.testIgnoreInFlightDataDuringRecovery hangs on azure
Xintong Song created FLINK-24069: Summary: IgnoreInFlightDataITCase.testIgnoreInFlightDataDuringRecovery hangs on azure Key: FLINK-24069 URL: https://issues.apache.org/jira/browse/FLINK-24069 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23144&view=logs&j=4d4a0d10-fca2-5507-8eed-c07f0bdf4887&t=7b25afdf-cc6c-566f-5459-359dc2585798&l=12083 {code} "main" #1 prio=5 os_prio=0 tid=0x7f90bc00b800 nid=0x86d54 waiting on condition [0x7f90c4e53000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x80f25d48> (a java.util.concurrent.CompletableFuture$Signaller) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707) at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323) at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1937) at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1917) at org.apache.flink.test.checkpointing.IgnoreInFlightDataITCase.executeIgnoreInFlightDataDuringRecovery(IgnoreInFlightDataITCase.java:136) at org.apache.flink.test.checkpointing.IgnoreInFlightDataITCase.testIgnoreInFlightDataDuringRecovery(IgnoreInFlightDataITCase.java:107) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24061) RMQSourceITCase.testAckFailure fails on azure
Xintong Song created FLINK-24061: Summary: RMQSourceITCase.testAckFailure fails on azure Key: FLINK-24061 URL: https://issues.apache.org/jira/browse/FLINK-24061 Project: Flink Issue Type: Bug Components: Connectors/ RabbitMQ Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23141&view=logs&j=ba53eb01-1462-56a3-8e98-0dd97fbcaab5&t=2e426bf0-b717-56bb-ab62-d63086457354&l=14514 {code} Aug 30 22:30:34 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 93.936 s <<< FAILURE! - in org.apache.flink.streaming.connectors.rabbitmq.RMQSourceITCase Aug 30 22:30:34 [ERROR] testAckFailure Time elapsed: 61.713 s <<< ERROR! Aug 30 22:30:34 java.util.concurrent.TimeoutException: Condition was not met in given timeout. Aug 30 22:30:34 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:158) Aug 30 22:30:34 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:136) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24058) TaskSlotTableImplTest.testMarkSlotActiveDeactivatesSlotTimeout fails on azure
Xintong Song created FLINK-24058: Summary: TaskSlotTableImplTest.testMarkSlotActiveDeactivatesSlotTimeout fails on azure Key: FLINK-24058 URL: https://issues.apache.org/jira/browse/FLINK-24058 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Xintong Song Fix For: 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23083&view=logs&j=0da23115-68bb-5dcd-192c-bd4c8adebde1&t=24c3384f-1bcb-57b3-224f-51bf973bbee8&l=8583 {code} Aug 30 10:55:16 [ERROR] Tests run: 20, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.243 s <<< FAILURE! - in org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImplTest Aug 30 10:55:16 [ERROR] testMarkSlotActiveDeactivatesSlotTimeout Time elapsed: 0.334 s <<< FAILURE! Aug 30 10:55:16 java.lang.AssertionError: The slot timeout should have been deactivated. Aug 30 10:55:16 at org.junit.Assert.fail(Assert.java:89) Aug 30 10:55:16 at org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImplTest.runDeactivateSlotTimeoutTest(TaskSlotTableImplTest.java:509) Aug 30 10:55:16 at org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImplTest.testMarkSlotActiveDeactivatesSlotTimeout(TaskSlotTableImplTest.java:472) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24047) SavepointITCase.testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState fails due to 'Service temporarily unavailable due to an ongoing leader election.'
Xintong Song created FLINK-24047: Summary: SavepointITCase.testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState fails due to 'Service temporarily unavailable due to an ongoing leader election.' Key: FLINK-24047 URL: https://issues.apache.org/jira/browse/FLINK-24047 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.14.0, 1.15.0 Reporter: Xintong Song Fix For: 1.14.0, 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23043&view=logs&j=8fd9202e-fd17-5b26-353c-ac1ff76c8f28&t=ea7cf968-e585-52cb-e0fc-f48de023a7ca&l=4857 {code} Aug 29 22:12:23 [ERROR] Tests run: 15, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 50.922 s <<< FAILURE! - in org.apache.flink.test.checkpointing.SavepointITCase Aug 29 22:12:23 [ERROR] testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState Time elapsed: 1.854 s <<< ERROR! Aug 29 22:12:23 java.util.concurrent.ExecutionException: org.apache.flink.runtime.rest.util.RestClientException: [Service temporarily unavailable due to an ongoing leader election. Please refresh.] Aug 29 22:12:23 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) Aug 29 22:12:23 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) Aug 29 22:12:23 at org.apache.flink.test.checkpointing.SavepointITCase.lambda$waitUntilAllTasksAreRunning$5(SavepointITCase.java:919) Aug 29 22:12:23 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:152) Aug 29 22:12:23 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:136) Aug 29 22:12:23 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:128) Aug 29 22:12:23 at org.apache.flink.test.checkpointing.SavepointITCase.waitUntilAllTasksAreRunning(SavepointITCase.java:909) Aug 29 22:12:23 at org.apache.flink.test.checkpointing.SavepointITCase.testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState(SavepointITCase.java:246) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24045) KafkaTableITCase.testPerPartitionWatermarkKafka fails on azure
Xintong Song created FLINK-24045: Summary: KafkaTableITCase.testPerPartitionWatermarkKafka fails on azure Key: FLINK-24045 URL: https://issues.apache.org/jira/browse/FLINK-24045 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.14.0, 1.15.0 Reporter: Xintong Song Fix For: 1.14.0, 1.15.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23008&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7128 {code} Aug 28 23:14:05 [ERROR] Tests run: 24, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 88.767 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.table.KafkaTableITCase Aug 28 23:14:05 [ERROR] testPerPartitionWatermarkKafka[format = json] Time elapsed: 6.571 s <<< FAILURE! Aug 28 23:14:05 java.lang.AssertionError: expected:<[+I[0, partition-0-name-0, 2020-03-08T13:12:11.123], +I[0, partition-0-name-1, 2020-03-08T14:12:12.223], +I[0, partition-0-name-2, 2020-03-08T15:12:13.323], +I[1, partition-1-name-0, 2020-03-09T13:13:11.123], +I[1, partition-1-name-1, 2020-03-09T15:13:11.133], +I[1, partition-1-name-2, 2020-03-09T16:13:11.143], +I[2, partition-2-name-0, 2020-03-10T13:12:14.123], +I[2, partition-2-name-1, 2020-03-10T14:12:14.123], +I[2, partition-2-name-2, 2020-03-10T14:13:14.123], +I[2, partition-2-name-3, 2020-03-10T14:14:14.123], +I[2, partition-2-name-4, 2020-03-10T14:15:14.123], +I[2, partition-2-name-5, 2020-03-10T14:16:14.123], +I[3, partition-3-name-0, 2020-03-11T17:12:11.123], +I[3, partition-3-name-1, 2020-03-11T18:12:11.123]]> but was:<[+I[3, partition-3-name-0, 2020-03-11T17:12:11.123], +I[3, partition-3-name-1, 2020-03-11T18:12:11.123]]> Aug 28 23:14:05 at org.junit.Assert.fail(Assert.java:89) Aug 28 23:14:05 at org.junit.Assert.failNotEquals(Assert.java:835) Aug 28 23:14:05 at org.junit.Assert.assertEquals(Assert.java:120) Aug 28 23:14:05 at org.junit.Assert.assertEquals(Assert.java:146) Aug 28 23:14:05 at org.apache.flink.streaming.connectors.kafka.table.KafkaTableTestUtils.waitingExpectedResults(KafkaTableTestUtils.java:93) Aug 28 23:14:05 at org.apache.flink.streaming.connectors.kafka.table.KafkaTableITCase.testPerPartitionWatermarkKafka(KafkaTableITCase.java:739) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24012) PulsarSourceITCase.testTaskManagerFailure fails due to NoResourceAvailableException
Xintong Song created FLINK-24012: Summary: PulsarSourceITCase.testTaskManagerFailure fails due to NoResourceAvailableException Key: FLINK-24012 URL: https://issues.apache.org/jira/browse/FLINK-24012 Project: Flink Issue Type: Bug Components: Connectors / Pulsar Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22918&view=logs&j=a5ef94ef-68c2-57fd-3794-dc108ed1c495&t=2c68b137-b01d-55c9-e603-3ff3f320364b&l=24431 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23984) 'Run kubernetes pyflink application test' fail with "Package 'python3.7' has no installation candidate"
Xintong Song created FLINK-23984: Summary: 'Run kubernetes pyflink application test' fail with "Package 'python3.7' has no installation candidate" Key: FLINK-23984 URL: https://issues.apache.org/jira/browse/FLINK-23984 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22862&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=4201 {code} Aug 26 03:34:14 Step 1/9 : FROM test_kubernetes_application-1 Aug 26 03:34:14 ---> 95da2424deaa Aug 26 03:34:14 Step 2/9 : RUN apt-get update -y && apt-get install -y python3.7 python3-pip python3.7-dev && rm -rf /var/lib/apt/lists/* Aug 26 03:34:17 ---> Running in 4751135e4612 Aug 26 03:34:17 Get:1 http://deb.debian.org/debian bullseye InRelease [113 kB] Aug 26 03:34:17 Get:2 http://security.debian.org/debian-security bullseye-security InRelease [44.1 kB] Aug 26 03:34:17 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [36.8 kB] Aug 26 03:34:17 Get:4 http://security.debian.org/debian-security bullseye-security/main amd64 Packages [27.5 kB] Aug 26 03:34:17 Get:5 http://deb.debian.org/debian bullseye/main amd64 Packages [8178 kB] Aug 26 03:34:19 Fetched 8399 kB in 2s (5266 kB/s) Aug 26 03:34:19 Reading package lists... Aug 26 03:34:20 Reading package lists... Aug 26 03:34:20 Building dependency tree... Aug 26 03:34:20 Reading state information... Aug 26 03:34:20 Package python3.7 is not available, but is referred to by another package. Aug 26 03:34:20 This may mean that the package is missing, has been obsoleted, or Aug 26 03:34:20 is only available from another source Aug 26 03:34:20 Aug 26 03:34:20 E: Package 'python3.7' has no installation candidate Aug 26 03:34:20 E: Unable to locate package python3.7-dev Aug 26 03:34:20 E: Couldn't find any package by glob 'python3.7-dev' Aug 26 03:34:20 E: Couldn't find any package by regex 'python3.7-dev' The command '/bin/sh -c apt-get update -y && apt-get install -y python3.7 python3-pip python3.7-dev && rm -rf /var/lib/apt/lists/*' returned a non-zero code: 100 {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23983) JVM crash when running RocksDBStateBackendConfigTest
Xintong Song created FLINK-23983: Summary: JVM crash when running RocksDBStateBackendConfigTest Key: FLINK-23983 URL: https://issues.apache.org/jira/browse/FLINK-23983 Project: Flink Issue Type: Bug Components: Runtime / State Backends Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22855&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33&t=125e07e7-8de0-5c6c-a541-a567415af3ef&l=11131 You would need to compare the mvn logs "Running xxx" with "Test run xxx in xxx" to find out the unfinished test. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23982) Compiling error in WindowOperatorTest with JDK11
Xintong Song created FLINK-23982: Summary: Compiling error in WindowOperatorTest with JDK11 Key: FLINK-23982 URL: https://issues.apache.org/jira/browse/FLINK-23982 Project: Flink Issue Type: Bug Components: Build System Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 What I don't understand is, while the error does not seem to be environment related, the other JDK11 compiling stages in the same build did not fail. https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22855&view=logs&j=6caf31d6-847a-526e-9624-468e053467d6&t=0b23652f-b18b-5b6e-6eb6-a11070364610&l=3650 {code} [INFO] - [ERROR] COMPILATION ERROR : [INFO] - [ERROR] /home/vsts/work/1/s/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperatorTest.java:[678,43] incompatible types: cannot infer type arguments for org.apache.flink.streaming.runtime.operators.windowing.WindowOperator<> reason: inference variable KEY has incompatible equality constraints ACC,org.apache.flink.api.java.tuple.Tuple2,IN,K,java.lang.String {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23960) StreamTaskTimerTest.checkScheduledTimestamps fails on azure
Xintong Song created FLINK-23960: Summary: StreamTaskTimerTest.checkScheduledTimestamps fails on azure Key: FLINK-23960 URL: https://issues.apache.org/jira/browse/FLINK-23960 Project: Flink Issue Type: Bug Components: Runtime / Task Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22770&view=logs&j=f0ac5c25-1168-55a5-07ff-0e88223afed9&t=50bf7a25-bdc4-5e56-5478-c7b4511dde53&l=10736 {code} Aug 24 22:32:06 [ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.421 s <<< FAILURE! - in org.apache.flink.streaming.runtime.operators.StreamTaskTimerTest Aug 24 22:32:06 [ERROR] checkScheduledTimestamps Time elapsed: 1.372 s <<< FAILURE! Aug 24 22:32:06 java.lang.AssertionError: expected:<1> but was:<0> Aug 24 22:32:06 at org.junit.Assert.fail(Assert.java:89) Aug 24 22:32:06 at org.apache.flink.streaming.runtime.operators.StreamTaskTimerTest.verifyNoException(StreamTaskTimerTest.java:166) Aug 24 22:32:06 at org.apache.flink.streaming.runtime.operators.StreamTaskTimerTest.checkScheduledTimestamps(StreamTaskTimerTest.java:129) Aug 24 22:32:06 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 24 22:32:06 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 24 22:32:06 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 24 22:32:06 at java.base/java.lang.reflect.Method.invoke(Method.java:566) Aug 24 22:32:06 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Aug 24 22:32:06 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 24 22:32:06 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Aug 24 22:32:06 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 24 22:32:06 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Aug 24 22:32:06 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Aug 24 22:32:06 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) Aug 24 22:32:06 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) Aug 24 22:32:06 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) Aug 24 22:32:06 at java.base/java.lang.Thread.run(Thread.java:829) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23957) KafkaProducerAtLeastOnceITCase.testOneToOneAtLeastOnceRegularSink fails on azure
Xintong Song created FLINK-23957: Summary: KafkaProducerAtLeastOnceITCase.testOneToOneAtLeastOnceRegularSink fails on azure Key: FLINK-23957 URL: https://issues.apache.org/jira/browse/FLINK-23957 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.13.2 Reporter: Xintong Song Fix For: 1.13.3 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22755&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5&l=6557 {code} Aug 24 16:40:33 [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 51.969 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaProducerAtLeastOnceITCase Aug 24 16:40:33 [ERROR] testOneToOneAtLeastOnceRegularSink(org.apache.flink.streaming.connectors.kafka.KafkaProducerAtLeastOnceITCase) Time elapsed: 13.97 s <<< FAILURE! Aug 24 16:40:33 java.lang.AssertionError: Create test topic : oneToOneTopicRegularSink failed, The topic metadata failed to propagate to Kafka broker. Aug 24 16:40:33 at org.junit.Assert.fail(Assert.java:88) Aug 24 16:40:33 at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:226) Aug 24 16:40:33 at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:112) Aug 24 16:40:33 at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:212) Aug 24 16:40:33 at org.apache.flink.streaming.connectors.kafka.KafkaProducerTestBase.testOneToOneAtLeastOnce(KafkaProducerTestBase.java:241) Aug 24 16:40:33 at org.apache.flink.streaming.connectors.kafka.KafkaProducerTestBase.testOneToOneAtLeastOnceRegularSink(KafkaProducerTestBase.java:217) Aug 24 16:40:33 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 24 16:40:33 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 24 16:40:33 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 24 16:40:33 at java.lang.reflect.Method.invoke(Method.java:498) Aug 24 16:40:33 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) Aug 24 16:40:33 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 24 16:40:33 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) Aug 24 16:40:33 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 24 16:40:33 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Aug 24 16:40:33 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) Aug 24 16:40:33 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Aug 24 16:40:33 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) Aug 24 16:40:33 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) Aug 24 16:40:33 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) Aug 24 16:40:33 at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) Aug 24 16:40:33 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) Aug 24 16:40:33 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) Aug 24 16:40:33 at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) Aug 24 16:40:33 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) Aug 24 16:40:33 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Aug 24 16:40:33 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Aug 24 16:40:33 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) Aug 24 16:40:33 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) Aug 24 16:40:33 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Aug 24 16:40:33 at org.junit.runners.ParentRunner.run(ParentRunner.java:363) Aug 24 16:40:33 at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) Aug 24 16:40:33 at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) Aug 24 16:40:33 at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) Aug 24 16:40:33 at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) Aug 24 16:40:33 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) Aug 24 16:40:33
[jira] [Created] (FLINK-23956) KafkaITCase.testOneSourceMultiplePartitions fails due to "The topic metadata failed to propagate to Kafka broker"
Xintong Song created FLINK-23956: Summary: KafkaITCase.testOneSourceMultiplePartitions fails due to "The topic metadata failed to propagate to Kafka broker" Key: FLINK-23956 URL: https://issues.apache.org/jira/browse/FLINK-23956 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.13.2 Reporter: Xintong Song Fix For: 1.13.3 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22741&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5&l=6912 {code} Aug 24 13:44:11 [ERROR] Tests run: 23, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 181.317 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaITCase Aug 24 13:44:11 [ERROR] testOneSourceMultiplePartitions(org.apache.flink.streaming.connectors.kafka.KafkaITCase) Time elapsed: 22.794 s <<< FAILURE! Aug 24 13:44:11 java.lang.AssertionError: Create test topic : oneToManyTopic failed, The topic metadata failed to propagate to Kafka broker. Aug 24 13:44:11 at org.junit.Assert.fail(Assert.java:88) Aug 24 13:44:11 at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:226) Aug 24 13:44:11 at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:112) Aug 24 13:44:11 at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:212) Aug 24 13:44:11 at org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runOneSourceMultiplePartitionsExactlyOnceTest(KafkaConsumerTestBase.java:1027) Aug 24 13:44:11 at org.apache.flink.streaming.connectors.kafka.KafkaITCase.testOneSourceMultiplePartitions(KafkaITCase.java:100) Aug 24 13:44:11 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 24 13:44:11 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 24 13:44:11 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 24 13:44:11 at java.lang.reflect.Method.invoke(Method.java:498) Aug 24 13:44:11 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) Aug 24 13:44:11 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 24 13:44:11 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) Aug 24 13:44:11 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 24 13:44:11 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) Aug 24 13:44:11 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) Aug 24 13:44:11 at java.util.concurrent.FutureTask.run(FutureTask.java:266) Aug 24 13:44:11 at java.lang.Thread.run(Thread.java:748) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23954) Queryable state (rocksdb) with TM restart end-to-end test fails on azure
Xintong Song created FLINK-23954: Summary: Queryable state (rocksdb) with TM restart end-to-end test fails on azure Key: FLINK-23954 URL: https://issues.apache.org/jira/browse/FLINK-23954 Project: Flink Issue Type: Bug Components: Runtime / Queryable State Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22714&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=11090 {code} Aug 24 09:54:17 == Aug 24 09:54:17 Running 'Queryable state (rocksdb) with TM restart end-to-end test' Aug 24 09:54:17 == Aug 24 09:54:17 TEST_DATA_DIR: /home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/temp-test-directory-17362481511 Aug 24 09:54:17 Flink dist directory: /home/vsts/work/1/s/flink-dist/target/flink-1.14-SNAPSHOT-bin/flink-1.14-SNAPSHOT Aug 24 09:54:17 Adding flink-queryable-state-runtime to lib/ Aug 24 09:54:17 Starting cluster. Aug 24 09:54:18 Starting standalonesession daemon on host fv-az123-794. Aug 24 09:54:19 Starting taskexecutor daemon on host fv-az123-794. Aug 24 09:54:19 Waiting for Dispatcher REST endpoint to come up... Aug 24 09:54:20 Waiting for Dispatcher REST endpoint to come up... Aug 24 09:54:21 Waiting for Dispatcher REST endpoint to come up... Aug 24 09:54:22 Waiting for Dispatcher REST endpoint to come up... Aug 24 09:54:23 Waiting for Dispatcher REST endpoint to come up... Aug 24 09:54:24 Dispatcher REST endpoint is up. Aug 24 09:54:31 Job (f230364470a082b78dc34147f8da38f1) is running. Aug 24 09:54:31 Starting to wait for completion of 10 checkpoints Aug 24 09:54:31 2/10 completed checkpoints Aug 24 09:54:33 6/10 completed checkpoints Aug 24 09:54:35 6/10 completed checkpoints Aug 24 09:54:37 SERVER: 127.0.0.1 Aug 24 09:54:37 PORT: 9069 SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. Aug 24 09:54:38 MapState has 17 entries Aug 24 09:54:38 TaskManager 412715 killed. Aug 24 09:54:38 Number of running task managers 1 is not yet 0. Aug 24 09:54:42 Number of running task managers has reached 0. Aug 24 09:54:42 Latest snapshot count was 22 Aug 24 09:54:43 Starting taskexecutor daemon on host fv-az123-794. Aug 24 09:54:43 Number of running task managers 0 is not yet 1. Aug 24 09:54:47 Number of running task managers has reached 1. Aug 24 09:54:49 Job (f230364470a082b78dc34147f8da38f1) is running. Aug 24 09:54:49 Starting to wait for completion of 16 checkpoints Aug 24 09:54:49 11/16 completed checkpoints Aug 24 09:54:51 11/16 completed checkpoints SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. Aug 24 09:54:54 after: 21 Aug 24 09:54:54 An error occurred Aug 24 09:54:54 [FAIL] Test script contains errors. Aug 24 09:54:54 Checking of logs skipped. Aug 24 09:54:54 Aug 24 09:54:54 [FAIL] 'Queryable state (rocksdb) with TM restart end-to-end test' failed after 0 minutes and 37 seconds! Test exited with exit code 1 {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23903) ZooKeeperLeaderRetrievalConnectionHandlingTest.testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection fails on azure
Xintong Song created FLINK-23903: Summary: ZooKeeperLeaderRetrievalConnectionHandlingTest.testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection fails on azure Key: FLINK-23903 URL: https://issues.apache.org/jira/browse/FLINK-23903 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22534&view=logs&j=a57e0635-3fad-5b08-57c7-a4142d7d6fa9&t=2ef0effc-1da1-50e5-c2bd-aab434b1c5b7&l=6647 {code} Aug 20 07:54:25 [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.652 s <<< FAILURE! - in org.apache.flink.runtime.leaderelection.ZooKeeperLeaderRetrievalConnectionHandlingTest Aug 20 07:54:25 [ERROR] testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection Time elapsed: 2.244 s <<< FAILURE! Aug 20 07:54:25 java.lang.AssertionError: Aug 20 07:54:25 Aug 20 07:54:25 Expected: is null Aug 20 07:54:25 but: was Aug 20 07:54:25 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) Aug 20 07:54:25 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) Aug 20 07:54:25 at org.apache.flink.runtime.leaderelection.ZooKeeperLeaderRetrievalConnectionHandlingTest.testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection(ZooKeeperLeaderRetrievalConnectionHandlingTest.java:211) Aug 20 07:54:25 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 20 07:54:25 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 20 07:54:25 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 20 07:54:25 at java.lang.reflect.Method.invoke(Method.java:498) Aug 20 07:54:25 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Aug 20 07:54:25 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 20 07:54:25 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Aug 20 07:54:25 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 20 07:54:25 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Aug 20 07:54:25 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Aug 20 07:54:25 at org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.evaluate(TestingFatalErrorHandlerResource.java:91) Aug 20 07:54:25 at org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.access$200(TestingFatalErrorHandlerResource.java:83) Aug 20 07:54:25 at org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$1.evaluate(TestingFatalErrorHandlerResource.java:55) Aug 20 07:54:25 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23881) SemiJoinITCase.testExistsWithOver4 fails with "failed to fetch next result"
Xintong Song created FLINK-23881: Summary: SemiJoinITCase.testExistsWithOver4 fails with "failed to fetch next result" Key: FLINK-23881 URL: https://issues.apache.org/jira/browse/FLINK-23881 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22511&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=9780 {code} Aug 20 00:40:06 [ERROR] Tests run: 172, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 164.436 s <<< FAILURE! - in org.apache.flink.table.planner.runtime.batch.sql.join.SemiJoinITCase Aug 20 00:40:06 [ERROR] testExistsWithOver4[NestedLoopJoin-{1}] Time elapsed: 53.47 s <<< ERROR! Aug 20 00:40:06 java.lang.RuntimeException: Failed to fetch next result Aug 20 00:40:06 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:109) Aug 20 00:40:06 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80) Aug 20 00:40:06 at org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370) Aug 20 00:40:06 at java.util.Iterator.forEachRemaining(Iterator.java:115) Aug 20 00:40:06 at org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109) Aug 20 00:40:06 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.executeQuery(BatchTestBase.scala:300) Aug 20 00:40:06 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.check(BatchTestBase.scala:140) Aug 20 00:40:06 at org.apache.flink.table.planner.runtime.utils.BatchTestBase.checkResult(BatchTestBase.scala:106) Aug 20 00:40:06 at org.apache.flink.table.planner.runtime.batch.sql.join.SemiJoinITCase.testExistsWithOver4(SemiJoinITCase.scala:314) Aug 20 00:40:06 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 20 00:40:06 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 20 00:40:06 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 20 00:40:06 at java.lang.reflect.Method.invoke(Method.java:498) Aug 20 00:40:06 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Aug 20 00:40:06 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 20 00:40:06 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Aug 20 00:40:06 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 20 00:40:06 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Aug 20 00:40:06 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Aug 20 00:40:06 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Aug 20 00:40:06 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Aug 20 00:40:06 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Aug 20 00:40:06 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Aug 20 00:40:06 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Aug 20 00:40:06 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Aug 20 00:40:06 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Aug 20 00:40:06 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Aug 20 00:40:06 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Aug 20 00:40:06 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Aug 20 00:40:06 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Aug 20 00:40:06 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Aug 20 00:40:06 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Aug 20 00:40:06 at org.junit.runners.Suite.runChild(Suite.java:128) Aug 20 00:40:06 at org.junit.runners.Suite.runChild(Suite.java:27) Aug 20 00:40:06 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Aug 20 00:40:06 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Aug 20 00:40:06 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Aug 20 00:40:06 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Aug 20 00:40:06 at org.junit.runners.Pa
[jira] [Created] (FLINK-23880) WindowAggregateITCase.testCascadeEventTimeTumbleWindowWithOffset fail with Artificial Failure
Xintong Song created FLINK-23880: Summary: WindowAggregateITCase.testCascadeEventTimeTumbleWindowWithOffset fail with Artificial Failure Key: FLINK-23880 URL: https://issues.apache.org/jira/browse/FLINK-23880 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22511&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=9621 {code} Aug 20 00:28:31 Caused by: java.lang.Exception: Artificial Failure Aug 20 00:28:31 at org.apache.flink.table.planner.runtime.utils.FailingCollectionSource.run(FailingCollectionSource.java:172) Aug 20 00:28:31 at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:116) Aug 20 00:28:31 at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:73) Aug 20 00:28:31 at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:323) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23867) FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed fails with IllegalStateException
Xintong Song created FLINK-23867: Summary: FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed fails with IllegalStateException Key: FLINK-23867 URL: https://issues.apache.org/jira/browse/FLINK-23867 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.13.2 Reporter: Xintong Song Fix For: 1.13.3 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22465&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=c1d93a6a-ba91-515d-3196-2ee8019fbda7&l=6862 {code} Aug 18 23:20:14 [ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 51.905 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase Aug 18 23:20:14 [ERROR] testCommitTransactionAfterClosed(org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase) Time elapsed: 7.848 s <<< ERROR! Aug 18 23:20:14 java.lang.Exception: Unexpected exception, expected but was Aug 18 23:20:14 at org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:28) Aug 18 23:20:14 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) Aug 18 23:20:14 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) Aug 18 23:20:14 at java.util.concurrent.FutureTask.run(FutureTask.java:266) Aug 18 23:20:14 at java.lang.Thread.run(Thread.java:748) Aug 18 23:20:14 Caused by: java.lang.AssertionError: The message should have been successfully sent expected null, but was: Aug 18 23:20:14 at org.junit.Assert.fail(Assert.java:88) Aug 18 23:20:14 at org.junit.Assert.failNotNull(Assert.java:755) Aug 18 23:20:14 at org.junit.Assert.assertNull(Assert.java:737) Aug 18 23:20:14 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase.getClosedProducer(FlinkKafkaInternalProducerITCase.java:228) Aug 18 23:20:14 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed(FlinkKafkaInternalProducerITCase.java:177) Aug 18 23:20:14 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 18 23:20:14 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 18 23:20:14 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 18 23:20:14 at java.lang.reflect.Method.invoke(Method.java:498) Aug 18 23:20:14 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) Aug 18 23:20:14 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 18 23:20:14 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) Aug 18 23:20:14 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 18 23:20:14 at org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:19) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23866) KafkaTransactionLogITCase.testGetTransactionsToAbort fails with IllegalStateException
Xintong Song created FLINK-23866: Summary: KafkaTransactionLogITCase.testGetTransactionsToAbort fails with IllegalStateException Key: FLINK-23866 URL: https://issues.apache.org/jira/browse/FLINK-23866 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22463&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7098 {code} Aug 18 23:14:24 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 67.32 s <<< FAILURE! - in org.apache.flink.connector.kafka.sink.KafkaTransactionLogITCase Aug 18 23:14:24 [ERROR] testGetTransactionsToAbort Time elapsed: 22.35 s <<< ERROR! Aug 18 23:14:24 java.lang.IllegalStateException: You can only check the position for partitions assigned to this consumer. Aug 18 23:14:24 at org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:1717) Aug 18 23:14:24 at org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:1684) Aug 18 23:14:24 at org.apache.flink.connector.kafka.sink.KafkaTransactionLog.hasReadAllRecords(KafkaTransactionLog.java:144) Aug 18 23:14:24 at org.apache.flink.connector.kafka.sink.KafkaTransactionLog.getTransactionsToAbort(KafkaTransactionLog.java:133) Aug 18 23:14:24 at org.apache.flink.connector.kafka.sink.KafkaTransactionLogITCase.testGetTransactionsToAbort(KafkaTransactionLogITCase.java:110) Aug 18 23:14:24 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 18 23:14:24 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 18 23:14:24 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 18 23:14:24 at java.lang.reflect.Method.invoke(Method.java:498) Aug 18 23:14:24 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Aug 18 23:14:24 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 18 23:14:24 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Aug 18 23:14:24 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 18 23:14:24 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Aug 18 23:14:24 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Aug 18 23:14:24 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Aug 18 23:14:24 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Aug 18 23:14:24 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Aug 18 23:14:24 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Aug 18 23:14:24 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Aug 18 23:14:24 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Aug 18 23:14:24 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Aug 18 23:14:24 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Aug 18 23:14:24 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Aug 18 23:14:24 at org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30) Aug 18 23:14:24 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Aug 18 23:14:24 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Aug 18 23:14:24 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Aug 18 23:14:24 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Aug 18 23:14:24 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Aug 18 23:14:24 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43) Aug 18 23:14:24 at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) Aug 18 23:14:24 at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) Aug 18 23:14:24 at java.util.Iterator.forEachRemaining(Iterator.java:116) Aug 18 23:14:24 at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801) Aug 18 23:14:24 at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) Aug 18 23:14:24 at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) Aug 18 23:14:24 at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) Aug 18 23:14:24
[jira] [Created] (FLINK-23851) AggregationsITCase.testDistinctAfterAggregate fails due to AskTimeoutException
Xintong Song created FLINK-23851: Summary: AggregationsITCase.testDistinctAfterAggregate fails due to AskTimeoutException Key: FLINK-23851 URL: https://issues.apache.org/jira/browse/FLINK-23851 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.13.2 Reporter: Xintong Song Fix For: 1.13.3 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22417&view=logs&j=56781494-ebb0-5eae-f732-b9c397ec6ede&t=6568c985-5fcc-5b89-1ebd-0385b8088b14&l=8303 {code} Aug 17 21:27:07 Caused by: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/rpc/taskmanager_288#1055484738]] after [1 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalRpcInvocation]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. Aug 17 21:27:07 at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635) Aug 17 21:27:07 at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635) Aug 17 21:27:07 at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648) Aug 17 21:27:07 at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) Aug 17 21:27:07 at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601) Aug 17 21:27:07 at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109) Aug 17 21:27:07 at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599) Aug 17 21:27:07 at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) Aug 17 21:27:07 at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279) Aug 17 21:27:07 at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23830) FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on azure
Xintong Song created FLINK-23830: Summary: FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on azure Key: FLINK-23830 URL: https://issues.apache.org/jira/browse/FLINK-23830 Project: Flink Issue Type: Bug Affects Versions: 1.12.5 Reporter: Xintong Song Fix For: 1.12.6 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22330&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5&l=6536 {code} [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 172.104 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerMigrationOperatorTest [ERROR] testRestoreProducer[Migration Savepoint: 1.11](org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerMigrationOperatorTest) Time elapsed: 71.614 s <<< FAILURE! java.lang.AssertionError: Expected elements: <[42, 44]>, but was: elements: <[]> at org.junit.Assert.fail(Assert.java:88) at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:349) at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:303) at org.apache.flink.streaming.connectors.kafka.KafkaMigrationTestBase.testRestoreProducer(KafkaMigrationTestBase.java:154) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23829) SavepointITCase JVM crash on azure
Xintong Song created FLINK-23829: Summary: SavepointITCase JVM crash on azure Key: FLINK-23829 URL: https://issues.apache.org/jira/browse/FLINK-23829 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=5224 {code} Aug 16 16:26:11 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (integration-tests) on project flink-tests: There are test failures. Aug 16 16:26:11 [ERROR] Aug 16 16:26:11 [ERROR] Please refer to /__w/1/s/flink-tests/target/surefire-reports for the individual test results. Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream. Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called? Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=2 -XX:+UseG1GC -jar /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2 surefire8582412554358604743tmp surefire_2118489584967019297925tmp Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log Aug 16 16:26:11 [ERROR] Process Exit Code: 239 Aug 16 16:26:11 [ERROR] Crashed tests: Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase Aug 16 16:26:11 [ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: ExecutionException The forked VM terminated without properly saying goodbye. VM crash or System.exit called? Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m -Dmvn.forkNumber=2 -XX:+UseG1GC -jar /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2 surefire8582412554358604743tmp surefire_2118489584967019297925tmp Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log Aug 16 16:26:11 [ERROR] Process Exit Code: 239 Aug 16 16:26:11 [ERROR] Crashed tests: Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510) Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457) Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298) Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246) Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183) Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011) Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857) Aug 16 16:26:11 [ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) Aug 16 16:26:11 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) Aug 16 16:26:11 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) Aug 16 16:26:11 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) Aug 16 16:26:11 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) Aug 16 16:26:11 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) Aug 16 16:26:11 [ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) Aug 16 16:26:11 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120) Aug 16 16:26:11 [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355) Aug 16 16:26:11 [ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) Aug 16 16:26:11 [ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) Aug 16 16:26:11 [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216) Aug 16 16:26:11 [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160) Aug 16 16:26:11 [ERROR] at sun.reflect.NativeMeth
[jira] [Created] (FLINK-23828) KafkaSourceITCase.testIdleReader fails on azure
Xintong Song created FLINK-23828: Summary: KafkaSourceITCase.testIdleReader fails on azure Key: FLINK-23828 URL: https://issues.apache.org/jira/browse/FLINK-23828 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22284&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7355 {code} Aug 16 14:25:00 [ERROR] Tests run: 12, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 67.241 s <<< FAILURE! - in org.apache.flink.connector.kafka.source.KafkaSourceITCase Aug 16 14:25:00 [ERROR] testIdleReader{TestEnvironment, ExternalContext}[1] Time elapsed: 0.918 s <<< FAILURE! Aug 16 14:25:00 java.lang.AssertionError: Aug 16 14:25:00 Aug 16 14:25:00 Expected: Records consumed by Flink should be identical to test data and preserve the order in multiple splits Aug 16 14:25:00 but: Unexpected record 'la3OaJDch7vuUXDmGOYf' Aug 16 14:25:00 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) Aug 16 14:25:00 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) Aug 16 14:25:00 at org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testIdleReader(SourceTestSuiteBase.java:193) Aug 16 14:25:00 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 16 14:25:00 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 16 14:25:00 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 16 14:25:00 at java.lang.reflect.Method.invoke(Method.java:498) Aug 16 14:25:00 at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:688) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) Aug 16 14:25:00 at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) Aug 16 14:25:00 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) Aug 16 14:25:00 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) Aug 16 14:25:00 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) Aug 16 14:25:00 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:210) Aug 16 14:25:00 at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) Aug 16 14:25:00 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:206) Aug 16 14:25:00 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:131) Aug 16 14:25:00 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:65) Aug 16 14:25:00 at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139) Aug 16 14:25:00 at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) Aug 16 14:25:00 at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129) Aug 16 14:25:00 at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) Aug 16 14:25:00 at org.junit.platform.engine.support.hierarchical.NodeTestTask.lamb
[jira] [Created] (FLINK-23797) SavepointITCase.testStopSavepointWithBoundedInput fails on azure
Xintong Song created FLINK-23797: Summary: SavepointITCase.testStopSavepointWithBoundedInput fails on azure Key: FLINK-23797 URL: https://issues.apache.org/jira/browse/FLINK-23797 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=0&view=logs&j=baf26b34-3c6a-54e8-f93f-cf269b32f802&t=8c9d126d-57d2-5a9e-a8c8-ff53f7b35cd9&l=4945 {code} Aug 15 22:57:53 [ERROR] Tests run: 15, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 58.799 s <<< FAILURE! - in org.apache.flink.test.checkpointing.SavepointITCase Aug 15 22:57:53 [ERROR] testStopSavepointWithBoundedInput Time elapsed: 4.431 s <<< ERROR! Aug 15 22:57:53 java.util.concurrent.ExecutionException: org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint triggering task Sink: Unnamed (1/1) of job a27d76d1e3a0145b179b30b3a4cd6564 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running. Aug 15 22:57:53 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) Aug 15 22:57:53 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) Aug 15 22:57:53 at org.apache.flink.test.checkpointing.SavepointITCase.testStopSavepointWithBoundedInput(SavepointITCase.java:612) Aug 15 22:57:53 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Aug 15 22:57:53 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Aug 15 22:57:53 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Aug 15 22:57:53 at java.lang.reflect.Method.invoke(Method.java:498) Aug 15 22:57:53 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Aug 15 22:57:53 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Aug 15 22:57:53 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Aug 15 22:57:53 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Aug 15 22:57:53 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Aug 15 22:57:53 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Aug 15 22:57:53 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Aug 15 22:57:53 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Aug 15 22:57:53 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Aug 15 22:57:53 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Aug 15 22:57:53 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Aug 15 22:57:53 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Aug 15 22:57:53 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Aug 15 22:57:53 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Aug 15 22:57:53 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Aug 15 22:57:53 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Aug 15 22:57:53 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Aug 15 22:57:53 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Aug 15 22:57:53 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Aug 15 22:57:53 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Aug 15 22:57:53 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Aug 15 22:57:53 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Aug 15 22:57:53 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43) Aug 15 22:57:53 at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) Aug 15 22:57:53 at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) Aug 15 22:57:53 at java.util.Iterator.forEachRemaining(Iterator.java:116) Aug 15 22:57:53 at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801) Aug 15 22:57:53 at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) Aug 15 22:57:53 at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) Aug 15 22:57:53 at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) Aug 15 22:57:53 at java.util.stream.ForEachOps$ForEachOp$OfRef