[jira] [Created] (FLINK-36360) Prepare release process and Scripts for the preview release

2024-09-24 Thread Xintong Song (Jira)
Xintong Song created FLINK-36360:


 Summary: Prepare release process and Scripts for the preview 
release
 Key: FLINK-36360
 URL: https://issues.apache.org/jira/browse/FLINK-36360
 Project: Flink
  Issue Type: New Feature
  Components: Release System
Reporter: Xintong Song
Assignee: Xintong Song
 Fix For: 2.0-preview






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-36261) Revisit all breaking changes before Flink 2.0 Preview

2024-09-11 Thread Xintong Song (Jira)
Xintong Song created FLINK-36261:


 Summary: Revisit all breaking changes before Flink 2.0 Preview
 Key: FLINK-36261
 URL: https://issues.apache.org/jira/browse/FLINK-36261
 Project: Flink
  Issue Type: Technical Debt
Reporter: Xintong Song
 Fix For: 2.0-preview


Japicmp for @Deprecated APIs is disabled in FLINK-36207.

We need to check whether there's any unexpected breaking changes right before 
the Flink 2.0 Preview release, by re-enable the checking locally.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-36200) Breaking changes for Flink 3.0

2024-09-02 Thread Xintong Song (Jira)
Xintong Song created FLINK-36200:


 Summary: Breaking changes for Flink 3.0
 Key: FLINK-36200
 URL: https://issues.apache.org/jira/browse/FLINK-36200
 Project: Flink
  Issue Type: Technical Debt
Reporter: Xintong Song
 Fix For: 3.0.0


This is an umbrella for tracking planed breaking changes that are targeting for 
the next major version bump.

Please be aware that, in order for the breaking changes to be included in the 
next major version bump, the following preparations need to be done in advance:
* The old APIs need to be deprecated, 2 minor releases before the major version 
bump for @Public APIs, and 1 minor release for @PublicEvolving APIs

* All internal usages of the deprecated APIs should be either migrated to 
replacing new APIs (if any) or deprecated / removed. This ensure that we can 
quickly remove the APIs during major version bump without need for extra 
migration efforts.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-35331) Download links for binary releases are displayed as source releases on website

2024-05-10 Thread Xintong Song (Jira)
Xintong Song created FLINK-35331:


 Summary: Download links for binary releases are displayed as 
source releases on website
 Key: FLINK-35331
 URL: https://issues.apache.org/jira/browse/FLINK-35331
 Project: Flink
  Issue Type: Bug
  Components: Project Website
Reporter: Xintong Song


Take Pre-bundled Hadoop as examples. The content for downloading are binary 
releases, while the link is displayed as "Pre-bundled Hadoop 2.x.y Source 
Release (asc, sha512)". The problem is caused by misusing 
`source_release_[url|asc_url|sha512_url]` for binary contents in the 
corresponding [yaml 
file.|https://github.com/apache/flink-web/blob/asf-site/docs/data/additional_components.yml]

There are many similar cases in the webpage.

And a relevant issues is that, some source releases are displayed as "XXX 
Source Release Source Release", due to including "Source Release" in the `name` 
field of the corresponding yaml file.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-32560) Properly deprecate all Scala APIs

2023-07-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-32560:


 Summary: Properly deprecate all Scala APIs
 Key: FLINK-32560
 URL: https://issues.apache.org/jira/browse/FLINK-32560
 Project: Flink
  Issue Type: Sub-task
  Components: API / Scala
Reporter: Xintong Song
 Fix For: 1.18.0


We agreed to drop Scala API support in FLIP-265 [1], and have tried to 
deprecate them in FLINK-29740. Also, both user documentation and roadmap[2] 
shows that scala API supports are deprecated. However, none of the APIs in 
`flink-streaming-scala` are annotated with `@Deprecated` atm, and only 
`ExecutionEnvironment` and `package` are marked `@Deprecated` in `flink-scala`.

[1] 
https://cwiki.apache.org/confluence/display/FLINK/FLIP-265+Deprecate+and+remove+Scala+API+support
[2] https://flink.apache.org/roadmap/




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-32559) Deprecate Queryable State

2023-07-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-32559:


 Summary: Deprecate Queryable State
 Key: FLINK-32559
 URL: https://issues.apache.org/jira/browse/FLINK-32559
 Project: Flink
  Issue Type: Sub-task
  Components: Runtime / Queryable State
Reporter: Xintong Song
 Fix For: 1.18.0


Queryable State is described as approaching end-of-life in the roadmap [1], but 
is neither deprecated in codes nor in user documentation [2]. There're also 
more negative opinions than positive ones in the discussion about rescuing it 
[3].

[1] https://flink.apache.org/roadmap/
[2] 
https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/datastream/fault-tolerance/queryable_state/
[3] https://lists.apache.org/thread/9hmwcjb3q5c24pk3qshjvybfqk62v17m



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-32558) Properly deprecate DataSet API

2023-07-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-32558:


 Summary: Properly deprecate DataSet API
 Key: FLINK-32558
 URL: https://issues.apache.org/jira/browse/FLINK-32558
 Project: Flink
  Issue Type: Sub-task
  Components: API / DataSet
Reporter: Xintong Song
 Fix For: 1.18.0


DataSet API is described as "legacy", "soft deprecated" in user documentation 
[1]. The required tasks for formally deprecating / removing it, according to 
FLIP-131 [2], are all completed.

This task include marking all related API classes as `@Deprecated` and update 
the user documentation.

[1] 
https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/dataset/overview/
[2] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-32557) API deprecations in Flink 1.18

2023-07-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-32557:


 Summary: API deprecations in Flink 1.18
 Key: FLINK-32557
 URL: https://issues.apache.org/jira/browse/FLINK-32557
 Project: Flink
  Issue Type: Technical Debt
Reporter: Xintong Song
 Fix For: 1.18.0


As discussed in [1], we are deprecating multiple APIs in release 1.18, in order 
to completely remove them in release 2.0.

The listed APIs possibly should have been deprecated already, i.e., already (or 
won't) have replacements, but are somehow not yet.

[1] https://lists.apache.org/thread/3dw4f8frlg8hzlv324ql7n2755bzs9hy



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-30629) ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat is unstable

2023-01-11 Thread Xintong Song (Jira)
Xintong Song created FLINK-30629:


 Summary: ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat 
is unstable
 Key: FLINK-30629
 URL: https://issues.apache.org/jira/browse/FLINK-30629
 Project: Flink
  Issue Type: Bug
  Components: Client / Job Submission
Affects Versions: 1.17.0
Reporter: Xintong Song
 Fix For: 1.17.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=44690&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33&t=125e07e7-8de0-5c6c-a541-a567415af3ef&l=10819

{code:java}
Jan 11 04:32:39 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 21.02 s <<< FAILURE! - in org.apache.flink.client.ClientHeartbeatTest
Jan 11 04:32:39 [ERROR] 
org.apache.flink.client.ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat
  Time elapsed: 9.157 s  <<< ERROR!
Jan 11 04:32:39 java.lang.IllegalStateException: MiniCluster is not yet running 
or has already been shut down.
Jan 11 04:32:39 at 
org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
Jan 11 04:32:39 at 
org.apache.flink.runtime.minicluster.MiniCluster.getDispatcherGatewayFuture(MiniCluster.java:1044)
Jan 11 04:32:39 at 
org.apache.flink.runtime.minicluster.MiniCluster.runDispatcherCommand(MiniCluster.java:917)
Jan 11 04:32:39 at 
org.apache.flink.runtime.minicluster.MiniCluster.getJobStatus(MiniCluster.java:841)
Jan 11 04:32:39 at 
org.apache.flink.runtime.minicluster.MiniClusterJobClient.getJobStatus(MiniClusterJobClient.java:91)
Jan 11 04:32:39 at 
org.apache.flink.client.ClientHeartbeatTest.testJobRunningIfClientReportHeartbeat(ClientHeartbeatTest.java:79)
{code}




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-29344) Make Adaptive Scheduler supports Fine-Grained Resource Management

2022-09-19 Thread Xintong Song (Jira)
Xintong Song created FLINK-29344:


 Summary: Make Adaptive Scheduler supports Fine-Grained Resource 
Management
 Key: FLINK-29344
 URL: https://issues.apache.org/jira/browse/FLINK-29344
 Project: Flink
  Issue Type: Improvement
  Components: Runtime / Coordination
Reporter: Xintong Song


This ticket is a reflection of the following Slack discussion:
{quote}
Donatien Schmitz
Adaptive Scheduler thread:
Hey all, it seems like the Adaptive Scheduler does not support fine grain 
resource management. I have fixed it and would like to know if you would be 
interested in a PR or if it was purposely designed to not support Fine grain 
resource management.

rmetzger
@Donatien Schmitz: I’m concerned that we don’t have a lot of review capacity 
right now, and I’m now aware of any users asking for it.

rmetzger
I couldn’t find a ticket for adding this feature, did you find one?
If not, can you add one? This will allow us to at least making this feature 
show up on google, and people might comment on it, if they need it.

rmetzger
If the change is fairly self-contained, is unlikely to cause instabilities, 
then we can also consider merging it

rmetzger
@Xintong Song what do you think?

Xintong Song
@rmetzger, thanks for involving me.
@Donatien Schmitz, thanks for bringing this up, and for volunteering on fixing 
this. Could you explain a bit more about how do you plan to fix this?
Fine-grained resource management is not yet supported by adaptive scheduler, 
because there’s an issue that we haven’t find a good solution for. Namely, if 
only part of the resource requirements can be fulfilled, how do we decide which 
requirements should be fulfilled. E.g., say the job declares it needs 10 slots 
with resource 1 for map tasks, and another 10 slots with resource 2 for reduce 
tasks. If there’s not enough resources (say only 10 slots can be allocated for 
simplicity), how many slots for map / reduce tasks should be allocated? 
Obviously, <10 map, 0 reduce> & <0 map, 10 reduce> would not work. For this 
example, a proportional scale-down (<5 map, 5 reduce>) seems reasonable. 
However, a proportional scale-down is not always easy (e.g., requirements is 
<100 map, 1 reduce>), and the issue grows more complicated if you take lots of 
stages and the differences of slot sizes into consideration.
I’d like to see adaptive scheduler also supports fine-grained resource 
management. If there’s a good solution to the above issue, I’d love to help 
review the effort.

Donatien Schmitz
Dear Robert and Xintong, thanks for reading and reacting to my message! I'll 
reply tomorrow (GTM +1 time) if that's quite alright with you. Best, Donatien 
Schmitz

Donatien Schmitz
@Xintong Song
* We are working on fine-grain scheduling for resource optimisation of long 
running or periodic jobs. One of the feature we are experiencing is a 
"rescheduling plan", a mapping of operators and Resource Profiles that can be 
dynamically applied to a running job. This rescheduling would be triggered by 
policies about some metrics (focus on RocksDB in our case).
* While developing this new feature, we decided to implement it on the Adpative 
Scheduler instead of the Base Scheduler because the logic brought by the state 
machine already present made it more logical: transitions from states Executing 
-> Cancelling -> Rescheduling -> Waiting for Resources -> Creating -> Executing
* In our case we are working on a POC and thus focusing on a real simple job 
with a // of 1. The issue you brought is indeed something we have faced while 
raising the // of the job.
* If you create a Jira Ticket we can discuss it over there if you'd like!

Donatien Schmitz
@rmetzger The changes do not break the default resource management but does not 
fix the issue brought out by Xintong.
{quote}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-28923) Release Testing: Verify flip-241 completed jobs information enhancement

2022-08-11 Thread Xintong Song (Jira)
Xintong Song created FLINK-28923:


 Summary: Release Testing: Verify flip-241 completed jobs 
information enhancement 
 Key: FLINK-28923
 URL: https://issues.apache.org/jira/browse/FLINK-28923
 Project: Flink
  Issue Type: Sub-task
  Components: Runtime / Web Frontend
Affects Versions: 1.16.0
Reporter: Xintong Song
 Fix For: 1.16.0


* Please refer to release note of FLINK-28307 for a list of changes to be 
verified
* The changes should be verified for both JobManager and HistoryServer
* I'd suggest to verify the history server functionality for various deployment 
modes. Previously, it didn't work with application mode (FLINK-19358).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-28558) HistoryServer log retrieval configuration improvement

2022-07-14 Thread Xintong Song (Jira)
Xintong Song created FLINK-28558:


 Summary: HistoryServer log retrieval configuration improvement
 Key: FLINK-28558
 URL: https://issues.apache.org/jira/browse/FLINK-28558
 Project: Flink
  Issue Type: Improvement
  Components: Runtime / Configuration, Runtime / REST
Reporter: Xintong Song
 Fix For: 1.16.0


HistoryServer generates log retrieval urls base on the following configuration:
- historyserver.log.jobmanager.url-pattern
- historyserver.log.taskmanager.url-pattern

The usability can be improved in two ways:
- Explicitly explain in description that only http/https schemas are supported, 
and add sanity checks for it.
- If the schema is not specified, add "http://"; by default.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-28555) Update history server documentation

2022-07-14 Thread Xintong Song (Jira)
Xintong Song created FLINK-28555:


 Summary: Update history server documentation
 Key: FLINK-28555
 URL: https://issues.apache.org/jira/browse/FLINK-28555
 Project: Flink
  Issue Type: Sub-task
  Components: Documentation
Reporter: Xintong Song
Assignee: Xintong Song


Update the history server documentation, w.r.t the log-viewing integration and 
the supported rest apis.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-28125) Promote leadership changing logs to INFO level

2022-06-19 Thread Xintong Song (Jira)
Xintong Song created FLINK-28125:


 Summary: Promote leadership changing logs to INFO level
 Key: FLINK-28125
 URL: https://issues.apache.org/jira/browse/FLINK-28125
 Project: Flink
  Issue Type: Improvement
  Components: Runtime / Coordination
Reporter: Xintong Song


Currently, {{DefaultLeaderElectionService}} logs leadership changing events in 
DEBUG level, expecting the contender to log the changes in INFO level. This is 
fragile because there're many different {{LeaderContender}} implementations and 
not all of them print the logs properly. E.g., 
{{JobMasterServiceLeadershipRunner}} logs the leadership changes in TRACE level.

I'd suggest to revisit the logging of leadership changing, printing the INFO 
logs from {{LeaderElectionService}}. That probably also means removing the 
contender side logs to avoid redundancy.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27848) ZooKeeperLeaderElectionDriver keeps writing leader information, using up zxid

2022-05-30 Thread Xintong Song (Jira)
Xintong Song created FLINK-27848:


 Summary: ZooKeeperLeaderElectionDriver keeps writing leader 
information, using up zxid
 Key: FLINK-27848
 URL: https://issues.apache.org/jira/browse/FLINK-27848
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.14.4, 1.15.0
Reporter: Xintong Song
Assignee: Weijie Guo
 Fix For: 1.14.5, 1.15.1


After a leadership change, the new leader may keeps writing its information 
(which is identical) to ZK, causing the zxid on ZK quickly used up.

The problem is that, in 
{{ZooKeeperLeaderElectionDriver#retrieveLeaderInformationFromZooKeeper}}, 
{{leaderElectionEventHandler.onLeaderInformationChange(LeaderInformation.empty())}}
 is called no matter {{childData}} is {{null}} or not. In case of non-null, 
this will cause the driver keeps re-writing the leader information to ZK.

The problem is introduced in FLINK-24038, and only affects the legacy 
{{ZooKeeperHaServices}}. Thus, only 1.14 / 1.15 are affected.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27731) Cannot build documentation with Hugo docker image

2022-05-21 Thread Xintong Song (Jira)
Xintong Song created FLINK-27731:


 Summary: Cannot build documentation with Hugo docker image
 Key: FLINK-27731
 URL: https://issues.apache.org/jira/browse/FLINK-27731
 Project: Flink
  Issue Type: Bug
  Components: Documentation
Affects Versions: 1.16.0
Reporter: Xintong Song


Flink provides 2 ways for building the documentation: 1) using a Hugo docker 
image, and 2) using a local Hugo installation.

Currently, 1) is broken due to the `setup_docs.sh` script requires a local Hugo 
installation.

This was introduced in FLINK-27394.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27723) Slack: revisit how this communication channel works

2022-05-20 Thread Xintong Song (Jira)
Xintong Song created FLINK-27723:


 Summary: Slack: revisit how this communication channel works
 Key: FLINK-27723
 URL: https://issues.apache.org/jira/browse/FLINK-27723
 Project: Flink
  Issue Type: Sub-task
Reporter: Xintong Song






--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27722) Slack: set up auto-updated invitation link

2022-05-20 Thread Xintong Song (Jira)
Xintong Song created FLINK-27722:


 Summary: Slack: set up auto-updated invitation link
 Key: FLINK-27722
 URL: https://issues.apache.org/jira/browse/FLINK-27722
 Project: Flink
  Issue Type: Sub-task
Reporter: Xintong Song






--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27721) Slack: set up archive

2022-05-20 Thread Xintong Song (Jira)
Xintong Song created FLINK-27721:


 Summary: Slack: set up archive
 Key: FLINK-27721
 URL: https://issues.apache.org/jira/browse/FLINK-27721
 Project: Flink
  Issue Type: Sub-task
Reporter: Xintong Song






--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27720) Slack: Update the project website regarding communication channels

2022-05-20 Thread Xintong Song (Jira)
Xintong Song created FLINK-27720:


 Summary: Slack: Update the project website regarding communication 
channels
 Key: FLINK-27720
 URL: https://issues.apache.org/jira/browse/FLINK-27720
 Project: Flink
  Issue Type: Sub-task
Reporter: Xintong Song






--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27719) Create Apache Flink slack workspace

2022-05-20 Thread Xintong Song (Jira)
Xintong Song created FLINK-27719:


 Summary: Create Apache Flink slack workspace
 Key: FLINK-27719
 URL: https://issues.apache.org/jira/browse/FLINK-27719
 Project: Flink
  Issue Type: Improvement
Reporter: Xintong Song
Assignee: Xintong Song


This is an umbrella for tasks related to setting up the Apache Flink slack 
channel.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27514) Website links to up-to-date committer and PMC member lists

2022-05-05 Thread Xintong Song (Jira)
Xintong Song created FLINK-27514:


 Summary: Website links to up-to-date committer and PMC member lists
 Key: FLINK-27514
 URL: https://issues.apache.org/jira/browse/FLINK-27514
 Project: Flink
  Issue Type: Improvement
  Components: Project Website
Reporter: Xintong Song
Assignee: Xintong Song


According to the [ML 
discussion|https://lists.apache.org/thread/679ds6lfqs8f4q8lnt7tnlofl58str4y], 
we are going to add a link to the up-to-date [committer and PMC member 
list|https://projects.apache.org/committee.html?flink] from the community page 
of our project website, as well as a notice about the current list could be 
outdated.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-25970) SerializedThrowable should record type of the original throwable.

2022-02-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-25970:


 Summary: SerializedThrowable should record type of the original 
throwable.
 Key: FLINK-25970
 URL: https://issues.apache.org/jira/browse/FLINK-25970
 Project: Flink
  Issue Type: Improvement
  Components: API / Core
Affects Versions: 1.14.3
Reporter: Xintong Song


Currently, only the message and stack of the original throwable is preserved in 
{{{}SerializedThrowable{}}}, while the type of the original throwable is 
discarded.

Sometimes, it would be helpful if message of {{SerializedThrowable}} can also 
include the full class name of the original throwable.

E.g., in the following stack.
{code:java}
Caused by: org.apache.flink.util.SerializedThrowable
at java.util.HashMap$HashIterator.nextNode(HashMap.java:1437) ~[?:1.8.0_102]
at java.util.HashMap$EntryIterator.next(HashMap.java:1471) ~[?:1.8.0_102]
at java.util.HashMap$EntryIterator.next(HashMap.java:1469) ~[?:1.8.0_102]
...
{code}
It's not that easy to understand what is wrong from this stack. JDK does not 
provide a message for the original exception. We have to look into the JDK 
source codes to find out what's going on. Sometimes it's even more annoying 
having to look for the JDK source codes of the exactly same version in order to 
match the line numbers.

Turns out the original exception was a {{ConcurrentModificationException}}. I 
think it would be much more straightforward if we can have a stack like the 
following.
{code}
Caused by: org.apache.flink.util.SerializedThrowable: 
java.util.ConcurrentModificationException
at java.util.HashMap$HashIterator.nextNode(HashMap.java:1437) ~[?:1.8.0_102]
at java.util.HashMap$EntryIterator.next(HashMap.java:1471) ~[?:1.8.0_102]
at java.util.HashMap$EntryIterator.next(HashMap.java:1469) ~[?:1.8.0_102]
...
{code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Created] (FLINK-25356) Add benchmarks for performance in OLAP scenarios

2021-12-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-25356:


 Summary: Add benchmarks for performance in OLAP scenarios
 Key: FLINK-25356
 URL: https://issues.apache.org/jira/browse/FLINK-25356
 Project: Flink
  Issue Type: Sub-task
  Components: Benchmarks
Reporter: Xintong Song


As discussed in FLINK-25318, we would need a unified, public visible benchmark 
setups, for supporting OLAP performance improvements and investigations.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Created] (FLINK-24584) ClientTest.testRequestUnavailableHost fails on azure

2021-10-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-24584:


 Summary: ClientTest.testRequestUnavailableHost fails on azure
 Key: FLINK-24584
 URL: https://issues.apache.org/jira/browse/FLINK-24584
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Queryable State
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.1


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25194&view=logs&j=961f8f81-6b52-53df-09f6-7291a2e4af6a&t=f53023d8-92c3-5d78-ec7e-70c2bf37be20&l=15189

{code}
Oct 19 00:31:59 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 1.597 s <<< FAILURE! - in 
org.apache.flink.queryablestate.network.ClientTest
Oct 19 00:31:59 [ERROR] testRequestUnavailableHost  Time elapsed: 0.025 s  <<< 
FAILURE!
Oct 19 00:31:59 java.lang.AssertionError: Did not throw expected 
ConnectException
Oct 19 00:31:59 at org.junit.Assert.fail(Assert.java:89)
Oct 19 00:31:59 at 
org.apache.flink.queryablestate.network.ClientTest.testRequestUnavailableHost(ClientTest.java:274)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24583) ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush timeout on azure

2021-10-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-24583:


 Summary: ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush 
timeout on azure
 Key: FLINK-24583
 URL: https://issues.apache.org/jira/browse/FLINK-24583
 Project: Flink
  Issue Type: Bug
  Components: Connectors / ElasticSearch
Affects Versions: 1.15.0
 Environment: ElasticsearchWriterITCase
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25191&view=logs&j=961f8f81-6b52-53df-09f6-7291a2e4af6a&t=f53023d8-92c3-5d78-ec7e-70c2bf37be20&l=12452

{code}
Oct 18 23:47:27 [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 22.228 s <<< FAILURE! - in 
org.apache.flink.connector.elasticsearch.sink.ElasticsearchWriterITCase
Oct 18 23:47:27 [ERROR] testWriteOnBulkIntervalFlush  Time elapsed: 2.032 s  
<<< ERROR!
Oct 18 23:47:27 java.util.concurrent.TimeoutException: Condition was not met in 
given timeout.
Oct 18 23:47:27 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:166)
Oct 18 23:47:27 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:144)
Oct 18 23:47:27 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:136)
Oct 18 23:47:27 at 
org.apache.flink.connector.elasticsearch.sink.ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush(ElasticsearchWriterITCase.java:139)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24582) PrometheusReporterEndToEndITCase fails due to timeout

2021-10-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-24582:


 Summary: PrometheusReporterEndToEndITCase fails due to timeout
 Key: FLINK-24582
 URL: https://issues.apache.org/jira/browse/FLINK-24582
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Metrics
Affects Versions: 1.15.0
Reporter: Xintong Song


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25180&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=23451

{code}
Oct 18 18:17:44 [ERROR] Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time 
elapsed: 9.138 s <<< FAILURE! - in 
org.apache.flink.metrics.prometheus.tests.PrometheusReporterEndToEndITCase
Oct 18 18:17:44 [ERROR] testReporter[0: Jar in 'lib', instantiated via 
reflection]  Time elapsed: 1.779 s  <<< ERROR!
Oct 18 18:17:44 java.io.IOException: Process ([wget, -q, -P, 
/home/vsts/work/1/e2e_cache/downloads/-1930370649, --timeout, 240, 
https://github.com/prometheus/prometheus/releases/download/v2.4.3/prometheus-2.4.3.linux-amd64.tar.gz])
 exceeded timeout (60) or number of retries (3).
Oct 18 18:17:44 at 
org.apache.flink.tests.util.AutoClosableProcess$AutoClosableProcessBuilder.runBlockingWithRetry(AutoClosableProcess.java:168)
Oct 18 18:17:44 at 
org.apache.flink.tests.util.cache.AbstractDownloadCache.getOrDownload(AbstractDownloadCache.java:135)
Oct 18 18:17:44 at 
org.apache.flink.tests.util.cache.PersistingDownloadCache.getOrDownload(PersistingDownloadCache.java:36)
Oct 18 18:17:44 at 
org.apache.flink.metrics.prometheus.tests.PrometheusReporterEndToEndITCase.testReporter(PrometheusReporterEndToEndITCase.java:209)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24538) ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten fails with NPE

2021-10-13 Thread Xintong Song (Jira)
Xintong Song created FLINK-24538:


 Summary: 
ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten fails 
with NPE
 Key: FLINK-24538
 URL: https://issues.apache.org/jira/browse/FLINK-24538
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.15.0, 1.14.1


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25020&view=logs&j=f2b08047-82c3-520f-51ee-a30fd6254285&t=3810d23d-4df2-586c-103c-ec14ede6af00&l=7573

{code}
Oct 13 22:26:04 [ERROR] Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 12.355 s <<< FAILURE! - in 
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionTest
Oct 13 22:26:04 [ERROR] testLeaderShouldBeCorrectedWhenOverwritten  Time 
elapsed: 1.138 s  <<< ERROR!
Oct 13 22:26:04 java.lang.NullPointerException
Oct 13 22:26:04 at 
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten(ZooKeeperLeaderElectionTest.java:434)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24502) Automate updating of `MigrationVersion` and migration tests.

2021-10-11 Thread Xintong Song (Jira)
Xintong Song created FLINK-24502:


 Summary: Automate updating of `MigrationVersion` and migration 
tests.
 Key: FLINK-24502
 URL: https://issues.apache.org/jira/browse/FLINK-24502
 Project: Flink
  Issue Type: Improvement
  Components: Release System
Reporter: Xintong Song


This ticket comes from this[ PR 
discussion|https://github.com/apache/flink/pull/17403#issuecomment-939739016].

Currently, to update the migration tests w.r.t. a new released version, we need 
to the followings:
* Add new version to `MigrationVersion`
* Find out the test cases where the `MigrationVersion` is used, and update the 
test to cover the new version
* Generate required files (e.g., snapshot) for the new version, which is 
usually discovered by running into test failures.

The problems are:
* It requires too many manual efforts, which is more fragile.
* It is too complicate for release managers to work on, who may not have the 
required knowledges of the migration/serialization.

Potential improvements includes:
* Introduce something like `MigrationVersion#versionListSince(MigrationVersion 
sinceVersion)`, so that most test cases can get an up-to-date list of versions 
without changing the codes.
* Find a way to automate the regeneration of migration tests files. E.g., a 
script or maven profile that executes all test cases / methods with a specific 
annotation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24495) Python installdeps hangs

2021-10-10 Thread Xintong Song (Jira)
Xintong Song created FLINK-24495:


 Summary: Python installdeps hangs
 Key: FLINK-24495
 URL: https://issues.apache.org/jira/browse/FLINK-24495
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24922&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=6bb545dd-772d-5d8c-f258-f5085fba3295&l=23587

{code}
Oct 10 02:30:01 py38-cython create: /__w/1/s/flink-python/.tox/py38-cython
Oct 10 02:30:04 py38-cython installdeps: pytest, apache-beam==2.27.0, 
cython==0.29.16, grpcio>=1.29.0,<2, grpcio-tools>=1.3.5,<=1.14.2, 
apache-flink-libraries
Oct 10 02:45:22 
==
Oct 10 02:45:22 Process produced no output for 900 seconds.
Oct 10 02:45:22 
==
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24480) EqualiserCodeGeneratorTest fails on azure

2021-10-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-24480:


 Summary: EqualiserCodeGeneratorTest fails on azure
 Key: FLINK-24480
 URL: https://issues.apache.org/jira/browse/FLINK-24480
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Legacy Planner
Affects Versions: 1.13.2
Reporter: Xintong Song
 Fix For: 1.13.3


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24809&view=logs&j=955770d3-1fed-5a0a-3db6-0c7554c910cb&t=14447d61-56b4-5000-80c1-daa459247f6a&l=42615

{code}
Oct 07 01:11:46 [ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 8.236 s <<< FAILURE! - in 
org.apache.flink.table.planner.codegen.EqualiserCodeGeneratorTest
Oct 07 01:11:46 [ERROR] 
testManyFields(org.apache.flink.table.planner.codegen.EqualiserCodeGeneratorTest)
  Time elapsed: 8.21 s  <<< FAILURE!
Oct 07 01:11:46 java.lang.AssertionError: Expected compilation to succeed
Oct 07 01:11:46 at org.junit.Assert.fail(Assert.java:88)
Oct 07 01:11:46 at 
org.apache.flink.table.planner.codegen.EqualiserCodeGeneratorTest.testManyFields(EqualiserCodeGeneratorTest.java:102)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24405) KafkaWriterITCase.testLingeringTransaction fails on azure

2021-09-29 Thread Xintong Song (Jira)
Xintong Song created FLINK-24405:


 Summary: KafkaWriterITCase.testLingeringTransaction fails on azure
 Key: FLINK-24405
 URL: https://issues.apache.org/jira/browse/FLINK-24405
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24595&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=e424005a-b16e-540f-196d-da062cc19bdf&l=7344

{code}
Sep 28 22:36:05 [ERROR] Tests run: 13, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 35.773 s <<< FAILURE! - in 
org.apache.flink.connector.kafka.sink.KafkaWriterITCase
Sep 28 22:36:05 [ERROR] testLingeringTransaction  Time elapsed: 3.07 s  <<< 
FAILURE!
Sep 28 22:36:05 java.lang.AssertionError: 
Sep 28 22:36:05 
Sep 28 22:36:05 Expected: a collection with size <1>
Sep 28 22:36:05  but: collection size was <0>
Sep 28 22:36:05 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
Sep 28 22:36:05 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
Sep 28 22:36:05 at 
org.apache.flink.connector.kafka.sink.KafkaWriterITCase.testLingeringTransaction(KafkaWriterITCase.java:213)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24390) Python 'build_wheels mac' fails on azure

2021-09-27 Thread Xintong Song (Jira)
Xintong Song created FLINK-24390:


 Summary: Python 'build_wheels mac' fails on azure
 Key: FLINK-24390
 URL: https://issues.apache.org/jira/browse/FLINK-24390
 Project: Flink
  Issue Type: Bug
  Components: API / Python, Build System
Affects Versions: 1.12.5
Reporter: Xintong Song
 Fix For: 1.12.6


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24547&view=logs&j=33dd8067-7758-552f-a1cf-a8b8ff0e44cd&t=789348ee-cf3e-5c4b-7c78-355970e5f360&l=17982



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24377) TM resource may not be properly released after heartbeat timeout

2021-09-26 Thread Xintong Song (Jira)
Xintong Song created FLINK-24377:


 Summary: TM resource may not be properly released after heartbeat 
timeout
 Key: FLINK-24377
 URL: https://issues.apache.org/jira/browse/FLINK-24377
 Project: Flink
  Issue Type: Bug
  Components: Deployment / Kubernetes, Deployment / YARN, Runtime / 
Coordination
Affects Versions: 1.13.2, 1.14.0
Reporter: Xintong Song
Assignee: Xintong Song
 Fix For: 1.14.0, 1.13.3, 1.15.0


In native k8s and yarn deploy modes, RM disconnects a TM when its heartbeat 
times out. However, it does not actively release the pod / container of that 
TM. The releasing of pod / container relies on the TM to terminate itself after 
failing to re-register to the RM.

In some rare conditions, the TM process may not terminate and hang out for long 
time. In such cases, k8s / yarn sees the process running, thus will not release 
the pod / container. Neither will Flink's resource manager. Consequently, the 
resource is leaked until the entire application is terminated.

To fix this, we should make {{ActiveResourceManager}} to actively release the 
resource to K8s / Yarn after a TM heartbeat timeout.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24374) ManualCheckpointITCase.testTriggeringWhenPeriodicDisabled fails on azure

2021-09-25 Thread Xintong Song (Jira)
Xintong Song created FLINK-24374:


 Summary: ManualCheckpointITCase.testTriggeringWhenPeriodicDisabled 
fails on azure
 Key: FLINK-24374
 URL: https://issues.apache.org/jira/browse/FLINK-24374
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Checkpointing
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24489&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=5037

{code}
Sep 25 01:47:42 java.lang.AssertionError: 
Sep 25 01:47:42 
Sep 25 01:47:42 Expected: <1L>
Sep 25 01:47:42  but: was <0L>
Sep 25 01:47:42 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
Sep 25 01:47:42 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
Sep 25 01:47:42 at 
org.apache.flink.test.checkpointing.ManualCheckpointITCase.testTriggeringWhenPeriodicDisabled(ManualCheckpointITCase.java:106)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24358) flink-avro-glue-schema-registry fails compiling with dependency convergence

2021-09-22 Thread Xintong Song (Jira)
Xintong Song created FLINK-24358:


 Summary: flink-avro-glue-schema-registry fails compiling with 
dependency convergence
 Key: FLINK-24358
 URL: https://issues.apache.org/jira/browse/FLINK-24358
 Project: Flink
  Issue Type: Bug
  Components: Build System
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24405&view=logs&j=ed6509f5-1153-558c-557a-5ee0afbcdf24&t=241b1e5e-1a8e-5e6a-469a-a9b8cad87065&l=13506

{code}
[WARNING] 
Dependency convergence error for io.netty:netty-handler:4.1.63.Final paths to 
dependency are:
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
  +-software.amazon.awssdk:netty-nio-client:2.16.92
+-io.netty:netty-codec-http:4.1.63.Final
  +-io.netty:netty-handler:4.1.63.Final
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
  +-software.amazon.awssdk:netty-nio-client:2.16.92
+-io.netty:netty-codec-http2:4.1.63.Final
  +-io.netty:netty-handler:4.1.63.Final
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
  +-software.amazon.awssdk:netty-nio-client:2.16.92
+-io.netty:netty-handler:4.1.63.Final
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-common:1.1.2
+-software.amazon.awssdk:glue:2.16.92
  +-software.amazon.awssdk:netty-nio-client:2.16.92
+-com.typesafe.netty:netty-reactive-streams-http:2.0.5
  +-com.typesafe.netty:netty-reactive-streams:2.0.5
+-io.netty:netty-handler:4.1.52.Final

[WARNING] 
Dependency convergence error for org.jetbrains.kotlin:kotlin-stdlib:1.3.50 
paths to dependency are:
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
  +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
  +-org.jetbrains.kotlin:kotlin-scripting-common:1.3.50
+-org.jetbrains.kotlin:kotlin-reflect:1.3.50
  +-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
  +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
  +-org.jetbrains.kotlin:kotlin-scripting-common:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
  +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
  +-org.jetbrains.kotlin:kotlin-scripting-jvm:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
  +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
  +-org.jetbrains.kotlin:kotlin-stdlib:1.3.50
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
  +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-scripting-compiler-impl-embeddable:1.3.50
  +-org.jetbrains.kotlinx:kotlinx-coroutines-core:1.1.1
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.20
and
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-serde:1.1.2
+-com.kjetland:mbknor-jackson-jsonschema_2.12:1.0.39
  +-org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable:1.3.50
+-org.jetbrains.kotlin:kotlin-stdlib:1.3.50

[WARNING] 
Dependency convergence error for io.netty:netty-codec-http:4.1.63.Final paths 
to dependency are:
+-org.apache.flink:flink-avro-glue-schema-registry_2.12:1.15-SNAPSHOT
  +-software.amazon.glue:schema-registry-common:1.1.2
+-soft

[jira] [Created] (FLINK-24353) Bash scripts do not respect dynamic configurations when calculating memory sizes

2021-09-22 Thread Xintong Song (Jira)
Xintong Song created FLINK-24353:


 Summary: Bash scripts do not respect dynamic configurations when 
calculating memory sizes
 Key: FLINK-24353
 URL: https://issues.apache.org/jira/browse/FLINK-24353
 Project: Flink
  Issue Type: Bug
  Components: Deployment / Scripts
Affects Versions: 1.13.2, 1.14.0, 1.15.0
Reporter: Xintong Song
Assignee: Xintong Song


Dynamic configurations (the '-D' arguments) are lost due to changes in 
FLINK-21128.

Consequently, dynamic configurations like the following commands will not take 
effect.
```
./bin/taskmanager.sh start -D taskmanager.memory.task.off-heap.size=128m
```



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24350) Resuming Savepoint (hashmap, sync, scale up) end-to-end test fails due to ask timeout

2021-09-21 Thread Xintong Song (Jira)
Xintong Song created FLINK-24350:


 Summary: Resuming Savepoint (hashmap, sync, scale up) end-to-end 
test fails due to ask timeout
 Key: FLINK-24350
 URL: https://issues.apache.org/jira/browse/FLINK-24350
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.15.0
Reporter: Xintong Song


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24361&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=142119

{code}
Sep 21 16:51:46 Caused by: org.apache.flink.util.SerializedThrowable: 
Invocation of [RemoteRpcInvocation(null.triggerCheckpoint(ExecutionAttemptID, 
long, long, CheckpointOptions))] at recipient 
[akka.tcp://flink@10.1.0.216:38779/user/rpc/taskmanager_0] timed out.
Sep 21 16:51:46 at 
org.apache.flink.runtime.jobmaster.RpcTaskManagerGateway.triggerCheckpoint(RpcTaskManagerGateway.java:106)
 ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
Sep 21 16:51:46 at 
org.apache.flink.runtime.executiongraph.Execution.triggerCheckpointHelper(Execution.java:868)
 ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
Sep 21 16:51:46 at 
org.apache.flink.runtime.executiongraph.Execution.triggerSynchronousSavepoint(Execution.java:850)
 ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
Sep 21 16:51:46 at 
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.triggerTasks(CheckpointCoordinator.java:710)
 ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
Sep 21 16:51:46 at 
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.triggerCheckpointRequest(CheckpointCoordinator.java:653)
 ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
Sep 21 16:51:46 at 
org.apache.flink.runtime.checkpoint.CheckpointCoordinator.lambda$startTriggeringCheckpoint$6(CheckpointCoordinator.java:620)
 ~[flink-dist_2.11-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
Sep 21 16:51:46 at 
java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) 
~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)
 ~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
 ~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
 ~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
 ~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
~[?:1.8.0_292]
Sep 21 16:51:46 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
~[?:1.8.0_292]
Sep 21 16:51:46 at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_292]
Sep 21 16:51:46 Caused by: org.apache.flink.util.SerializedThrowable: Ask timed 
out on 
[Actor[akka.tcp://flink@10.1.0.216:38779/user/rpc/taskmanager_0#-1544322105]] 
after [1 ms]. Message of type 
[org.apache.flink.runtime.rpc.messages.RemoteRpcInvocation]. A typical reason 
for `AskTimeoutException` is that the recipient actor didn't send a reply.
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24333) StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredOnCheckpoint fails on azure

2021-09-17 Thread Xintong Song (Jira)
Xintong Song created FLINK-24333:


 Summary: 
StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredOnCheckpoint
 fails on azure
 Key: FLINK-24333
 URL: https://issues.apache.org/jira/browse/FLINK-24333
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24290&view=logs&j=5cae8624-c7eb-5c51-92d3-4d2dacedd221&t=5acec1b4-945b-59ca-34f8-168928ce5199&l=29243

{code}
Sep 18 03:47:19 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 0.304 s <<< FAILURE! - in 
org.apache.flink.table.runtime.operators.python.aggregate.arrow.stream.StreamArrowPythonGroupWindowAggregateFunctionOperatorTest
Sep 18 03:47:19 [ERROR] testFinishBundleTriggeredOnCheckpoint  Time elapsed: 
0.059 s  <<< FAILURE!
Sep 18 03:47:19 java.lang.AssertionError: expected:<8> but was:<6>
Sep 18 03:47:19 at org.junit.Assert.fail(Assert.java:89)
Sep 18 03:47:19 at org.junit.Assert.failNotEquals(Assert.java:835)
Sep 18 03:47:19 at org.junit.Assert.assertEquals(Assert.java:647)
Sep 18 03:47:19 at org.junit.Assert.assertEquals(Assert.java:633)
Sep 18 03:47:19 at 
org.apache.flink.table.runtime.util.RowDataHarnessAssertor.assertOutputEquals(RowDataHarnessAssertor.java:80)
Sep 18 03:47:19 at 
org.apache.flink.table.runtime.util.RowDataHarnessAssertor.assertOutputEquals(RowDataHarnessAssertor.java:60)
Sep 18 03:47:19 at 
org.apache.flink.table.runtime.operators.python.aggregate.arrow.ArrowPythonAggregateFunctionOperatorTestBase.assertOutputEquals(ArrowPythonAggregateFunctionOperatorTestBase.java:62)
Sep 18 03:47:19 at 
org.apache.flink.table.runtime.operators.python.aggregate.arrow.stream.StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredOnCheckpoint(StreamArrowPythonGroupWindowAggregateFunctionOperatorTest.java:238)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24331) PartiallyFinishedSourcesITCase fails with "No downstream received 0 from xxx;"

2021-09-17 Thread Xintong Song (Jira)
Xintong Song created FLINK-24331:


 Summary: PartiallyFinishedSourcesITCase fails with "No downstream 
received 0 from xxx;"
 Key: FLINK-24331
 URL: https://issues.apache.org/jira/browse/FLINK-24331
 Project: Flink
  Issue Type: Bug
  Components: API / DataStream
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24287&view=logs&j=4d4a0d10-fca2-5507-8eed-c07f0bdf4887&t=7b25afdf-cc6c-566f-5459-359dc2585798&l=10945

{code}
Sep 18 02:21:08 [ERROR] Tests run: 12, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 224.44 s <<< FAILURE! - in 
org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase
Sep 18 02:21:08 [ERROR] test[complex graph SINGLE_SUBTASK, failover: true, 
strategy: region]  Time elapsed: 28.807 s  <<< FAILURE!
Sep 18 02:21:08 java.lang.AssertionError: No downstream received 0 from 
0003[0]; received: {0=OperatorFinished 
0007/0, 1=OperatorFinished 
0007/1, 2=OperatorFinished 
0007/2, 3=OperatorFinished 
0007/3}
Sep 18 02:21:08 at org.junit.Assert.fail(Assert.java:89)
Sep 18 02:21:08 at org.junit.Assert.assertTrue(Assert.java:42)
Sep 18 02:21:08 at 
org.apache.flink.runtime.operators.lifecycle.validation.TestJobDataFlowValidator.lambda$checkDataFlow$1(TestJobDataFlowValidator.java:96)
Sep 18 02:21:08 at java.util.HashMap.forEach(HashMap.java:1289)
Sep 18 02:21:08 at 
org.apache.flink.runtime.operators.lifecycle.validation.TestJobDataFlowValidator.checkDataFlow(TestJobDataFlowValidator.java:94)
Sep 18 02:21:08 at 
org.apache.flink.runtime.operators.lifecycle.validation.TestJobDataFlowValidator.checkDataFlow(TestJobDataFlowValidator.java:62)
Sep 18 02:21:08 at 
org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase.test(PartiallyFinishedSourcesITCase.java:139)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24330) HiveRunnerITCase JVM crash

2021-09-17 Thread Xintong Song (Jira)
Xintong Song created FLINK-24330:


 Summary: HiveRunnerITCase JVM crash
 Key: FLINK-24330
 URL: https://issues.apache.org/jira/browse/FLINK-24330
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Hive
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24282&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=24092



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24329) PulsarSourceITCase fails due to port conflict

2021-09-17 Thread Xintong Song (Jira)
Xintong Song created FLINK-24329:


 Summary: PulsarSourceITCase fails due to port conflict 
 Key: FLINK-24329
 URL: https://issues.apache.org/jira/browse/FLINK-24329
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Pulsar
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24255&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=24666

{code}
Sep 17 12:47:02 Caused by: org.apache.pulsar.broker.PulsarServerException: 
org.apache.pulsar.broker.PulsarServerException: java.io.IOException: Failed to 
bind to /0.0.0.0:6972
Sep 17 12:47:02 at 
org.apache.pulsar.broker.PulsarService.start(PulsarService.java:821)
Sep 17 12:47:02 at 
org.apache.flink.connector.pulsar.testutils.runtime.mock.PulsarMockRuntime.startUp(PulsarMockRuntime.java:59)
Sep 17 12:47:02 ... 39 more
Sep 17 12:47:02 Caused by: org.apache.pulsar.broker.PulsarServerException: 
java.io.IOException: Failed to bind to /0.0.0.0:6972
Sep 17 12:47:02 at 
org.apache.pulsar.broker.web.WebService.start(WebService.java:258)
Sep 17 12:47:02 at 
org.apache.pulsar.broker.PulsarService.start(PulsarService.java:723)
Sep 17 12:47:02 ... 40 more
Sep 17 12:47:02 Caused by: java.io.IOException: Failed to bind to /0.0.0.0:6972
Sep 17 12:47:02 at 
org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:349)
Sep 17 12:47:02 at 
org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:310)
Sep 17 12:47:02 at 
org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
Sep 17 12:47:02 at 
org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:234)
Sep 17 12:47:02 at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
Sep 17 12:47:02 at 
org.eclipse.jetty.server.Server.doStart(Server.java:401)
Sep 17 12:47:02 at 
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
Sep 17 12:47:02 at 
org.apache.pulsar.broker.web.WebService.start(WebService.java:241)
Sep 17 12:47:02 ... 41 more
Sep 17 12:47:02 Caused by: java.net.BindException: Address already in use
Sep 17 12:47:02 at sun.nio.ch.Net.bind0(Native Method)
Sep 17 12:47:02 at sun.nio.ch.Net.bind(Net.java:461)
Sep 17 12:47:02 at sun.nio.ch.Net.bind(Net.java:453)
Sep 17 12:47:02 at 
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:222)
Sep 17 12:47:02 at 
sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
Sep 17 12:47:02 at 
org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:344)
Sep 17 12:47:02 ... 48 more
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24313) JdbcCatalogFactoryTest fails due to "Gave up waiting for server to start after 10000ms"

2021-09-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-24313:


 Summary: JdbcCatalogFactoryTest fails due to "Gave up waiting for 
server to start after 1ms"
 Key: FLINK-24313
 URL: https://issues.apache.org/jira/browse/FLINK-24313
 Project: Flink
  Issue Type: Bug
  Components: Connectors / JDBC
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24212&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=14018

{code}
Sep 16 14:07:22 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 14.065 s <<< FAILURE! - in 
org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactoryTest
Sep 16 14:07:22 [ERROR] 
org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactoryTest  Time 
elapsed: 14.065 s  <<< ERROR!
Sep 16 14:07:22 java.io.IOException: Gave up waiting for server to start after 
1ms
Sep 16 14:07:22 at 
com.opentable.db.postgres.embedded.EmbeddedPostgres.waitForServerStartup(EmbeddedPostgres.java:308)
Sep 16 14:07:22 at 
com.opentable.db.postgres.embedded.EmbeddedPostgres.startPostmaster(EmbeddedPostgres.java:257)
Sep 16 14:07:22 at 
com.opentable.db.postgres.embedded.EmbeddedPostgres.(EmbeddedPostgres.java:146)
Sep 16 14:07:22 at 
com.opentable.db.postgres.embedded.EmbeddedPostgres$Builder.start(EmbeddedPostgres.java:554)
Sep 16 14:07:22 at 
com.opentable.db.postgres.junit.SingleInstancePostgresRule.pg(SingleInstancePostgresRule.java:46)
Sep 16 14:07:22 at 
com.opentable.db.postgres.junit.SingleInstancePostgresRule.before(SingleInstancePostgresRule.java:39)
Sep 16 14:07:22 at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
Sep 16 14:07:22 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
Sep 16 14:07:22 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Sep 16 14:07:22 at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Sep 16 14:07:22 at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
Sep 16 14:07:22 at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
Sep 16 14:07:22 at 
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
Sep 16 14:07:22 at 
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
Sep 16 14:07:22 at 
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
Sep 16 14:07:22 at 
java.util.Iterator.forEachRemaining(Iterator.java:116)
Sep 16 14:07:22 at 
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
Sep 16 14:07:22 at 
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
Sep 16 14:07:22 at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
Sep 16 14:07:22 at 
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
Sep 16 14:07:22 at 
java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
Sep 16 14:07:22 at 
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
Sep 16 14:07:22 at 
java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
Sep 16 14:07:22 at 
org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82)
Sep 16 14:07:22 at 
org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73)
Sep 16 14:07:22 at 
org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
Sep 16 14:07:22 at 
org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
Sep 16 14:07:22 at 
org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
Sep 16 14:07:22 at 
org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
Sep 16 14:07:22 at 
org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
Sep 16 14:07:22 at 
org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
Sep 16 14:07:22 at 
org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
Sep 16 14:07:22 at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
Sep 16 14:07:22 at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
Sep 16 14:07:22 at 
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
Sep 16 14:07:22 at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
Sep 16 14:07:22 Caused by: java.sql.SQ

[jira] [Created] (FLINK-24312) 'New File Sink s3 end-to-end test' fails due to timeout

2021-09-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-24312:


 Summary: 'New File Sink s3 end-to-end test' fails due to timeout
 Key: FLINK-24312
 URL: https://issues.apache.org/jira/browse/FLINK-24312
 Project: Flink
  Issue Type: Bug
  Components: API / DataStream, Connectors / FileSystem
Affects Versions: 1.12.5
Reporter: Xintong Song
 Fix For: 1.12.6


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24194&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=ff888d9b-cd34-53cc-d90f-3e446d355529&l=12970



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24305) BatchPandasUDAFITTests.test_over_window_aggregate_function fails on azure

2021-09-15 Thread Xintong Song (Jira)
Xintong Song created FLINK-24305:


 Summary: 
BatchPandasUDAFITTests.test_over_window_aggregate_function fails on azure
 Key: FLINK-24305
 URL: https://issues.apache.org/jira/browse/FLINK-24305
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24170&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=c67e71ed-6451-5d26-8920-5a8cf9651901&l=23011

{code}
Sep 15 20:40:43 cls = 
Sep 15 20:40:43 actual = JavaObject id=o8666
Sep 15 20:40:43 expected = ['+I[1, 4.335, 13, 5.5, 3.0, 3.0, 4.335, 
8.0, 5.0, 5.0]', '+I[1, 4.335, 5, 4.335, 3.0, 3.0, 2.5, 4.3330, 
4.0, 2.0]', '+I[2, 2.0, 9, 2.0, 4.0, 4.0, 2.0, 2.0, 4.0, 4.0]', '+I[3, 2.0, 3, 
2.0, 1.0, 1.0, 2.0, 2.0, 1.0, 1.0]']
Sep 15 20:40:43 
Sep 15 20:40:43 @classmethod
Sep 15 20:40:43 def assert_equals(cls, actual, expected):
Sep 15 20:40:43 if isinstance(actual, JavaObject):
Sep 15 20:40:43 actual_py_list = cls.to_py_list(actual)
Sep 15 20:40:43 else:
Sep 15 20:40:43 actual_py_list = actual
Sep 15 20:40:43 actual_py_list.sort()
Sep 15 20:40:43 expected.sort()
Sep 15 20:40:43 assert len(actual_py_list) == len(expected)
Sep 15 20:40:43 >   assert all(x == y for x, y in zip(actual_py_list, 
expected))
Sep 15 20:40:43 E   AssertionError: assert False
Sep 15 20:40:43 E+  where False = all(. at 0x7f792d98b900>)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24304) ProcessFailureCancelingITCase.testCancelingOnProcessFailure fails due to leader retrieval timeout

2021-09-15 Thread Xintong Song (Jira)
Xintong Song created FLINK-24304:


 Summary: 
ProcessFailureCancelingITCase.testCancelingOnProcessFailure fails due to leader 
retrieval timeout
 Key: FLINK-24304
 URL: https://issues.apache.org/jira/browse/FLINK-24304
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.12.5
Reporter: Xintong Song
 Fix For: 1.12.6


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24145&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=f508e270-48d6-5f1e-3138-42a17e0714f0&l=4153

{code}
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 26.597 
s <<< FAILURE! - in org.apache.flink.test.recovery.ProcessFailureCancelingITCase
[ERROR] 
testCancelingOnProcessFailure(org.apache.flink.test.recovery.ProcessFailureCancelingITCase)
  Time elapsed: 25.988 s  <<< ERROR!
org.apache.flink.runtime.leaderretrieval.LeaderRetrievalException: Could not 
retrieve the leader address and leader session ID.
at 
org.apache.flink.runtime.util.LeaderRetrievalUtils.retrieveLeaderConnectionInfo(LeaderRetrievalUtils.java:63)
at 
org.apache.flink.test.recovery.ProcessFailureCancelingITCase.retrieveDispatcherGateway(ProcessFailureCancelingITCase.java:283)
at 
org.apache.flink.test.recovery.ProcessFailureCancelingITCase.testCancelingOnProcessFailure(ProcessFailureCancelingITCase.java:216)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at 
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
Caused by: java.util.concurrent.TimeoutException
at 
java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1784)
at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928)
at 
org.apache.flink.runtime.util.LeaderRetrievalUtils.retrieveLeaderConnectionInfo(LeaderRetrievalUtils.java:61)
... 32 more
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24288) YARNITCase.testPerJobWithArchive fails on azure

2021-09-14 Thread Xintong Song (Jira)
Xintong Song created FLINK-24288:


 Summary: YARNITCase.testPerJobWithArchive fails on azure
 Key: FLINK-24288
 URL: https://issues.apache.org/jira/browse/FLINK-24288
 Project: Flink
  Issue Type: Bug
  Components: Deployment / YARN
Affects Versions: 1.13.2
Reporter: Xintong Song
 Fix For: 1.13.3


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24110&view=logs&j=5cae8624-c7eb-5c51-92d3-4d2dacedd221&t=420bd9ec-164e-562e-8947-0dacde3cec91&l=28978

{code}
Sep 15 03:56:13 [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 152.597 s <<< FAILURE! - in org.apache.flink.yarn.YARNITCase
Sep 15 03:56:13 [ERROR] testPerJobWithArchive(org.apache.flink.yarn.YARNITCase) 
 Time elapsed: 25.161 s  <<< FAILURE!
Sep 15 03:56:13 java.lang.AssertionError: The lib directory should be uploaded 
to staging directory.
Sep 15 03:56:13 at org.junit.Assert.fail(Assert.java:88)
Sep 15 03:56:13 at org.junit.Assert.assertTrue(Assert.java:41)
Sep 15 03:56:13 at 
org.apache.flink.yarn.YARNITCase.checkStagingDirectory(YARNITCase.java:209)
Sep 15 03:56:13 at 
org.apache.flink.yarn.YARNITCase.deployPerJob(YARNITCase.java:184)
Sep 15 03:56:13 at 
org.apache.flink.yarn.YARNITCase.lambda$testPerJobWithArchive$4(YARNITCase.java:133)
Sep 15 03:56:13 at 
org.apache.flink.yarn.YarnTestBase.runTest(YarnTestBase.java:288)
Sep 15 03:56:13 at 
org.apache.flink.yarn.YARNITCase.testPerJobWithArchive(YARNITCase.java:133)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24268) Documentation for building PyFlink does not show correctly.

2021-09-12 Thread Xintong Song (Jira)
Xintong Song created FLINK-24268:


 Summary: Documentation for building PyFlink does not show 
correctly.
 Key: FLINK-24268
 URL: https://issues.apache.org/jira/browse/FLINK-24268
 Project: Flink
  Issue Type: Bug
  Components: API / Python, Documentation
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0
 Attachments: 截屏2021-09-13 下午2.53.41.png

https://ci.apache.org/projects/flink/flink-docs-master/docs/flinkdev/building/#build-pyflink

"The sdist package of xxx will be found under..." where xxx is not showing.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24267) PyFlink Table API example from docs does not work.

2021-09-12 Thread Xintong Song (Jira)
Xintong Song created FLINK-24267:


 Summary: PyFlink Table API example from docs does not work.
 Key: FLINK-24267
 URL: https://issues.apache.org/jira/browse/FLINK-24267
 Project: Flink
  Issue Type: Bug
  Components: API / Python, Documentation
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


I followed the following documentation to build and install pyflink from 
sources.
https://ci.apache.org/projects/flink/flink-docs-master/docs/flinkdev/building/#build-pyflink

Then I tried the WordCount.py example from the following documentation.
https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/python/table_api_tutorial/

This results in the following error.
{code}
$ python WordCount.py
Traceback (most recent call last):
  File "WordCount.py", line 2, in 
from pyflink.table.descriptors import Schema, FileSystem
ImportError: cannot import name 'FileSystem' from 'pyflink.table.descriptors' 
(/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pyflink/table/descriptors.py)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24265) Streaming File Sink s3 end-to-end test fails due to Output hash mismatch

2021-09-12 Thread Xintong Song (Jira)
Xintong Song created FLINK-24265:


 Summary: Streaming File Sink s3 end-to-end test fails due to 
Output hash mismatch 
 Key: FLINK-24265
 URL: https://issues.apache.org/jira/browse/FLINK-24265
 Project: Flink
  Issue Type: Bug
  Components: API / DataStream
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23962&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=11428

{code}
Sep 13 04:56:56 FAIL File Streaming Sink: Output hash mismatch.  Got 
e700d1164e7deb36fbbd95c38ff62897, expected 6727342fdd3aae2129e61fc8f433fb6f.
Sep 13 04:56:56 head hexdump of actual:
Sep 13 04:56:56 000   E   r   r   o   r   e   x   e   c   u   t   i   n 
  g
Sep 13 04:56:56 010   a   w   s   c   o   m   m   a   n   d   :   s 
  3
Sep 13 04:56:56 020   c   p   -   -   q   u   i   e   t   s   3   : 
  /   /
Sep 13 04:56:56 030   f   l   i   n   k   -   i   n   t   e   g   r   a   t 
  i   o
Sep 13 04:56:56 040   n   -   t   e   s   t   s   /   t   e   m   p   /   t 
  e   s
Sep 13 04:56:56 050   t   _   f   i   l   e   _   s   i   n   k   -   6   8 
  4   6
Sep 13 04:56:56 060   c   8   2   1   -   3   b   5   8   -   4   c   6   6 
  -   b
Sep 13 04:56:56 070   0   e   f   -   3   2   0   3   2   a   7   3   4   4 
  1   3
Sep 13 04:56:56 080   /   h   o   s   t   d   i   r   /   /   t   e   m 
  p   -
Sep 13 04:56:56 090   t   e   s   t   -   d   i   r   e   c   t   o   r   y 
  -   4
Sep 13 04:56:56 0a0   1   9   6   9   4   8   8   4   2   0   /   t   e   m 
  p   /
Sep 13 04:56:56 0b0   t   e   s   t   _   f   i   l   e   _   s   i   n   k 
  -   6
Sep 13 04:56:56 0c0   8   4   6   c   8   2   1   -   3   b   5   8   -   4 
  c   6
Sep 13 04:56:56 0d0   6   -   b   0   e   f   -   3   2   0   3   2   a   7 
  3   4
Sep 13 04:56:56 0e0   4   1   3   -   -   e   x   c   l   u   d   e 
  '   *
Sep 13 04:56:56 0f0   '   -   -   i   n   c   l   u   d   e   '   * 
  /   p
Sep 13 04:56:56 100   a   r   t   -   [   !   /   ]   *   '   -   -   r 
  e   c
Sep 13 04:56:56 110   u   r   s   i   v   e  \n   
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24263) PulsarSourceITCase.testMultipleSplits fails due to "Consumer not found"

2021-09-12 Thread Xintong Song (Jira)
Xintong Song created FLINK-24263:


 Summary: PulsarSourceITCase.testMultipleSplits fails due to 
"Consumer not found"
 Key: FLINK-24263
 URL: https://issues.apache.org/jira/browse/FLINK-24263
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Pulsar
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23958&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=24936

{code}
Sep 13 00:00:49 Caused by: 
org.apache.pulsar.client.api.PulsarClientException$BrokerMetadataException: 
Consumer not found
Sep 13 00:00:49 at 
org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:987)
Sep 13 00:00:49 at 
org.apache.pulsar.client.impl.PulsarClientImpl.close(PulsarClientImpl.java:658)
Sep 13 00:00:49 at 
org.apache.flink.connector.pulsar.source.reader.source.PulsarSourceReaderBase.close(PulsarSourceReaderBase.java:83)
Sep 13 00:00:49 at 
org.apache.flink.connector.pulsar.source.reader.source.PulsarOrderedSourceReader.close(PulsarOrderedSourceReader.java:170)
Sep 13 00:00:49 at 
org.apache.flink.streaming.api.operators.SourceOperator.close(SourceOperator.java:324)
Sep 13 00:00:49 at 
org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:141)
Sep 13 00:00:49 at 
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:127)
Sep 13 00:00:49 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1030)
Sep 13 00:00:49 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:874)
Sep 13 00:00:49 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:762)
Sep 13 00:00:49 at 
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
Sep 13 00:00:49 at 
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
Sep 13 00:00:49 at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766)
Sep 13 00:00:49 at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:575)
Sep 13 00:00:49 at java.lang.Thread.run(Thread.java:748){code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24261) KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"

2021-09-12 Thread Xintong Song (Jira)
Xintong Song created FLINK-24261:


 Summary: KafkaSourceITCase.testMultipleSplits fails due to "Cannot 
create topic"
 Key: FLINK-24261
 URL: https://issues.apache.org/jira/browse/FLINK-24261
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23955&view=logs&j=b0097207-033c-5d9a-b48c-6d4796fbe60d&t=8338a7d2-16f7-52e5-f576-4b7b3071eb3d&l=7119

{code}
Sep 13 01:14:27 [ERROR] Tests run: 12, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 180.412 s <<< FAILURE! - in 
org.apache.flink.connector.kafka.source.KafkaSourceITCase
Sep 13 01:14:27 [ERROR] testMultipleSplits{TestEnvironment, ExternalContext}[1] 
 Time elapsed: 120.244 s  <<< ERROR!
Sep 13 01:14:27 java.lang.RuntimeException: Cannot create topic 
'kafka-single-topic-7245292146378659602'
Sep 13 01:14:27 at 
org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createTopic(KafkaSingleTopicExternalContext.java:100)
Sep 13 01:14:27 at 
org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createSourceSplitDataWriter(KafkaSingleTopicExternalContext.java:142)
Sep 13 01:14:27 at 
org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.generateAndWriteTestData(SourceTestSuiteBase.java:301)
Sep 13 01:14:27 at 
org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testMultipleSplits(SourceTestSuiteBase.java:142)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24260) py35-cython fails due to could not find requests>=2.26.0

2021-09-12 Thread Xintong Song (Jira)
Xintong Song created FLINK-24260:


 Summary: py35-cython fails due to could not find requests>=2.26.0
 Key: FLINK-24260
 URL: https://issues.apache.org/jira/browse/FLINK-24260
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.12.5
Reporter: Xintong Song
 Fix For: 1.12.6


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23942&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=8d78fe4f-d658-5c70-12f8-4921589024c3&l=21015

{code}
Collecting requests>=2.26.0 (from apache-flink==1.12.dev0)
  Could not find a version that satisfies the requirement requests>=2.26.0 
(from apache-flink==1.12.dev0) (from versions: 0.2.0, 0.2.1, 0.2.2, 0.2.3, 
0.2.4, 0.3.0, 0.3.1, 0.3.2, 0.3.3, 0.3.4, 0.4.0, 0.4.1, 0.5.0, 0.5.1, 0.6.0, 
0.6.1, 0.6.2, 0.6.3, 0.6.4, 0.6.5, 0.6.6, 0.7.0, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 
0.7.5, 0.7.6, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.5, 0.8.6, 0.8.7, 0.8.8, 
0.8.9, 0.9.0, 0.9.1, 0.9.2, 0.9.3, 0.10.0, 0.10.1, 0.10.2, 0.10.3, 0.10.4, 
0.10.6, 0.10.7, 0.10.8, 0.11.1, 0.11.2, 0.12.0, 0.12.1, 0.13.0, 0.13.1, 0.13.2, 
0.13.3, 0.13.4, 0.13.5, 0.13.6, 0.13.7, 0.13.8, 0.13.9, 0.14.0, 0.14.1, 0.14.2, 
1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.1.0, 1.2.0, 1.2.1, 1.2.2, 1.2.3, 2.0.0, 
2.0.1, 2.1.0, 2.2.0, 2.2.1, 2.3.0, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.5.0, 2.5.1, 
2.5.2, 2.5.3, 2.6.0, 2.6.1, 2.6.2, 2.7.0, 2.8.0, 2.8.1, 2.9.0, 2.9.1, 2.9.2, 
2.10.0, 2.11.0, 2.11.1, 2.12.0, 2.12.1, 2.12.2, 2.12.3, 2.12.4, 2.12.5, 2.13.0, 
2.14.0, 2.14.1, 2.14.2, 2.15.1, 2.16.0, 2.16.1, 2.16.2, 2.16.3, 2.16.4, 2.16.5, 
2.17.0, 2.17.1, 2.17.2, 2.17.3, 2.18.0, 2.18.1, 2.18.2, 2.18.3, 2.18.4, 2.19.0, 
2.19.1, 2.20.0, 2.20.1, 2.21.0, 2.22.0, 2.23.0, 2.24.0, 2.25.0, 2.25.1)
No matching distribution found for requests>=2.26.0 (from 
apache-flink==1.12.dev0)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24242) KafkaSinkITCase.testAbortTransactionsOfPendingCheckpointsAfterFailure fails due to NoSuchFileException

2021-09-09 Thread Xintong Song (Jira)
Xintong Song created FLINK-24242:


 Summary: 
KafkaSinkITCase.testAbortTransactionsOfPendingCheckpointsAfterFailure fails due 
to NoSuchFileException
 Key: FLINK-24242
 URL: https://issues.apache.org/jira/browse/FLINK-24242
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23876&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=e424005a-b16e-540f-196d-da062cc19bdf&l=7335

{code}
Sep 10 00:06:17 [ERROR] Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 79.401 s <<< FAILURE! - in 
org.apache.flink.connector.kafka.sink.KafkaSinkITCase
Sep 10 00:06:17 [ERROR] testAbortTransactionsOfPendingCheckpointsAfterFailure  
Time elapsed: 2.358 s  <<< ERROR!
Sep 10 00:06:17 java.io.UncheckedIOException: 
java.nio.file.NoSuchFileException: 
/tmp/junit7927515964136749979/junit1325061264264479088/9554f057606834081bc37f12e8f298f5/chk-2
Sep 10 00:06:17 at 
java.nio.file.FileTreeIterator.fetchNextIfNeeded(FileTreeIterator.java:88)
Sep 10 00:06:17 at 
java.nio.file.FileTreeIterator.hasNext(FileTreeIterator.java:104)
Sep 10 00:06:17 at 
java.util.Iterator.forEachRemaining(Iterator.java:115)
Sep 10 00:06:17 at 
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
Sep 10 00:06:17 at 
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
Sep 10 00:06:17 at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
Sep 10 00:06:17 at 
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
Sep 10 00:06:17 at 
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
Sep 10 00:06:17 at 
java.util.stream.ReferencePipeline.reduce(ReferencePipeline.java:546)
Sep 10 00:06:17 at 
java.util.stream.ReferencePipeline.max(ReferencePipeline.java:582)
Sep 10 00:06:17 at 
org.apache.flink.test.util.TestUtils.getMostRecentCompletedCheckpoint(TestUtils.java:99)
Sep 10 00:06:17 at 
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testAbortTransactionsOfPendingCheckpointsAfterFailure(KafkaSinkITCase.java:247)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24241) test_table_environment_api.py fail with NPE

2021-09-09 Thread Xintong Song (Jira)
Xintong Song created FLINK-24241:


 Summary: test_table_environment_api.py fail with NPE
 Key: FLINK-24241
 URL: https://issues.apache.org/jira/browse/FLINK-24241
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23876&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=6bb545dd-772d-5d8c-f258-f5085fba3295&l=23263

{code}
Sep 10 03:03:39 E   py4j.protocol.Py4JJavaError: An error 
occurred while calling o16211.execute.
Sep 10 03:03:39 E   : java.lang.NullPointerException
Sep 10 03:03:39 E   at 
java.util.Objects.requireNonNull(Objects.java:203)
Sep 10 03:03:39 E   at 
org.apache.calcite.rel.metadata.RelMetadataQuery.(RelMetadataQuery.java:144)
Sep 10 03:03:39 E   at 
org.apache.calcite.rel.metadata.RelMetadataQuery.(RelMetadataQuery.java:108)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.metadata.FlinkRelMetadataQuery.(FlinkRelMetadataQuery.java:78)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.metadata.FlinkRelMetadataQuery.instance(FlinkRelMetadataQuery.java:59)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.calcite.FlinkRelOptClusterFactory$$anon$1.get(FlinkRelOptClusterFactory.scala:39)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.calcite.FlinkRelOptClusterFactory$$anon$1.get(FlinkRelOptClusterFactory.scala:38)
Sep 10 03:03:39 E   at 
org.apache.calcite.plan.RelOptCluster.getMetadataQuery(RelOptCluster.java:178)
Sep 10 03:03:39 E   at 
org.apache.calcite.rel.metadata.RelMdUtil.clearCache(RelMdUtil.java:965)
Sep 10 03:03:39 E   at 
org.apache.calcite.plan.hep.HepPlanner.buildFinalPlan(HepPlanner.java:942)
Sep 10 03:03:39 E   at 
org.apache.calcite.plan.hep.HepPlanner.buildFinalPlan(HepPlanner.java:939)
Sep 10 03:03:39 E   at 
org.apache.calcite.plan.hep.HepPlanner.findBestExp(HepPlanner.java:194)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.optimize.program.FlinkHepProgram.optimize(FlinkHepProgram.scala:69)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.optimize.program.FlinkHepRuleSetProgram.optimize(FlinkHepRuleSetProgram.scala:87)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1$$anonfun$apply$1.apply(FlinkGroupProgram.scala:63)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1$$anonfun$apply$1.apply(FlinkGroupProgram.scala:60)
Sep 10 03:03:39 E   at 
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
Sep 10 03:03:39 E   at 
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
Sep 10 03:03:39 E   at 
scala.collection.Iterator$class.foreach(Iterator.scala:891)
Sep 10 03:03:39 E   at 
scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
Sep 10 03:03:39 E   at 
scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
Sep 10 03:03:39 E   at 
scala.collection.AbstractIterable.foreach(Iterable.scala:54)
Sep 10 03:03:39 E   at 
scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
Sep 10 03:03:39 E   at 
scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1.apply(FlinkGroupProgram.scala:60)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram$$anonfun$optimize$1.apply(FlinkGroupProgram.scala:55)
Sep 10 03:03:39 E   at 
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
Sep 10 03:03:39 E   at 
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
Sep 10 03:03:39 E   at 
scala.collection.immutable.Range.foreach(Range.scala:160)
Sep 10 03:03:39 E   at 
scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
Sep 10 03:03:39 E   at 
scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
Sep 10 03:03:39 E   at 
org.apache.flink.table.planner.plan.optimize.program.FlinkGroupProgram.optimize(FlinkGroupP

[jira] [Created] (FLINK-24205) AggregateReduceGroupingITCase hangs on azure

2021-09-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-24205:


 Summary: AggregateReduceGroupingITCase hangs on azure
 Key: FLINK-24205
 URL: https://issues.apache.org/jira/browse/FLINK-24205
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.13.2
Reporter: Xintong Song
 Fix For: 1.13.3


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23720&view=logs&j=955770d3-1fed-5a0a-3db6-0c7554c910cb&t=14447d61-56b4-5000-80c1-daa459247f6a&l=7574

{code}
Sep 08 02:08:51 "main" #1 prio=5 os_prio=0 tid=0x7f02d400b800 nid=0x1471 
waiting on condition [0x7f02dc62a000]
Sep 08 02:08:51java.lang.Thread.State: WAITING (parking)
Sep 08 02:08:51 at sun.misc.Unsafe.park(Native Method)
Sep 08 02:08:51 - parking to wait for  <0xd465c060> (a 
java.util.concurrent.CompletableFuture$Signaller)
Sep 08 02:08:51 at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
Sep 08 02:08:51 at 
java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
Sep 08 02:08:51 at 
java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
Sep 08 02:08:51 at 
java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
Sep 08 02:08:51 at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
Sep 08 02:08:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sendRequest(CollectResultFetcher.java:163)
Sep 08 02:08:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:128)
Sep 08 02:08:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
Sep 08 02:08:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
Sep 08 02:08:51 at 
org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370)
Sep 08 02:08:51 at 
java.util.Iterator.forEachRemaining(Iterator.java:115)
Sep 08 02:08:51 at 
org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109)
Sep 08 02:08:51 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.executeQuery(BatchTestBase.scala:300)
Sep 08 02:08:51 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.check(BatchTestBase.scala:140)
Sep 08 02:08:51 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.checkResult(BatchTestBase.scala:106)
Sep 08 02:08:51 at 
org.apache.flink.table.planner.runtime.batch.sql.agg.AggregateReduceGroupingITCase.testAggOnWindow(AggregateReduceGroupingITCase.scala:282)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24203) AbstractServerTest fails due to port conflict

2021-09-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-24203:


 Summary: AbstractServerTest fails due to port conflict
 Key: FLINK-24203
 URL: https://issues.apache.org/jira/browse/FLINK-24203
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Queryable State
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23718&view=logs&j=c91190b6-40ae-57b2-5999-31b869b0a7c1&t=41463ccd-0694-5d4d-220d-8f771e7d098b&l=15081

{code}
Sep 08 00:18:11 [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 0.19 s <<< FAILURE! - in 
org.apache.flink.queryablestate.network.AbstractServerTest
Sep 08 00:18:11 [ERROR] testServerInitializationFailure  Time elapsed: 0.026 s  
<<< FAILURE!
Sep 08 00:18:11 java.lang.AssertionError: 
Sep 08 00:18:11 
Sep 08 00:18:11 Expected: (an instance of 
org.apache.flink.util.FlinkRuntimeException and exception with message a string 
containing "Unable to start Test Server 2. All ports in provided range are 
occupied.")
Sep 08 00:18:11  but: exception with message a string containing "Unable to 
start Test Server 2. All ports in provided range are occupied." message was 
"Unable to start Test Server 1. All ports in provided range are occupied."
Sep 08 00:18:11 Stacktrace was: org.apache.flink.util.FlinkRuntimeException: 
Unable to start Test Server 1. All ports in provided range are occupied.
Sep 08 00:18:11 at 
org.apache.flink.queryablestate.network.AbstractServerBase.start(AbstractServerBase.java:209)
Sep 08 00:18:11 at 
org.apache.flink.queryablestate.network.AbstractServerTest.testServerInitializationFailure(AbstractServerTest.java:73)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24202) BoundedSourceITCase hangs on azure

2021-09-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-24202:


 Summary: BoundedSourceITCase hangs on azure
 Key: FLINK-24202
 URL: https://issues.apache.org/jira/browse/FLINK-24202
 Project: Flink
  Issue Type: Bug
  Components: API / DataStream
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23718&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=5389



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24200) CheckpointBarrierTrackerTest.testTwoLastBarriersOneByOne fails on azure

2021-09-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-24200:


 Summary: CheckpointBarrierTrackerTest.testTwoLastBarriersOneByOne 
fails on azure
 Key: FLINK-24200
 URL: https://issues.apache.org/jira/browse/FLINK-24200
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Checkpointing
Affects Versions: 1.12.5
Reporter: Xintong Song
 Fix For: 1.12.6


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23719&view=logs&j=f0ac5c25-1168-55a5-07ff-0e88223afed9&t=0dbaca5d-7c38-52e6-f4fe-2fb69ccb3ada&l=8983

{code}
[ERROR] Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.893 
s <<< FAILURE! - in 
org.apache.flink.streaming.runtime.io.CheckpointBarrierTrackerTest
[ERROR] 
testTwoLastBarriersOneByOne(org.apache.flink.streaming.runtime.io.CheckpointBarrierTrackerTest)
  Time elapsed: 0.093 s  <<< FAILURE!
java.lang.AssertionError: 

Expected: a value less than or equal to <30L>
 but: <33L> was greater than <30L>
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.junit.Assert.assertThat(Assert.java:956)
at org.junit.Assert.assertThat(Assert.java:923)
at 
org.apache.flink.streaming.runtime.io.CheckpointBarrierTrackerTest.testTwoLastBarriersOneByOne(CheckpointBarrierTrackerTest.java:616)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24188) flink-python NOTICE file contains unnecessary dependencies

2021-09-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-24188:


 Summary: flink-python NOTICE file contains unnecessary dependencies
 Key: FLINK-24188
 URL: https://issues.apache.org/jira/browse/FLINK-24188
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


The following items in the NOTICE file should not be needed.
* com.github.jponge:lzma-java:1.3
* com.google.api.grpc:proto-google-common-protos:1.12.0
* com.google.auth:google-auth-library-credentials:0.18.0
* com.google.code.gson:gson:2.8.6
* com.google.guava:guava:26.0-jre
* com.google.protobuf.nano:protobuf-javanano:3.0.0-alpha-5
* com.google.protobuf:protobuf-java-util:3.11.0
* com.google.protobuf:protobuf-java:3.11.0
* com.jcraft:jzlib:1.1.3
* com.ning:compress-lzf:1.0.3
* io.grpc:grpc-auth:1.26.0
* io.grpc:grpc-context:1.26.0
* io.grpc:grpc-core:1.26.0
* io.grpc:grpc-netty:1.26.0
* io.grpc:grpc-protobuf:1.26.0
* io.grpc:grpc-stub:1.26.0
* io.grpc:grpc-testing:1.26.0
* io.netty:netty-buffer:4.1.51.Final
* io.netty:netty-codec-http2:4.1.51.Final
* io.netty:netty-codec-http:4.1.51.Final
* io.netty:netty-codec-socks:4.1.51.Final
* io.netty:netty-codec:4.1.51.Final
* io.netty:netty-common:4.1.51.Final
* io.netty:netty-handler-proxy:4.1.51.Final
* io.netty:netty-handler:4.1.51.Final
* io.netty:netty-resolver:4.1.51.Final
* io.netty:netty-tcnative-boringssl-static:2.0.33.Final
* io.netty:netty-transport-native-epoll:4.1.51.Final
* io.netty:netty-transport-native-unix-common:4.1.51.Final
* io.netty:netty-transport:4.1.51.Final
* io.opencensus:opencensus-api:0.24.0
* io.opencensus:opencensus-contrib-grpc-metrics:0.24.0
* io.perfmark:perfmark-api:0.19.0
* net.jpountz.lz4:lz4:1.3.0
* org.bouncycastle:bcpkix-jdk15on:1.54
* org.bouncycastle:bcprov-jdk15on:1.54



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24185) flink-s3-fs-presto bundled dependencies not listed in NOTICE file

2021-09-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-24185:


 Summary: flink-s3-fs-presto bundled dependencies not listed in 
NOTICE file
 Key: FLINK-24185
 URL: https://issues.apache.org/jira/browse/FLINK-24185
 Project: Flink
  Issue Type: Bug
  Components: FileSystems
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


The following bundled dependencies missing in NOTICE file.
* aopalliance:aopalliance:1.0
* com.facebook.airlift:configuration:0.201
* com.facebook.airlift:log:0.201
* com.facebook.airlift:stats:0.201
* com.facebook.presto.hadoop:hadoop-apache2:2.7.3-1
* com.facebook.presto:presto-common:0.257
* com.facebook.presto:presto-hive-common:0.257
* com.facebook.presto:presto-hive-metastore:0.257
* com.facebook.presto:presto-hive:0.257
* com.google.inject:guice:4.2.2
* dnsjava:dnsjava:2.1.7
* io.airlift:slice:0.38
* io.airlift:units:1.3
* org.alluxio:alluxio-shaded-client:2.5.0-3
* org.hdrhistogram:HdrHistogram:2.1.9
* org.weakref:jmxutils:1.19

The following bundled dependencies listed with incorrect version in NOTICE file.
* com.google.guava:guava:26.0-jre

The following should not be listed in NOTICE file
* com.google.errorprone:error_prone_annotations:2.2.0
* com.google.guava:failureaccess:1.0
* com.google.guava:listenablefuture:.0-empty-to-avoid-conflict-with-guava
* com.google.j2objc:j2objc-annotations:1.1
* commons-lang:commons-lang:2.6
* org.apache.hadoop.thirdparty:hadoop-shaded-guava:1.1.1
* org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:1.1.1
* org.wildfly.openssl:wildfly-openssl:1.0.7.Final



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24180) UnalignedCheckpointRescaleITCase fails due to direct OOM

2021-09-06 Thread Xintong Song (Jira)
Xintong Song created FLINK-24180:


 Summary: UnalignedCheckpointRescaleITCase fails due to direct OOM
 Key: FLINK-24180
 URL: https://issues.apache.org/jira/browse/FLINK-24180
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Checkpointing
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23626&view=logs&j=b0a398c0-685b-599c-eb57-c8c2a771138e&t=747432ad-a576-5911-1e2a-68c6bedc248a&l=10707

{code}
Sep 07 00:42:31 Caused by: java.lang.OutOfMemoryError: Direct buffer memory. 
The direct out-of-memory error has occurred. This can mean two things: either 
job(s) require(s) a larger size of JVM direct memory or there is a direct 
memory leak. The direct memory can be allocated by user code or some of its 
dependencies. In this case 'taskmanager.memory.task.off-heap.size' 
configuration option should be increased. Flink framework and its dependencies 
also consume the direct memory, mostly for network communication. The most of 
network memory is managed by Flink and should not result in out-of-memory 
error. In certain special cases, in particular for jobs with high parallelism, 
the framework may require more direct memory which is not managed by Flink. In 
this case 'taskmanager.memory.framework.off-heap.size' configuration option 
should be increased. If the error persists then there is probably a direct 
memory leak in user code or some of its dependencies which has to be 
investigated and fixed. The task executor has to be shutdown...
Sep 07 00:42:31 at java.base/java.nio.Bits.reserveMemory(Bits.java:175)
Sep 07 00:42:31 at 
java.base/java.nio.DirectByteBuffer.(DirectByteBuffer.java:118)
Sep 07 00:42:31 at 
java.base/java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:317)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:632)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:607)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:202)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.tcacheAllocateSmall(PoolArena.java:172)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.allocate(PoolArena.java:134)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.PoolArena.allocate(PoolArena.java:126)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:395)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.channel.unix.PreferredDirectByteBufAllocator.ioBuffer(PreferredDirectByteBufAllocator.java:53)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollRecvByteAllocatorHandle.allocate(EpollRecvByteAllocatorHandle.java:75)
Sep 07 00:42:31 at 
org.apache.flink.shaded.netty4.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:780)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24179) KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee fails on azure

2021-09-06 Thread Xintong Song (Jira)
Xintong Song created FLINK-24179:


 Summary: KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee 
fails on azure
 Key: FLINK-24179
 URL: https://issues.apache.org/jira/browse/FLINK-24179
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23626&view=logs&j=ce8f3cc3-c1ea-5281-f5eb-df9ebd24947f&t=918e890f-5ed9-5212-a25e-962628fb4bc5&l=7339

{code}
Sep 06 23:42:30 [ERROR] Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 59.927 s <<< FAILURE! - in 
org.apache.flink.connector.kafka.sink.KafkaSinkITCase
Sep 06 23:42:30 [ERROR] testRecoveryWithExactlyOnceGuarantee  Time elapsed: 
10.505 s  <<< FAILURE!
Sep 06 23:42:30 java.lang.AssertionError: expected:<[1, 2, 3, 4, 5, 6]> but 
was:<[1, 2, 3, 4]>
Sep 06 23:42:30 at org.junit.Assert.fail(Assert.java:89)
Sep 06 23:42:30 at org.junit.Assert.failNotEquals(Assert.java:835)
Sep 06 23:42:30 at org.junit.Assert.assertEquals(Assert.java:120)
Sep 06 23:42:30 at org.junit.Assert.assertEquals(Assert.java:146)
Sep 06 23:42:30 at 
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.lambda$testRecoveryWithExactlyOnceGuarantee$1(KafkaSinkITCase.java:201)
Sep 06 23:42:30 at 
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testRecoveryWithAssertion(KafkaSinkITCase.java:320)
Sep 06 23:42:30 at 
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee(KafkaSinkITCase.java:198)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24175) KafkaITCase.testConcurrentProducerConsumerTopology times out

2021-09-06 Thread Xintong Song (Jira)
Xintong Song created FLINK-24175:


 Summary: KafkaITCase.testConcurrentProducerConsumerTopology times 
out
 Key: FLINK-24175
 URL: https://issues.apache.org/jira/browse/FLINK-24175
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.12.5
Reporter: Xintong Song
 Fix For: 1.12.6


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23627&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=c1d93a6a-ba91-515d-3196-2ee8019fbda7&l=6191

{code}
[ERROR] Tests run: 23, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 214.45 
s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaITCase
[ERROR] 
testConcurrentProducerConsumerTopology(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
  Time elapsed: 60.013 s  <<< ERROR!
org.junit.runners.model.TestTimedOutException: test timed out after 6 
milliseconds
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at 
java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
at 
java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
at 
java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
at 
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1802)
at 
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1782)
at 
org.apache.flink.streaming.connectors.kafka.KafkaTestBase.tryExecutePropagateExceptions(KafkaTestBase.java:194)
at 
org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runSimpleConcurrentProducerConsumerTopology(KafkaConsumerTestBase.java:923)
at 
org.apache.flink.streaming.connectors.kafka.KafkaITCase.testConcurrentProducerConsumerTopology(KafkaITCase.java:71)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24173) BatchFileSystemITCaseBase.testProjectPushDown hangs on azure

2021-09-06 Thread Xintong Song (Jira)
Xintong Song created FLINK-24173:


 Summary: BatchFileSystemITCaseBase.testProjectPushDown hangs on 
azure
 Key: FLINK-24173
 URL: https://issues.apache.org/jira/browse/FLINK-24173
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23579&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=14779

{code}
Sep 06 09:32:51 "main" #1 prio=5 os_prio=0 tid=0x7f4ae400b800 nid=0x75e9 
waiting on condition [0x7f4aee144000]
Sep 06 09:32:51java.lang.Thread.State: WAITING (parking)
Sep 06 09:32:51 at sun.misc.Unsafe.park(Native Method)
Sep 06 09:32:51 - parking to wait for  <0x8ef18ae8> (a 
java.util.concurrent.CompletableFuture$Signaller)
Sep 06 09:32:51 at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
Sep 06 09:32:51 at 
java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
Sep 06 09:32:51 at 
java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
Sep 06 09:32:51 at 
java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
Sep 06 09:32:51 at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
Sep 06 09:32:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sendRequest(CollectResultFetcher.java:163)
Sep 06 09:32:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:128)
Sep 06 09:32:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
Sep 06 09:32:51 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
Sep 06 09:32:51 at 
org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370)
Sep 06 09:32:51 at 
java.util.Iterator.forEachRemaining(Iterator.java:115)
Sep 06 09:32:51 at 
org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109)
Sep 06 09:32:51 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.executeQuery(BatchTestBase.scala:300)
Sep 06 09:32:51 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.check(BatchTestBase.scala:140)
Sep 06 09:32:51 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.checkResult(BatchTestBase.scala:106)
Sep 06 09:32:51 at 
org.apache.flink.table.planner.runtime.batch.sql.BatchFileSystemITCaseBase.check(BatchFileSystemITCaseBase.scala:46)
Sep 06 09:32:51 at 
org.apache.flink.table.planner.runtime.FileSystemITCaseBase$class.testProjectPushDown(FileSystemITCaseBase.scala:251)
Sep 06 09:32:51 at 
org.apache.flink.table.planner.runtime.batch.sql.BatchFileSystemITCaseBase.testProjectPushDown(BatchFileSystemITCaseBase.scala:33)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24163) PartiallyFinishedSourcesITCase fails due to timeout

2021-09-05 Thread Xintong Song (Jira)
Xintong Song created FLINK-24163:


 Summary: PartiallyFinishedSourcesITCase fails due to timeout
 Key: FLINK-24163
 URL: https://issues.apache.org/jira/browse/FLINK-24163
 Project: Flink
  Issue Type: Bug
Reporter: Xintong Song


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23529&view=logs&j=4d4a0d10-fca2-5507-8eed-c07f0bdf4887&t=7b25afdf-cc6c-566f-5459-359dc2585798&l=10996

{code}
Sep 04 04:35:28 [ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 155.236 s <<< FAILURE! - in 
org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase
Sep 04 04:35:28 [ERROR] test[complex graph ALL_SUBTASKS, failover: false]  Time 
elapsed: 65.999 s  <<< ERROR!
Sep 04 04:35:28 java.util.concurrent.TimeoutException: Condition was not met in 
given timeout.
Sep 04 04:35:28 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:164)
Sep 04 04:35:28 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:142)
Sep 04 04:35:28 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:134)
Sep 04 04:35:28 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitForSubtasksToFinish(CommonTestUtils.java:297)
Sep 04 04:35:28 at 
org.apache.flink.runtime.operators.lifecycle.TestJobExecutor.waitForSubtasksToFinish(TestJobExecutor.java:219)
Sep 04 04:35:28 at 
org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase.test(PartiallyFinishedSourcesITCase.java:82)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24162) PartiallyFinishedSourcesITCase fails due to assertion error in DrainingValidator.validateOperatorLifecycle

2021-09-05 Thread Xintong Song (Jira)
Xintong Song created FLINK-24162:


 Summary: PartiallyFinishedSourcesITCase fails due to assertion 
error in DrainingValidator.validateOperatorLifecycle
 Key: FLINK-24162
 URL: https://issues.apache.org/jira/browse/FLINK-24162
 Project: Flink
  Issue Type: Bug
  Components: API / DataStream
Affects Versions: 1.14.0, 1.15.0
Reporter: Xintong Song
 Fix For: 1.14.0, 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23526&view=logs&j=8fd9202e-fd17-5b26-353c-ac1ff76c8f28&t=ea7cf968-e585-52cb-e0fc-f48de023a7ca&l=4639

{code}
Sep 03 23:17:11 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 19.233 s <<< FAILURE! - in 
org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase
Sep 03 23:17:11 [ERROR] test[simple graph SINGLE_SUBTASK, failover: true]  Time 
elapsed: 2.27 s  <<< FAILURE!
Sep 03 23:17:11 java.lang.AssertionError
Sep 03 23:17:11 at org.junit.Assert.fail(Assert.java:87)
Sep 03 23:17:11 at org.junit.Assert.assertTrue(Assert.java:42)
Sep 03 23:17:11 at org.junit.Assert.assertFalse(Assert.java:65)
Sep 03 23:17:11 at org.junit.Assert.assertFalse(Assert.java:75)
Sep 03 23:17:11 at 
org.apache.flink.runtime.operators.lifecycle.validation.DrainingValidator.validateOperatorLifecycle(DrainingValidator.java:56)
Sep 03 23:17:11 at 
org.apache.flink.runtime.operators.lifecycle.validation.TestOperatorLifecycleValidator.lambda$checkOperatorsLifecycle$1(TestOperatorLifecycleValidator.java:52)
Sep 03 23:17:11 at java.util.HashMap.forEach(HashMap.java:1289)
Sep 03 23:17:11 at 
org.apache.flink.runtime.operators.lifecycle.validation.TestOperatorLifecycleValidator.checkOperatorsLifecycle(TestOperatorLifecycleValidator.java:47)
Sep 03 23:17:11 at 
org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase.test(PartiallyFinishedSourcesITCase.java:94)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24160) PartiallyFinishedSourcesITCase fails due to 'Size of the state is larger than the maximum permitted memory-backed state.'

2021-09-05 Thread Xintong Song (Jira)
Xintong Song created FLINK-24160:


 Summary: PartiallyFinishedSourcesITCase fails due to 'Size of the 
state is larger than the maximum permitted memory-backed state.'
 Key: FLINK-24160
 URL: https://issues.apache.org/jira/browse/FLINK-24160
 Project: Flink
  Issue Type: Bug
Reporter: Xintong Song


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23526&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=5526

{code}
Sep 04 02:31:13 Caused by: java.io.IOException: Size of the state is larger 
than the maximum permitted memory-backed state. Size=6281708, maxSize=5242880. 
Consider using a different checkpoint storage, like the 
FileSystemCheckpointStorage.
Sep 04 02:31:13 at 
org.apache.flink.runtime.state.memory.MemCheckpointStreamFactory.checkSize(MemCheckpointStreamFactory.java:63)
Sep 04 02:31:13 at 
org.apache.flink.runtime.state.memory.MemCheckpointStreamFactory$MemoryCheckpointOutputStream.closeAndGetBytes(MemCheckpointStreamFactory.java:140)
Sep 04 02:31:13 at 
org.apache.flink.runtime.state.memory.MemCheckpointStreamFactory$MemoryCheckpointOutputStream.closeAndGetHandle(MemCheckpointStreamFactory.java:120)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.finishWriteAndResult(ChannelStateCheckpointWriter.java:218)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.doComplete(ChannelStateCheckpointWriter.java:240)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.lambda$complete$5(ChannelStateCheckpointWriter.java:202)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.runWithChecks(ChannelStateCheckpointWriter.java:296)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.complete(ChannelStateCheckpointWriter.java:200)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateCheckpointWriter.completeInput(ChannelStateCheckpointWriter.java:187)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.CheckpointInProgressRequest.execute(ChannelStateWriteRequest.java:212)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestDispatcherImpl.dispatchInternal(ChannelStateWriteRequestDispatcherImpl.java:85)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestDispatcherImpl.dispatch(ChannelStateWriteRequestDispatcherImpl.java:62)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestExecutorImpl.loop(ChannelStateWriteRequestExecutorImpl.java:96)
Sep 04 02:31:13 at 
org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestExecutorImpl.run(ChannelStateWriteRequestExecutorImpl.java:75)
Sep 04 02:31:13 ... 1 more
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24123) test_dependency.py fails due to 'Failed to close remote bundle'

2021-09-01 Thread Xintong Song (Jira)
Xintong Song created FLINK-24123:


 Summary: test_dependency.py fails due to 'Failed to close remote 
bundle'
 Key: FLINK-24123
 URL: https://issues.apache.org/jira/browse/FLINK-24123
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.14.0, 1.15.0
 Environment: test_dependency
Reporter: Xintong Song
 Fix For: 1.14.0, 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23343&view=logs&j=bdd9ea51-4de2-506a-d4d9-f3930e4d2355&t=dd50312f-73b5-56b5-c172-4d81d03e2ef1&l=23922

{code}
Caused by: java.lang.RuntimeException: Error while waiting for 
BeamPythonFunctionRunner flush
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.invokeFinishBundle(AbstractPythonFunctionOperator.java:361)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.checkInvokeFinishBundleByCount(AbstractPythonFunctionOperator.java:321)
Sep 02 01:34:47 E   at 
org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator.processElement(AbstractStatelessFunctionOperator.java:119)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:82)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29)
Sep 02 01:34:47 E   at 
SourceConversion$38.processElement(Unknown Source)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:82)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.StreamSourceContexts$ManualWatermarkContext.processAndCollect(StreamSourceContexts.java:418)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.StreamSourceContexts$WatermarkContext.collect(StreamSourceContexts.java:513)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.StreamSourceContexts$SwitchingOnClose.collect(StreamSourceContexts.java:103)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:92)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:116)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:73)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:323)
Sep 02 01:34:47 E   Caused by: java.lang.RuntimeException: 
Failed to close remote bundle
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.finishBundle(BeamPythonFunctionRunner.java:377)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.flush(BeamPythonFunctionRunner.java:361)
Sep 02 01:34:47 E   at 
org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.lambda$invokeFinishBundle$2(AbstractPythonFunctionOperator.java:340)
Sep 02 01:34:47 E   at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
Sep 02 01:34:47 E   at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
Sep 02 01:34:47 E   at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
Sep 02 01:34:47 E   at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe

[jira] [Created] (FLINK-24119) KafkaITCase.testTimestamps fails due to "Topic xxx already exist"

2021-09-01 Thread Xintong Song (Jira)
Xintong Song created FLINK-24119:


 Summary: KafkaITCase.testTimestamps fails due to "Topic xxx 
already exist"
 Key: FLINK-24119
 URL: https://issues.apache.org/jira/browse/FLINK-24119
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23328&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7419

{code}
Sep 01 15:53:20 [ERROR] Tests run: 23, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 162.65 s <<< FAILURE! - in 
org.apache.flink.streaming.connectors.kafka.KafkaITCase
Sep 01 15:53:20 [ERROR] testTimestamps  Time elapsed: 23.237 s  <<< FAILURE!
Sep 01 15:53:20 java.lang.AssertionError: Create test topic : tstopic failed, 
org.apache.kafka.common.errors.TopicExistsException: Topic 'tstopic' already 
exists.
Sep 01 15:53:20 at org.junit.Assert.fail(Assert.java:89)
Sep 01 15:53:20 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:226)
Sep 01 15:53:20 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:112)
Sep 01 15:53:20 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:212)
Sep 01 15:53:20 at 
org.apache.flink.streaming.connectors.kafka.KafkaITCase.testTimestamps(KafkaITCase.java:191)
Sep 01 15:53:20 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Sep 01 15:53:20 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Sep 01 15:53:20 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Sep 01 15:53:20 at java.lang.reflect.Method.invoke(Method.java:498)
Sep 01 15:53:20 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Sep 01 15:53:20 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Sep 01 15:53:20 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Sep 01 15:53:20 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Sep 01 15:53:20 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
Sep 01 15:53:20 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
Sep 01 15:53:20 at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
Sep 01 15:53:20 at java.lang.Thread.run(Thread.java:748)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24100) test_connectors.py fails on azure

2021-09-01 Thread Xintong Song (Jira)
Xintong Song created FLINK-24100:


 Summary: test_connectors.py fails on azure
 Key: FLINK-24100
 URL: https://issues.apache.org/jira/browse/FLINK-24100
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23253&view=logs&j=bdd9ea51-4de2-506a-d4d9-f3930e4d2355&t=dd50312f-73b5-56b5-c172-4d81d03e2ef1&l=22622

{code}
Sep 01 02:26:21 E   Caused by: java.lang.RuntimeException: 
Failed to create stage bundle factory! INFO:root:Initializing python harness: 
/__w/1/s/flink-python/pyflink/fn_execution/beam/beam_boot.py --id=1-1 
--provision_endpoint=localhost:44544
Sep 01 02:26:21 E   
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:566)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.open(BeamPythonFunctionRunner.java:255)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator.open(AbstractPythonFunctionOperator.java:131)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.api.operators.python.AbstractOneInputPythonFunctionOperator.open(AbstractOneInputPythonFunctionOperator.java:116)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.api.operators.python.PythonProcessOperator.open(PythonProcessOperator.java:59)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:110)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:691)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:667)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:639)
Sep 01 02:26:21 E   at 
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
Sep 01 02:26:21 E   at 
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
Sep 01 02:26:21 E   at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766)
Sep 01 02:26:21 E   at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:575)
Sep 01 02:26:21 E   at java.lang.Thread.run(Thread.java:748)
Sep 01 02:26:21 E   Caused by: 
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
 java.lang.IllegalStateException: Process died with exit code 0
Sep 01 02:26:21 E   at 
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2050)
Sep 01 02:26:21 E   at 
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
Sep 01 02:26:21 E   at 
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
Sep 01 02:26:21 E   at 
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
Sep 01 02:26:21 E   at 
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
Sep 01 02:26:21 E   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.(DefaultJobBundleFactory.java:451)
Sep 01 02:26:21 E   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.(DefaultJobBundleFactory.java:436)
Sep 01 02:26:21 E   at 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:303)
Sep 01 02:26:21 E   at 
org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.createStageBundleFactory(BeamPythonFunctionRunner.java:564)
Sep 01 02:26:21 E   ... 14 more
Sep 01 02:26:21 E   Caused by: java.lang.IllegalStateException: 
Process died with exit code 0
Sep 01 02:26:21 E   at 
org.apache.beam.runners.fnexecution.environment.ProcessManager$RunningProcess.isAliveOrThrow(ProcessManager.java:75)
Sep 01 02:26

[jira] [Created] (FLINK-24096) JoinITCase.testNullFullOuterJoin fails due to NPE

2021-08-31 Thread Xintong Song (Jira)
Xintong Song created FLINK-24096:


 Summary: JoinITCase.testNullFullOuterJoin fails due to NPE
 Key: FLINK-24096
 URL: https://issues.apache.org/jira/browse/FLINK-24096
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23250&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=9417

{code}
Sep 01 01:57:41 Caused by: java.lang.NullPointerException
Sep 01 01:57:41 at 
org.apache.flink.table.planner.runtime.utils.FailingCollectionSource.notifyCheckpointComplete(FailingCollectionSource.java:242)
Sep 01 01:57:41 at 
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.notifyCheckpointComplete(AbstractUdfStreamOperator.java:126)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.notifyCheckpointComplete(StreamOperatorWrapper.java:99)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.notifyCheckpointComplete(RegularOperatorChain.java:152)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.notifyCheckpointComplete(SubtaskCheckpointCoordinatorImpl.java:348)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.notifyCheckpointComplete(StreamTask.java:1397)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$notifyCheckpointAbortAsync$16(StreamTask.java:1355)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$notifyCheckpointOperation$17(StreamTask.java:1377)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$SynchronizedStreamTaskActionExecutor.runThrowing(StreamTaskActionExecutor.java:93)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.drain(MailboxProcessor.java:177)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:834)
Sep 01 01:57:41 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:747)
Sep 01 01:57:41 at 
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
Sep 01 01:57:41 at 
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
Sep 01 01:57:41 at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766)
Sep 01 01:57:41 at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:575)
Sep 01 01:57:41 at java.lang.Thread.run(Thread.java:748)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24095) Elasticsearch7DynamicSinkITCase.testWritingDocuments fails due to socket timeout

2021-08-31 Thread Xintong Song (Jira)
Xintong Song created FLINK-24095:


 Summary: Elasticsearch7DynamicSinkITCase.testWritingDocuments 
fails due to socket timeout
 Key: FLINK-24095
 URL: https://issues.apache.org/jira/browse/FLINK-24095
 Project: Flink
  Issue Type: Bug
  Components: Connectors / ElasticSearch
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23250&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=12781

{code}
Aug 31 23:06:22 Caused by: java.net.SocketTimeoutException: 30,000 milliseconds 
timeout on connection http-outgoing-3 [ACTIVE]
Aug 31 23:06:22 at 
org.elasticsearch.client.RestClient.extractAndWrapCause(RestClient.java:808)
Aug 31 23:06:22 at 
org.elasticsearch.client.RestClient.performRequest(RestClient.java:248)
Aug 31 23:06:22 at 
org.elasticsearch.client.RestClient.performRequest(RestClient.java:235)
Aug 31 23:06:22 at 
org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1514)
Aug 31 23:06:22 at 
org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1499)
Aug 31 23:06:22 at 
org.elasticsearch.client.RestHighLevelClient.ping(RestHighLevelClient.java:720)
Aug 31 23:06:22 at 
org.apache.flink.streaming.connectors.elasticsearch7.Elasticsearch7ApiCallBridge.verifyClientConnection(Elasticsearch7ApiCallBridge.java:138)
Aug 31 23:06:22 at 
org.apache.flink.streaming.connectors.elasticsearch7.Elasticsearch7ApiCallBridge.verifyClientConnection(Elasticsearch7ApiCallBridge.java:46)
Aug 31 23:06:22 at 
org.apache.flink.streaming.connectors.elasticsearch.ElasticsearchSinkBase.open(ElasticsearchSinkBase.java:318)
Aug 31 23:06:22 at 
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:34)
Aug 31 23:06:22 at 
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:100)
Aug 31 23:06:22 at 
org.apache.flink.streaming.api.operators.StreamSink.open(StreamSink.java:46)
Aug 31 23:06:22 at 
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:110)
Aug 31 23:06:22 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:691)
Aug 31 23:06:22 at 
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
Aug 31 23:06:22 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:667)
Aug 31 23:06:22 at 
org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:639)
Aug 31 23:06:22 at 
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
Aug 31 23:06:22 at 
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
Aug 31 23:06:22 at 
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766)
Aug 31 23:06:22 at 
org.apache.flink.runtime.taskmanager.Task.run(Task.java:575)
Aug 31 23:06:22 at java.lang.Thread.run(Thread.java:748)
Aug 31 23:06:22 Caused by: java.net.SocketTimeoutException: 30,000 milliseconds 
timeout on connection http-outgoing-3 [ACTIVE]
Aug 31 23:06:22 at 
org.apache.http.nio.protocol.HttpAsyncRequestExecutor.timeout(HttpAsyncRequestExecutor.java:387)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:92)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.client.InternalIODispatch.onTimeout(InternalIODispatch.java:39)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.reactor.AbstractIODispatch.timeout(AbstractIODispatch.java:175)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.reactor.BaseIOReactor.sessionTimedOut(BaseIOReactor.java:261)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.reactor.AbstractIOReactor.timeoutCheck(AbstractIOReactor.java:502)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:211)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:280)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
Aug 31 23:06:22 at 
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:591)
Aug 31 23:06:22 ... 1 more
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24092) OrcFsStreamingSinkITCase.testPart times out on azure

2021-08-31 Thread Xintong Song (Jira)
Xintong Song created FLINK-24092:


 Summary: OrcFsStreamingSinkITCase.testPart times out on azure
 Key: FLINK-24092
 URL: https://issues.apache.org/jira/browse/FLINK-24092
 Project: Flink
  Issue Type: Bug
  Components: Connectors / ORC
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23245&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=13074

{code}
Aug 31 20:07:07 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 32.79 s <<< FAILURE! - in org.apache.flink.orc.OrcFsStreamingSinkITCase
Aug 31 20:07:07 [ERROR] testPart  Time elapsed: 20.322 s  <<< ERROR!
Aug 31 20:07:07 org.junit.runners.model.TestTimedOutException: test timed out 
after 20 seconds
Aug 31 20:07:07 at java.lang.Thread.sleep(Native Method)
Aug 31 20:07:07 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sleepBeforeRetry(CollectResultFetcher.java:237)
Aug 31 20:07:07 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:113)
Aug 31 20:07:07 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
Aug 31 20:07:07 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
Aug 31 20:07:07 at 
org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370)
Aug 31 20:07:07 at 
java.util.Iterator.forEachRemaining(Iterator.java:115)
Aug 31 20:07:07 at 
org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109)
Aug 31 20:07:07 at 
org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.check(FsStreamingSinkITCaseBase.scala:133)
Aug 31 20:07:07 at 
org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.test(FsStreamingSinkITCaseBase.scala:120)
Aug 31 20:07:07 at 
org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.testPart(FsStreamingSinkITCaseBase.scala:84)
Aug 31 20:07:07 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 31 20:07:07 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 31 20:07:07 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 31 20:07:07 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 31 20:07:07 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Aug 31 20:07:07 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 31 20:07:07 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Aug 31 20:07:07 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 31 20:07:07 at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Aug 31 20:07:07 at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Aug 31 20:07:07 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
Aug 31 20:07:07 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
Aug 31 20:07:07 at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
Aug 31 20:07:07 at java.lang.Thread.run(Thread.java:748)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24091) TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure fails on azure

2021-08-31 Thread Xintong Song (Jira)
Xintong Song created FLINK-24091:


 Summary: 
TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure 
fails on azure
 Key: FLINK-24091
 URL: https://issues.apache.org/jira/browse/FLINK-24091
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23187&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=6112

{code}
Aug 31 10:04:21 [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 28.263 s <<< FAILURE! - in 
org.apache.flink.test.recovery.TaskManagerProcessFailureBatchRecoveryITCase
Aug 31 10:04:21 [ERROR] testTaskManagerProcessFailure[0]  Time elapsed: 16.147 
s  <<< FAILURE!
Aug 31 10:04:21 java.lang.AssertionError: The program encountered a 
ProgramInvocationException : Job failed (JobID: 
c68654bb03c0ec88707ef7ada2239f62)
Aug 31 10:04:21 at org.junit.Assert.fail(Assert.java:89)
Aug 31 10:04:21 at 
org.apache.flink.test.recovery.AbstractTaskManagerProcessFailureRecoveryTest.testTaskManagerProcessFailure(AbstractTaskManagerProcessFailureRecoveryTest.java:204)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24077) HBaseConnectorITCase.testTableSink

2021-08-31 Thread Xintong Song (Jira)
Xintong Song created FLINK-24077:


 Summary: HBaseConnectorITCase.testTableSink
 Key: FLINK-24077
 URL: https://issues.apache.org/jira/browse/FLINK-24077
 Project: Flink
  Issue Type: Bug
  Components: Connectors / HBase
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23160&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=12962

{code}
Aug 31 05:10:58 Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 
73.758 sec <<< FAILURE! - in 
org.apache.flink.connector.hbase2.HBaseConnectorITCase
Aug 31 05:10:58 
testTableSink(org.apache.flink.connector.hbase2.HBaseConnectorITCase)  Time 
elapsed: 6.516 sec  <<< FAILURE!
Aug 31 05:10:58 java.lang.AssertionError: 
Aug 31 05:10:58 Different elements in arrays: expected 8 elements and received 3
Aug 31 05:10:58  expected: [+I[1, 10, Hello-1, 100, 1.01, false, Welt-1], +I[2, 
20, Hello-2, 200, 2.02, true, Welt-2], +I[3, 30, Hello-3, 300, 3.03, false, 
Welt-3], +I[4, 40, null, 400, 4.04, true, Welt-4], +I[5, 50, Hello-5, 500, 
5.05, false, Welt-5], +I[6, 60, Hello-6, 600, 6.06, true, Welt-6], +I[7, 70, 
Hello-7, 700, 7.07, false, Welt-7], +I[8, 80, null, 800, 8.08, true, Welt-8]]
Aug 31 05:10:58  received: [+I[1, 10, Hello-1, 100, 1.01, false, Welt-1], +I[2, 
20, Hello-2, 200, 2.02, true, Welt-2], +I[3, 30, Hello-3, 300, 3.03, false, 
Welt-3]] expected:<8> but was:<3>
Aug 31 05:10:58 at org.junit.Assert.fail(Assert.java:89)
Aug 31 05:10:58 at org.junit.Assert.failNotEquals(Assert.java:835)
Aug 31 05:10:58 at org.junit.Assert.assertEquals(Assert.java:647)
Aug 31 05:10:58 at 
org.apache.flink.test.util.TestBaseUtils.compareResult(TestBaseUtils.java:395)
Aug 31 05:10:58 at 
org.apache.flink.test.util.TestBaseUtils.compareResultAsText(TestBaseUtils.java:347)
Aug 31 05:10:58 at 
org.apache.flink.connector.hbase2.HBaseConnectorITCase.testTableSink(HBaseConnectorITCase.java:284)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24074) Check 1.14 licensing

2021-08-31 Thread Xintong Song (Jira)
Xintong Song created FLINK-24074:


 Summary: Check 1.14 licensing
 Key: FLINK-24074
 URL: https://issues.apache.org/jira/browse/FLINK-24074
 Project: Flink
  Issue Type: Technical Debt
Reporter: Xintong Song
Assignee: Xintong Song
 Fix For: 1.14.0


Check the licensing of the 1.14 release.
https://cwiki.apache.org/confluence/display/FLINK/Licensing



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24069) IgnoreInFlightDataITCase.testIgnoreInFlightDataDuringRecovery hangs on azure

2021-08-30 Thread Xintong Song (Jira)
Xintong Song created FLINK-24069:


 Summary: 
IgnoreInFlightDataITCase.testIgnoreInFlightDataDuringRecovery hangs on azure
 Key: FLINK-24069
 URL: https://issues.apache.org/jira/browse/FLINK-24069
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Checkpointing
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23144&view=logs&j=4d4a0d10-fca2-5507-8eed-c07f0bdf4887&t=7b25afdf-cc6c-566f-5459-359dc2585798&l=12083

{code}
"main" #1 prio=5 os_prio=0 tid=0x7f90bc00b800 nid=0x86d54 waiting on 
condition [0x7f90c4e53000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x80f25d48> (a 
java.util.concurrent.CompletableFuture$Signaller)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at 
java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
at 
java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
at 
java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
at 
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1937)
at 
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1917)
at 
org.apache.flink.test.checkpointing.IgnoreInFlightDataITCase.executeIgnoreInFlightDataDuringRecovery(IgnoreInFlightDataITCase.java:136)
at 
org.apache.flink.test.checkpointing.IgnoreInFlightDataITCase.testIgnoreInFlightDataDuringRecovery(IgnoreInFlightDataITCase.java:107)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24061) RMQSourceITCase.testAckFailure fails on azure

2021-08-30 Thread Xintong Song (Jira)
Xintong Song created FLINK-24061:


 Summary: RMQSourceITCase.testAckFailure fails on azure
 Key: FLINK-24061
 URL: https://issues.apache.org/jira/browse/FLINK-24061
 Project: Flink
  Issue Type: Bug
  Components: Connectors/ RabbitMQ
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23141&view=logs&j=ba53eb01-1462-56a3-8e98-0dd97fbcaab5&t=2e426bf0-b717-56bb-ab62-d63086457354&l=14514

{code}
Aug 30 22:30:34 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 93.936 s <<< FAILURE! - in 
org.apache.flink.streaming.connectors.rabbitmq.RMQSourceITCase
Aug 30 22:30:34 [ERROR] testAckFailure  Time elapsed: 61.713 s  <<< ERROR!
Aug 30 22:30:34 java.util.concurrent.TimeoutException: Condition was not met in 
given timeout.
Aug 30 22:30:34 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:158)
Aug 30 22:30:34 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:136)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24058) TaskSlotTableImplTest.testMarkSlotActiveDeactivatesSlotTimeout fails on azure

2021-08-30 Thread Xintong Song (Jira)
Xintong Song created FLINK-24058:


 Summary: 
TaskSlotTableImplTest.testMarkSlotActiveDeactivatesSlotTimeout fails on azure
 Key: FLINK-24058
 URL: https://issues.apache.org/jira/browse/FLINK-24058
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.15.0
Reporter: Xintong Song
 Fix For: 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23083&view=logs&j=0da23115-68bb-5dcd-192c-bd4c8adebde1&t=24c3384f-1bcb-57b3-224f-51bf973bbee8&l=8583

{code}
Aug 30 10:55:16 [ERROR] Tests run: 20, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 1.243 s <<< FAILURE! - in 
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImplTest
Aug 30 10:55:16 [ERROR] testMarkSlotActiveDeactivatesSlotTimeout  Time elapsed: 
0.334 s  <<< FAILURE!
Aug 30 10:55:16 java.lang.AssertionError: The slot timeout should have been 
deactivated.
Aug 30 10:55:16 at org.junit.Assert.fail(Assert.java:89)
Aug 30 10:55:16 at 
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImplTest.runDeactivateSlotTimeoutTest(TaskSlotTableImplTest.java:509)
Aug 30 10:55:16 at 
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImplTest.testMarkSlotActiveDeactivatesSlotTimeout(TaskSlotTableImplTest.java:472)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24047) SavepointITCase.testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState fails due to 'Service temporarily unavailable due to an ongoing leader election.'

2021-08-29 Thread Xintong Song (Jira)
Xintong Song created FLINK-24047:


 Summary: 
SavepointITCase.testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState 
fails due to 'Service temporarily unavailable due to an ongoing leader 
election.'
 Key: FLINK-24047
 URL: https://issues.apache.org/jira/browse/FLINK-24047
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.14.0, 1.15.0
Reporter: Xintong Song
 Fix For: 1.14.0, 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23043&view=logs&j=8fd9202e-fd17-5b26-353c-ac1ff76c8f28&t=ea7cf968-e585-52cb-e0fc-f48de023a7ca&l=4857

{code}
Aug 29 22:12:23 [ERROR] Tests run: 15, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 50.922 s <<< FAILURE! - in 
org.apache.flink.test.checkpointing.SavepointITCase
Aug 29 22:12:23 [ERROR] 
testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState  Time elapsed: 
1.854 s  <<< ERROR!
Aug 29 22:12:23 java.util.concurrent.ExecutionException: 
org.apache.flink.runtime.rest.util.RestClientException: [Service temporarily 
unavailable due to an ongoing leader election. Please refresh.]
Aug 29 22:12:23 at 
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
Aug 29 22:12:23 at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
Aug 29 22:12:23 at 
org.apache.flink.test.checkpointing.SavepointITCase.lambda$waitUntilAllTasksAreRunning$5(SavepointITCase.java:919)
Aug 29 22:12:23 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:152)
Aug 29 22:12:23 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:136)
Aug 29 22:12:23 at 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:128)
Aug 29 22:12:23 at 
org.apache.flink.test.checkpointing.SavepointITCase.waitUntilAllTasksAreRunning(SavepointITCase.java:909)
Aug 29 22:12:23 at 
org.apache.flink.test.checkpointing.SavepointITCase.testStopWithSavepointWithDrainCallsFinishBeforeSnapshotState(SavepointITCase.java:246)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24045) KafkaTableITCase.testPerPartitionWatermarkKafka fails on azure

2021-08-29 Thread Xintong Song (Jira)
Xintong Song created FLINK-24045:


 Summary: KafkaTableITCase.testPerPartitionWatermarkKafka fails on 
azure
 Key: FLINK-24045
 URL: https://issues.apache.org/jira/browse/FLINK-24045
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.14.0, 1.15.0
Reporter: Xintong Song
 Fix For: 1.14.0, 1.15.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23008&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7128

{code}
Aug 28 23:14:05 [ERROR] Tests run: 24, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 88.767 s <<< FAILURE! - in 
org.apache.flink.streaming.connectors.kafka.table.KafkaTableITCase
Aug 28 23:14:05 [ERROR] testPerPartitionWatermarkKafka[format = json]  Time 
elapsed: 6.571 s  <<< FAILURE!
Aug 28 23:14:05 java.lang.AssertionError: expected:<[+I[0, partition-0-name-0, 
2020-03-08T13:12:11.123], +I[0, partition-0-name-1, 2020-03-08T14:12:12.223], 
+I[0, partition-0-name-2, 2020-03-08T15:12:13.323], +I[1, partition-1-name-0, 
2020-03-09T13:13:11.123], +I[1, partition-1-name-1, 2020-03-09T15:13:11.133], 
+I[1, partition-1-name-2, 2020-03-09T16:13:11.143], +I[2, partition-2-name-0, 
2020-03-10T13:12:14.123], +I[2, partition-2-name-1, 2020-03-10T14:12:14.123], 
+I[2, partition-2-name-2, 2020-03-10T14:13:14.123], +I[2, partition-2-name-3, 
2020-03-10T14:14:14.123], +I[2, partition-2-name-4, 2020-03-10T14:15:14.123], 
+I[2, partition-2-name-5, 2020-03-10T14:16:14.123], +I[3, partition-3-name-0, 
2020-03-11T17:12:11.123], +I[3, partition-3-name-1, 2020-03-11T18:12:11.123]]> 
but was:<[+I[3, partition-3-name-0, 2020-03-11T17:12:11.123], +I[3, 
partition-3-name-1, 2020-03-11T18:12:11.123]]>
Aug 28 23:14:05 at org.junit.Assert.fail(Assert.java:89)
Aug 28 23:14:05 at org.junit.Assert.failNotEquals(Assert.java:835)
Aug 28 23:14:05 at org.junit.Assert.assertEquals(Assert.java:120)
Aug 28 23:14:05 at org.junit.Assert.assertEquals(Assert.java:146)
Aug 28 23:14:05 at 
org.apache.flink.streaming.connectors.kafka.table.KafkaTableTestUtils.waitingExpectedResults(KafkaTableTestUtils.java:93)
Aug 28 23:14:05 at 
org.apache.flink.streaming.connectors.kafka.table.KafkaTableITCase.testPerPartitionWatermarkKafka(KafkaTableITCase.java:739)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-24012) PulsarSourceITCase.testTaskManagerFailure fails due to NoResourceAvailableException

2021-08-26 Thread Xintong Song (Jira)
Xintong Song created FLINK-24012:


 Summary: PulsarSourceITCase.testTaskManagerFailure fails due to 
NoResourceAvailableException
 Key: FLINK-24012
 URL: https://issues.apache.org/jira/browse/FLINK-24012
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Pulsar
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22918&view=logs&j=a5ef94ef-68c2-57fd-3794-dc108ed1c495&t=2c68b137-b01d-55c9-e603-3ff3f320364b&l=24431




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23984) 'Run kubernetes pyflink application test' fail with "Package 'python3.7' has no installation candidate"

2021-08-25 Thread Xintong Song (Jira)
Xintong Song created FLINK-23984:


 Summary: 'Run kubernetes pyflink application test' fail with 
"Package 'python3.7' has no installation candidate" 
 Key: FLINK-23984
 URL: https://issues.apache.org/jira/browse/FLINK-23984
 Project: Flink
  Issue Type: Bug
  Components: API / Python
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22862&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=4201

{code}
Aug 26 03:34:14 Step 1/9 : FROM test_kubernetes_application-1
Aug 26 03:34:14  ---> 95da2424deaa
Aug 26 03:34:14 Step 2/9 : RUN apt-get update -y && apt-get install -y 
python3.7 python3-pip python3.7-dev && rm -rf /var/lib/apt/lists/*
Aug 26 03:34:17  ---> Running in 4751135e4612
Aug 26 03:34:17 Get:1 http://deb.debian.org/debian bullseye InRelease [113 kB]
Aug 26 03:34:17 Get:2 http://security.debian.org/debian-security 
bullseye-security InRelease [44.1 kB]
Aug 26 03:34:17 Get:3 http://deb.debian.org/debian bullseye-updates InRelease 
[36.8 kB]
Aug 26 03:34:17 Get:4 http://security.debian.org/debian-security 
bullseye-security/main amd64 Packages [27.5 kB]
Aug 26 03:34:17 Get:5 http://deb.debian.org/debian bullseye/main amd64 Packages 
[8178 kB]
Aug 26 03:34:19 Fetched 8399 kB in 2s (5266 kB/s)
Aug 26 03:34:19 Reading package lists...
Aug 26 03:34:20 Reading package lists...
Aug 26 03:34:20 Building dependency tree...
Aug 26 03:34:20 Reading state information...
Aug 26 03:34:20 Package python3.7 is not available, but is referred to by 
another package.
Aug 26 03:34:20 This may mean that the package is missing, has been obsoleted, 
or
Aug 26 03:34:20 is only available from another source
Aug 26 03:34:20 
Aug 26 03:34:20 E: Package 'python3.7' has no installation candidate
Aug 26 03:34:20 E: Unable to locate package python3.7-dev
Aug 26 03:34:20 E: Couldn't find any package by glob 'python3.7-dev'
Aug 26 03:34:20 E: Couldn't find any package by regex 'python3.7-dev'
The command '/bin/sh -c apt-get update -y && apt-get install -y python3.7 
python3-pip python3.7-dev && rm -rf /var/lib/apt/lists/*' returned a non-zero 
code: 100
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23983) JVM crash when running RocksDBStateBackendConfigTest

2021-08-25 Thread Xintong Song (Jira)
Xintong Song created FLINK-23983:


 Summary: JVM crash when running RocksDBStateBackendConfigTest
 Key: FLINK-23983
 URL: https://issues.apache.org/jira/browse/FLINK-23983
 Project: Flink
  Issue Type: Bug
  Components: Runtime / State Backends
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22855&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33&t=125e07e7-8de0-5c6c-a541-a567415af3ef&l=11131

You would need to compare the mvn logs "Running xxx" with "Test run xxx in xxx" 
to find out the unfinished test.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23982) Compiling error in WindowOperatorTest with JDK11

2021-08-25 Thread Xintong Song (Jira)
Xintong Song created FLINK-23982:


 Summary: Compiling error in WindowOperatorTest with JDK11
 Key: FLINK-23982
 URL: https://issues.apache.org/jira/browse/FLINK-23982
 Project: Flink
  Issue Type: Bug
  Components: Build System
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


What I don't understand is, while the error does not seem to be environment 
related, the other JDK11 compiling stages in the same build did not fail. 

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22855&view=logs&j=6caf31d6-847a-526e-9624-468e053467d6&t=0b23652f-b18b-5b6e-6eb6-a11070364610&l=3650

{code}
[INFO] -
[ERROR] COMPILATION ERROR : 
[INFO] -
[ERROR] 
/home/vsts/work/1/s/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperatorTest.java:[678,43]
 incompatible types: cannot infer type arguments for 
org.apache.flink.streaming.runtime.operators.windowing.WindowOperator<>
reason: inference variable KEY has incompatible equality constraints 
ACC,org.apache.flink.api.java.tuple.Tuple2,IN,K,java.lang.String
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23960) StreamTaskTimerTest.checkScheduledTimestamps fails on azure

2021-08-24 Thread Xintong Song (Jira)
Xintong Song created FLINK-23960:


 Summary: StreamTaskTimerTest.checkScheduledTimestamps fails on 
azure
 Key: FLINK-23960
 URL: https://issues.apache.org/jira/browse/FLINK-23960
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Task
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22770&view=logs&j=f0ac5c25-1168-55a5-07ff-0e88223afed9&t=50bf7a25-bdc4-5e56-5478-c7b4511dde53&l=10736

{code}
Aug 24 22:32:06 [ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 1.421 s <<< FAILURE! - in 
org.apache.flink.streaming.runtime.operators.StreamTaskTimerTest
Aug 24 22:32:06 [ERROR] checkScheduledTimestamps  Time elapsed: 1.372 s  <<< 
FAILURE!
Aug 24 22:32:06 java.lang.AssertionError: expected:<1> but was:<0>
Aug 24 22:32:06 at org.junit.Assert.fail(Assert.java:89)
Aug 24 22:32:06 at 
org.apache.flink.streaming.runtime.operators.StreamTaskTimerTest.verifyNoException(StreamTaskTimerTest.java:166)
Aug 24 22:32:06 at 
org.apache.flink.streaming.runtime.operators.StreamTaskTimerTest.checkScheduledTimestamps(StreamTaskTimerTest.java:129)
Aug 24 22:32:06 at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Aug 24 22:32:06 at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 24 22:32:06 at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 24 22:32:06 at 
java.base/java.lang.reflect.Method.invoke(Method.java:566)
Aug 24 22:32:06 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Aug 24 22:32:06 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 24 22:32:06 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Aug 24 22:32:06 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 24 22:32:06 at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Aug 24 22:32:06 at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Aug 24 22:32:06 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
Aug 24 22:32:06 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
Aug 24 22:32:06 at 
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Aug 24 22:32:06 at java.base/java.lang.Thread.run(Thread.java:829)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23957) KafkaProducerAtLeastOnceITCase.testOneToOneAtLeastOnceRegularSink fails on azure

2021-08-24 Thread Xintong Song (Jira)
Xintong Song created FLINK-23957:


 Summary: 
KafkaProducerAtLeastOnceITCase.testOneToOneAtLeastOnceRegularSink fails on azure
 Key: FLINK-23957
 URL: https://issues.apache.org/jira/browse/FLINK-23957
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.13.2
Reporter: Xintong Song
 Fix For: 1.13.3


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22755&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5&l=6557

{code}
Aug 24 16:40:33 [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 51.969 s <<< FAILURE! - in 
org.apache.flink.streaming.connectors.kafka.KafkaProducerAtLeastOnceITCase
Aug 24 16:40:33 [ERROR] 
testOneToOneAtLeastOnceRegularSink(org.apache.flink.streaming.connectors.kafka.KafkaProducerAtLeastOnceITCase)
  Time elapsed: 13.97 s  <<< FAILURE!
Aug 24 16:40:33 java.lang.AssertionError: Create test topic : 
oneToOneTopicRegularSink failed, The topic metadata failed to propagate to 
Kafka broker.
Aug 24 16:40:33 at org.junit.Assert.fail(Assert.java:88)
Aug 24 16:40:33 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:226)
Aug 24 16:40:33 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:112)
Aug 24 16:40:33 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:212)
Aug 24 16:40:33 at 
org.apache.flink.streaming.connectors.kafka.KafkaProducerTestBase.testOneToOneAtLeastOnce(KafkaProducerTestBase.java:241)
Aug 24 16:40:33 at 
org.apache.flink.streaming.connectors.kafka.KafkaProducerTestBase.testOneToOneAtLeastOnceRegularSink(KafkaProducerTestBase.java:217)
Aug 24 16:40:33 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 24 16:40:33 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 24 16:40:33 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 24 16:40:33 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 24 16:40:33 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
Aug 24 16:40:33 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 24 16:40:33 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
Aug 24 16:40:33 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 24 16:40:33 at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Aug 24 16:40:33 at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
Aug 24 16:40:33 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
Aug 24 16:40:33 at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
Aug 24 16:40:33 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
Aug 24 16:40:33 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
Aug 24 16:40:33 at 
org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
Aug 24 16:40:33 at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
Aug 24 16:40:33 at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
Aug 24 16:40:33 at 
org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
Aug 24 16:40:33 at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
Aug 24 16:40:33 at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Aug 24 16:40:33 at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Aug 24 16:40:33 at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
Aug 24 16:40:33 at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
Aug 24 16:40:33 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
Aug 24 16:40:33 at 
org.junit.runners.ParentRunner.run(ParentRunner.java:363)
Aug 24 16:40:33 at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
Aug 24 16:40:33 at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
Aug 24 16:40:33 at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
Aug 24 16:40:33 at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
Aug 24 16:40:33 at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
Aug 24 16:40:33  

[jira] [Created] (FLINK-23956) KafkaITCase.testOneSourceMultiplePartitions fails due to "The topic metadata failed to propagate to Kafka broker"

2021-08-24 Thread Xintong Song (Jira)
Xintong Song created FLINK-23956:


 Summary: KafkaITCase.testOneSourceMultiplePartitions fails due to 
"The topic metadata failed to propagate to Kafka broker"
 Key: FLINK-23956
 URL: https://issues.apache.org/jira/browse/FLINK-23956
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.13.2
Reporter: Xintong Song
 Fix For: 1.13.3


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22741&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5&l=6912

{code}
Aug 24 13:44:11 [ERROR] Tests run: 23, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 181.317 s <<< FAILURE! - in 
org.apache.flink.streaming.connectors.kafka.KafkaITCase
Aug 24 13:44:11 [ERROR] 
testOneSourceMultiplePartitions(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
  Time elapsed: 22.794 s  <<< FAILURE!
Aug 24 13:44:11 java.lang.AssertionError: Create test topic : oneToManyTopic 
failed, The topic metadata failed to propagate to Kafka broker.
Aug 24 13:44:11 at org.junit.Assert.fail(Assert.java:88)
Aug 24 13:44:11 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:226)
Aug 24 13:44:11 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:112)
Aug 24 13:44:11 at 
org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:212)
Aug 24 13:44:11 at 
org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runOneSourceMultiplePartitionsExactlyOnceTest(KafkaConsumerTestBase.java:1027)
Aug 24 13:44:11 at 
org.apache.flink.streaming.connectors.kafka.KafkaITCase.testOneSourceMultiplePartitions(KafkaITCase.java:100)
Aug 24 13:44:11 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 24 13:44:11 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 24 13:44:11 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 24 13:44:11 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 24 13:44:11 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
Aug 24 13:44:11 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 24 13:44:11 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
Aug 24 13:44:11 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 24 13:44:11 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
Aug 24 13:44:11 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
Aug 24 13:44:11 at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
Aug 24 13:44:11 at java.lang.Thread.run(Thread.java:748)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23954) Queryable state (rocksdb) with TM restart end-to-end test fails on azure

2021-08-24 Thread Xintong Song (Jira)
Xintong Song created FLINK-23954:


 Summary: Queryable state (rocksdb) with TM restart end-to-end test 
fails on azure
 Key: FLINK-23954
 URL: https://issues.apache.org/jira/browse/FLINK-23954
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Queryable State
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22714&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=11090

{code}
Aug 24 09:54:17 
==
Aug 24 09:54:17 Running 'Queryable state (rocksdb) with TM restart end-to-end 
test'
Aug 24 09:54:17 
==
Aug 24 09:54:17 TEST_DATA_DIR: 
/home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/temp-test-directory-17362481511
Aug 24 09:54:17 Flink dist directory: 
/home/vsts/work/1/s/flink-dist/target/flink-1.14-SNAPSHOT-bin/flink-1.14-SNAPSHOT
Aug 24 09:54:17 Adding flink-queryable-state-runtime to lib/
Aug 24 09:54:17 Starting cluster.
Aug 24 09:54:18 Starting standalonesession daemon on host fv-az123-794.
Aug 24 09:54:19 Starting taskexecutor daemon on host fv-az123-794.
Aug 24 09:54:19 Waiting for Dispatcher REST endpoint to come up...
Aug 24 09:54:20 Waiting for Dispatcher REST endpoint to come up...
Aug 24 09:54:21 Waiting for Dispatcher REST endpoint to come up...
Aug 24 09:54:22 Waiting for Dispatcher REST endpoint to come up...
Aug 24 09:54:23 Waiting for Dispatcher REST endpoint to come up...
Aug 24 09:54:24 Dispatcher REST endpoint is up.
Aug 24 09:54:31 Job (f230364470a082b78dc34147f8da38f1) is running.
Aug 24 09:54:31 Starting to wait for completion of 10 checkpoints
Aug 24 09:54:31 2/10 completed checkpoints
Aug 24 09:54:33 6/10 completed checkpoints
Aug 24 09:54:35 6/10 completed checkpoints
Aug 24 09:54:37 SERVER: 127.0.0.1
Aug 24 09:54:37 PORT: 9069
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further 
details.
Aug 24 09:54:38 MapState has 17 entries
Aug 24 09:54:38 TaskManager 412715 killed.
Aug 24 09:54:38 Number of running task managers 1 is not yet 0.
Aug 24 09:54:42 Number of running task managers has reached 0.
Aug 24 09:54:42 Latest snapshot count was 22
Aug 24 09:54:43 Starting taskexecutor daemon on host fv-az123-794.
Aug 24 09:54:43 Number of running task managers 0 is not yet 1.
Aug 24 09:54:47 Number of running task managers has reached 1.
Aug 24 09:54:49 Job (f230364470a082b78dc34147f8da38f1) is running.
Aug 24 09:54:49 Starting to wait for completion of 16 checkpoints
Aug 24 09:54:49 11/16 completed checkpoints
Aug 24 09:54:51 11/16 completed checkpoints
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further 
details.
Aug 24 09:54:54 after: 21
Aug 24 09:54:54 An error occurred
Aug 24 09:54:54 [FAIL] Test script contains errors.
Aug 24 09:54:54 Checking of logs skipped.
Aug 24 09:54:54 
Aug 24 09:54:54 [FAIL] 'Queryable state (rocksdb) with TM restart end-to-end 
test' failed after 0 minutes and 37 seconds! Test exited with exit code 1
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23903) ZooKeeperLeaderRetrievalConnectionHandlingTest.testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection fails on azure

2021-08-20 Thread Xintong Song (Jira)
Xintong Song created FLINK-23903:


 Summary: 
ZooKeeperLeaderRetrievalConnectionHandlingTest.testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection
 fails on azure
 Key: FLINK-23903
 URL: https://issues.apache.org/jira/browse/FLINK-23903
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22534&view=logs&j=a57e0635-3fad-5b08-57c7-a4142d7d6fa9&t=2ef0effc-1da1-50e5-c2bd-aab434b1c5b7&l=6647

{code}
Aug 20 07:54:25 [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 14.652 s <<< FAILURE! - in 
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderRetrievalConnectionHandlingTest
Aug 20 07:54:25 [ERROR] 
testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection 
 Time elapsed: 2.244 s  <<< FAILURE!
Aug 20 07:54:25 java.lang.AssertionError: 
Aug 20 07:54:25 
Aug 20 07:54:25 Expected: is null
Aug 20 07:54:25  but: was 

Aug 20 07:54:25 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
Aug 20 07:54:25 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
Aug 20 07:54:25 at 
org.apache.flink.runtime.leaderelection.ZooKeeperLeaderRetrievalConnectionHandlingTest.testSuspendedConnectionDoesNotClearLeaderInformationIfClearanceOnLostConnection(ZooKeeperLeaderRetrievalConnectionHandlingTest.java:211)
Aug 20 07:54:25 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 20 07:54:25 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 20 07:54:25 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 20 07:54:25 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 20 07:54:25 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Aug 20 07:54:25 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 20 07:54:25 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Aug 20 07:54:25 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 20 07:54:25 at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Aug 20 07:54:25 at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Aug 20 07:54:25 at 
org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.evaluate(TestingFatalErrorHandlerResource.java:91)
Aug 20 07:54:25 at 
org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.access$200(TestingFatalErrorHandlerResource.java:83)
Aug 20 07:54:25 at 
org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$1.evaluate(TestingFatalErrorHandlerResource.java:55)
Aug 20 07:54:25 at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23881) SemiJoinITCase.testExistsWithOver4 fails with "failed to fetch next result"

2021-08-19 Thread Xintong Song (Jira)
Xintong Song created FLINK-23881:


 Summary: SemiJoinITCase.testExistsWithOver4 fails with "failed to 
fetch next result"
 Key: FLINK-23881
 URL: https://issues.apache.org/jira/browse/FLINK-23881
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22511&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=9780

{code}
Aug 20 00:40:06 [ERROR] Tests run: 172, Failures: 0, Errors: 1, Skipped: 0, 
Time elapsed: 164.436 s <<< FAILURE! - in 
org.apache.flink.table.planner.runtime.batch.sql.join.SemiJoinITCase
Aug 20 00:40:06 [ERROR] testExistsWithOver4[NestedLoopJoin-{1}]  Time elapsed: 
53.47 s  <<< ERROR!
Aug 20 00:40:06 java.lang.RuntimeException: Failed to fetch next result
Aug 20 00:40:06 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:109)
Aug 20 00:40:06 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
Aug 20 00:40:06 at 
org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370)
Aug 20 00:40:06 at 
java.util.Iterator.forEachRemaining(Iterator.java:115)
Aug 20 00:40:06 at 
org.apache.flink.util.CollectionUtil.iteratorToList(CollectionUtil.java:109)
Aug 20 00:40:06 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.executeQuery(BatchTestBase.scala:300)
Aug 20 00:40:06 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.check(BatchTestBase.scala:140)
Aug 20 00:40:06 at 
org.apache.flink.table.planner.runtime.utils.BatchTestBase.checkResult(BatchTestBase.scala:106)
Aug 20 00:40:06 at 
org.apache.flink.table.planner.runtime.batch.sql.join.SemiJoinITCase.testExistsWithOver4(SemiJoinITCase.scala:314)
Aug 20 00:40:06 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 20 00:40:06 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 20 00:40:06 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 20 00:40:06 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 20 00:40:06 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Aug 20 00:40:06 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 20 00:40:06 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Aug 20 00:40:06 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 20 00:40:06 at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Aug 20 00:40:06 at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Aug 20 00:40:06 at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Aug 20 00:40:06 at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Aug 20 00:40:06 at 
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
Aug 20 00:40:06 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
Aug 20 00:40:06 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Aug 20 00:40:06 at org.junit.runners.Suite.runChild(Suite.java:128)
Aug 20 00:40:06 at org.junit.runners.Suite.runChild(Suite.java:27)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Aug 20 00:40:06 at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Aug 20 00:40:06 at 
org.junit.runners.Pa

[jira] [Created] (FLINK-23880) WindowAggregateITCase.testCascadeEventTimeTumbleWindowWithOffset fail with Artificial Failure

2021-08-19 Thread Xintong Song (Jira)
Xintong Song created FLINK-23880:


 Summary: 
WindowAggregateITCase.testCascadeEventTimeTumbleWindowWithOffset fail with  
Artificial Failure
 Key: FLINK-23880
 URL: https://issues.apache.org/jira/browse/FLINK-23880
 Project: Flink
  Issue Type: Bug
  Components: Table SQL / Planner
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22511&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=9621

{code}
Aug 20 00:28:31 Caused by: java.lang.Exception: Artificial Failure
Aug 20 00:28:31 at 
org.apache.flink.table.planner.runtime.utils.FailingCollectionSource.run(FailingCollectionSource.java:172)
Aug 20 00:28:31 at 
org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:116)
Aug 20 00:28:31 at 
org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:73)
Aug 20 00:28:31 at 
org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:323)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23867) FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed fails with IllegalStateException

2021-08-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-23867:


 Summary: 
FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed fails with 
IllegalStateException
 Key: FLINK-23867
 URL: https://issues.apache.org/jira/browse/FLINK-23867
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.13.2
Reporter: Xintong Song
 Fix For: 1.13.3


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22465&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=c1d93a6a-ba91-515d-3196-2ee8019fbda7&l=6862

{code}
Aug 18 23:20:14 [ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 51.905 s <<< FAILURE! - in 
org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase
Aug 18 23:20:14 [ERROR] 
testCommitTransactionAfterClosed(org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase)
  Time elapsed: 7.848 s  <<< ERROR!
Aug 18 23:20:14 java.lang.Exception: Unexpected exception, 
expected but was
Aug 18 23:20:14 at 
org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:28)
Aug 18 23:20:14 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
Aug 18 23:20:14 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
Aug 18 23:20:14 at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
Aug 18 23:20:14 at java.lang.Thread.run(Thread.java:748)
Aug 18 23:20:14 Caused by: java.lang.AssertionError: The message should have 
been successfully sent expected null, but 
was:
Aug 18 23:20:14 at org.junit.Assert.fail(Assert.java:88)
Aug 18 23:20:14 at org.junit.Assert.failNotNull(Assert.java:755)
Aug 18 23:20:14 at org.junit.Assert.assertNull(Assert.java:737)
Aug 18 23:20:14 at 
org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase.getClosedProducer(FlinkKafkaInternalProducerITCase.java:228)
Aug 18 23:20:14 at 
org.apache.flink.streaming.connectors.kafka.FlinkKafkaInternalProducerITCase.testCommitTransactionAfterClosed(FlinkKafkaInternalProducerITCase.java:177)
Aug 18 23:20:14 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 18 23:20:14 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 18 23:20:14 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 18 23:20:14 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 18 23:20:14 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
Aug 18 23:20:14 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 18 23:20:14 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
Aug 18 23:20:14 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 18 23:20:14 at 
org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:19)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23866) KafkaTransactionLogITCase.testGetTransactionsToAbort fails with IllegalStateException

2021-08-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-23866:


 Summary: KafkaTransactionLogITCase.testGetTransactionsToAbort 
fails with IllegalStateException
 Key: FLINK-23866
 URL: https://issues.apache.org/jira/browse/FLINK-23866
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22463&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7098

{code}
Aug 18 23:14:24 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 67.32 s <<< FAILURE! - in 
org.apache.flink.connector.kafka.sink.KafkaTransactionLogITCase
Aug 18 23:14:24 [ERROR] testGetTransactionsToAbort  Time elapsed: 22.35 s  <<< 
ERROR!
Aug 18 23:14:24 java.lang.IllegalStateException: You can only check the 
position for partitions assigned to this consumer.
Aug 18 23:14:24 at 
org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:1717)
Aug 18 23:14:24 at 
org.apache.kafka.clients.consumer.KafkaConsumer.position(KafkaConsumer.java:1684)
Aug 18 23:14:24 at 
org.apache.flink.connector.kafka.sink.KafkaTransactionLog.hasReadAllRecords(KafkaTransactionLog.java:144)
Aug 18 23:14:24 at 
org.apache.flink.connector.kafka.sink.KafkaTransactionLog.getTransactionsToAbort(KafkaTransactionLog.java:133)
Aug 18 23:14:24 at 
org.apache.flink.connector.kafka.sink.KafkaTransactionLogITCase.testGetTransactionsToAbort(KafkaTransactionLogITCase.java:110)
Aug 18 23:14:24 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 18 23:14:24 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 18 23:14:24 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 18 23:14:24 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 18 23:14:24 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Aug 18 23:14:24 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 18 23:14:24 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Aug 18 23:14:24 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 18 23:14:24 at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Aug 18 23:14:24 at 
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
Aug 18 23:14:24 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
Aug 18 23:14:24 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
Aug 18 23:14:24 at 
org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
Aug 18 23:14:24 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Aug 18 23:14:24 at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Aug 18 23:14:24 at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
Aug 18 23:14:24 at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
Aug 18 23:14:24 at 
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
Aug 18 23:14:24 at 
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
Aug 18 23:14:24 at 
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
Aug 18 23:14:24 at 
java.util.Iterator.forEachRemaining(Iterator.java:116)
Aug 18 23:14:24 at 
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
Aug 18 23:14:24 at 
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
Aug 18 23:14:24 at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
Aug 18 23:14:24 at 
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
Aug 18 23:14:24

[jira] [Created] (FLINK-23851) AggregationsITCase.testDistinctAfterAggregate fails due to AskTimeoutException

2021-08-17 Thread Xintong Song (Jira)
Xintong Song created FLINK-23851:


 Summary: AggregationsITCase.testDistinctAfterAggregate fails due 
to AskTimeoutException
 Key: FLINK-23851
 URL: https://issues.apache.org/jira/browse/FLINK-23851
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.13.2
Reporter: Xintong Song
 Fix For: 1.13.3


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22417&view=logs&j=56781494-ebb0-5eae-f732-b9c397ec6ede&t=6568c985-5fcc-5b89-1ebd-0385b8088b14&l=8303

{code}
Aug 17 21:27:07 Caused by: akka.pattern.AskTimeoutException: Ask timed out on 
[Actor[akka://flink/user/rpc/taskmanager_288#1055484738]] after [1 ms]. 
Message of type [org.apache.flink.runtime.rpc.messages.LocalRpcInvocation]. A 
typical reason for `AskTimeoutException` is that the recipient actor didn't 
send a reply.
Aug 17 21:27:07 at 
akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
Aug 17 21:27:07 at 
akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
Aug 17 21:27:07 at 
akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
Aug 17 21:27:07 at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
Aug 17 21:27:07 at 
scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
Aug 17 21:27:07 at 
scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
Aug 17 21:27:07 at 
scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
Aug 17 21:27:07 at 
akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
Aug 17 21:27:07 at 
akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
Aug 17 21:27:07 at 
akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23830) FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on azure

2021-08-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-23830:


 Summary: 
FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on azure
 Key: FLINK-23830
 URL: https://issues.apache.org/jira/browse/FLINK-23830
 Project: Flink
  Issue Type: Bug
Affects Versions: 1.12.5
Reporter: Xintong Song
 Fix For: 1.12.6


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22330&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5&l=6536

{code}
[ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 172.104 
s <<< FAILURE! - in 
org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerMigrationOperatorTest
[ERROR] testRestoreProducer[Migration Savepoint: 
1.11](org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerMigrationOperatorTest)
  Time elapsed: 71.614 s  <<< FAILURE!
java.lang.AssertionError: Expected elements: <[42, 44]>, but was: elements: <[]>
at org.junit.Assert.fail(Assert.java:88)
at 
org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:349)
at 
org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:303)
at 
org.apache.flink.streaming.connectors.kafka.KafkaMigrationTestBase.testRestoreProducer(KafkaMigrationTestBase.java:154)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at 
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-23829) SavepointITCase JVM crash on azure

2021-08-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-23829:


 Summary: SavepointITCase JVM crash on azure
 Key: FLINK-23829
 URL: https://issues.apache.org/jira/browse/FLINK-23829
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Checkpointing
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=5224

{code}
Aug 16 16:26:11 [ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (integration-tests) 
on project flink-tests: There are test failures.
Aug 16 16:26:11 [ERROR] 
Aug 16 16:26:11 [ERROR] Please refer to 
/__w/1/s/flink-tests/target/surefire-reports for the individual test results.
Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist) [date].dump, 
[date]-jvmRun[N].dump and [date].dumpstream.
Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without 
properly saying goodbye. VM crash or System.exit called?
Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target 
&& /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m 
-Dmvn.forkNumber=2 -XX:+UseG1GC -jar 
/__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar 
/__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2 
surefire8582412554358604743tmp surefire_2118489584967019297925tmp
Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
Aug 16 16:26:11 [ERROR] Process Exit Code: 239
Aug 16 16:26:11 [ERROR] Crashed tests:
Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
Aug 16 16:26:11 [ERROR] 
org.apache.maven.surefire.booter.SurefireBooterForkException: 
ExecutionException The forked VM terminated without properly saying goodbye. VM 
crash or System.exit called?
Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target 
&& /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m 
-Dmvn.forkNumber=2 -XX:+UseG1GC -jar 
/__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar 
/__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2 
surefire8582412554358604743tmp surefire_2118489584967019297925tmp
Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
Aug 16 16:26:11 [ERROR] Process Exit Code: 239
Aug 16 16:26:11 [ERROR] Crashed tests:
Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
Aug 16 16:26:11 [ERROR] at 
org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
Aug 16 16:26:11 [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
Aug 16 16:26:11 [ERROR] at sun.reflect.NativeMeth

[jira] [Created] (FLINK-23828) KafkaSourceITCase.testIdleReader fails on azure

2021-08-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-23828:


 Summary: KafkaSourceITCase.testIdleReader fails on azure
 Key: FLINK-23828
 URL: https://issues.apache.org/jira/browse/FLINK-23828
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22284&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7355

{code}
Aug 16 14:25:00 [ERROR] Tests run: 12, Failures: 1, Errors: 0, Skipped: 0, Time 
elapsed: 67.241 s <<< FAILURE! - in 
org.apache.flink.connector.kafka.source.KafkaSourceITCase
Aug 16 14:25:00 [ERROR] testIdleReader{TestEnvironment, ExternalContext}[1]  
Time elapsed: 0.918 s  <<< FAILURE!
Aug 16 14:25:00 java.lang.AssertionError: 
Aug 16 14:25:00 
Aug 16 14:25:00 Expected: Records consumed by Flink should be identical to test 
data and preserve the order in multiple splits
Aug 16 14:25:00  but: Unexpected record 'la3OaJDch7vuUXDmGOYf'
Aug 16 14:25:00 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
Aug 16 14:25:00 at 
org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
Aug 16 14:25:00 at 
org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testIdleReader(SourceTestSuiteBase.java:193)
Aug 16 14:25:00 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 16 14:25:00 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 16 14:25:00 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 16 14:25:00 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 16 14:25:00 at 
org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:688)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:210)
Aug 16 14:25:00 at 
org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:206)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:131)
Aug 16 14:25:00 at 
org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:65)
Aug 16 14:25:00 at 
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139)
Aug 16 14:25:00 at 
org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
Aug 16 14:25:00 at 
org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
Aug 16 14:25:00 at 
org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
Aug 16 14:25:00 at 
org.junit.platform.engine.support.hierarchical.NodeTestTask.lamb

[jira] [Created] (FLINK-23797) SavepointITCase.testStopSavepointWithBoundedInput fails on azure

2021-08-15 Thread Xintong Song (Jira)
Xintong Song created FLINK-23797:


 Summary: SavepointITCase.testStopSavepointWithBoundedInput fails 
on azure
 Key: FLINK-23797
 URL: https://issues.apache.org/jira/browse/FLINK-23797
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Checkpointing
Affects Versions: 1.14.0
Reporter: Xintong Song
 Fix For: 1.14.0


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=0&view=logs&j=baf26b34-3c6a-54e8-f93f-cf269b32f802&t=8c9d126d-57d2-5a9e-a8c8-ff53f7b35cd9&l=4945

{code}
Aug 15 22:57:53 [ERROR] Tests run: 15, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 58.799 s <<< FAILURE! - in 
org.apache.flink.test.checkpointing.SavepointITCase
Aug 15 22:57:53 [ERROR] testStopSavepointWithBoundedInput  Time elapsed: 4.431 
s  <<< ERROR!
Aug 15 22:57:53 java.util.concurrent.ExecutionException: 
org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint triggering 
task Sink: Unnamed (1/1) of job a27d76d1e3a0145b179b30b3a4cd6564 is not being 
executed at the moment. Aborting checkpoint. Failure reason: Not all required 
tasks are currently running.
Aug 15 22:57:53 at 
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
Aug 15 22:57:53 at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
Aug 15 22:57:53 at 
org.apache.flink.test.checkpointing.SavepointITCase.testStopSavepointWithBoundedInput(SavepointITCase.java:612)
Aug 15 22:57:53 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
Aug 15 22:57:53 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Aug 15 22:57:53 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Aug 15 22:57:53 at java.lang.reflect.Method.invoke(Method.java:498)
Aug 15 22:57:53 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Aug 15 22:57:53 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Aug 15 22:57:53 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Aug 15 22:57:53 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Aug 15 22:57:53 at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Aug 15 22:57:53 at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
Aug 15 22:57:53 at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Aug 15 22:57:53 at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Aug 15 22:57:53 at 
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
Aug 15 22:57:53 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
Aug 15 22:57:53 at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Aug 15 22:57:53 at 
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Aug 15 22:57:53 at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
Aug 15 22:57:53 at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
Aug 15 22:57:53 at 
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
Aug 15 22:57:53 at 
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
Aug 15 22:57:53 at 
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
Aug 15 22:57:53 at 
java.util.Iterator.forEachRemaining(Iterator.java:116)
Aug 15 22:57:53 at 
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
Aug 15 22:57:53 at 
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
Aug 15 22:57:53 at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
Aug 15 22:57:53 at 
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
Aug 15 22:57:53 at 
java.util.stream.ForEachOps$ForEachOp$OfRef

  1   2   3   4   >