[jira] [Comment Edited] (FLINK-33727) JoinRestoreTest is failing on AZP

2023-12-03 Thread Sergey Nuyanzin (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-33727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792536#comment-17792536
 ] 

Sergey Nuyanzin edited comment on FLINK-33727 at 12/3/23 2:58 PM:
--

{quote}
Presently, the method `generateTestSetupFiles` is disabled and only run by test 
developers before a PR is submitted.  This method takes the SQL, gets and saves 
a compiled plan, and runs through the beforeRestore data making some 
comparisons, and finally stopping the job and taking a savepoint.  
{quote}
if so I'm curious whether it would be more helpful for others to have at least 
a comment about that in sources?
IMHO it could help others who is editing the code around however not aware of 
it and since currently there is no any such info in code and the code is not a 
part of "turned on" tests, then it could be simply be broken and neither 
contributor nor reviewer could notice that 


was (Author: sergey nuyanzin):
{quote}
Presently, the method `generateTestSetupFiles` is disabled and only run by test 
developers before a PR is submitted.  This method takes the SQL, gets and saves 
a compiled plan, and runs through the beforeRestore data making some 
comparisons, and finally stopping the job and taking a savepoint.  
{quote}
if so I'm curious whether it would be more helpful for others to have at least 
a comment about that in sources?
IMHO it could help others who is editing the code around however not aware of 
it and since currently there is no any such info in code and the code is not a 
part of "turned on" tests, then it could be simply be broken without and 
neither contributor nor reviewer could notice that 

> JoinRestoreTest is failing on AZP
> -
>
> Key: FLINK-33727
> URL: https://issues.apache.org/jira/browse/FLINK-33727
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / Planner
>Affects Versions: 1.19.0
>Reporter: Sergey Nuyanzin
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> Since {{JoinRestoreTest}} was introduced in FLINK-33470 it seems to be a 
> reason
> {noformat}
> Dec 02 04:42:26 04:42:26.408 [ERROR] Failures: 
> Dec 02 04:42:26 04:42:26.408 [ERROR]   
> JoinRestoreTest>RestoreTestBase.testRestore:283 
> Dec 02 04:42:26 Expecting actual:
> Dec 02 04:42:26   ["+I[9, carol, apple, 9000]",
> Dec 02 04:42:26 "+I[8, bill, banana, 8000]",
> Dec 02 04:42:26 "+I[6, jerry, pen, 6000]"]
> Dec 02 04:42:26 to contain exactly in any order:
> Dec 02 04:42:26   ["+I[Adam, null]",
> Dec 02 04:42:26 "+I[Baker, Research]",
> Dec 02 04:42:26 "+I[Charlie, Human Resources]",
> Dec 02 04:42:26 "+I[Charlie, HR]",
> Dec 02 04:42:26 "+I[Don, Sales]",
> Dec 02 04:42:26 "+I[Victor, null]",
> Dec 02 04:42:26 "+I[Helena, Engineering]",
> Dec 02 04:42:26 "+I[Juliet, Engineering]",
> Dec 02 04:42:26 "+I[Ivana, Research]",
> Dec 02 04:42:26 "+I[Charlie, People Operations]"]
> {noformat}
> examples of failures
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55120=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55129=logs=a9db68b9-a7e0-54b6-0f98-010e0aff39e2=cdd32e0b-6047-565b-c58f-14054472f1be=11786
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55136=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55137=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=11779



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (FLINK-33727) JoinRestoreTest is failing on AZP

2023-12-03 Thread Sergey Nuyanzin (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-33727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792533#comment-17792533
 ] 

Sergey Nuyanzin edited comment on FLINK-33727 at 12/3/23 2:32 PM:
--

{quote}
I'm pretty sure that if you removed the run SQL, that'd be like removing the 
section in a JUnit test function which does anything and then asserts that it 
works.  (That'd explain why the tests pass without it.)
{quote}
I don't understand it

as another experiment I just changed SQL to the wrong SQL with syntax error.
e.g. just add a couple of commas in wrong places
{code:java}
.runSql(
"insert, into, deduplicate_sink "
+ "select order_id, user, product, order_time \n"
+ "FROM ("
+ "  SELECT *,"
+ "ROW_NUMBER() OVER (PARTITION BY product ORDER BY event_time ASC) AS 
row_num\n"
+ "  FROM MyTable)"
+ "WHERE row_num = 1")
{code}
, however tests are continuing passing. Is it expected?
Then it's is not clear what is the reason to have it and how to check that it 
tests what it is expected to test?

{quote}
If you are looking to sort things immediately, I'd suggest adding `Disabled` to 
`testRestore` here: 
https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java#L229
{quote}
what is wrong with current PR for this JIRA?


was (Author: sergey nuyanzin):
{quote}
I'm pretty sure that if you removed the run SQL, that'd be like removing the 
section in a JUnit test function which does anything and then asserts that it 
works.  (That'd explain why the tests pass without it.)
{quote}
I don't understand it

as another experiment I just changed SQL to the wrong SQL with syntax error, 
however tests are continuing passing. Is it expected?
Then it's is not clear what is the reason to have it and how to check that it 
tests what it is expected to test?

{quote}
If you are looking to sort things immediately, I'd suggest adding `Disabled` to 
`testRestore` here: 
https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java#L229
{quote}
what is wrong with current PR for this JIRA?

> JoinRestoreTest is failing on AZP
> -
>
> Key: FLINK-33727
> URL: https://issues.apache.org/jira/browse/FLINK-33727
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / Planner
>Affects Versions: 1.19.0
>Reporter: Sergey Nuyanzin
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> Since {{JoinRestoreTest}} was introduced in FLINK-33470 it seems to be a 
> reason
> {noformat}
> Dec 02 04:42:26 04:42:26.408 [ERROR] Failures: 
> Dec 02 04:42:26 04:42:26.408 [ERROR]   
> JoinRestoreTest>RestoreTestBase.testRestore:283 
> Dec 02 04:42:26 Expecting actual:
> Dec 02 04:42:26   ["+I[9, carol, apple, 9000]",
> Dec 02 04:42:26 "+I[8, bill, banana, 8000]",
> Dec 02 04:42:26 "+I[6, jerry, pen, 6000]"]
> Dec 02 04:42:26 to contain exactly in any order:
> Dec 02 04:42:26   ["+I[Adam, null]",
> Dec 02 04:42:26 "+I[Baker, Research]",
> Dec 02 04:42:26 "+I[Charlie, Human Resources]",
> Dec 02 04:42:26 "+I[Charlie, HR]",
> Dec 02 04:42:26 "+I[Don, Sales]",
> Dec 02 04:42:26 "+I[Victor, null]",
> Dec 02 04:42:26 "+I[Helena, Engineering]",
> Dec 02 04:42:26 "+I[Juliet, Engineering]",
> Dec 02 04:42:26 "+I[Ivana, Research]",
> Dec 02 04:42:26 "+I[Charlie, People Operations]"]
> {noformat}
> examples of failures
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55120=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55129=logs=a9db68b9-a7e0-54b6-0f98-010e0aff39e2=cdd32e0b-6047-565b-c58f-14054472f1be=11786
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55136=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55137=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=11779



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (FLINK-33727) JoinRestoreTest is failing on AZP

2023-12-03 Thread Jim Hughes (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-33727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792532#comment-17792532
 ] 

Jim Hughes edited comment on FLINK-33727 at 12/3/23 2:26 PM:
-

{quote}...
It seems it relies on some internal state...
{quote}
The tests have internal state.  Your testing shows that it not being reset 
between test classes!

Thanks for digging into that; that will help us identify what we need to sort 
out with the TestRestoreBase.  

If you are looking to sort things immediately, I'd suggest adding `Disabled` to 
`testRestore` here: 
[https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java#L229]

That'd turn off all of these tests until [~twalthr] [~dwysakowicz] [~bvarghese] 
and I have a 
solution.[https://issues.apache.org/jira/secure/ViewProfile.jspa?name=dwysakowicz]


was (Author: JIRAUSER284726):
{quote}...
It seems it relies on some internal state...
{quote}
The tests have internal state.  Your testing shows that it not being reset 
between test classes!

Thanks for digging into that; that will help us identify what we need to sort 
out with the TestRestoreBase.  

If you are looking to sort things immediately, I'd suggest adding `Disabled` to 
`testRestore` here: 
[https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java#L229]

That'd turn off all of these tests until [~twalthr] [~dwysakowicz] and I have a 
solution.[|https://issues.apache.org/jira/secure/ViewProfile.jspa?name=dwysakowicz]

> JoinRestoreTest is failing on AZP
> -
>
> Key: FLINK-33727
> URL: https://issues.apache.org/jira/browse/FLINK-33727
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / Planner
>Affects Versions: 1.19.0
>Reporter: Sergey Nuyanzin
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> Since {{JoinRestoreTest}} was introduced in FLINK-33470 it seems to be a 
> reason
> {noformat}
> Dec 02 04:42:26 04:42:26.408 [ERROR] Failures: 
> Dec 02 04:42:26 04:42:26.408 [ERROR]   
> JoinRestoreTest>RestoreTestBase.testRestore:283 
> Dec 02 04:42:26 Expecting actual:
> Dec 02 04:42:26   ["+I[9, carol, apple, 9000]",
> Dec 02 04:42:26 "+I[8, bill, banana, 8000]",
> Dec 02 04:42:26 "+I[6, jerry, pen, 6000]"]
> Dec 02 04:42:26 to contain exactly in any order:
> Dec 02 04:42:26   ["+I[Adam, null]",
> Dec 02 04:42:26 "+I[Baker, Research]",
> Dec 02 04:42:26 "+I[Charlie, Human Resources]",
> Dec 02 04:42:26 "+I[Charlie, HR]",
> Dec 02 04:42:26 "+I[Don, Sales]",
> Dec 02 04:42:26 "+I[Victor, null]",
> Dec 02 04:42:26 "+I[Helena, Engineering]",
> Dec 02 04:42:26 "+I[Juliet, Engineering]",
> Dec 02 04:42:26 "+I[Ivana, Research]",
> Dec 02 04:42:26 "+I[Charlie, People Operations]"]
> {noformat}
> examples of failures
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55120=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55129=logs=a9db68b9-a7e0-54b6-0f98-010e0aff39e2=cdd32e0b-6047-565b-c58f-14054472f1be=11786
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55136=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55137=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=11779



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (FLINK-33727) JoinRestoreTest is failing on AZP

2023-12-03 Thread Sergey Nuyanzin (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-33727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792499#comment-17792499
 ] 

Sergey Nuyanzin edited comment on FLINK-33727 at 12/3/23 9:12 AM:
--

[~jhughes] there is also a question about {{DeduplicationRestoreTest}}
what is the reason to have {{runSql}} this in {{DeduplicationTestPrograms}} 
e.g. for 
{{org.apache.flink.table.planner.plan.nodes.exec.stream.DeduplicationTestPrograms#DEDUPLICATE}}
{code:java}
.runSql(
"insert into deduplicate_sink "
+ "select order_id, user, product, order_time \n"
+ "FROM ("
+ "  SELECT *,"
+ "ROW_NUMBER() OVER (PARTITION BY product ORDER BY event_time ASC) AS 
row_num\n"
+ "  FROM MyTable)"
+ "WHERE row_num = 1")
{code}

I'm asking since I tried to remove it just to see what happens and tests just 
continue passing..
So from tests point of view it seems there is no difference whether we have 
this or not for {{DeduplicationTestPrograms}} 
Or did I miss anything?


was (Author: sergey nuyanzin):
[~jhughes]there is also a question about {{DeduplicationRestoreTest}}
what is the reason to have {{runSql}} this in {{DeduplicationTestPrograms}} 
e.g. for 
{{org.apache.flink.table.planner.plan.nodes.exec.stream.DeduplicationTestPrograms#DEDUPLICATE}}
{code:java}
.runSql(
"insert into deduplicate_sink "
+ "select order_id, user, product, order_time \n"
+ "FROM ("
+ "  SELECT *,"
+ "ROW_NUMBER() OVER (PARTITION BY product ORDER BY event_time ASC) AS 
row_num\n"
+ "  FROM MyTable)"
+ "WHERE row_num = 1")
{code}

I'm asking since I tried to remove it just to see what happens and tests just 
continue passing..
So from tests point of view it seems there is no difference whether we have 
this or not for {{DeduplicationTestPrograms}} 
Or did I miss anything?

> JoinRestoreTest is failing on AZP
> -
>
> Key: FLINK-33727
> URL: https://issues.apache.org/jira/browse/FLINK-33727
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / Planner
>Affects Versions: 1.19.0
>Reporter: Sergey Nuyanzin
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> Since {{JoinRestoreTest}} was introduced in FLINK-33470 it seems to be a 
> reason
> {noformat}
> Dec 02 04:42:26 04:42:26.408 [ERROR] Failures: 
> Dec 02 04:42:26 04:42:26.408 [ERROR]   
> JoinRestoreTest>RestoreTestBase.testRestore:283 
> Dec 02 04:42:26 Expecting actual:
> Dec 02 04:42:26   ["+I[9, carol, apple, 9000]",
> Dec 02 04:42:26 "+I[8, bill, banana, 8000]",
> Dec 02 04:42:26 "+I[6, jerry, pen, 6000]"]
> Dec 02 04:42:26 to contain exactly in any order:
> Dec 02 04:42:26   ["+I[Adam, null]",
> Dec 02 04:42:26 "+I[Baker, Research]",
> Dec 02 04:42:26 "+I[Charlie, Human Resources]",
> Dec 02 04:42:26 "+I[Charlie, HR]",
> Dec 02 04:42:26 "+I[Don, Sales]",
> Dec 02 04:42:26 "+I[Victor, null]",
> Dec 02 04:42:26 "+I[Helena, Engineering]",
> Dec 02 04:42:26 "+I[Juliet, Engineering]",
> Dec 02 04:42:26 "+I[Ivana, Research]",
> Dec 02 04:42:26 "+I[Charlie, People Operations]"]
> {noformat}
> examples of failures
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55120=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55129=logs=a9db68b9-a7e0-54b6-0f98-010e0aff39e2=cdd32e0b-6047-565b-c58f-14054472f1be=11786
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55136=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55137=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=11779



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (FLINK-33727) JoinRestoreTest is failing on AZP

2023-12-02 Thread Sergey Nuyanzin (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-33727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792458#comment-17792458
 ] 

Sergey Nuyanzin edited comment on FLINK-33727 at 12/2/23 11:29 PM:
---

Based on local tests seems these {{MySink}} is kind of "state holder" for the 
tests...

Renaming helps
{quote}
  (Right now, the DeduplicationTestPrograms and JoinTestPrograms both use sinks 
called "MySink".)
{quote}
is there any reason to have same name?

Also I guess it is worth noting: there is a number of other tests with same 
potential issue e.g. with sink name "sink_t", probably something else


was (Author: sergey nuyanzin):
Based on local tests seems these {{MySink}} is kind of "state holder" for the 
tests...

{quote}
  (Right now, the DeduplicationTestPrograms and JoinTestPrograms both use sinks 
called "MySink".)
{quote}
is there any reason to have same name?

> JoinRestoreTest is failing on AZP
> -
>
> Key: FLINK-33727
> URL: https://issues.apache.org/jira/browse/FLINK-33727
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / Planner
>Affects Versions: 1.19.0
>Reporter: Sergey Nuyanzin
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> Since {{JoinRestoreTest}} was introduced in FLINK-33470 it seems to be a 
> reason
> {noformat}
> Dec 02 04:42:26 04:42:26.408 [ERROR] Failures: 
> Dec 02 04:42:26 04:42:26.408 [ERROR]   
> JoinRestoreTest>RestoreTestBase.testRestore:283 
> Dec 02 04:42:26 Expecting actual:
> Dec 02 04:42:26   ["+I[9, carol, apple, 9000]",
> Dec 02 04:42:26 "+I[8, bill, banana, 8000]",
> Dec 02 04:42:26 "+I[6, jerry, pen, 6000]"]
> Dec 02 04:42:26 to contain exactly in any order:
> Dec 02 04:42:26   ["+I[Adam, null]",
> Dec 02 04:42:26 "+I[Baker, Research]",
> Dec 02 04:42:26 "+I[Charlie, Human Resources]",
> Dec 02 04:42:26 "+I[Charlie, HR]",
> Dec 02 04:42:26 "+I[Don, Sales]",
> Dec 02 04:42:26 "+I[Victor, null]",
> Dec 02 04:42:26 "+I[Helena, Engineering]",
> Dec 02 04:42:26 "+I[Juliet, Engineering]",
> Dec 02 04:42:26 "+I[Ivana, Research]",
> Dec 02 04:42:26 "+I[Charlie, People Operations]"]
> {noformat}
> examples of failures
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55120=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55129=logs=a9db68b9-a7e0-54b6-0f98-010e0aff39e2=cdd32e0b-6047-565b-c58f-14054472f1be=11786
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55136=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55137=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=11779



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (FLINK-33727) JoinRestoreTest is failing on AZP

2023-12-02 Thread Sergey Nuyanzin (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-33727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792458#comment-17792458
 ] 

Sergey Nuyanzin edited comment on FLINK-33727 at 12/2/23 11:23 PM:
---

Based on local tests seems these {{MySink}} is kind of "state holder" for the 
tests...

{quote}
  (Right now, the DeduplicationTestPrograms and JoinTestPrograms both use sinks 
called "MySink".)
{quote}
is there any reason to have same name?


was (Author: sergey nuyanzin):
Seems these {{MySink}} is kind of "state holder" for the tests...

{quote}
  (Right now, the DeduplicationTestPrograms and JoinTestPrograms both use sinks 
called "MySink".)
{quote}
is there any reason to have same name?

> JoinRestoreTest is failing on AZP
> -
>
> Key: FLINK-33727
> URL: https://issues.apache.org/jira/browse/FLINK-33727
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / Planner
>Affects Versions: 1.19.0
>Reporter: Sergey Nuyanzin
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> Since {{JoinRestoreTest}} was introduced in FLINK-33470 it seems to be a 
> reason
> {noformat}
> Dec 02 04:42:26 04:42:26.408 [ERROR] Failures: 
> Dec 02 04:42:26 04:42:26.408 [ERROR]   
> JoinRestoreTest>RestoreTestBase.testRestore:283 
> Dec 02 04:42:26 Expecting actual:
> Dec 02 04:42:26   ["+I[9, carol, apple, 9000]",
> Dec 02 04:42:26 "+I[8, bill, banana, 8000]",
> Dec 02 04:42:26 "+I[6, jerry, pen, 6000]"]
> Dec 02 04:42:26 to contain exactly in any order:
> Dec 02 04:42:26   ["+I[Adam, null]",
> Dec 02 04:42:26 "+I[Baker, Research]",
> Dec 02 04:42:26 "+I[Charlie, Human Resources]",
> Dec 02 04:42:26 "+I[Charlie, HR]",
> Dec 02 04:42:26 "+I[Don, Sales]",
> Dec 02 04:42:26 "+I[Victor, null]",
> Dec 02 04:42:26 "+I[Helena, Engineering]",
> Dec 02 04:42:26 "+I[Juliet, Engineering]",
> Dec 02 04:42:26 "+I[Ivana, Research]",
> Dec 02 04:42:26 "+I[Charlie, People Operations]"]
> {noformat}
> examples of failures
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55120=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55129=logs=a9db68b9-a7e0-54b6-0f98-010e0aff39e2=cdd32e0b-6047-565b-c58f-14054472f1be=11786
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55136=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=12099
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=55137=logs=0c940707-2659-5648-cbe6-a1ad63045f0a=075c2716-8010-5565-fe08-3c4bb45824a4=11779



--
This message was sent by Atlassian Jira
(v8.20.10#820010)