[GitHub] [flink] flinkbot edited a comment on pull request #17933: [FLINK-24948][jdbc] Fix bug that special character in column names breaks JDBC statement parsing
flinkbot edited a comment on pull request #17933: URL: https://github.com/apache/flink/pull/17933#issuecomment-980508183 ## CI report: * 78d03eb751dfc0b74613d7c5855e6d0dd5f0fc00 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27161) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-25076) Simplify name of SQL operators
[ https://issues.apache.org/jira/browse/FLINK-25076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449773#comment-17449773 ] junbiao chen commented on FLINK-25076: -- Could you cite an example? > Simplify name of SQL operators > -- > > Key: FLINK-25076 > URL: https://issues.apache.org/jira/browse/FLINK-25076 > Project: Flink > Issue Type: Sub-task >Reporter: Wenlong Lyu >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #17935: [FLINK-14438][core] Fix RowTypeInfo.equals()
flinkbot edited a comment on pull request #17935: URL: https://github.com/apache/flink/pull/17935#issuecomment-980516470 ## CI report: * 79fae89afd065ef8be12dcb54bfa85c6a3c3a837 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27164) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17935: [FLINK-14438][core] Fix RowTypeInfo.equals()
flinkbot commented on pull request #17935: URL: https://github.com/apache/flink/pull/17935#issuecomment-980516547 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit 79fae89afd065ef8be12dcb54bfa85c6a3c3a837 (Sat Nov 27 07:15:42 UTC 2021) **Warnings:** * No documentation files were touched! Remember to keep the Flink docs up to date! * **This pull request references an unassigned [Jira ticket](https://issues.apache.org/jira/browse/FLINK-14438).** According to the [code contribution guide](https://flink.apache.org/contributing/contribute-code.html), tickets need to be assigned before starting with the implementation work. Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17935: [FLINK-14438][core] Fix RowTypeInfo.equals()
flinkbot commented on pull request #17935: URL: https://github.com/apache/flink/pull/17935#issuecomment-980516470 ## CI report: * 79fae89afd065ef8be12dcb54bfa85c6a3c3a837 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-14438) Fix RowTypeInfo.equals()
[
https://issues.apache.org/jira/browse/FLINK-14438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-14438:
---
Labels: auto-deprioritized-major auto-deprioritized-minor
pull-request-available (was: auto-deprioritized-major auto-deprioritized-minor)
> Fix RowTypeInfo.equals()
>
>
> Key: FLINK-14438
> URL: https://issues.apache.org/jira/browse/FLINK-14438
> Project: Flink
> Issue Type: Improvement
> Components: API / Type Serialization System
>Reporter: Timo Walther
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> pull-request-available
>
> As discussed in FLINK-12848, the {{equals}} method of {{RowTypeInfo}} causes
> confusion because it does not consider field names which makes it difficult
> to use the type in data structures (such as hash maps) or testing.
> So far {{RowTypeInfo}} is marked as {{@PublicEvolving}}. However, it is not
> feasible to perform changes to {{RowTypeInfo.equals()}} in the current code
> base. The number of affected tests (>80) shows that this change is not
> trivial and would affect the stability of the legacy planner. However, most
> of the failing tests are in the legacy planner. It seems the Blink code has
> no problems with this change which is great! We suggest to apply the changes
> once we drop the legacy planner.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] shenzhu opened a new pull request #17935: [FLINK-14438][core] Fix RowTypeInfo.equals()
shenzhu opened a new pull request #17935: URL: https://github.com/apache/flink/pull/17935 ## What is the purpose of the change [FLINK-14438](https://issues.apache.org/jira/browse/FLINK-14438): Fix RowTypeInfo.equals() to consider field names. ## Brief change log - Update `hashCode` and `equals` in `RowTypeInfo` to also consider field names. ## Verifying this change Please make sure both new and modified tests in this PR follows the conventions defined in our code quality guide: https://flink.apache.org/contributing/code-style-and-quality-common.html#testing *(Please pick either of the following options)* Unit tests are added to `RowTypeInfoTest.java`. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (no) - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (yes) - The serializers: (no) - The runtime per-record code paths (performance sensitive): (no) - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (no) - The S3 file system connector: (no) ## Documentation - Does this pull request introduce a new feature? (no) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17934: [FLINK-25083]Fix Flaky RowTest
flinkbot edited a comment on pull request #17934: URL: https://github.com/apache/flink/pull/17934#issuecomment-980515424 ## CI report: * 2cf66390cb9ab7243ac6faadf2f433aa1334984b Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27163) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17934: [FLINK-25083]Fix Flaky RowTest
flinkbot commented on pull request #17934: URL: https://github.com/apache/flink/pull/17934#issuecomment-980515552 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit 2cf66390cb9ab7243ac6faadf2f433aa1334984b (Sat Nov 27 07:08:02 UTC 2021) **Warnings:** * No documentation files were touched! Remember to keep the Flink docs up to date! * **This pull request references an unassigned [Jira ticket](https://issues.apache.org/jira/browse/FLINK-25083).** According to the [code contribution guide](https://flink.apache.org/contributing/contribute-code.html), tickets need to be assigned before starting with the implementation work. Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17934: [FLINK-25083]Fix Flaky RowTest
flinkbot commented on pull request #17934: URL: https://github.com/apache/flink/pull/17934#issuecomment-980515424 ## CI report: * 2cf66390cb9ab7243ac6faadf2f433aa1334984b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-25083) Flaky Test in RowTest
[ https://issues.apache.org/jira/browse/FLINK-25083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25083: --- Labels: pull-request-available (was: ) > Flaky Test in RowTest > - > > Key: FLINK-25083 > URL: https://issues.apache.org/jira/browse/FLINK-25083 > Project: Flink > Issue Type: Improvement > Components: API / Core >Reporter: Minyang Ye >Priority: Minor > Labels: pull-request-available > > In the description of Row class it says that Row has a deterministic field > order. However the tests "testRowNamed" and "testDeepToString" are flaky. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] HildoYe opened a new pull request #17934: [FLINK-25083]Fix Flaky RowTest
HildoYe opened a new pull request #17934: URL: https://github.com/apache/flink/pull/17934 ## What is the purpose of the change The tests `testRowNamed` and `testDeepToString` are flaky due to the non-deterministic order of HashMap. In this PR the order is fixed with the use of LinkedHashMap. ## Brief change log - Used `LinkedHashMap` instead of `HashMap` in Class `Row` ## Verifying this change This change is already covered by existing tests, such as *(please describe tests)*. - `testRowNamed` - `testDeepToString` ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): no - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no - The serializers: don't know - The runtime per-record code paths (performance sensitive): don't know - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no - The S3 file system connector: no ## Documentation - Does this pull request introduce a new feature? no -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (FLINK-25083) Flaky Test in RowTest
Minyang Ye created FLINK-25083: -- Summary: Flaky Test in RowTest Key: FLINK-25083 URL: https://issues.apache.org/jira/browse/FLINK-25083 Project: Flink Issue Type: Improvement Components: API / Core Reporter: Minyang Ye In the description of Row class it says that Row has a deterministic field order. However the tests "testRowNamed" and "testDeepToString" are flaky. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-14438) Fix RowTypeInfo.equals()
[
https://issues.apache.org/jira/browse/FLINK-14438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449769#comment-17449769
]
Shen Zhu commented on FLINK-14438:
--
Hey [~twalthr] , I'm interested in working on this ticket, would you mind
assigning it to me? Thanks!
> Fix RowTypeInfo.equals()
>
>
> Key: FLINK-14438
> URL: https://issues.apache.org/jira/browse/FLINK-14438
> Project: Flink
> Issue Type: Improvement
> Components: API / Type Serialization System
>Reporter: Timo Walther
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> As discussed in FLINK-12848, the {{equals}} method of {{RowTypeInfo}} causes
> confusion because it does not consider field names which makes it difficult
> to use the type in data structures (such as hash maps) or testing.
> So far {{RowTypeInfo}} is marked as {{@PublicEvolving}}. However, it is not
> feasible to perform changes to {{RowTypeInfo.equals()}} in the current code
> base. The number of affected tests (>80) shows that this change is not
> trivial and would affect the stability of the legacy planner. However, most
> of the failing tests are in the legacy planner. It seems the Blink code has
> no problems with this change which is great! We suggest to apply the changes
> once we drop the legacy planner.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #17560: [FLINK-22315][table] Support ADD column/constraint/watermark for ALTER TABLE statement.
flinkbot edited a comment on pull request #17560: URL: https://github.com/apache/flink/pull/17560#issuecomment-951002521 ## CI report: * 2f7d301efba608404032a246c8204b2ce62b8a25 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27160) * 99f7650c9b2b0a6a800e6681fb6d413b4e3cbca1 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27162) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17560: [FLINK-22315][table] Support ADD column/constraint/watermark for ALTER TABLE statement.
flinkbot edited a comment on pull request #17560: URL: https://github.com/apache/flink/pull/17560#issuecomment-951002521 ## CI report: * 6207c0492807434173487d39e7f2f53b1a60d50c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27146) * 2f7d301efba608404032a246c8204b2ce62b8a25 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27160) * 99f7650c9b2b0a6a800e6681fb6d413b4e3cbca1 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27162) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17560: [FLINK-22315][table] Support ADD column/constraint/watermark for ALTER TABLE statement.
flinkbot edited a comment on pull request #17560: URL: https://github.com/apache/flink/pull/17560#issuecomment-951002521 ## CI report: * 6207c0492807434173487d39e7f2f53b1a60d50c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27146) * 2f7d301efba608404032a246c8204b2ce62b8a25 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27160) * 99f7650c9b2b0a6a800e6681fb6d413b4e3cbca1 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17933: [FLINK-24948][jdbc] Fix bug that special character in column names breaks JDBC statement parsing
flinkbot edited a comment on pull request #17933: URL: https://github.com/apache/flink/pull/17933#issuecomment-980508183 ## CI report: * 78d03eb751dfc0b74613d7c5855e6d0dd5f0fc00 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27161) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17933: [FLINK-24948][jdbc] Fix bug that special character in column names breaks JDBC statement parsing
flinkbot commented on pull request #17933: URL: https://github.com/apache/flink/pull/17933#issuecomment-980508216 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit 78d03eb751dfc0b74613d7c5855e6d0dd5f0fc00 (Sat Nov 27 05:54:18 UTC 2021) **Warnings:** * No documentation files were touched! Remember to keep the Flink docs up to date! Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17933: [FLINK-24948][jdbc] Fix bug that special character in column names breaks JDBC statement parsing
flinkbot commented on pull request #17933: URL: https://github.com/apache/flink/pull/17933#issuecomment-980508183 ## CI report: * 78d03eb751dfc0b74613d7c5855e6d0dd5f0fc00 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-24948) Special character in column names breaks JDBC statement parsing
[ https://issues.apache.org/jira/browse/FLINK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-24948: --- Labels: pull-request-available (was: ) > Special character in column names breaks JDBC statement parsing > --- > > Key: FLINK-24948 > URL: https://issues.apache.org/jira/browse/FLINK-24948 > Project: Flink > Issue Type: Bug > Components: Connectors / JDBC >Affects Versions: 1.12.4 >Reporter: Paul Lin >Assignee: Paul Lin >Priority: Major > Labels: pull-request-available > > Currently, JDBC connector assumes columns names respect Java identifier > naming restrictions, but Databases that support JDBC may have different > naming restrictions. For example, MySQL allows dots and colons in column > names. In that case, JDBC connector would have trouble parsing the SQL. > We could fix this by validating field names in `JdbcDmlOptions`. In addition, > it'd be good to clarify the naming restrictions of Flink SQL, so users and > connector developers would know the standard. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] link3280 opened a new pull request #17933: [FLINK-24948][jdbc] Fix bug that special character in column names breaks JDBC statement parsing
link3280 opened a new pull request #17933: URL: https://github.com/apache/flink/pull/17933 ## What is the purpose of the change Currently, JDBC connector assumes columns names respect Java identifier naming restrictions, but databases that support JDBC may have different naming restrictions. For example, MySQL allows dots and colons in column names. In that case, JDBC connector would have trouble parsing the named parameters in SQL. This PR fixes the problem by adding enclosing parentheses to the named parameters. ## Brief change log - Add enclosing parentheses to the named parameters - Escape reserved characters like ':' ## Verifying this change Update existing tests to cover some corner cases. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): no - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no - The serializers: no - The runtime per-record code paths (performance sensitive): no - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no - The S3 file system connector: no ## Documentation - Does this pull request introduce a new feature? no - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Aitozi closed pull request #17554: [FLINK-24624][Kubernetes]Kill cluster when starting kubernetes session or application cluster failed
Aitozi closed pull request #17554: URL: https://github.com/apache/flink/pull/17554 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Aitozi commented on a change in pull request #17554: [FLINK-24624][Kubernetes]Kill cluster when starting kubernetes session or application cluster failed
Aitozi commented on a change in pull request #17554:
URL: https://github.com/apache/flink/pull/17554#discussion_r757741776
##
File path:
flink-kubernetes/src/main/java/org/apache/flink/kubernetes/KubernetesClusterDescriptor.java
##
@@ -256,36 +244,51 @@ private String getWebMonitorAddress(Configuration
configuration) throws Exceptio
flinkConfig.get(JobManagerOptions.PORT));
}
+final KubernetesJobManagerParameters kubernetesJobManagerParameters =
+new KubernetesJobManagerParameters(flinkConfig,
clusterSpecification);
+
+final FlinkPod podTemplate =
+kubernetesJobManagerParameters
+.getPodTemplateFilePath()
+.map(
+file ->
+
KubernetesUtils.loadPodFromTemplateFile(
+client, file,
Constants.MAIN_CONTAINER_NAME))
+.orElse(new FlinkPod.Builder().build());
+final KubernetesJobManagerSpecification kubernetesJobManagerSpec =
+
KubernetesJobManagerFactory.buildKubernetesJobManagerSpecification(
+podTemplate, kubernetesJobManagerParameters);
+
+client.createJobManagerComponent(kubernetesJobManagerSpec);
+
+return createClusterClientProvider(clusterId);
+}
+
+private ClusterClientProvider safelyDeployCluster(
+SupplierWithException, Exception>
supplier)
+throws ClusterDeploymentException {
try {
-final KubernetesJobManagerParameters
kubernetesJobManagerParameters =
-new KubernetesJobManagerParameters(flinkConfig,
clusterSpecification);
-
-final FlinkPod podTemplate =
-kubernetesJobManagerParameters
-.getPodTemplateFilePath()
-.map(
-file ->
-
KubernetesUtils.loadPodFromTemplateFile(
-client, file,
Constants.MAIN_CONTAINER_NAME))
-.orElse(new FlinkPod.Builder().build());
-final KubernetesJobManagerSpecification kubernetesJobManagerSpec =
-
KubernetesJobManagerFactory.buildKubernetesJobManagerSpecification(
-podTemplate, kubernetesJobManagerParameters);
-
-client.createJobManagerComponent(kubernetesJobManagerSpec);
-
-return createClusterClientProvider(clusterId);
+
+ClusterClientProvider clusterClientProvider =
supplier.get();
+
+try (ClusterClient clusterClient =
clusterClientProvider.getClusterClient()) {
Review comment:
Thanks for your comments @cc13ny @wangyang0918 , closing this PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17560: [FLINK-22315][table] Support ADD column/constraint/watermark for ALTER TABLE statement.
flinkbot edited a comment on pull request #17560: URL: https://github.com/apache/flink/pull/17560#issuecomment-951002521 ## CI report: * 6207c0492807434173487d39e7f2f53b1a60d50c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27146) * 2f7d301efba608404032a246c8204b2ce62b8a25 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27160) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17560: [FLINK-22315][table] Support ADD column/constraint/watermark for ALTER TABLE statement.
flinkbot edited a comment on pull request #17560: URL: https://github.com/apache/flink/pull/17560#issuecomment-951002521 ## CI report: * 6207c0492807434173487d39e7f2f53b1a60d50c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27146) * 2f7d301efba608404032a246c8204b2ce62b8a25 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-15202) Increment metric when Interval Join record is late
[ https://issues.apache.org/jira/browse/FLINK-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449721#comment-17449721 ] Shen Zhu commented on FLINK-15202: -- Hey [~klion26] , I'm interested in working on this ticket, would you mind assigning it to me? By the way, what names do you think we should use for interval join late events, something like *numLateRecordsDropped1* and ** *numLateRecordsDropped2?* > Increment metric when Interval Join record is late > -- > > Key: FLINK-15202 > URL: https://issues.apache.org/jira/browse/FLINK-15202 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Reporter: Chris Gillespie >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > > Currently an interval join will silently drop late records. I think it would > be quite useful to have the metric *numLateRecordsDropped* incremented when > this happens. Window Join already does this, so it would make sense to have > it happen for both types of joins. > Mailing List Idea: > [https://lists.apache.org/thread.html/f463d81db3777a529d1764723189a57c33d601a6c142441fb5036ff9%40%3Cuser.flink.apache.org%3E] > Window Join: > > [https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java#L424] > Interval Join: > [https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/co/IntervalJoinOperator.java#L222] -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] Ivan0626 commented on pull request #14344: [docs] fix typos in Basic Concepts documentation
Ivan0626 commented on pull request #14344: URL: https://github.com/apache/flink/pull/14344#issuecomment-980491559 fix typos -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-25082) RMQSource is not parallel
[
https://issues.apache.org/jira/browse/FLINK-25082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mike Lynch updated FLINK-25082:
---
Description:
The official
[documentation|https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/rabbitmq/]
states that {{RMQSource}} can have at-least-once processing when "when
checkpointing is enabled, but correlation ids are not used or the source is
parallel." However, as {{RMQSource}} does not implement
{{{}ParallelSourceFunction{}}}, {{StreamExecutionEnvironment}} will throw an
exception whenever parallelism is set to a value higher than 1.
Either the documentation should be corrected or {{RMQSource}} should implement
{{{}ParallelSourceFunction{}}}.
Implementing it seems like it should be fairly easy and I'd be willing to
submit a patch, but as I'm new to the Flink code base I'm not sure if there
would be unexpected side effects. If I can get feedback from more experienced
contributors, I'll submit a patch in the near future.
was:
The official
[documentation|https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/rabbitmq/]
states that{{ RMQSource}} can have at-least-once processing when "when
checkpointing is enabled, but correlation ids are not used or the source is
parallel." However, as {{RMQSource}} does not implement
{{{}ParallelSourceFunction{}}}, {{StreamExecutionEnvironment}} will throw an
exception whenever parallelism is set to a value higher than 1.
Either the documentation should be corrected or {{RMQSource}} should implement
{{{}ParallelSourceFunction{}}}.
Implementing it seems like it should be fairly easy and I'd be willing to
submit a patch, but as I'm new to the Flink code base I'm not sure if there
would be unexpected side effects. If I can get feedback from more experienced
contributors, I'll submit a patch in the near future.
> RMQSource is not parallel
> -
>
> Key: FLINK-25082
> URL: https://issues.apache.org/jira/browse/FLINK-25082
> Project: Flink
> Issue Type: Bug
> Components: Connectors/ RabbitMQ
>Reporter: Mike Lynch
>Priority: Minor
>
> The official
> [documentation|https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/rabbitmq/]
> states that {{RMQSource}} can have at-least-once processing when "when
> checkpointing is enabled, but correlation ids are not used or the source is
> parallel." However, as {{RMQSource}} does not implement
> {{{}ParallelSourceFunction{}}}, {{StreamExecutionEnvironment}} will throw an
> exception whenever parallelism is set to a value higher than 1.
> Either the documentation should be corrected or {{RMQSource}} should
> implement {{{}ParallelSourceFunction{}}}.
> Implementing it seems like it should be fairly easy and I'd be willing to
> submit a patch, but as I'm new to the Flink code base I'm not sure if there
> would be unexpected side effects. If I can get feedback from more experienced
> contributors, I'll submit a patch in the near future.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Created] (FLINK-25082) RMQSource is not parallel
Mike Lynch created FLINK-25082:
--
Summary: RMQSource is not parallel
Key: FLINK-25082
URL: https://issues.apache.org/jira/browse/FLINK-25082
Project: Flink
Issue Type: Bug
Components: Connectors/ RabbitMQ
Reporter: Mike Lynch
The official
[documentation|https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/rabbitmq/]
states that{{ RMQSource}} can have at-least-once processing when "when
checkpointing is enabled, but correlation ids are not used or the source is
parallel." However, as {{RMQSource}} does not implement
{{{}ParallelSourceFunction{}}}, {{StreamExecutionEnvironment}} will throw an
exception whenever parallelism is set to a value higher than 1.
Either the documentation should be corrected or {{RMQSource}} should implement
{{{}ParallelSourceFunction{}}}.
Implementing it seems like it should be fairly easy and I'd be willing to
submit a patch, but as I'm new to the Flink code base I'm not sure if there
would be unexpected side effects. If I can get feedback from more experienced
contributors, I'll submit a patch in the near future.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (FLINK-24466) Interval Join late events handling behaviour is not consistent
[
https://issues.apache.org/jira/browse/FLINK-24466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449708#comment-17449708
]
Shen Zhu commented on FLINK-24466:
--
Hey [~slinkydeveloper] , thanks for writing the patch, it's very useful!
However, I have a question about filtering late events in
{*}KeyedCoProcessOperatorWithWatermarkDelayAndFilterLateEvents{*}, based on the
tests in {*}RowTimeIntervalJoinTest{*}, seems the late events will be cached
{code:java}
testHarness.processWatermark1(new Watermark(1));
testHarness.processWatermark2(new Watermark(1));
// Test late data.
testHarness.processElement1(insertRecord(1L, "k1"));
// Though (1L, "k1") is actually late, it will also be cached.
assertEquals(1, testHarness.numEventTimeTimers());
{code}
And if we filter the events in
{*}KeyedCoProcessOperatorWithWatermarkDelayAndFilterLateEvents{*}, those events
wouldn't be part of the join process, which will cause the following test cast
to fail
{code:java}
List expectedOutput = new ArrayList<>();
expectedOutput.add(new Watermark(-19));
// This result is produced by the late row (1, "k1").
expectedOutput.add(insertRecord(1L, "k1", 2L, "k1"));
expectedOutput.add(insertRecord(2L, "k1", 2L, "k1"));
expectedOutput.add(insertRecord(5L, "k1", 2L, "k1"));
expectedOutput.add(insertRecord(5L, "k1", 15L, "k1"));
expectedOutput.add(new Watermark(0));
expectedOutput.add(insertRecord(35L, "k1", 15L, "k1"));
expectedOutput.add(new Watermark(18));
expectedOutput.add(insertRecord(40L, "k2", 39L, "k2"));
expectedOutput.add(new Watermark(41));{code}
Do you think we would update the path to respect such behavior?
Best,
Shen Zhu
> Interval Join late events handling behaviour is not consistent
> --
>
> Key: FLINK-24466
> URL: https://issues.apache.org/jira/browse/FLINK-24466
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
>Reporter: Francesco Guardiani
>Priority: Major
> Attachments: Fix_late_events_filtering_for_interval_join.patch
>
>
> Interval Join handles late events emitting them in the output, as a padded
> row. This behavior is also tested extensively in {{RowTimeIntervalJoinTest}}.
> The problem with this behavior is the way an event is considered "late" or
> not: in order to distinguish between the two, {{RowTimeIntervalJoin}} uses
> the {{ctx.timerService().currentWatermark()}} to find out if an event is
> later than the last received watermark or not. But that method returns the
> "combined" watermark across all the keys, partitions and *input streams*,
> that is if one of the two streams goes "slower" than the other one, the
> returned watermark is going to be the minimum among the two.
> This means that our late events handling effectively works only if the two
> streams run "at the same pace", otherwise we'll just see what we consider
> _late events_ for one of the two streams as joined.
> To observe this behavior, just run the test
> {{IntervalJoinITCase#testRowTimeInnerJoinWithEquiTimeAttrs}} in this revision
> https://github.com/apache/flink/commit/7033cbfe404bea1519d3342a611e2f92768d70f9
> several times and you'll see that after a couple of runs it fails, joining
> one of the {{"should-be-discarded"}} records. Those records are way behind
> the watermark - 1 second, as defined.
> You'll find attached in the issue a small patch to show how this could be
> fixed.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-19158) Revisit java e2e download timeouts
[
https://issues.apache.org/jira/browse/FLINK-19158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-19158:
---
Labels: auto-deprioritized-major pull-request-available stale-minor
test-stability (was: auto-deprioritized-major pull-request-available
test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> Revisit java e2e download timeouts
> --
>
> Key: FLINK-19158
> URL: https://issues.apache.org/jira/browse/FLINK-19158
> Project: Flink
> Issue Type: Improvement
> Components: Build System
>Affects Versions: 1.12.0
>Reporter: Robert Metzger
>Priority: Minor
> Labels: auto-deprioritized-major, pull-request-available,
> stale-minor, test-stability
>
> Consider this failed test case
> {code}
> Test testHBase(org.apache.flink.tests.util.hbase.SQLClientHBaseITCase) is
> running.
>
> 09:38:38,719 [main] INFO
> org.apache.flink.tests.util.cache.PersistingDownloadCache[] - Downloading
> https://archive.apache.org/dist/hbase/1.4.3/hbase-1.4.3-bin.tar.gz.
> 09:40:38,732 [main] ERROR
> org.apache.flink.tests.util.hbase.SQLClientHBaseITCase [] -
>
> Test testHBase(org.apache.flink.tests.util.hbase.SQLClientHBaseITCase) failed
> with:
> java.io.IOException: Process ([wget, -q, -P,
> /home/vsts/work/1/e2e_cache/downloads/1598516010,
> https://archive.apache.org/dist/hbase/1.4.3/hbase-1.4.3-bin.tar.gz]) exceeded
> timeout (12) or number of retries (3).
> at
> org.apache.flink.tests.util.AutoClosableProcess$AutoClosableProcessBuilder.runBlockingWithRetry(AutoClosableProcess.java:148)
> at
> org.apache.flink.tests.util.cache.AbstractDownloadCache.getOrDownload(AbstractDownloadCache.java:127)
> at
> org.apache.flink.tests.util.cache.PersistingDownloadCache.getOrDownload(PersistingDownloadCache.java:36)
> at
> org.apache.flink.tests.util.hbase.LocalStandaloneHBaseResource.setupHBaseDist(LocalStandaloneHBaseResource.java:76)
> at
> org.apache.flink.tests.util.hbase.LocalStandaloneHBaseResource.before(LocalStandaloneHBaseResource.java:70)
> at
> org.apache.flink.util.ExternalResource$1.evaluate(ExternalResource.java:46)
> {code}
> It seems that the download has not been retried. The download might be stuck?
> I would propose to set a timeout per try and increase the total time from 2
> to 5 minutes.
> This example is from:
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=6267=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=ff888d9b-cd34-53cc-d90f-3e446d355529
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-12090) Can the log on the Apache Flink Dashboard be partitioned by day?
[ https://issues.apache.org/jira/browse/FLINK-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-12090: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Can the log on the Apache Flink Dashboard be partitioned by day? > > > Key: FLINK-12090 > URL: https://issues.apache.org/jira/browse/FLINK-12090 > Project: Flink > Issue Type: Improvement > Components: Runtime / Web Frontend >Affects Versions: 1.7.2 >Reporter: 彭洋 >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > > The flink job is always executed by the real-time task, so its taskmanager > log and jobmanager log will be larger and larger. It will be very > inconvenient to view on the flink webui. The loading is very slow, and the > log can be partitioned according to the day. Or you can set the maximum > retention time of the log, only keep the logs of the last few days, so it is > more convenient to view the log, and there is another point, can you output > gc information to the log? -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-20983) FlinkKafkaProducerITCase.testMigrateFromAtExactlyOnceToAtLeastOnce failed with Timeout expired after 60000milliseconds while awaiting InitProducerId
[
https://issues.apache.org/jira/browse/FLINK-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-20983:
---
Labels: auto-deprioritized-major stale-minor (was:
auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> FlinkKafkaProducerITCase.testMigrateFromAtExactlyOnceToAtLeastOnce failed
> with Timeout expired after 6milliseconds while awaiting InitProducerId
>
>
> Key: FLINK-20983
> URL: https://issues.apache.org/jira/browse/FLINK-20983
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.12.0
>Reporter: Leonard Xu
>Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
>
>
> {code:java}
> 11:56:18,264 [main] INFO
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase[] -
> -
> 11:56:18,264 [main] INFO
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase[] - Shut
> down KafkaTestBase
> 11:56:18,264 [main] INFO
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase[] -
> -
> 11:56:41,367 [main] INFO
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase[] -
> -
> 11:56:41,367 [main] INFO
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase[] -
> KafkaTestBase finished
> 11:56:41,367 [main] INFO
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase[] -
> -
> [ERROR] Tests run: 12, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 266.877 s <<< FAILURE! - in
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase
> [ERROR]
> testMigrateFromAtExactlyOnceToAtLeastOnce(org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase)
> Time elapsed: 60.797 s <<< ERROR!
> org.apache.kafka.common.errors.TimeoutException:
> org.apache.kafka.common.errors.TimeoutException: Timeout expired after
> 6milliseconds while awaiting InitProducerId
> Caused by: org.apache.kafka.common.errors.TimeoutException: Timeout expired
> after 6milliseconds while awaiting InitProducerId
> {code}
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=12046=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5]
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-17969) Enhance Flink (Task) logging to include job name as context diagnostic information
[
https://issues.apache.org/jira/browse/FLINK-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-17969:
---
Labels: pull-request-available stale-minor (was: pull-request-available)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> Enhance Flink (Task) logging to include job name as context diagnostic
> information
> --
>
> Key: FLINK-17969
> URL: https://issues.apache.org/jira/browse/FLINK-17969
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Task
>Affects Versions: 1.10.0
>Reporter: Bhagavan
>Priority: Minor
> Labels: pull-request-available, stale-minor
>
> Problem statement:
> We use a shared session cluster (Standalone/Yarn) to execute jobs. All logs
> from the cluster are shipped using log aggregation framework
> (Logstash/Splunk) so that application diagnostic is easier.
> However, we are missing one vital information in the logline. i.e. Job name
> so that we can filter the logs for a single job.
> Background
> Currently, Flink logging uses SLF4J as API to abstract away from concrete
> logging implementation (log4j 1.x, Logback or log4j2) and configuration of
> logging pattern and implementation can be configured at deployment, However,
> there is no MDC info from framework indicating job context.
> Proposed improvement.
> Add jobName field to Task class so that we can add it as MDC when task thread
> starts executing.
> Change is trivial and uses SLF4J MDC API.
> With this change, user can customise logging pattern to include MDC (e.g. in
> Logback %X{jobName} )
> Change required.
> {code:java}
> @@ -319,6 +323,7 @@ public class Task implements Runnable, TaskSlotPayload,
> TaskActions, PartitionPr
>
> this.jobId = jobInformation.getJobId();
> + this.jobName = jobInformation.getJobName();
> this.vertexId = taskInformation.getJobVertexId();
> @@ -530,8 +535,10 @@ public class Task implements Runnable, TaskSlotPayload,
> TaskActions, PartitionPr
> @Override
> public void run() {
> try {
> + MDC.put("jobName", this.jobName);
> doRun();
> } finally {
> + MDC.remove("jobName");
> terminationFuture.complete(executionState);
> }
> }
> {code}
> if we are in agreement for this small change. Will raise PR.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-17110) Make StreamExecutionEnvironment#configure also affects StreamExecutionEnvironment#configuration
[ https://issues.apache.org/jira/browse/FLINK-17110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-17110: --- Labels: auto-deprioritized-major pull-request-available stale-minor (was: auto-deprioritized-major pull-request-available) I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Minor but is unassigned and neither itself nor its Sub-Tasks have been updated for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is still Minor, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized. > Make StreamExecutionEnvironment#configure also affects > StreamExecutionEnvironment#configuration > --- > > Key: FLINK-17110 > URL: https://issues.apache.org/jira/browse/FLINK-17110 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Reporter: Wenlong Lyu >Priority: Minor > Labels: auto-deprioritized-major, pull-request-available, > stale-minor > > If StreamExecutionEnvironment#configure can also affect the configuration in > StreamExecutionEnvironment, we can easily not only add some library jars or > classpaths dynamically according to the job we want to run which is quite > important for a platform product, but also optimize some runtime > configuration in program. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-21282) Support UPDATE for flink sql
[
https://issues.apache.org/jira/browse/FLINK-21282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21282:
---
Labels: auto-deprioritized-major stale-minor (was:
auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> Support UPDATE for flink sql
> -
>
> Key: FLINK-21282
> URL: https://issues.apache.org/jira/browse/FLINK-21282
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / API, Table SQL / Client
>Affects Versions: 1.12.1
>Reporter: Jun Zhang
>Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
>
> Support UPDATE for flink sql,the syntax like this:
> {code:java}
> UPDATE tablename SET column = value [, column = value ...] [WHERE expression]
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-9382) Inconsistent file storage behavior in FileCache
[
https://issues.apache.org/jira/browse/FLINK-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-9382:
--
Labels: auto-deprioritized-major stale-minor (was:
auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> Inconsistent file storage behavior in FileCache
> ---
>
> Key: FLINK-9382
> URL: https://issues.apache.org/jira/browse/FLINK-9382
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Task
>Affects Versions: 1.6.0
>Reporter: Chesnay Schepler
>Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
>
> The file storage behavior in the {{FileCache}} is inconsistent and depends
> whether we're accessing a file or zipped folder.
> In case of a file we return the file returned from the
> {{PermanentBlobService}} as is, in this case the blobserver takes care of
> deleting the file _at some point_.
> In case of a directory (that is implicitly zipped!) we extract the zip into a
> separate storage directory and delete the zip afterwards (the deletion in
> particular is questionable as it interferes with the blob server).
> The underlying issue to me is that the responsibilities between the
> {{PermanentBlobService}} and {{FileCache}} aren't clearly laid out, and they
> actually seem a bit redundant.
> We may want to change the FIleCache to be a thin wrapper around the
> {{PermanentBlobService}} that only takes care of unzipping directories and
> setting executable flags.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-9268) RockDB errors from WindowOperator
[
https://issues.apache.org/jira/browse/FLINK-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-9268:
--
Labels: auto-deprioritized-major stale-minor (was:
auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> RockDB errors from WindowOperator
> -
>
> Key: FLINK-9268
> URL: https://issues.apache.org/jira/browse/FLINK-9268
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream, Runtime / State Backends
>Affects Versions: 1.4.2
>Reporter: Narayanan Arunachalam
>Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
>
> The job has no sinks, one Kafka source, does a windowing based on session and
> uses processing time. The job fails with the error given below after running
> for few hours. The only way to recover from this error is to cancel the job
> and start a new one.
> Using S3 backend for externalized checkpoints.
> A representative job DAG:
> val streams = sEnv
> .addSource(makeKafkaSource(config))
> .map(makeEvent)
> .keyBy(_.get(EVENT_GROUP_ID))
> .window(ProcessingTimeSessionWindows.withGap(Time.seconds(60)))
> .trigger(PurgingTrigger.of(ProcessingTimeTrigger.create()))
> .apply(makeEventsList)
> .addSink(makeNoOpSink)
> A representative config:
> state.backend=rocksDB
> checkpoint.enabled=true
> external.checkpoint.enabled=true
> checkpoint.mode=AT_LEAST_ONCE
> checkpoint.interval=90
> checkpoint.timeout=30
> Error:
> TimerException\{java.lang.NegativeArraySizeException}
> at
> org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService$TriggerTask.run(SystemProcessingTimeService.java:252)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.NegativeArraySizeException
> at org.rocksdb.RocksDB.get(Native Method)
> at org.rocksdb.RocksDB.get(RocksDB.java:810)
> at
> org.apache.flink.contrib.streaming.state.RocksDBListState.get(RocksDBListState.java:86)
> at
> org.apache.flink.contrib.streaming.state.RocksDBListState.get(RocksDBListState.java:49)
> at
> org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.onProcessingTime(WindowOperator.java:496)
> at
> org.apache.flink.streaming.api.operators.HeapInternalTimerService.onProcessingTime(HeapInternalTimerService.java:255)
> at
> org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService$TriggerTask.run(SystemProcessingTimeService.java:249)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-21015) Wait for checkpoint cleanup completion during shutdown
[
https://issues.apache.org/jira/browse/FLINK-21015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21015:
---
Labels: auto-deprioritized-major stale-minor (was:
auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> Wait for checkpoint cleanup completion during shutdown
> --
>
> Key: FLINK-21015
> URL: https://issues.apache.org/jira/browse/FLINK-21015
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Checkpointing
>Affects Versions: 1.13.0
>Reporter: Roman Khachatryan
>Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
>
> From the
> [discussion|https://issues.apache.org/jira/browse/FLINK-20992?focusedCommentId=17267188=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17267188]
> in FLINK-20992
>
> {quote}Additionally, I found that during the shutting down we don't wait for
> checkpoint cleanup to complete (or any other tasks submitted to executors):
> {code:java}
> checkpointCoordinatorTimer.shutdownNow() // in ExecutionGraph
> scheduledExecutorService.shutdownNow(); // in JobManagerSharedServices
> {code}
> So only currently executing actions will complete, but not any queued.
> I think we SHOULD complete cleanup on shutdown and propose the following:
> # Replace shutdownNow with shutdown to allow cleanup to finish
> # Add awaitTermination (with timeout)
> # At least log the result of shutdownNow (list of runnables)
> {quote}
>
> [~trohrmann]
> {quote}I think you are also right that we currently don't wait for the
> checkpoint cleanup to complete. I think the component responsible for the
> clean up tasks should make sure that they are completed before shutting down
> or hand them over to a new owner who is responsible for them. Hence, if the
> {{CheckpointCoordinator}} is responsible, then the
> {{CheckpointCoordinator.shutdown}} method should make sure that all
> checkpoints are cleaned up. Alternatively, {{CheckpointCoordinator.shutdown}}
> could return a {{CompletableFuture}} which is completed once everything is
> cleaned up. Consequently, I wouldn't make it the responsibility of the
> exeuctors to make sure that all checkpoints are properly cleaned up by
> waiting on the completion of all enqueued tasks.
> {quote}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-12172) Flink fails to close pending BucketingSink
[ https://issues.apache.org/jira/browse/FLINK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-12172: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Flink fails to close pending BucketingSink > -- > > Key: FLINK-12172 > URL: https://issues.apache.org/jira/browse/FLINK-12172 > Project: Flink > Issue Type: Bug > Components: Connectors / FileSystem >Affects Versions: 1.7.2 >Reporter: Mario Georgiev >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > > Hello, > The problem is if you have a BucketingSink, the following case may occur : > Let's say you have a 2019-04-12–12 bucket created with several files inside > which are pending/finished > You create a savepoint and shut down the job > After an hour for instance you start the job from the savepoint and a new > bucket is created, 2019-04-16 for instance. > The problem is that the .pending ones from the old buckets seem to never be > moved to finished state if there is a new hourly bucket created. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-12118) Documentation in left navigation is not in step with its content
[ https://issues.apache.org/jira/browse/FLINK-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-12118: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Documentation in left navigation is not in step with its content > > > Key: FLINK-12118 > URL: https://issues.apache.org/jira/browse/FLINK-12118 > Project: Flink > Issue Type: Bug > Components: Documentation >Reporter: Yu Haidong >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > Attachments: 图片 11.png, 图片 12.png > > > Hi Team: > A little bug I think. > The content in offical website documentation of left navigation is : > "1.8(snapshot)", > but when you click it, you will see : > "1.9-SNAPSHOT" > in the content, maybe it is a little bug. > Thank you! > > Haidong > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-12173) Optimize "SELECT DISTINCT" into Deduplicate with keep first row
[
https://issues.apache.org/jira/browse/FLINK-12173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-12173:
---
Labels: auto-deprioritized-major auto-deprioritized-minor (was:
auto-deprioritized-major stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Optimize "SELECT DISTINCT" into Deduplicate with keep first row
> ---
>
> Key: FLINK-12173
> URL: https://issues.apache.org/jira/browse/FLINK-12173
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / Planner
>Reporter: Jark Wu
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> The following distinct query can be optimized into deduplicate on keys "a, b,
> c, d" and keep the first row.
> {code:sql}
> SELECT DISTINCT a, b, c, d;
> {code}
> We can optimize this query into Deduplicate to get a better performance than
> GroupAggregate.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-21060) Could not create the DispatcherResourceManagerComponent
[ https://issues.apache.org/jira/browse/FLINK-21060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-21060: --- Labels: auto-deprioritized-major stale-minor (was: auto-deprioritized-major) I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Minor but is unassigned and neither itself nor its Sub-Tasks have been updated for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is still Minor, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized. > Could not create the DispatcherResourceManagerComponent > --- > > Key: FLINK-21060 > URL: https://issues.apache.org/jira/browse/FLINK-21060 > Project: Flink > Issue Type: Bug > Components: Runtime / Task, Table SQL / Ecosystem >Affects Versions: 1.12.0 > Environment: flink: 1.12.0 > hive: 3.1.2 >Reporter: Spongebob >Priority: Minor > Labels: auto-deprioritized-major, stale-minor > Attachments: yarn.log, yarn_with_detached_mode.log > > > I set multi sink to hive table in flink application then deploy it on yarn, > if I run with detached mode, the application can run successful but sink > nothing. And if I run without detached mode, the application would throw this > exception: Could not create the DispatcherResourceManagerComponent. > Attachment is the log of this application run without detached mode. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-12093) Apache Flink:Active MQ consumer job is getting finished after first message consume.
[
https://issues.apache.org/jira/browse/FLINK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-12093:
---
Labels: auto-deprioritized-major auto-deprioritized-minor (was:
auto-deprioritized-major stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Apache Flink:Active MQ consumer job is getting finished after first message
> consume.
>
>
> Key: FLINK-12093
> URL: https://issues.apache.org/jira/browse/FLINK-12093
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
>Affects Versions: 1.7.2
> Environment: Working in my local IDE(Eclipse).
>Reporter: shiv kumar
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Hi Team,
>
> Below is my the code the the execution environment to run the Apache Flink
> job that's consume message from ActiveMQ topic::
>
> StreamExecutionEnvironment env = createExecutionEnvironment();
> connectionFactory = new ActiveMQConnectionFactory("**", "**.",
> "failover:(tcp://amq-master-01:61668)?timeout=3000");
> LOG.info("exceptionListener{}", new AMQExceptionListLocal(LOG, true));
> RunningChecker runningChecker = new RunningChecker();
> runningChecker.setIsRunning(true);
> AMQSourceConfig config = new
> AMQSourceConfig.AMQSourceConfigBuilder()
> .setConnectionFactory(connectionFactory).setDestinationName("test_flink")
>
> .setDeserializationSchema(deserializationSchema).setRunningChecker(runningChecker)
> .setDestinationType(DestinationType.TOPIC).build();
> amqSource = new AMQSourceLocal<>(config);
> LOG.info("Check whether ctx is null ::{}", amqSource);
> DataStream dataMessage = env.addSource(amqSource);
> dataMessage.writeAsText("C:/Users/shivkumar/Desktop/flinksjar/output.txt",
> WriteMode.OVERWRITE);
> System.out.println("Step 1");
> env.execute("Check ACTIVE_MQ");
>
> When we are starting the job, Topic is getting created and message is getting
> dequeued from that topic.
> But After that is getting finished. What Can be done to keep the job running?
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-9396) Allow streaming sources (especially Files, Kafka) to set max queued input elements
[ https://issues.apache.org/jira/browse/FLINK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-9396: -- Labels: auto-deprioritized-major stale-minor (was: auto-deprioritized-major) I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Minor but is unassigned and neither itself nor its Sub-Tasks have been updated for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is still Minor, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized. > Allow streaming sources (especially Files, Kafka) to set max queued input > elements > -- > > Key: FLINK-9396 > URL: https://issues.apache.org/jira/browse/FLINK-9396 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Reporter: Josh Lemer >Priority: Minor > Labels: auto-deprioritized-major, stale-minor > > In some applications, there can be situations where a file source queues up > so many files, that when it is time for a checkpoint to start, the checkpoint > takes way too long. It would be nice if we could limit the total queued files > to read to some number, to place an upper bound on how long checkpoints take. > See > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Fwd-Decrease-initial-source-read-speed-td20207.html > for previous questions about this. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-21281) Support DELETE FROM for flink sql
[
https://issues.apache.org/jira/browse/FLINK-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-21281:
---
Labels: auto-deprioritized-major stale-minor (was:
auto-deprioritized-major)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is
still Minor, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> Support DELETE FROM for flink sql
> --
>
> Key: FLINK-21281
> URL: https://issues.apache.org/jira/browse/FLINK-21281
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / API, Table SQL / Client
>Affects Versions: 1.12.1
>Reporter: Jun Zhang
>Priority: Minor
> Labels: auto-deprioritized-major, stale-minor
>
> Support DELETE FROM for flink sql,the syntax like this:
> {code:java}
> DELETE FROM tablename [WHERE expression]
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-12243) Support generic table stats related operations in HiveCatalog
[ https://issues.apache.org/jira/browse/FLINK-12243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-12243: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Support generic table stats related operations in HiveCatalog > - > > Key: FLINK-12243 > URL: https://issues.apache.org/jira/browse/FLINK-12243 > Project: Flink > Issue Type: Improvement > Components: Connectors / Hive >Reporter: Bowen Li >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > > Support table stats related operations in GenericHiveMetastoreCatalog, which > implements ReadableWritableCatalog API -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-16686) [State TTL] Make user class loader available in native RocksDB compaction thread
[ https://issues.apache.org/jira/browse/FLINK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-16686: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > [State TTL] Make user class loader available in native RocksDB compaction > thread > > > Key: FLINK-16686 > URL: https://issues.apache.org/jira/browse/FLINK-16686 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends >Affects Versions: 1.8.0, 1.11.3, 1.13.0, 1.12.3 >Reporter: Andrey Zagrebin >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > > The issue is initially reported > [here|https://stackoverflow.com/questions/60745711/flink-kryo-serializer-because-chill-serializer-couldnt-be-found]. > The problem is that the java code of Flink compaction filter is called from > RocksDB native C++ code. It is called in the context of the native compaction > thread. RocksDB has utilities to create java Thread context for the Flink > java callback. Presumably, the Java thread context class loader is not set at > all and if it is queried then it produces NullPointerException. > The provided report enabled a list state with TTL. The compaction filter has > to deserialise elements to check expiration. The deserialiser relies on Kryo > which queries the thread context class loader which is expected to be the > user class loader of the task but turns out to be null. > We should investigate how to pass the user class loader to the compaction > thread of the list state with TTL. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-20094) Make JobMaster.jobStatusChanged directly called by JobManagerJobStatusListener
[
https://issues.apache.org/jira/browse/FLINK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-20094:
---
Labels: auto-deprioritized-major auto-deprioritized-minor (was:
auto-deprioritized-major stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> Make JobMaster.jobStatusChanged directly called by JobManagerJobStatusListener
> --
>
> Key: FLINK-20094
> URL: https://issues.apache.org/jira/browse/FLINK-20094
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Coordination
>Affects Versions: 1.12.0
>Reporter: Till Rohrmann
>Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Since the {{ExecutionGraph}} is only modified by the main thread, we no
> longer need to splice the {{JobManagerJobStatusListener}} callbacks back into
> the {{JobMaster's}} main thread using {{runAsync}}. Instead it should be
> possible to directly call {{JobMaster.jobStatusChanged}}.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-12186) Add implementation of FLIP-23 - Model Serving
[ https://issues.apache.org/jira/browse/FLINK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-12186: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Add implementation of FLIP-23 - Model Serving > - > > Key: FLINK-12186 > URL: https://issues.apache.org/jira/browse/FLINK-12186 > Project: Flink > Issue Type: New Feature > Components: Library / Machine Learning >Affects Versions: 1.9.0 > Environment: Any >Reporter: Boris Lublinsky >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > > This is code implementing Flip 23 > The code is > [https://github.com/apache/flink/tree/65ce66eff9248817af0d900d101432341de00ab3/flink-modelserving] > and > [https://github.com/apache/flink/tree/65ce66eff9248817af0d900d101432341de00ab3/flink-examples/flink-examples-modelserving] > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-12294) Kafka connector, work with grouping partitions
[ https://issues.apache.org/jira/browse/FLINK-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-12294: --- Labels: auto-deprioritized-major auto-deprioritized-minor performance (was: auto-deprioritized-major performance stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Kafka connector, work with grouping partitions > -- > > Key: FLINK-12294 > URL: https://issues.apache.org/jira/browse/FLINK-12294 > Project: Flink > Issue Type: New Feature > Components: API / DataStream, Connectors / Kafka, Runtime / Task >Reporter: Sergey >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor, > performance > Attachments: KeyGroupAssigner.java, KeyGroupRangeAssignment.java > > > Additional flag (with default false value) controlling whether topic > partitions already grouped by the key. Exclude unnecessary shuffle/resorting > operation when this parameter set to true. As an example, say we have > client's payment transaction in a kafka topic. We grouping by clientId > (transaction with the same clientId goes to one kafka topic partition) and > the task is to find max transaction per client in sliding windows. In terms > of map\reduce there is no needs to shuffle data between all topic consumers, > may be it`s worth to do within each consumer to gain some speedup due to > increasing number of executors within each partition data. With N messages > (in partition) instead of N*ln(N) (current realization with > shuffle/resorting) it will be just N operations. For windows with thousands > events - the tenfold gain of execution speed. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27155) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (FLINK-24573) ZooKeeperJobGraphsStoreITCase crashes JVM
[
https://issues.apache.org/jira/browse/FLINK-24573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449678#comment-17449678
]
Matthias edited comment on FLINK-24573 at 11/26/21, 10:23 PM:
--
We experienced the same odd behavior on our Flink fork pointing to
{{{}release-1.14{}}}. It happened in the test phase, though. ...in contrast to
the integration tests in the ticket's description. I've attached the logs of
the failed build.
No specific test failure is listed even though the error logs at the end state
that there are test failures. That makes me think that the issue is not
connected to {{ZooKeeperJobGraphsStoreITCase}}
was (Author: mapohl):
We experienced the same odd behavior on our Flink fork pointing to
{{{}release-1.14{}}}. It happened in the test phase, though. ...in contrast to
the integration tests in the ticket's description. I've attached the logs of
the failed build.
No specific test failure is listed even though the error logs at the end state
that there are test failures.
> ZooKeeperJobGraphsStoreITCase crashes JVM
> -
>
> Key: FLINK-24573
> URL: https://issues.apache.org/jira/browse/FLINK-24573
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
>Affects Versions: 1.14.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: test-stability
> Attachments: logs-ci_build-test_ci_build_core-1637952435.zip
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25123=logs=a549b384-c55a-52c0-c451-00e0477ab6db=eef5922c-08d9-5ba3-7299-8393476594e7=8375
> {code}
> Oct 17 00:15:16 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-runtime: There are test failures.
> Oct 17 00:15:16 [ERROR]
> Oct 17 00:15:16 [ERROR] Please refer to
> /__w/1/s/flink-runtime/target/surefire-reports for the individual test
> results.
> Oct 17 00:15:16 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Oct 17 00:15:16 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Oct 17 00:15:16 [ERROR] at
>
[jira] [Comment Edited] (FLINK-24573) ZooKeeperJobGraphsStoreITCase crashes JVM
[
https://issues.apache.org/jira/browse/FLINK-24573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449678#comment-17449678
]
Matthias edited comment on FLINK-24573 at 11/26/21, 10:20 PM:
--
We experienced the same odd behavior on our Flink fork pointing to
{{{}release-1.14{}}}. It happened in the test phase, though. ...in contrast to
the integration tests in the ticket's description. I've attached the logs of
the failed build.
No specific test failure is listed even though the error logs at the end state
that there are test failures.
was (Author: mapohl):
We experienced the same odd behavior on our Flink fork pointing to
{{{}release-1.14{}}}. It happened in the test phase, though. ...in contrast to
the integration tests in the ticket's description. I've attached the logs of
the failed build.
> ZooKeeperJobGraphsStoreITCase crashes JVM
> -
>
> Key: FLINK-24573
> URL: https://issues.apache.org/jira/browse/FLINK-24573
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
>Affects Versions: 1.14.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: test-stability
> Attachments: logs-ci_build-test_ci_build_core-1637952435.zip
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25123=logs=a549b384-c55a-52c0-c451-00e0477ab6db=eef5922c-08d9-5ba3-7299-8393476594e7=8375
> {code}
> Oct 17 00:15:16 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-runtime: There are test failures.
> Oct 17 00:15:16 [ERROR]
> Oct 17 00:15:16 [ERROR] Please refer to
> /__w/1/s/flink-runtime/target/surefire-reports for the individual test
> results.
> Oct 17 00:15:16 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Oct 17 00:15:16 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Oct 17 00:15:16 [ERROR] at
>
[GitHub] [flink] flinkbot edited a comment on pull request #17919: [FLINK-24419][table-planner] Trim to precision when casting to BINARY/VARBINARY
flinkbot edited a comment on pull request #17919: URL: https://github.com/apache/flink/pull/17919#issuecomment-979659835 ## CI report: * 8e8aaa7df0ebae7ec45b9bc2e61ea8e55d9f45b8 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27154) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-24573) ZooKeeperJobGraphsStoreITCase crashes JVM
[
https://issues.apache.org/jira/browse/FLINK-24573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias updated FLINK-24573:
-
Attachment: logs-ci_build-test_ci_build_core-1637952435.zip
> ZooKeeperJobGraphsStoreITCase crashes JVM
> -
>
> Key: FLINK-24573
> URL: https://issues.apache.org/jira/browse/FLINK-24573
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
>Affects Versions: 1.14.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: test-stability
> Attachments: logs-ci_build-test_ci_build_core-1637952435.zip
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25123=logs=a549b384-c55a-52c0-c451-00e0477ab6db=eef5922c-08d9-5ba3-7299-8393476594e7=8375
> {code}
> Oct 17 00:15:16 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-runtime: There are test failures.
> Oct 17 00:15:16 [ERROR]
> Oct 17 00:15:16 [ERROR] Please refer to
> /__w/1/s/flink-runtime/target/surefire-reports for the individual test
> results.
> Oct 17 00:15:16 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Oct 17 00:15:16 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Oct 17 00:15:16 [ERROR] at
>
[jira] [Commented] (FLINK-24573) ZooKeeperJobGraphsStoreITCase crashes JVM
[
https://issues.apache.org/jira/browse/FLINK-24573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449678#comment-17449678
]
Matthias commented on FLINK-24573:
--
We experienced the same odd behavior on our Flink fork pointing to
{{{}release-1.14{}}}. It happened in the test phase, though. ...in contrast to
the integration tests in the ticket's description. I've attached the logs of
the failed build.
> ZooKeeperJobGraphsStoreITCase crashes JVM
> -
>
> Key: FLINK-24573
> URL: https://issues.apache.org/jira/browse/FLINK-24573
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
>Affects Versions: 1.14.0
>Reporter: Dawid Wysakowicz
>Priority: Major
> Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=25123=logs=a549b384-c55a-52c0-c451-00e0477ab6db=eef5922c-08d9-5ba3-7299-8393476594e7=8375
> {code}
> Oct 17 00:15:16 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-runtime: There are test failures.
> Oct 17 00:15:16 [ERROR]
> Oct 17 00:15:16 [ERROR] Please refer to
> /__w/1/s/flink-runtime/target/surefire-reports for the individual test
> results.
> Oct 17 00:15:16 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Oct 17 00:15:16 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Oct 17 00:15:16 [ERROR] Command was /bin/sh -c cd
> /__w/1/s/flink-runtime/target &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6284072213813812385.jar
> /__w/1/s/flink-runtime/target/surefire 2021-10-16T23-44-38_893-jvmRun2
> surefire134157100872108937tmp surefire_819867287453033687541tmp
> Oct 17 00:15:16 [ERROR] Error occurred in starting fork, check output in log
> Oct 17 00:15:16 [ERROR] Process Exit Code: 239
> Oct 17 00:15:16 [ERROR] Crashed tests:
> Oct 17 00:15:16 [ERROR]
> org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphsStoreITCase
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Oct 17 00:15:16 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Oct 17 00:15:16 [ERROR] at
>
[GitHub] [flink] XComp commented on a change in pull request #17928: [FLINK-25080] Moves unit tests into flink-core
XComp commented on a change in pull request #17928: URL: https://github.com/apache/flink/pull/17928#discussion_r757701025 ## File path: flink-test-utils-parent/flink-test-utils/pom.xml ## @@ -57,6 +57,14 @@ under the License. compile + + org.apache.flink + flink-core Review comment: Correct. There was a compilation error in `JMXJobManagerMetricTest` after moving `TestingUtils` into `flink-core`. Providing `flink-core` as an explicit dependency in `flink-test-utils` solved the issue. ## File path: flink-test-utils-parent/flink-test-utils/pom.xml ## @@ -57,6 +57,14 @@ under the License. compile + + org.apache.flink + flink-core Review comment: Correct. There was a compilation error in `JMXJobManagerMetricTest` after moving `TestingUtils` into `flink-core`. Providing `flink-core` as an explicit test dependency in `flink-test-utils` solved the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27155) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17345: [FLINK-24227][connectors/kinesis] Added Kinesis Data Streams Sink i…
flinkbot edited a comment on pull request #17345: URL: https://github.com/apache/flink/pull/17345#issuecomment-926109717 ## CI report: * a4a0c2567a2a4733ead4821a53db599f7f61ed1d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27152) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27155) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17919: [FLINK-24419][table-planner] Trim to precision when casting to BINARY/VARBINARY
flinkbot edited a comment on pull request #17919: URL: https://github.com/apache/flink/pull/17919#issuecomment-979659835 ## CI report: * 87fd0c5c53eab00390b5e49eb4a5f51663b00928 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27103) * 8e8aaa7df0ebae7ec45b9bc2e61ea8e55d9f45b8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27154) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17919: [FLINK-24419][table-planner] Trim to precision when casting to BINARY/VARBINARY
flinkbot edited a comment on pull request #17919: URL: https://github.com/apache/flink/pull/17919#issuecomment-979659835 ## CI report: * 87fd0c5c53eab00390b5e49eb4a5f51663b00928 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27103) * 8e8aaa7df0ebae7ec45b9bc2e61ea8e55d9f45b8 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] shenzhu commented on pull request #17919: [FLINK-24419][table-planner] Trim to precision when casting to BINARY/VARBINARY
shenzhu commented on pull request #17919: URL: https://github.com/apache/flink/pull/17919#issuecomment-980395218 > @shenzhu Could please adjust the title of your PR to: > > ``` > [FLINK-24419][table-planner] Trim to precision when casting to BINARY/VARBINARY > ``` > > ? Sure, just updated PR and commit message, thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] shenzhu commented on a change in pull request #17919: [FLINK-24419][table-planner] Trim to precision when casting to BINARY/VARBINARY
shenzhu commented on a change in pull request #17919:
URL: https://github.com/apache/flink/pull/17919#discussion_r757682218
##
File path:
flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/functions/casting/StringToBinaryCastRule.java
##
@@ -45,6 +52,28 @@ public String generateExpression(
String inputTerm,
LogicalType inputLogicalType,
LogicalType targetLogicalType) {
-return methodCall(inputTerm, "toBytes");
+int inputLength = Integer.MAX_VALUE;
+if (inputLogicalType instanceof CharType) {
+inputLength = ((CharType) inputLogicalType).getLength();
+} else if (inputLogicalType instanceof VarCharType) {
+inputLength = ((VarCharType) inputLogicalType).getLength();
+}
+
+int targetLength = Integer.MAX_VALUE;
+if (targetLogicalType instanceof BinaryType) {
+targetLength = ((BinaryType) targetLogicalType).getLength();
+} else if (targetLogicalType instanceof VarBinaryType) {
+targetLength = ((VarBinaryType) targetLogicalType).getLength();
+}
+targetLength = Math.min(targetLength, inputLength);
Review comment:
Hey @matriv , thanks for your review! I will update the code here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) * e90077b322d2826456b7fbf4ba6f2c0c22f4c137 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27153) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17598: [FLINK-24703][connectors][formats] Add CSV format support for filesystem based on StreamFormat and BulkWriter interfaces.
flinkbot edited a comment on pull request #17598: URL: https://github.com/apache/flink/pull/17598#issuecomment-954282485 ## CI report: * 12d370196fdbe6ff098e8c93512b90fb774aa5c6 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27098) * 50b889f3b887a3dafc99e8928f96c31b460b11a8 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17345: [FLINK-24227][connectors/kinesis] Added Kinesis Data Streams Sink i…
flinkbot edited a comment on pull request #17345: URL: https://github.com/apache/flink/pull/17345#issuecomment-926109717 ## CI report: * 81279df4656e9aa5055b7d9469dfa4dceee97014 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27119) * a4a0c2567a2a4733ead4821a53db599f7f61ed1d Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27152) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17345: [FLINK-24227][connectors/kinesis] Added Kinesis Data Streams Sink i…
flinkbot edited a comment on pull request #17345: URL: https://github.com/apache/flink/pull/17345#issuecomment-926109717 ## CI report: * 81279df4656e9aa5055b7d9469dfa4dceee97014 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27119) * a4a0c2567a2a4733ead4821a53db599f7f61ed1d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17932: [FLINK-25079][table-common] Add some initial assertj assertions for table data and types apis
flinkbot edited a comment on pull request #17932: URL: https://github.com/apache/flink/pull/17932#issuecomment-980084610 ## CI report: * 25b5f673226d428f7487b4d2161110049af0386a Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27142) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17931: [FLINK-25075] Refactor PlannerExpressionParser, removing the reflection to instantiate it
flinkbot edited a comment on pull request #17931: URL: https://github.com/apache/flink/pull/17931#issuecomment-980071064 ## CI report: * 64bad8b9969ee451ff7b5082c42d53f994aa1f8c Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27141) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17560: [FLINK-22315][table] Support ADD column/constraint/watermark for ALTER TABLE statement.
flinkbot edited a comment on pull request #17560: URL: https://github.com/apache/flink/pull/17560#issuecomment-951002521 ## CI report: * 6207c0492807434173487d39e7f2f53b1a60d50c Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27146) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] tillrohrmann merged pull request #17926: [FLINK-24789][BP-1.14][runtime] Trigger checkpoint disposal prior completing t…
tillrohrmann merged pull request #17926: URL: https://github.com/apache/flink/pull/17926 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Closed] (FLINK-24789) IllegalStateException with CheckpointCleaner being closed already
[
https://issues.apache.org/jira/browse/FLINK-24789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Till Rohrmann closed FLINK-24789.
-
Resolution: Fixed
Fixed via
1.15.0: e42890fc67f55702f8aa61e465a16b251d0bc87a
1.14.1: 0258419c66a696baf37b69ad29bb58ee5c62e912
> IllegalStateException with CheckpointCleaner being closed already
> -
>
> Key: FLINK-24789
> URL: https://issues.apache.org/jira/browse/FLINK-24789
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing, Runtime / Coordination
>Affects Versions: 1.14.0
>Reporter: Matthias
>Assignee: David Morávek
>Priority: Critical
> Labels: pull-request-available, test-stability
> Fix For: 1.15.0, 1.14.1
>
> Attachments:
> logs-ci_build-test_ci_build_finegrained_resource_management-1635785399.zip
>
>
> * We experienced a failure of {{OperatorCoordinatorSchedulerTest}} in our VVP
> Fork of Flink. The {{finegrained_resource_management}} test run failed with
> an non-0 exit code:
> {code}
> Nov 01 17:19:12 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (default-test) on
> project flink-runtime: There are test failures.
> Nov 01 17:19:12 [ERROR]
> Nov 01 17:19:12 [ERROR] Please refer to
> /__w/1/s/flink-runtime/target/surefire-reports for the individual test
> results.
> Nov 01 17:19:12 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Nov 01 17:19:12 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Nov 01 17:19:12 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-runtime &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6007815607334336440.jar
> /__w/1/s/flink-runtime/target/surefire 2021-11-01T16-51-51_363-jvmRun2
> surefire6448660128033443499tmp surefire_4131168043975619749001tmp
> Nov 01 17:19:12 [ERROR] Error occurred in starting fork, check output in log
> Nov 01 17:19:12 [ERROR] Process Exit Code: 239
> Nov 01 17:19:12 [ERROR] Crashed tests:
> Nov 01 17:19:12 [ERROR]
> org.apache.flink.runtime.operators.coordination.OperatorCoordinatorSchedulerTest
> Nov 01 17:19:12 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Nov 01 17:19:12 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-runtime &&
> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-runtime/target/surefire/surefirebooter6007815607334336440.jar
> /__w/1/s/flink-runtime/target/surefire 2021-11-01T16-51-51_363-jvmRun2
> surefire6448660128033443499tmp surefire_4131168043975619749001tmp
> Nov 01 17:19:12 [ERROR] Error occurred in starting fork, check output in log
> Nov 01 17:19:12 [ERROR] Process Exit Code: 239
> Nov 01 17:19:12 [ERROR] Crashed tests:
> Nov 01 17:19:12 [ERROR]
> org.apache.flink.runtime.operators.coordination.OperatorCoordinatorSchedulerTest
> Nov 01 17:19:12 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Nov 01 17:19:12 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> {code}
> It looks like the {{testSnapshotAsyncFailureFailsCheckpoint}} caused it even
> though finishing successfully due to a fatal error when shutting down the
> cluster:
> {code}
> 17:07:27,264 [Checkpoint Timer] ERROR
> org.apache.flink.util.FatalExitExceptionHandler [] - FATAL:
> Thread 'Checkpoint Timer' produced an uncaught exception. Stopping the
> process...
> java.util.concurrent.CompletionException:
> java.util.concurrent.CompletionException: java.lang.IllegalStateException:
> CheckpointsCleaner has already been closed
> at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.lambda$startTriggeringCheckpoint$7(CheckpointCoordinator.java:626)
> ~[classes/:?]
> at
> java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884)
> ~[?:1.8.0_292]
> at
> java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866)
> ~[?:1.8.0_292]
> at
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> [?:1.8.0_292]
> at
> java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)
> [?:1.8.0_292]
> at
> java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:814)
> [?:1.8.0_292]
>
[GitHub] [flink] tillrohrmann closed pull request #17693: [FLINK-24789][runtime] Trigger checkpoint disposal prior completing t…
tillrohrmann closed pull request #17693: URL: https://github.com/apache/flink/pull/17693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Closed] (FLINK-24543) Zookeeper connection issue causes inconsistent state in Flink
[
https://issues.apache.org/jira/browse/FLINK-24543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Till Rohrmann closed FLINK-24543.
-
Resolution: Fixed
Fixed via
1.15.0: 3d7ad08ea24cb632d0d3db6dc942bb052ab9b464
1.14.1: 0a5481b2717dfe4d2e7c15ee98df36f85ff94d70
1.13.4: 07945ea8b346476ef17bd560671f8d7bfb14f0ee
> Zookeeper connection issue causes inconsistent state in Flink
> --
>
> Key: FLINK-24543
> URL: https://issues.apache.org/jira/browse/FLINK-24543
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
>Affects Versions: 1.14.0, 1.13.3
>Reporter: Jun Qin
>Assignee: David Morávek
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.15.0, 1.14.1, 1.13.4
>
>
> Env: Flink 1.13.2 with Zookeeper HA
> Here is what happened:
> {code:bash}
> # checkpoint 1116 was triggered
> 2021-10-09 00:16:49,555 [Checkpoint Timer] INFO
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator[] - Triggering
> checkpoint 1116 (type=CHECKPOINT) @ 1633738609538 for job
> a8a4fb85b681a897ba118db64333c9e5.
> # a few seconds later, zookeeper connection suspended, it turned out to be a
> disk issue at zookeeper side caused slow fsync and commit)
> 2021-10-09 00:16:58,563 [Curator-ConnectionStateManager-0] WARN
> org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
> Connection to ZooKeeper suspended. Can no longer retrieve the leader from
> ZooKeeper.
> 2021-10-09 00:16:58,563 [Curator-ConnectionStateManager-0] WARN
> org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
> Connection to ZooKeeper suspended. The contender LeaderContender:
> DefaultDispatcherRunner no longer participates in the leader election.
> # job was switching to suspended
> 2021-10-09 00:16:58,564 [flink-akka.actor.default-dispatcher-61] INFO
> org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
> Disconnect job manager
> b79b79fe513fb5f47e7bf447b7d94...@akka.tcp://flink@flink-...-jobmanager:50010/user/rpc/jobmanager_3
> for job a8a4fb85b681a897ba118db64333c9e5 from the resource manager.
> 2021-10-09 00:16:58,565 [flink-akka.actor.default-dispatcher-92] INFO
> org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
> Registering job manager
> b79b79fe513fb5f47e7bf447b7d94...@akka.tcp://flink@flink-...-jobmanager:50010/user/rpc/jobmanager_3
> for job a8a4fb85b681a897ba118db64333c9e5.
> 2021-10-09 00:16:58,565 [flink-akka.actor.default-dispatcher-90] INFO
> org.apache.flink.runtime.jobmaster.JobMaster [] - Stopping
> the JobMaster for job Flink ...(a8a4fb85b681a897ba118db64333c9e5).
> 2021-10-09 00:16:58,567 [flink-akka.actor.default-dispatcher-90] INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink
> ... (a8a4fb85b681a897ba118db64333c9e5) switched from state RUNNING to
> SUSPENDED.
> 2021-10-09 00:16:58,570 [flink-akka.actor.default-dispatcher-86] INFO
> org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
> Closing
> ZookeeperLeaderRetrievalDriver{retrievalPath='/leader/a8a4fb85b681a897ba118db64333c9e5/job_manager_lock'}.
> 2021-10-09 00:16:58,667 [flink-akka.actor.default-dispatcher-92] INFO
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job
> a8a4fb85b681a897ba118db64333c9e5 reached terminal state SUSPENDED.
> # zookeeper connector restored
> 2021-10-09 00:17:08,225 [Curator-ConnectionStateManager-0] INFO
> org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionDriver [] -
> Connection to ZooKeeper was reconnected. Leader election can be restarted.
> # received checkpoint acknowledgement, trying to finalize it, then failed to
> add to zookeeper due to KeeperException$NodeExistsException
> 2021-10-09 00:17:14,382 [flink-akka.actor.default-dispatcher-90] INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: ...
> (1/5) (09d25852e3e206d6b7fe0d6bc965870f) switched from RUNNING to CANCELING.
> 2021-10-09 00:17:14,382 [jobmanager-future-thread-1] WARN
> org.apache.flink.runtime.jobmaster.JobMaster [] - Error while
> processing AcknowledgeCheckpoint message
> org.apache.flink.runtime.checkpoint.CheckpointException: Could not complete
> the pending checkpoint 1116. Failure reason: Failure to finalize checkpoint.
> at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1227)
>
> at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1072)
>
> at
>
[GitHub] [flink] flinkbot edited a comment on pull request #17811: [FLINK-24754] Implement CHAR/VARCHAR length validation for sinks
flinkbot edited a comment on pull request #17811: URL: https://github.com/apache/flink/pull/17811#issuecomment-970441907 ## CI report: * 59f24655f7b7376033be5a0234f211bb8a58a83a Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27138) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] tillrohrmann merged pull request #17681: [FLINK-24543][BP-1.13][runtime] Avoid possible inconsistencies of ZookeeperSta…
tillrohrmann merged pull request #17681: URL: https://github.com/apache/flink/pull/17681 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17897: [FLINK-24687][table] Move FileSystemTableSource/Sink in flink-connector-files
flinkbot edited a comment on pull request #17897: URL: https://github.com/apache/flink/pull/17897#issuecomment-977984065 ## CI report: * 80e8bf5ce37a240ba2abcce2356552b4fbee8a36 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27147) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17681: [FLINK-24543][BP-1.13][runtime] Avoid possible inconsistencies of ZookeeperSta…
flinkbot edited a comment on pull request #17681: URL: https://github.com/apache/flink/pull/17681#issuecomment-960861704 ## CI report: * 5883510177f1f9524b175ec12575c9c02f4fe122 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27124) * 07945ea8b346476ef17bd560671f8d7bfb14f0ee Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27148) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17681: [FLINK-24543][BP-1.13][runtime] Avoid possible inconsistencies of ZookeeperSta…
flinkbot edited a comment on pull request #17681: URL: https://github.com/apache/flink/pull/17681#issuecomment-960861704 ## CI report: * 5883510177f1f9524b175ec12575c9c02f4fe122 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27124) * 07945ea8b346476ef17bd560671f8d7bfb14f0ee UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Airblader commented on a change in pull request #17897: [FLINK-24687][table] Move FileSystemTableSource/Sink in flink-connector-files
Airblader commented on a change in pull request #17897: URL: https://github.com/apache/flink/pull/17897#discussion_r757626258 ## File path: flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/stream/compact/CompactOperator.java ## @@ -68,7 +64,8 @@ * the file system. */ public class CompactOperator extends AbstractStreamOperator Review comment: It'd be nice if the world was like that, but it isn't. I think any public classes should be annotated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
