[jira] [Created] (FLINK-24013) Add IssueNavigationLink for IDEA
gaoyajun02 created FLINK-24013: -- Summary: Add IssueNavigationLink for IDEA Key: FLINK-24013 URL: https://issues.apache.org/jira/browse/FLINK-24013 Project: Flink Issue Type: Improvement Components: Build System Affects Versions: 1.14.1 Reporter: gaoyajun02 Fix For: 1.14.1 just like SPARK-35223 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-23604) 'csv.disable-quote-character' can not take effect during deserialization for old csv format
[ https://issues.apache.org/jira/browse/FLINK-23604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405598#comment-17405598 ] Jingsong Lee commented on FLINK-23604: -- [~hehuiyuan] Hi I response you in the PR > 'csv.disable-quote-character' can not take effect during deserialization for > old csv format > --- > > Key: FLINK-23604 > URL: https://issues.apache.org/jira/browse/FLINK-23604 > Project: Flink > Issue Type: Improvement > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) >Reporter: hehuiyuan >Assignee: hehuiyuan >Priority: Minor > Labels: pull-request-available > > https://issues.apache.org/jira/browse/FLINK-21207 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-23604) 'csv.disable-quote-character' can not take effect during deserialization for old csv format
[ https://issues.apache.org/jira/browse/FLINK-23604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-23604: --- Labels: pull-request-available (was: ) > 'csv.disable-quote-character' can not take effect during deserialization for > old csv format > --- > > Key: FLINK-23604 > URL: https://issues.apache.org/jira/browse/FLINK-23604 > Project: Flink > Issue Type: Improvement > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) >Reporter: hehuiyuan >Priority: Minor > Labels: pull-request-available > > https://issues.apache.org/jira/browse/FLINK-21207 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (FLINK-23604) 'csv.disable-quote-character' can not take effect during deserialization for old csv format
[ https://issues.apache.org/jira/browse/FLINK-23604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned FLINK-23604: Assignee: hehuiyuan > 'csv.disable-quote-character' can not take effect during deserialization for > old csv format > --- > > Key: FLINK-23604 > URL: https://issues.apache.org/jira/browse/FLINK-23604 > Project: Flink > Issue Type: Improvement > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) >Reporter: hehuiyuan >Assignee: hehuiyuan >Priority: Minor > Labels: pull-request-available > > https://issues.apache.org/jira/browse/FLINK-21207 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] zuston edited a comment on pull request #16994: [FLINK-23991] Specifying yarn.staging-dir fail when staging scheme is…
zuston edited a comment on pull request #16994: URL: https://github.com/apache/flink/pull/16994#issuecomment-906260473 If you have time, could you help review it? @XComp @lirui-apache @tillrohrmann @wuchong @dianfu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] JingsongLi commented on pull request #16612: [FLINK-23604][old csv version] Fix source table with 'csv.disable-quote-character' = 'true' can not take effect for old csv format version
JingsongLi commented on pull request #16612: URL: https://github.com/apache/flink/pull/16612#issuecomment-906938689 Hi @hehuiyuan can you rebase latest master? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] zuston edited a comment on pull request #16994: [FLINK-23991] Specifying yarn.staging-dir fail when staging scheme is…
zuston edited a comment on pull request #16994: URL: https://github.com/apache/flink/pull/16994#issuecomment-906260473 If you have time, could you help review it? @XComp @lirui-apache @tillrohrmann @wuchong -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-23991) Specifying yarn.staging-dir fail when staging scheme is different from default fs scheme
[ https://issues.apache.org/jira/browse/FLINK-23991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junfan Zhang updated FLINK-23991: - Description: When the yarn.staging-dir path scheme is different from the default fs scheme, the client will fail fast. > Specifying yarn.staging-dir fail when staging scheme is different from > default fs scheme > > > Key: FLINK-23991 > URL: https://issues.apache.org/jira/browse/FLINK-23991 > Project: Flink > Issue Type: Bug > Components: Deployment / YARN >Affects Versions: 1.13.2 >Reporter: Junfan Zhang >Priority: Major > Labels: pull-request-available > > When the yarn.staging-dir path scheme is different from the default fs > scheme, the client will fail fast. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #16999: [FLINK-23995][hive]fix hive dialect issue when run query like `insert…
flinkbot edited a comment on pull request #16999: URL: https://github.com/apache/flink/pull/16999#issuecomment-906394199 ## CI report: * a3c121977ca621df33c61c8a5f2c9947acb65976 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22899) Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22926) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16959: [FLINK-23912] Remove unnecessary "Clearing resource requirements of job" in SlotManager
flinkbot edited a comment on pull request #16959: URL: https://github.com/apache/flink/pull/16959#issuecomment-904476350 ## CI report: * 5daf77a36906d746fe85ca375b74eb35ed173602 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22928) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17007: [FLINK-17495][metrics] Add additional variables config for metric reporters
flinkbot edited a comment on pull request #17007: URL: https://github.com/apache/flink/pull/17007#issuecomment-906871869 ## CI report: * a4eedbe823d23c720e1ddc689ec39f1f684ed87e Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22929) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23971) PulsarSourceITCase.testIdleReader failed on azure
[
https://issues.apache.org/jira/browse/FLINK-23971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405573#comment-17405573
]
Hang Ruan commented on FLINK-23971:
---
There is a problem in the test method _matchesMultipleSplitTestData._ When
there are the same records between two split, the test may fail.
For example, there are totally two splits for the test. And the first split
records is like \{a,b,b,c}, the second split records is like \{a,b,c,d}. The
final result is \{a,a,b,c,d,b,b,c}. It is a right result, but the test will
fail.
I think we need to add a prefix for each record in different splits, like
"0-XX" for the first split. Then the test will return the right judgement.
The test should fail in both _testMultipleSplits_ and _testIdleReader_ test
case. But only the latter test case occurs, and the problem probability is
supposed to be very low. Maybe we need more evidence about it.
> PulsarSourceITCase.testIdleReader failed on azure
> -
>
> Key: FLINK-23971
> URL: https://issues.apache.org/jira/browse/FLINK-23971
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Pulsar
>Affects Versions: 1.14.0
>Reporter: Roman Khachatryan
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> {code:java}
> [INFO] Running org.apache.flink.connector.pulsar.source.PulsarSourceITCase
> [ERROR] Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> 353.527 s <<< FAILURE! - in
> org.apache.flink.connector.pulsar.source.PulsarSourceITCase
> [ERROR] testIdleReader{TestEnvironment, ExternalContext}[2] Time elapsed:
> 4.549 s <<< FAILURE!
> java.lang.AssertionError:
> Expected: Records consumed by Flink should be identical to test data and
> preserve the order in multiple splits
> but: Unexpected record 'tj7MpFRWX95GzBpSF3CCjxKSal6bRhR0aF'
>at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
>at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
>at
> org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testIdleReader(SourceTestSuiteBase.java:193)
> {code}
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22819=logs=fc5181b0-e452-5c8f-68de-1097947f6483=995c650b-6573-581c-9ce6-7ad4cc038461=24448]
> This is the same error as in FLINK-23828 (kafka).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-23604) 'csv.disable-quote-character' can not take effect during deserialization for old csv format
[ https://issues.apache.org/jira/browse/FLINK-23604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405570#comment-17405570 ] hehuiyuan commented on FLINK-23604: --- [~lzljs3620320], hi , if you have time to look at this problem > 'csv.disable-quote-character' can not take effect during deserialization for > old csv format > --- > > Key: FLINK-23604 > URL: https://issues.apache.org/jira/browse/FLINK-23604 > Project: Flink > Issue Type: Improvement > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) >Reporter: hehuiyuan >Priority: Minor > > https://issues.apache.org/jira/browse/FLINK-21207 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (FLINK-23943) "/jobs/:jobid/stop" in REST API can't stop the target job.
[ https://issues.apache.org/jira/browse/FLINK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405519#comment-17405519 ] Roc Marshal edited comment on FLINK-23943 at 8/27/21, 3:46 AM: --- [~trohrmann] [~chesnay] Yes. The problem is reproducible. I'm trying to locate the problem. The log level of 'org.apache.flink' was set as 'DEBUG' in the attach logs. was (Author: rocmarshal): [~trohrmann] [~chesnay] Yes. the problem is reproducible. I'm trying to locate the problem. The log level of 'org.apache.flink' was set as 'DEBUG' in the attach logs. > "/jobs/:jobid/stop" in REST API can't stop the target job. > -- > > Key: FLINK-23943 > URL: https://issues.apache.org/jira/browse/FLINK-23943 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing >Affects Versions: 1.13.2 >Reporter: Roc Marshal >Priority: Major > Labels: REST_API > Attachments: flink-roc-standalonesession-0-MacBook-Pro.local.log, > flink-roc-taskexecutor-0-MacBook-Pro.local.log > > > * "/jobs/:jobid/stop" in REST API can't stop the target job. > * It can trigger a savepoint with the parameters. > * The interface document link > https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-stop -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (FLINK-23943) "/jobs/:jobid/stop" in REST API can't stop the target job.
[ https://issues.apache.org/jira/browse/FLINK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405519#comment-17405519 ] Roc Marshal edited comment on FLINK-23943 at 8/27/21, 3:45 AM: --- [~trohrmann] [~chesnay] Yes. the problem is reproducible. I'm trying to locate the problem. The log level of 'org.apache.flink' was set as 'DEBUG' in the attach logs. was (Author: rocmarshal): [~trohrmann] [~chesnay] Yes. the problem reproducible. I'm trying to locate the problem. The log level of 'org.apache.flink' was set as 'DEBUG' in the attach logs. > "/jobs/:jobid/stop" in REST API can't stop the target job. > -- > > Key: FLINK-23943 > URL: https://issues.apache.org/jira/browse/FLINK-23943 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing >Affects Versions: 1.13.2 >Reporter: Roc Marshal >Priority: Major > Labels: REST_API > Attachments: flink-roc-standalonesession-0-MacBook-Pro.local.log, > flink-roc-taskexecutor-0-MacBook-Pro.local.log > > > * "/jobs/:jobid/stop" in REST API can't stop the target job. > * It can trigger a savepoint with the parameters. > * The interface document link > https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-stop -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-24005) Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool
[
https://issues.apache.org/jira/browse/FLINK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405565#comment-17405565
]
Zhu Zhu commented on FLINK-24005:
-
That's also my question that why we need to decrease requirements when a TM
disconnects. In my understanding, the requirement is from the job and should
only change if the job status changes. If a TM disconnects with slots assigned
to tasks, it will lead to FAILED task and the assigned slots releasing will
decrease the requirements(in {{DeclarativeSlotPoolBridge#releaseSlot(...)}}).
2 side notes:
- {{DeclarativeSlotPoolBridge#onFailAllocation()}} will decrease resource
requirements. So it may lead to similar issue as
{{DeclarativeSlotPoolBridge#onReleaseTaskManager()}}.
- The requirements decrease are only triggered in
{{DeclarativeSlotPoolBridge}}, so this issue will not affect adaptive scheduler.
> Resource requirements declaration may be incorrect if JobMaster disconnects
> with a TaskManager with available slots in the SlotPool
> ---
>
> Key: FLINK-24005
> URL: https://issues.apache.org/jira/browse/FLINK-24005
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
>Affects Versions: 1.14.0, 1.12.5, 1.13.2
>Reporter: Zhu Zhu
>Priority: Critical
> Attachments: decrease_resource_requirements.log
>
>
> When a TaskManager disconnects with JobMaster, it will trigger the
> `DeclarativeSlotPoolService#decreaseResourceRequirementsBy()` for all the
> slots that are registered to the JobMaster from the TaskManager. If the slots
> are still available, i.e. not assigned to any task, the
> `decreaseResourceRequirementsBy` may lead to incorrect resource requirements
> declaration.
> For example, there is one job with 3 source tasks only. It requires 3 slots
> and declares for 3 slots. Initially all the tasks are running. Suddenly one
> task failed and waits for some delay before restarting. The previous slot is
> returned to the SlotPool. Now the job requires 2 slots and declares for 2
> slots. At this moment, the TaskManager of that returned slot get lost. After
> the triggered `decreaseResourceRequirementsBy`, the job only declares for 1
> slot. Finally, when the failed task starts to re-schedule, the job will
> declare for 2 slots while it actually needs 3 slots.
> The attached log of a real job and logs of the added test in
> https://github.com/zhuzhurk/flink/commit/59ca0ac5fa9c77b97c6e8a43dcc53ca8a0ad6c37
> can demonstrate this case.
> Note that the real job is configured with a large
> "restart-strategy.fixed-delay.delay" and and large "slot.idle.timeout". So
> possibly in production it is a rare case.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] godfreyhe commented on pull request #16963: [FLINK-23582][docs][table] Add documentation for session window tvf.
godfreyhe commented on pull request #16963: URL: https://github.com/apache/flink/pull/16963#issuecomment-906898122 cc @wuchong -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17007: [FLINK-17495][metrics] Add additional variables config for metric reporters
flinkbot edited a comment on pull request #17007: URL: https://github.com/apache/flink/pull/17007#issuecomment-906871869 ## CI report: * c687d9d4027634a0a7877472a3ddec14d533291b Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22927) * a4eedbe823d23c720e1ddc689ec39f1f684ed87e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
flinkbot edited a comment on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906772069 ## CI report: * 36ccac3234861161b841d6d5a1706dde542a99fa Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22925) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16959: [FLINK-23912] Remove unnecessary "Clearing resource requirements of job" in SlotManager
flinkbot edited a comment on pull request #16959: URL: https://github.com/apache/flink/pull/16959#issuecomment-904476350 ## CI report: * 654b7c4764f1aba2a694d548ece96b05a1896589 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22786) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22727) * 5daf77a36906d746fe85ca375b74eb35ed173602 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22928) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23976) Add additional availability timing metrics to Job lifecycle events
[ https://issues.apache.org/jira/browse/FLINK-23976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405557#comment-17405557 ] Shen Zhu commented on FLINK-23976: -- Hey Seth([~sjwiesman] ), I have some ideas for this ticket. *startingTime* (1) If job is in terminal state, return -1 (2) If job doesn't have RUNNING state, return 0 (3) If job is not in terminal state and has RUNNING state, return the diff between RUNNING and CREATED *cancelingTime* (1) If job is in terminal state, return -1 (2) If job doesn't have CANCELING state, return 0 (3) If job is not in terminal state and has CANCELING state, then check if job has CANCELD state, if yes then return the diff between CANCELD and CALCELING, if no then return System.currentTimeMillis() - CALCELING timestamp. What do you think about it, if it looks good do you, could you please assign this ticket to me? Thanks for your help! > Add additional availability timing metrics to Job lifecycle events > -- > > Key: FLINK-23976 > URL: https://issues.apache.org/jira/browse/FLINK-23976 > Project: Flink > Issue Type: Improvement > Components: Runtime / Metrics >Reporter: Seth Wiesman >Priority: Major > > Flink currently contains a number of availability lifecycle metrics[1] > showing how long it takes to move through different job status'. We propose > adding two additional metrics; startingTime, and cancellingTime (open to > bikeshedding on the metric names). > > * startingTime is the time it takes a job to get to running. > * cancellingTime is the time spent in status CANCELLING > > > [1]https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/metrics/#availability -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #17007: [FLINK-17495][metrics] Add additional variables config for metric reporters
flinkbot edited a comment on pull request #17007: URL: https://github.com/apache/flink/pull/17007#issuecomment-906871869 ## CI report: * c687d9d4027634a0a7877472a3ddec14d533291b Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22927) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17006: [FLINK-24010][connector/common] HybridSourceReader delegates checkpoint notifications
flinkbot edited a comment on pull request #17006: URL: https://github.com/apache/flink/pull/17006#issuecomment-906820328 ## CI report: * 669cf9eb96190a6e9f7fa22c9c5a14bc337c9250 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22924) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16959: [FLINK-23912] Remove unnecessary "Clearing resource requirements of job" in SlotManager
flinkbot edited a comment on pull request #16959: URL: https://github.com/apache/flink/pull/16959#issuecomment-904476350 ## CI report: * 654b7c4764f1aba2a694d548ece96b05a1896589 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22786) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22727) * 5daf77a36906d746fe85ca375b74eb35ed173602 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure
[
https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405554#comment-17405554
]
Yun Gao commented on FLINK-22085:
-
Since we have fix this case via
https://issues.apache.org/jira/browse/FLINK-23223 and it has not pop up for a
long time, I'll close the issue for now.
> KafkaSourceLegacyITCase hangs/fails on azure
>
>
> Key: FLINK-22085
> URL: https://issues.apache.org/jira/browse/FLINK-22085
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.13.0, 1.14.0
>Reporter: Dawid Wysakowicz
>Assignee: Yun Gao
>Priority: Critical
> Labels: pull-request-available, stale-assigned, test-stability
> Fix For: 1.14.0
>
>
> 1) Observations
> a) The Azure pipeline would occasionally hang without printing any test error
> information.
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15939=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=8219]
> b) By running the test KafkaSourceLegacyITCase::testBrokerFailure() with INFO
> level logging, the the test would hang with the following error message
> printed repeatedly:
> {code:java}
> 20451 [New I/O boss #50] ERROR
> org.apache.flink.networking.NetworkFailureHandler [] - Closing communication
> channel because of an exception
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:50073
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> ~[?:1.8.0_151]
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> ~[?:1.8.0_151]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152)
> ~[flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_151]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_151]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_151]
> {code}
> *2) Root cause explanations*
> The test would hang because it enters the following loop:
> - closeOnFlush() is called for a given channel
> - closeOnFlush() calls channel.write(..)
> - channel.write() triggers the exceptionCaught(...) callback
> - closeOnFlush() is called for the same channel again.
> *3) Solution*
> Update closeOnFlush() so that, if a channel is being closed by this method,
> then closeOnFlush() would not try to write to this channel if it is called on
> this channel again.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Closed] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure
[
https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yun Gao closed FLINK-22085.
---
Resolution: Fixed
> KafkaSourceLegacyITCase hangs/fails on azure
>
>
> Key: FLINK-22085
> URL: https://issues.apache.org/jira/browse/FLINK-22085
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.13.0, 1.14.0
>Reporter: Dawid Wysakowicz
>Assignee: Yun Gao
>Priority: Critical
> Labels: pull-request-available, stale-assigned, test-stability
> Fix For: 1.14.0
>
>
> 1) Observations
> a) The Azure pipeline would occasionally hang without printing any test error
> information.
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15939=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=8219]
> b) By running the test KafkaSourceLegacyITCase::testBrokerFailure() with INFO
> level logging, the the test would hang with the following error message
> printed repeatedly:
> {code:java}
> 20451 [New I/O boss #50] ERROR
> org.apache.flink.networking.NetworkFailureHandler [] - Closing communication
> channel because of an exception
> java.net.ConnectException: Connection refused: localhost/127.0.0.1:50073
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> ~[?:1.8.0_151]
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
> ~[?:1.8.0_151]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152)
> ~[flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> org.apache.flink.shaded.testutils.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
> [flink-test-utils_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_151]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_151]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_151]
> {code}
> *2) Root cause explanations*
> The test would hang because it enters the following loop:
> - closeOnFlush() is called for a given channel
> - closeOnFlush() calls channel.write(..)
> - channel.write() triggers the exceptionCaught(...) callback
> - closeOnFlush() is called for the same channel again.
> *3) Solution*
> Update closeOnFlush() so that, if a channel is being closed by this method,
> then closeOnFlush() would not try to write to this channel if it is called on
> this channel again.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Closed] (FLINK-13973) Checkpoint recovery failed after user set uidHash
[ https://issues.apache.org/jira/browse/FLINK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-13973. --- Resolution: Fixed > Checkpoint recovery failed after user set uidHash > - > > Key: FLINK-13973 > URL: https://issues.apache.org/jira/browse/FLINK-13973 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing >Affects Versions: 1.8.0, 1.8.1, 1.9.0, 1.13.0 >Reporter: Zhouyu Pei >Assignee: Yun Gao >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > Checkpoint recovery failed after user set uidHash, the possible reasons are > as follows: > If altOperatorID is not null, operatorState will be obtained by altOperatorID > and will not be given -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (FLINK-23800) Expose newly added RocksDB native metrics
[ https://issues.apache.org/jira/browse/FLINK-23800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-23800. -- Resolution: Fixed merged in master bbcdb0b360f16647beb81206715ea54f7010b71e > Expose newly added RocksDB native metrics > - > > Key: FLINK-23800 > URL: https://issues.apache.org/jira/browse/FLINK-23800 > Project: Flink > Issue Type: Improvement > Components: Runtime / State Backends >Reporter: Yun Tang >Assignee: Yun Tang >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > Since Flink bumped RocksDB version, we could expose more newly added RocksDB > native metrics. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] Myasuka merged pull request #16846: [FLINK-23800][rocksdb] Expose live-sst-files-size to RocksDB native metrics
Myasuka merged pull request #16846: URL: https://github.com/apache/flink/pull/16846 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23886) An exception is thrown out when recover job timers from checkpoint file
[ https://issues.apache.org/jira/browse/FLINK-23886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405551#comment-17405551 ] Yun Tang commented on FLINK-23886: -- [~pnowojski] would you please share more information about the unsafe invocations of `onTimer()` and `processElement()`? From user's report and analysis on restored RocksDB instance, we can see that some data from other state has been written to timer state by mistake, could that happen under such unsafe case? > An exception is thrown out when recover job timers from checkpoint file > --- > > Key: FLINK-23886 > URL: https://issues.apache.org/jira/browse/FLINK-23886 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends >Reporter: JING ZHANG >Priority: Major > Attachments: image-2021-08-25-16-38-04-023.png, > image-2021-08-25-16-38-12-308.png, image-2021-08-25-17-06-29-806.png, > image-2021-08-25-17-07-38-327.png > > > A user report the bug in the [mailist. > |http://mail-archives.apache.org/mod_mbox/flink-user/202108.mbox/%3ccakmsf43j14nkjmgjuy4dh5qn2vbjtw4tfh4pmmuyvcvfhgf...@mail.gmail.com%3E]I > paste the content here. > Setup Specifics: > Version: 1.6.2 > RocksDB Map State > Timers stored in rocksdb > > When we have this job running for long periods of time like > 30 days, if > for some reason the job restarts, we encounter "Error while deserializing the > element". Is this a known issue fixed in later versions? I see some changes > to code for FLINK-10175, but we don't use any queryable state > > Below is the stack trace > > org.apache.flink.util.FlinkRuntimeException: Error while deserializing the > element. > at > org.apache.flink.contrib.streaming.state.RocksDBCachingPriorityQueueSet.deserializeElement(RocksDBCachingPriorityQueueSet.java:389) > at > org.apache.flink.contrib.streaming.state.RocksDBCachingPriorityQueueSet.peek(RocksDBCachingPriorityQueueSet.java:146) > at > org.apache.flink.contrib.streaming.state.RocksDBCachingPriorityQueueSet.peek(RocksDBCachingPriorityQueueSet.java:56) > at > org.apache.flink.runtime.state.heap.KeyGroupPartitionedPriorityQueue$InternalPriorityQueueComparator.comparePriority(KeyGroupPartitionedPriorityQueue.java:274) > at > org.apache.flink.runtime.state.heap.KeyGroupPartitionedPriorityQueue$InternalPriorityQueueComparator.comparePriority(KeyGroupPartitionedPriorityQueue.java:261) > at > org.apache.flink.runtime.state.heap.HeapPriorityQueue.isElementPriorityLessThen(HeapPriorityQueue.java:164) > at > org.apache.flink.runtime.state.heap.HeapPriorityQueue.siftUp(HeapPriorityQueue.java:121) > at > org.apache.flink.runtime.state.heap.HeapPriorityQueue.addInternal(HeapPriorityQueue.java:85) > at > org.apache.flink.runtime.state.heap.AbstractHeapPriorityQueue.add(AbstractHeapPriorityQueue.java:73) > at > org.apache.flink.runtime.state.heap.KeyGroupPartitionedPriorityQueue.(KeyGroupPartitionedPriorityQueue.java:89) > at > org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend$RocksDBPriorityQueueSetFactory.create(RocksDBKeyedStateBackend.java:2792) > at > org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.create(RocksDBKeyedStateBackend.java:450) > at > org.apache.flink.streaming.api.operators.InternalTimeServiceManager.createTimerPriorityQueue(InternalTimeServiceManager.java:121) > at > org.apache.flink.streaming.api.operators.InternalTimeServiceManager.registerOrGetTimerService(InternalTimeServiceManager.java:106) > at > org.apache.flink.streaming.api.operators.InternalTimeServiceManager.getInternalTimerService(InternalTimeServiceManager.java:87) > at > org.apache.flink.streaming.api.operators.AbstractStreamOperator.getInternalTimerService(AbstractStreamOperator.java:764) > at > org.apache.flink.streaming.api.operators.KeyedProcessOperator.open(KeyedProcessOperator.java:61) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:424) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:290) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:711) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.io.EOFException > at java.io.DataInputStream.readUnsignedByte(DataInputStream.java:290) > at org.apache.flink.types.StringValue.readString(StringValue.java:769) > at > org.apache.flink.api.common.typeutils.base.StringSerializer.deserialize(StringSerializer.java:69) > at > org.apache.flink.api.common.typeutils.base.StringSerializer.deserialize(StringSerializer.java:28) > at > org.apache.flink.api.java.typeutils.runtime.RowSerializer.deserialize(RowSerializer.java:179) > at > org.apache.flink.api.java.typeutils.runtime.RowSerializer.deserialize(RowSerializer.java:46) > at >
[jira] [Closed] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks
[ https://issues.apache.org/jira/browse/FLINK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23808. --- Resolution: Fixed > Bypass operators when advanceToEndOfEventTime for both legacy and new source > tasks > -- > > Key: FLINK-23808 > URL: https://issues.apache.org/jira/browse/FLINK-23808 > Project: Flink > Issue Type: Sub-task >Affects Versions: 1.14.0 >Reporter: Yun Gao >Assignee: Yun Gao >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > Currently when end of data processing, the sources would advance to max > watermark and emit MAX_WATERMARK. However, currently the output used is the > mainOperatorOutput, namely the output of the source operator. If the source > operator is chained with other operators and the tasks are finished on > restore, there would be problems since the following operators should be > skipped, but some operators still have actions when the watermark is > advanced, like WatermarkAssignerOperator, which might cause problems. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks
[ https://issues.apache.org/jira/browse/FLINK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405550#comment-17405550 ] Yun Gao commented on FLINK-23808: - Fix on master via b7d42f6636edb50da48c7ff12324f42f789455d7 > Bypass operators when advanceToEndOfEventTime for both legacy and new source > tasks > -- > > Key: FLINK-23808 > URL: https://issues.apache.org/jira/browse/FLINK-23808 > Project: Flink > Issue Type: Sub-task >Affects Versions: 1.14.0 >Reporter: Yun Gao >Assignee: Yun Gao >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > Currently when end of data processing, the sources would advance to max > watermark and emit MAX_WATERMARK. However, currently the output used is the > mainOperatorOutput, namely the output of the source operator. If the source > operator is chained with other operators and the tasks are finished on > restore, there would be problems since the following operators should be > skipped, but some operators still have actions when the watermark is > advanced, like WatermarkAssignerOperator, which might cause problems. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] gaoyunhaii closed pull request #16861: [FLINK-23808][checkpoint] Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks
gaoyunhaii closed pull request #16861: URL: https://github.com/apache/flink/pull/16861 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (FLINK-23992) Update doc version in release-1.13 to 1.13.2
[ https://issues.apache.org/jira/browse/FLINK-23992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-23992. -- Resolution: Fixed fixed in release-1.13.2 b5e593453fd57911827aa185e46fcbb8f8495260 > Update doc version in release-1.13 to 1.13.2 > > > Key: FLINK-23992 > URL: https://issues.apache.org/jira/browse/FLINK-23992 > Project: Flink > Issue Type: Bug > Components: Documentation >Reporter: Yun Tang >Assignee: Yun Tang >Priority: Major > Labels: pull-request-available > Fix For: 1.13.2 > > > Current version in doc of branch release-1.13 is still 1.13.0 and we should > fix it to 1.13.2 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (FLINK-23992) Update doc version in release-1.13 to 1.13.2
[ https://issues.apache.org/jira/browse/FLINK-23992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-23992: Assignee: Yun Tang > Update doc version in release-1.13 to 1.13.2 > > > Key: FLINK-23992 > URL: https://issues.apache.org/jira/browse/FLINK-23992 > Project: Flink > Issue Type: Bug > Components: Documentation >Reporter: Yun Tang >Assignee: Yun Tang >Priority: Major > Labels: pull-request-available > Fix For: 1.13.2 > > > Current version in doc of branch release-1.13 is still 1.13.0 and we should > fix it to 1.13.2 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] gaoyunhaii commented on pull request #16861: [FLINK-23808][checkpoint] Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks
gaoyunhaii commented on pull request #16861: URL: https://github.com/apache/flink/pull/16861#issuecomment-906882839 Very thanks Piotr @pnowojski for the review! I'll merge the code~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405546#comment-17405546
]
Yun Gao edited comment on FLINK-23829 at 8/27/21, 2:45 AM:
---
Since the fix is merged onto master as
475d9cace988fc7a8b163df64b19bbd84c360bfc, I'll first close this issue for now,
and we could reopen it if it re-occur.
was (Author: gaoyunhaii):
Since the fix is merged onto master as
475d9cace988fc7a8b163df64b19bbd84c360bfc, I'll first close this issue, and we
could reopen it if it re-occur.
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Closed] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yun Gao closed FLINK-23829.
---
Resolution: Fixed
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure
[
https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405546#comment-17405546
]
Yun Gao commented on FLINK-23829:
-
Since the fix is merged onto master as
475d9cace988fc7a8b163df64b19bbd84c360bfc, I'll first close this issue, and we
could reopen it if it re-occur.
> SavepointITCase JVM crash on azure
> --
>
> Key: FLINK-23829
> URL: https://issues.apache.org/jira/browse/FLINK-23829
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Yun Gao
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22293=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba=5224
> {code}
> Aug 16 16:26:11 [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test
> (integration-tests) on project flink-tests: There are test failures.
> Aug 16 16:26:11 [ERROR]
> Aug 16 16:26:11 [ERROR] Please refer to
> /__w/1/s/flink-tests/target/surefire-reports for the individual test results.
> Aug 16 16:26:11 [ERROR] Please refer to dump files (if any exist)
> [date].dump, [date]-jvmRun[N].dump and [date].dumpstream.
> Aug 16 16:26:11 [ERROR] ExecutionException The forked VM terminated without
> properly saying goodbye. VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Aug 16 16:26:11 [ERROR] Command was /bin/sh -c cd /__w/1/s/flink-tests/target
> && /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms256m -Xmx2048m
> -Dmvn.forkNumber=2 -XX:+UseG1GC -jar
> /__w/1/s/flink-tests/target/surefire/surefirebooter8870094541887019356.jar
> /__w/1/s/flink-tests/target/surefire 2021-08-16T15-45-06_363-jvmRun2
> surefire8582412554358604743tmp surefire_2118489584967019297925tmp
> Aug 16 16:26:11 [ERROR] Error occurred in starting fork, check output in log
> Aug 16 16:26:11 [ERROR] Process Exit Code: 239
> Aug 16 16:26:11 [ERROR] Crashed tests:
> Aug 16 16:26:11 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:510)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:457)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:246)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1183)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1011)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:857)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> Aug 16 16:26:11 [ERROR] at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> Aug 16 16:26:11 [ERROR] at
>
[jira] [Closed] (FLINK-23884) Fix the concurrent problem between triggering savepoint with drain and finish
[ https://issues.apache.org/jira/browse/FLINK-23884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23884. --- Resolution: Fixed > Fix the concurrent problem between triggering savepoint with drain and finish > - > > Key: FLINK-23884 > URL: https://issues.apache.org/jira/browse/FLINK-23884 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing >Affects Versions: 1.14.0 >Reporter: Yun Gao >Assignee: Yun Gao >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > Currently when triggering stop-with-savepoint --drain, we would like to first > finish the task and then trigger a savepoint. However, currently the > implement does not ensures triggering get successful before the task get > finished and close the mailbox, which might cause the savepoint fail. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-23884) Fix the concurrent problem between triggering savepoint with drain and finish
[ https://issues.apache.org/jira/browse/FLINK-23884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405545#comment-17405545 ] Yun Gao commented on FLINK-23884: - Fix on master via 475d9cace988fc7a8b163df64b19bbd84c360bfc > Fix the concurrent problem between triggering savepoint with drain and finish > - > > Key: FLINK-23884 > URL: https://issues.apache.org/jira/browse/FLINK-23884 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing >Affects Versions: 1.14.0 >Reporter: Yun Gao >Assignee: Yun Gao >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > Currently when triggering stop-with-savepoint --drain, we would like to first > finish the task and then trigger a savepoint. However, currently the > implement does not ensures triggering get successful before the task get > finished and close the mailbox, which might cause the savepoint fail. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] gaoyunhaii closed pull request #16905: [FLINK-23884][checkpoint] Fix the concurrent problem between triggering savepoint with drain and task finishing
gaoyunhaii closed pull request #16905: URL: https://github.com/apache/flink/pull/16905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Myasuka merged pull request #17001: [FLINK-23992][docs] Update link to 1.13.2 version
Myasuka merged pull request #17001: URL: https://github.com/apache/flink/pull/17001 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23969) Test Pulsar source end 2 end
[ https://issues.apache.org/jira/browse/FLINK-23969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405544#comment-17405544 ] Yufan Sheng commented on FLINK-23969: - [~Jiangang] Hi Liu, I'm very happy to see you would like to test this new Pulsar source connector. If you have some questions on Pulsar or this connector. Just ping me. I will help you ASAP. > Test Pulsar source end 2 end > > > Key: FLINK-23969 > URL: https://issues.apache.org/jira/browse/FLINK-23969 > Project: Flink > Issue Type: Sub-task > Components: Connectors / Pulsar >Reporter: Arvid Heise >Assignee: Liu >Priority: Blocker > Labels: release-testing > Fix For: 1.14.0 > > > Write a test application using Pulsar Source and execute it in distributed > fashion. Check fault-tolerance by crashing and restarting a TM. > Ideally, we test different subscription modes and sticky keys in particular. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] gaoyunhaii commented on pull request #16905: [FLINK-23884][checkpoint] Fix the concurrent problem between triggering savepoint with drain and task finishing
gaoyunhaii commented on pull request #16905: URL: https://github.com/apache/flink/pull/16905#issuecomment-906878818 Very thanks Piotr @pnowojski for the review! I'll merge the code~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405543#comment-17405543 ] Jark Wu commented on FLINK-22198: - The docker-based test is introduced in 1.13, so we may need another pull request for release-1.12. Could you help for that [~renqs]? > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Critical > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0, 1.12.6, 1.13.3 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405542#comment-17405542 ] Jark Wu edited comment on FLINK-22198 at 8/27/21, 2:29 AM: --- Fixed in - release-1.13: 96f7d900d64c49faaec59fa970e519aedae5958d was (Author: jark): Fixed in - release-1.13: 96f7d900d64c49faaec59fa970e519aedae5958d - release-1.12: > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Critical > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0, 1.12.6, 1.13.3 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Reopened] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reopened FLINK-22198: - > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Critical > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0, 1.12.6, 1.13.3 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-22198. --- Resolution: Fixed Fixed in - release-1.13: 96f7d900d64c49faaec59fa970e519aedae5958d - release-1.12: > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Critical > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0, 1.12.6, 1.13.3 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-24011) SET 'sql-client.verbose' = 'true'; on Flink SQL client does not give full stack trace
[ https://issues.apache.org/jira/browse/FLINK-24011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405540#comment-17405540 ] Jark Wu commented on FLINK-24011: - [~kgh475926], `sql-client.verbose` is only supported since 1.13, and SET command with quotes on key and values is supported since 1.13.2. So if you are using 1.12, you may need to upgrade your sql client version first. If you are in 1.13.0, you may need to upgrade to 1.13.2. > SET 'sql-client.verbose' = 'true'; on Flink SQL client does not give full > stack trace > - > > Key: FLINK-24011 > URL: https://issues.apache.org/jira/browse/FLINK-24011 > Project: Flink > Issue Type: Bug > Components: Connectors / Common, Table SQL / Client >Affects Versions: 1.12.1 > Environment: Ubuntu 18.04 >Reporter: James Kim >Priority: Major > > I'm trying to have Flink SQL client to read data from S3 Compatible Storage > but I've been getting this error > > "[ERROR] Could not execute SQL statement. Reason: > org.apache.flink.util.SerializedThrowable: Unsupported or unrecognized SSL > message" > But this did not help me to drop hints to start debugging so I tried SET > 'sql-client.verbose' = 'true'; but I did not get a verbose stack trace of the > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (FLINK-24011) SET 'sql-client.verbose' = 'true'; on Flink SQL client does not give full stack trace
[ https://issues.apache.org/jira/browse/FLINK-24011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-24011. --- Resolution: Not A Problem I close the issue for now. Feel free to reopen it if there is still problem. > SET 'sql-client.verbose' = 'true'; on Flink SQL client does not give full > stack trace > - > > Key: FLINK-24011 > URL: https://issues.apache.org/jira/browse/FLINK-24011 > Project: Flink > Issue Type: Bug > Components: Connectors / Common, Table SQL / Client >Affects Versions: 1.12.1 > Environment: Ubuntu 18.04 >Reporter: James Kim >Priority: Major > > I'm trying to have Flink SQL client to read data from S3 Compatible Storage > but I've been getting this error > > "[ERROR] Could not execute SQL statement. Reason: > org.apache.flink.util.SerializedThrowable: Unsupported or unrecognized SSL > message" > But this did not help me to drop hints to start debugging so I tried SET > 'sql-client.verbose' = 'true'; but I did not get a verbose stack trace of the > issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24012) PulsarSourceITCase.testTaskManagerFailure fails due to NoResourceAvailableException
Xintong Song created FLINK-24012: Summary: PulsarSourceITCase.testTaskManagerFailure fails due to NoResourceAvailableException Key: FLINK-24012 URL: https://issues.apache.org/jira/browse/FLINK-24012 Project: Flink Issue Type: Bug Components: Connectors / Pulsar Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22918=logs=a5ef94ef-68c2-57fd-3794-dc108ed1c495=2c68b137-b01d-55c9-e603-3ff3f320364b=24431 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] KarmaGYZ commented on a change in pull request #16959: [FLINK-23912] Remove unnecessary "Clearing resource requirements of job" in SlotManager
KarmaGYZ commented on a change in pull request #16959:
URL: https://github.com/apache/flink/pull/16959#discussion_r697104755
##
File path:
flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/DefaultDeclarativeSlotPool.java
##
@@ -117,7 +117,7 @@ public void increaseResourceRequirementsBy(ResourceCounter
increment) {
@Override
public void decreaseResourceRequirementsBy(ResourceCounter decrement) {
-if (decrement.isEmpty()) {
+if (decrement.isEmpty() || totalResourceRequirements.isEmpty()) {
Review comment:
Thanks @zhuzhurk for the investigation. I would only keep the second
commit 654b7c476 in this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (FLINK-23828) KafkaSourceITCase.testIdleReader fails on azure
[
https://issues.apache.org/jira/browse/FLINK-23828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405538#comment-17405538
]
Xintong Song commented on FLINK-23828:
--
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22918=logs=1fc6e7bf-633c-5081-c32a-9dea24b05730=576aba0a-d787-51b6-6a92-cf233f360582=7169
> KafkaSourceITCase.testIdleReader fails on azure
> ---
>
> Key: FLINK-23828
> URL: https://issues.apache.org/jira/browse/FLINK-23828
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Qingsheng Ren
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22284=logs=c5f0071e-1851-543e-9a45-9ac140befc32=15a22db7-8faa-5b34-3920-d33c9f0ca23c=7355
> {code}
> Aug 16 14:25:00 [ERROR] Tests run: 12, Failures: 1, Errors: 0, Skipped: 0,
> Time elapsed: 67.241 s <<< FAILURE! - in
> org.apache.flink.connector.kafka.source.KafkaSourceITCase
> Aug 16 14:25:00 [ERROR] testIdleReader{TestEnvironment, ExternalContext}[1]
> Time elapsed: 0.918 s <<< FAILURE!
> Aug 16 14:25:00 java.lang.AssertionError:
> Aug 16 14:25:00
> Aug 16 14:25:00 Expected: Records consumed by Flink should be identical to
> test data and preserve the order in multiple splits
> Aug 16 14:25:00 but: Unexpected record 'la3OaJDch7vuUXDmGOYf'
> Aug 16 14:25:00 at
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Aug 16 14:25:00 at
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Aug 16 14:25:00 at
> org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testIdleReader(SourceTestSuiteBase.java:193)
> Aug 16 14:25:00 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> Aug 16 14:25:00 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Aug 16 14:25:00 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Aug 16 14:25:00 at java.lang.reflect.Method.invoke(Method.java:498)
> Aug 16 14:25:00 at
> org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:688)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:210)
> Aug 16 14:25:00 at
> org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:206)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:131)
> Aug 16 14:25:00 at
> org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:65)
> Aug 16 14:25:00 at
>
[jira] [Closed] (FLINK-23994) ArrayDataSerializer and MapDataSerializer doesn't handle correctly for Null values
[ https://issues.apache.org/jira/browse/FLINK-23994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-23994. --- Resolution: Fixed Fixed in: - master via 4b89ac81e869455fe30a495c55f92a9d366a87b0 - release-1.13 via 198628c454bff1fb434646ef03506af56d1e2349 - release-1.12 via cfe9519a8cf4220b48dc327c95d568dfb121a82f > ArrayDataSerializer and MapDataSerializer doesn't handle correctly for Null > values > -- > > Key: FLINK-23994 > URL: https://issues.apache.org/jira/browse/FLINK-23994 > Project: Flink > Issue Type: Bug > Components: API / Python >Affects Versions: 1.10.0, 1.11.0, 1.12.0, 1.13.0, 1.14.0 >Reporter: Dian Fu >Assignee: Dian Fu >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0, 1.12.6, 1.13.3 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] fsk119 commented on pull request #13446: [FLINK-18779][table sql/planner]Support the SupportsFilterPushDown for LookupTableSource
fsk119 commented on pull request #13446: URL: https://github.com/apache/flink/pull/13446#issuecomment-906872956 Because this PR has too many conflicts with the master branch and I don't have time to resolve this recently. If you are interested in these feature, you can just resolve these conflicts and open a new PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23913) UnalignedCheckpointITCase fails with exit code 137 (kernel oom) on Azure VMs
[ https://issues.apache.org/jira/browse/FLINK-23913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405536#comment-17405536 ] Xintong Song commented on FLINK-23913: -- https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22918=logs=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3=0c010d0c-3dec-5bf1-d408-7b18988b1b2b=4746 > UnalignedCheckpointITCase fails with exit code 137 (kernel oom) on Azure VMs > > > Key: FLINK-23913 > URL: https://issues.apache.org/jira/browse/FLINK-23913 > Project: Flink > Issue Type: Bug > Components: Runtime / Network >Affects Versions: 1.14.0 > Environment: UnalignedCheckpointITCase >Reporter: Robert Metzger >Assignee: Arvid Heise >Priority: Blocker > Labels: test-stability > Fix For: 1.14.0 > > > Cases reported in FLINK-23525: > - > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22618=logs=4d4a0d10-fca2-5507-8eed-c07f0bdf4887=7b25afdf-cc6c-566f-5459-359dc2585798=10338 > - > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22618=logs=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3=0c010d0c-3dec-5bf1-d408-7b18988b1b2b=4743 > - > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22605=logs=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3=0c010d0c-3dec-5bf1-d408-7b18988b1b2b=4743 > - ... there are a lot more cases. > The problem seems to have started occurring around August 20. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-23954) Queryable state (rocksdb) with TM restart end-to-end test fails on azure
[
https://issues.apache.org/jira/browse/FLINK-23954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405534#comment-17405534
]
Xintong Song commented on FLINK-23954:
--
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22918=logs=4dd4dbdd-1802-5eb7-a518-6acd9d24d0fc=7c4a8fb8--5a77-f518-4176bfae300b=2238
> Queryable state (rocksdb) with TM restart end-to-end test fails on azure
>
>
> Key: FLINK-23954
> URL: https://issues.apache.org/jira/browse/FLINK-23954
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Queryable State
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Priority: Critical
> Labels: pull-request-available, test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22714=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=070ff179-953e-5bda-71fa-d6599415701c=11090
> {code}
> Aug 24 09:54:17
> ==
> Aug 24 09:54:17 Running 'Queryable state (rocksdb) with TM restart end-to-end
> test'
> Aug 24 09:54:17
> ==
> Aug 24 09:54:17 TEST_DATA_DIR:
> /home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/temp-test-directory-17362481511
> Aug 24 09:54:17 Flink dist directory:
> /home/vsts/work/1/s/flink-dist/target/flink-1.14-SNAPSHOT-bin/flink-1.14-SNAPSHOT
> Aug 24 09:54:17 Adding flink-queryable-state-runtime to lib/
> Aug 24 09:54:17 Starting cluster.
> Aug 24 09:54:18 Starting standalonesession daemon on host fv-az123-794.
> Aug 24 09:54:19 Starting taskexecutor daemon on host fv-az123-794.
> Aug 24 09:54:19 Waiting for Dispatcher REST endpoint to come up...
> Aug 24 09:54:20 Waiting for Dispatcher REST endpoint to come up...
> Aug 24 09:54:21 Waiting for Dispatcher REST endpoint to come up...
> Aug 24 09:54:22 Waiting for Dispatcher REST endpoint to come up...
> Aug 24 09:54:23 Waiting for Dispatcher REST endpoint to come up...
> Aug 24 09:54:24 Dispatcher REST endpoint is up.
> Aug 24 09:54:31 Job (f230364470a082b78dc34147f8da38f1) is running.
> Aug 24 09:54:31 Starting to wait for completion of 10 checkpoints
> Aug 24 09:54:31 2/10 completed checkpoints
> Aug 24 09:54:33 6/10 completed checkpoints
> Aug 24 09:54:35 6/10 completed checkpoints
> Aug 24 09:54:37 SERVER: 127.0.0.1
> Aug 24 09:54:37 PORT: 9069
> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
> SLF4J: Defaulting to no-operation (NOP) logger implementation
> SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further
> details.
> Aug 24 09:54:38 MapState has 17 entries
> Aug 24 09:54:38 TaskManager 412715 killed.
> Aug 24 09:54:38 Number of running task managers 1 is not yet 0.
> Aug 24 09:54:42 Number of running task managers has reached 0.
> Aug 24 09:54:42 Latest snapshot count was 22
> Aug 24 09:54:43 Starting taskexecutor daemon on host fv-az123-794.
> Aug 24 09:54:43 Number of running task managers 0 is not yet 1.
> Aug 24 09:54:47 Number of running task managers has reached 1.
> Aug 24 09:54:49 Job (f230364470a082b78dc34147f8da38f1) is running.
> Aug 24 09:54:49 Starting to wait for completion of 16 checkpoints
> Aug 24 09:54:49 11/16 completed checkpoints
> Aug 24 09:54:51 11/16 completed checkpoints
> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
> SLF4J: Defaulting to no-operation (NOP) logger implementation
> SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further
> details.
> Aug 24 09:54:54 after: 21
> Aug 24 09:54:54 An error occurred
> Aug 24 09:54:54 [FAIL] Test script contains errors.
> Aug 24 09:54:54 Checking of logs skipped.
> Aug 24 09:54:54
> Aug 24 09:54:54 [FAIL] 'Queryable state (rocksdb) with TM restart end-to-end
> test' failed after 0 minutes and 37 seconds! Test exited with exit code 1
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] flinkbot commented on pull request #17007: [FLINK-17495][metrics] Add additional variables config for metric reporters
flinkbot commented on pull request #17007: URL: https://github.com/apache/flink/pull/17007#issuecomment-906871869 ## CI report: * c687d9d4027634a0a7877472a3ddec14d533291b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-22971) Initialization of Testcontainers unstable on Azure
[
https://issues.apache.org/jira/browse/FLINK-22971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405533#comment-17405533
]
Xintong Song commented on FLINK-22971:
--
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22920=logs=c5612577-f1f7-5977-6ff6-7432788526f7=53f6305f-55e6-561c-8f1e-3a1dde2c77df=7002
> Initialization of Testcontainers unstable on Azure
> --
>
> Key: FLINK-22971
> URL: https://issues.apache.org/jira/browse/FLINK-22971
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Priority: Critical
> Labels: Umbrella, auto-deprioritized-critical, test-stability
> Fix For: 1.14.0
>
>
> The following properties can be observed in many high-frequency test
> instabilities. They are likely sharing a common root cause.
> * Use the Testcontainers framework
> * Fail due to no outputs in long time
> * A stack similar to the following can be find in the thread dump.
> ** Thread is RUNNABLE
> ** Testcontainers DockerClient is being created:
> {{org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:205)}}
> ** Seems to be downloading something via okhttp
> {code}
> "main" #1 prio=5 os_prio=0 tid=0x7f4fec00b800 nid=0x4f56 runnable
> [0x7f4ff536e000]
>java.lang.Thread.State: RUNNABLE
> at org.testcontainers.shaded.okio.Buffer.getByte(Buffer.java:312)
> at org.testcontainers.shaded.okio.Buffer.readUtf8Line(Buffer.java:766)
> at
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:231)
> at
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
> at
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
> at
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
> at
> org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
> at
> org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
> at
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
> at
> org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
> at
> org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
> at
> org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
> at
> org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
> at
> org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
> at org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
> at
> org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:285)
> at
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
> at
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$96/1409690119.close(Unknown
> Source)
> at
> com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
> at
> org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:202)
> at
> org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:205)
> - locked <0x8980f398> (a [Ljava.lang.Object;)
> at
> org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
> at
> org.testcontainers.LazyDockerClient.listImagesCmd(LazyDockerClient.java:12)
> at
> org.testcontainers.images.LocalImagesCache.maybeInitCache(LocalImagesCache.java:68)
> - locked <0x8980f3e8> (a
> org.testcontainers.images.LocalImagesCache)
> at
> org.testcontainers.images.LocalImagesCache.get(LocalImagesCache.java:32)
> at
> org.testcontainers.images.AbstractImagePullPolicy.shouldPull(AbstractImagePullPolicy.java:18)
> at
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:66)
> at
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:27)
> at
> org.testcontainers.utility.LazyFuture.getResolvedValue(LazyFuture.java:17)
> - locked <0x8980f478> (a
> java.util.concurrent.atomic.AtomicReference)
> at org.testcontainers.utility.LazyFuture.get(LazyFuture.java:39)
> at
> org.testcontainers.containers.GenericContainer.getDockerImageName(GenericContainer.java:1284)
> at
>
[GitHub] [flink] dianfu closed pull request #16998: [FLINK-23994][python] Handle properly for null values in ArrayDataSerializer and MapDataSerializer
dianfu closed pull request #16998: URL: https://github.com/apache/flink/pull/16998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-16720) Maven gets stuck downloading artifacts on Azure
[
https://issues.apache.org/jira/browse/FLINK-16720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405531#comment-17405531
]
Xintong Song commented on FLINK-16720:
--
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22920=logs=ba53eb01-1462-56a3-8e98-0dd97fbcaab5=bfbc6239-57a0-5db0-63f3-41551b4f7d51=8368
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22920=logs=8fd975ef-f478-511d-4997-6f15fe8a1fd3=ac0fa443-5d45-5a6b-3597-0310ecc1d2ab=19745
> Maven gets stuck downloading artifacts on Azure
> ---
>
> Key: FLINK-16720
> URL: https://issues.apache.org/jira/browse/FLINK-16720
> Project: Flink
> Issue Type: Bug
> Components: Build System / Azure Pipelines
>Affects Versions: 1.11.0, 1.13.0
>Reporter: Robert Metzger
>Priority: Major
> Labels: test-stability
> Fix For: 1.11.0
>
>
> Logs:
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=6509=logs=fc5181b0-e452-5c8f-68de-1097947f6483=27d1d645-cbce-54e2-51c4-d8b45fe24607
> {code}
> 2020-03-23T08:43:28.4128014Z [INFO]
>
> 2020-03-23T08:43:28.4128557Z [INFO] Building flink-avro-confluent-registry
> 1.11-SNAPSHOT
> 2020-03-23T08:43:28.4129129Z [INFO]
>
> 2020-03-23T08:48:47.6591333Z
> ==
> 2020-03-23T08:48:47.6594540Z Maven produced no output for 300 seconds.
> 2020-03-23T08:48:47.6595164Z
> ==
> 2020-03-23T08:48:47.6605370Z
> ==
> 2020-03-23T08:48:47.6605803Z The following Java processes are running (JPS)
> 2020-03-23T08:48:47.6606173Z
> ==
> 2020-03-23T08:48:47.7710037Z 920 Jps
> 2020-03-23T08:48:47.7778561Z 238 Launcher
> 2020-03-23T08:48:47.9270289Z
> ==
> 2020-03-23T08:48:47.9270832Z Printing stack trace of Java process 967
> 2020-03-23T08:48:47.9271199Z
> ==
> 2020-03-23T08:48:48.0165945Z 967: No such process
> 2020-03-23T08:48:48.0218260Z
> ==
> 2020-03-23T08:48:48.0218736Z Printing stack trace of Java process 238
> 2020-03-23T08:48:48.0219075Z
> ==
> 2020-03-23T08:48:48.3404066Z 2020-03-23 08:48:48
> 2020-03-23T08:48:48.3404828Z Full thread dump OpenJDK 64-Bit Server VM
> (25.242-b08 mixed mode):
> 2020-03-23T08:48:48.3405064Z
> 2020-03-23T08:48:48.3405445Z "Attach Listener" #370 daemon prio=9 os_prio=0
> tid=0x7fe130001000 nid=0x452 waiting on condition [0x]
> 2020-03-23T08:48:48.3405868Zjava.lang.Thread.State: RUNNABLE
> 2020-03-23T08:48:48.3411202Z
> 2020-03-23T08:48:48.3413171Z "resolver-5" #105 daemon prio=5 os_prio=0
> tid=0x7fe1ec2ad800 nid=0x177 waiting on condition [0x7fe1872d9000]
> 2020-03-23T08:48:48.3414175Zjava.lang.Thread.State: WAITING (parking)
> 2020-03-23T08:48:48.3414560Z at sun.misc.Unsafe.park(Native Method)
> 2020-03-23T08:48:48.3415451Z - parking to wait for <0x0003d5a9f828> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 2020-03-23T08:48:48.3416180Z at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> 2020-03-23T08:48:48.3416825Z at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> 2020-03-23T08:48:48.3417602Z at
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> 2020-03-23T08:48:48.3418250Z at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
> 2020-03-23T08:48:48.3418930Z at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
> 2020-03-23T08:48:48.3419900Z at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 2020-03-23T08:48:48.3420395Z at java.lang.Thread.run(Thread.java:748)
> 2020-03-23T08:48:48.3420648Z
> 2020-03-23T08:48:48.3421424Z "resolver-4" #104 daemon prio=5 os_prio=0
> tid=0x7fe1ec2ad000 nid=0x176 waiting on condition [0x7fe1863dd000]
> 2020-03-23T08:48:48.3421914Zjava.lang.Thread.State: WAITING (parking)
> 2020-03-23T08:48:48.3422233Z at sun.misc.Unsafe.park(Native Method)
> 2020-03-23T08:48:48.3422919Z - parking to wait for <0x0003d5a9f828> (a
>
[jira] [Updated] (FLINK-16720) Maven gets stuck downloading artifacts on Azure
[
https://issues.apache.org/jira/browse/FLINK-16720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xintong Song updated FLINK-16720:
-
Labels: test-stability (was: auto-deprioritized-major test-stability)
> Maven gets stuck downloading artifacts on Azure
> ---
>
> Key: FLINK-16720
> URL: https://issues.apache.org/jira/browse/FLINK-16720
> Project: Flink
> Issue Type: Bug
> Components: Build System / Azure Pipelines
>Affects Versions: 1.11.0, 1.13.0
>Reporter: Robert Metzger
>Priority: Minor
> Labels: test-stability
> Fix For: 1.11.0
>
>
> Logs:
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=6509=logs=fc5181b0-e452-5c8f-68de-1097947f6483=27d1d645-cbce-54e2-51c4-d8b45fe24607
> {code}
> 2020-03-23T08:43:28.4128014Z [INFO]
>
> 2020-03-23T08:43:28.4128557Z [INFO] Building flink-avro-confluent-registry
> 1.11-SNAPSHOT
> 2020-03-23T08:43:28.4129129Z [INFO]
>
> 2020-03-23T08:48:47.6591333Z
> ==
> 2020-03-23T08:48:47.6594540Z Maven produced no output for 300 seconds.
> 2020-03-23T08:48:47.6595164Z
> ==
> 2020-03-23T08:48:47.6605370Z
> ==
> 2020-03-23T08:48:47.6605803Z The following Java processes are running (JPS)
> 2020-03-23T08:48:47.6606173Z
> ==
> 2020-03-23T08:48:47.7710037Z 920 Jps
> 2020-03-23T08:48:47.7778561Z 238 Launcher
> 2020-03-23T08:48:47.9270289Z
> ==
> 2020-03-23T08:48:47.9270832Z Printing stack trace of Java process 967
> 2020-03-23T08:48:47.9271199Z
> ==
> 2020-03-23T08:48:48.0165945Z 967: No such process
> 2020-03-23T08:48:48.0218260Z
> ==
> 2020-03-23T08:48:48.0218736Z Printing stack trace of Java process 238
> 2020-03-23T08:48:48.0219075Z
> ==
> 2020-03-23T08:48:48.3404066Z 2020-03-23 08:48:48
> 2020-03-23T08:48:48.3404828Z Full thread dump OpenJDK 64-Bit Server VM
> (25.242-b08 mixed mode):
> 2020-03-23T08:48:48.3405064Z
> 2020-03-23T08:48:48.3405445Z "Attach Listener" #370 daemon prio=9 os_prio=0
> tid=0x7fe130001000 nid=0x452 waiting on condition [0x]
> 2020-03-23T08:48:48.3405868Zjava.lang.Thread.State: RUNNABLE
> 2020-03-23T08:48:48.3411202Z
> 2020-03-23T08:48:48.3413171Z "resolver-5" #105 daemon prio=5 os_prio=0
> tid=0x7fe1ec2ad800 nid=0x177 waiting on condition [0x7fe1872d9000]
> 2020-03-23T08:48:48.3414175Zjava.lang.Thread.State: WAITING (parking)
> 2020-03-23T08:48:48.3414560Z at sun.misc.Unsafe.park(Native Method)
> 2020-03-23T08:48:48.3415451Z - parking to wait for <0x0003d5a9f828> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 2020-03-23T08:48:48.3416180Z at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> 2020-03-23T08:48:48.3416825Z at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> 2020-03-23T08:48:48.3417602Z at
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> 2020-03-23T08:48:48.3418250Z at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
> 2020-03-23T08:48:48.3418930Z at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
> 2020-03-23T08:48:48.3419900Z at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 2020-03-23T08:48:48.3420395Z at java.lang.Thread.run(Thread.java:748)
> 2020-03-23T08:48:48.3420648Z
> 2020-03-23T08:48:48.3421424Z "resolver-4" #104 daemon prio=5 os_prio=0
> tid=0x7fe1ec2ad000 nid=0x176 waiting on condition [0x7fe1863dd000]
> 2020-03-23T08:48:48.3421914Zjava.lang.Thread.State: WAITING (parking)
> 2020-03-23T08:48:48.3422233Z at sun.misc.Unsafe.park(Native Method)
> 2020-03-23T08:48:48.3422919Z - parking to wait for <0x0003d5a9f828> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 2020-03-23T08:48:48.3423447Z at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> 2020-03-23T08:48:48.3424141Z at
>
[jira] [Updated] (FLINK-16720) Maven gets stuck downloading artifacts on Azure
[
https://issues.apache.org/jira/browse/FLINK-16720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xintong Song updated FLINK-16720:
-
Priority: Major (was: Minor)
> Maven gets stuck downloading artifacts on Azure
> ---
>
> Key: FLINK-16720
> URL: https://issues.apache.org/jira/browse/FLINK-16720
> Project: Flink
> Issue Type: Bug
> Components: Build System / Azure Pipelines
>Affects Versions: 1.11.0, 1.13.0
>Reporter: Robert Metzger
>Priority: Major
> Labels: test-stability
> Fix For: 1.11.0
>
>
> Logs:
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=6509=logs=fc5181b0-e452-5c8f-68de-1097947f6483=27d1d645-cbce-54e2-51c4-d8b45fe24607
> {code}
> 2020-03-23T08:43:28.4128014Z [INFO]
>
> 2020-03-23T08:43:28.4128557Z [INFO] Building flink-avro-confluent-registry
> 1.11-SNAPSHOT
> 2020-03-23T08:43:28.4129129Z [INFO]
>
> 2020-03-23T08:48:47.6591333Z
> ==
> 2020-03-23T08:48:47.6594540Z Maven produced no output for 300 seconds.
> 2020-03-23T08:48:47.6595164Z
> ==
> 2020-03-23T08:48:47.6605370Z
> ==
> 2020-03-23T08:48:47.6605803Z The following Java processes are running (JPS)
> 2020-03-23T08:48:47.6606173Z
> ==
> 2020-03-23T08:48:47.7710037Z 920 Jps
> 2020-03-23T08:48:47.7778561Z 238 Launcher
> 2020-03-23T08:48:47.9270289Z
> ==
> 2020-03-23T08:48:47.9270832Z Printing stack trace of Java process 967
> 2020-03-23T08:48:47.9271199Z
> ==
> 2020-03-23T08:48:48.0165945Z 967: No such process
> 2020-03-23T08:48:48.0218260Z
> ==
> 2020-03-23T08:48:48.0218736Z Printing stack trace of Java process 238
> 2020-03-23T08:48:48.0219075Z
> ==
> 2020-03-23T08:48:48.3404066Z 2020-03-23 08:48:48
> 2020-03-23T08:48:48.3404828Z Full thread dump OpenJDK 64-Bit Server VM
> (25.242-b08 mixed mode):
> 2020-03-23T08:48:48.3405064Z
> 2020-03-23T08:48:48.3405445Z "Attach Listener" #370 daemon prio=9 os_prio=0
> tid=0x7fe130001000 nid=0x452 waiting on condition [0x]
> 2020-03-23T08:48:48.3405868Zjava.lang.Thread.State: RUNNABLE
> 2020-03-23T08:48:48.3411202Z
> 2020-03-23T08:48:48.3413171Z "resolver-5" #105 daemon prio=5 os_prio=0
> tid=0x7fe1ec2ad800 nid=0x177 waiting on condition [0x7fe1872d9000]
> 2020-03-23T08:48:48.3414175Zjava.lang.Thread.State: WAITING (parking)
> 2020-03-23T08:48:48.3414560Z at sun.misc.Unsafe.park(Native Method)
> 2020-03-23T08:48:48.3415451Z - parking to wait for <0x0003d5a9f828> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 2020-03-23T08:48:48.3416180Z at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> 2020-03-23T08:48:48.3416825Z at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> 2020-03-23T08:48:48.3417602Z at
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> 2020-03-23T08:48:48.3418250Z at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
> 2020-03-23T08:48:48.3418930Z at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
> 2020-03-23T08:48:48.3419900Z at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 2020-03-23T08:48:48.3420395Z at java.lang.Thread.run(Thread.java:748)
> 2020-03-23T08:48:48.3420648Z
> 2020-03-23T08:48:48.3421424Z "resolver-4" #104 daemon prio=5 os_prio=0
> tid=0x7fe1ec2ad000 nid=0x176 waiting on condition [0x7fe1863dd000]
> 2020-03-23T08:48:48.3421914Zjava.lang.Thread.State: WAITING (parking)
> 2020-03-23T08:48:48.3422233Z at sun.misc.Unsafe.park(Native Method)
> 2020-03-23T08:48:48.3422919Z - parking to wait for <0x0003d5a9f828> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 2020-03-23T08:48:48.3423447Z at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> 2020-03-23T08:48:48.3424141Z at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>
[jira] [Commented] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405530#comment-17405530 ] Xintong Song commented on FLINK-22198: -- I've reopened the ticket and downgraded it to Critical. Please back port the fix to 1.12/1.13. > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Critical > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0, 1.12.6, 1.13.3 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-22198: - Priority: Critical (was: Blocker) > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Critical > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0, 1.12.6, 1.13.3 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-22198: - Fix Version/s: 1.13.3 1.12.6 > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Blocker > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0, 1.12.6, 1.13.3 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Reopened] (FLINK-22198) KafkaTableITCase hang.
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reopened FLINK-22198: -- Instance on 1.13: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22920=logs=72d4811f-9f0d-5fd0-014a-0bc26b72b642=c1d93a6a-ba91-515d-3196-2ee8019fbda7=6855 > KafkaTableITCase hang. > -- > > Key: FLINK-22198 > URL: https://issues.apache.org/jira/browse/FLINK-22198 > Project: Flink > Issue Type: Bug > Components: Connectors / Kafka >Affects Versions: 1.14.0, 1.12.4 >Reporter: Guowei Ma >Assignee: Qingsheng Ren >Priority: Blocker > Labels: pull-request-available, stale-blocker, test-stability > Fix For: 1.14.0 > > > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625 > There is no any artifacts. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-20329) Elasticsearch7DynamicSinkITCase hangs
[
https://issues.apache.org/jira/browse/FLINK-20329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405528#comment-17405528
]
Xintong Song commented on FLINK-20329:
--
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22920=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=12200
> Elasticsearch7DynamicSinkITCase hangs
> -
>
> Key: FLINK-20329
> URL: https://issues.apache.org/jira/browse/FLINK-20329
> Project: Flink
> Issue Type: Bug
> Components: Connectors / ElasticSearch
>Affects Versions: 1.12.0, 1.13.0
>Reporter: Dian Fu
>Assignee: Yangze Guo
>Priority: Major
> Labels: pull-request-available, test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10052=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20
> {code}
> 2020-11-24T16:04:05.9260517Z [INFO] Running
> org.apache.flink.streaming.connectors.elasticsearch.table.Elasticsearch7DynamicSinkITCase
> 2020-11-24T16:19:25.5481231Z
> ==
> 2020-11-24T16:19:25.5483549Z Process produced no output for 900 seconds.
> 2020-11-24T16:19:25.5484064Z
> ==
> 2020-11-24T16:19:25.5484498Z
> ==
> 2020-11-24T16:19:25.5484882Z The following Java processes are running (JPS)
> 2020-11-24T16:19:25.5485475Z
> ==
> 2020-11-24T16:19:25.5694497Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2020-11-24T16:19:25.7263048Z 16192 surefirebooter5057948964630155904.jar
> 2020-11-24T16:19:25.7263515Z 18566 Jps
> 2020-11-24T16:19:25.7263709Z 959 Launcher
> 2020-11-24T16:19:25.7411148Z
> ==
> 2020-11-24T16:19:25.7427013Z Printing stack trace of Java process 16192
> 2020-11-24T16:19:25.7427369Z
> ==
> 2020-11-24T16:19:25.7484365Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2020-11-24T16:19:26.0848776Z 2020-11-24 16:19:26
> 2020-11-24T16:19:26.0849578Z Full thread dump OpenJDK 64-Bit Server VM
> (25.275-b01 mixed mode):
> 2020-11-24T16:19:26.0849831Z
> 2020-11-24T16:19:26.0850185Z "Attach Listener" #32 daemon prio=9 os_prio=0
> tid=0x7fc148001000 nid=0x48e7 waiting on condition [0x]
> 2020-11-24T16:19:26.0850595Zjava.lang.Thread.State: RUNNABLE
> 2020-11-24T16:19:26.0850814Z
> 2020-11-24T16:19:26.0851375Z "testcontainers-ryuk" #31 daemon prio=5
> os_prio=0 tid=0x7fc251232000 nid=0x3fb0 in Object.wait()
> [0x7fc1012c4000]
> 2020-11-24T16:19:26.0854688Zjava.lang.Thread.State: TIMED_WAITING (on
> object monitor)
> 2020-11-24T16:19:26.0855379Z at java.lang.Object.wait(Native Method)
> 2020-11-24T16:19:26.0855844Z at
> org.testcontainers.utility.ResourceReaper.lambda$null$1(ResourceReaper.java:142)
> 2020-11-24T16:19:26.0857272Z - locked <0x8e2bd2d0> (a
> java.util.ArrayList)
> 2020-11-24T16:19:26.0857977Z at
> org.testcontainers.utility.ResourceReaper$$Lambda$93/1981729428.run(Unknown
> Source)
> 2020-11-24T16:19:26.0858471Z at
> org.rnorth.ducttape.ratelimits.RateLimiter.doWhenReady(RateLimiter.java:27)
> 2020-11-24T16:19:26.0858961Z at
> org.testcontainers.utility.ResourceReaper.lambda$start$2(ResourceReaper.java:133)
> 2020-11-24T16:19:26.0859422Z at
> org.testcontainers.utility.ResourceReaper$$Lambda$92/40191541.run(Unknown
> Source)
> 2020-11-24T16:19:26.0859788Z at java.lang.Thread.run(Thread.java:748)
> 2020-11-24T16:19:26.0860030Z
> 2020-11-24T16:19:26.0860371Z "process reaper" #24 daemon prio=10 os_prio=0
> tid=0x7fc0f803b800 nid=0x3f92 waiting on condition [0x7fc10296e000]
> 2020-11-24T16:19:26.0860913Zjava.lang.Thread.State: TIMED_WAITING
> (parking)
> 2020-11-24T16:19:26.0861387Z at sun.misc.Unsafe.park(Native Method)
> 2020-11-24T16:19:26.0862495Z - parking to wait for <0x8814bf30> (a
> java.util.concurrent.SynchronousQueue$TransferStack)
> 2020-11-24T16:19:26.0863253Z at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> 2020-11-24T16:19:26.0863760Z at
> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> 2020-11-24T16:19:26.0864274Z at
> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> 2020-11-24T16:19:26.0864762Z at
> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> 2020-11-24T16:19:26.0865299Z
[jira] [Assigned] (FLINK-23984) 'Run kubernetes pyflink application test' fail with "Package 'python3.7' has no installation candidate"
[
https://issues.apache.org/jira/browse/FLINK-23984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xintong Song reassigned FLINK-23984:
Assignee: Dian Fu
> 'Run kubernetes pyflink application test' fail with "Package 'python3.7' has
> no installation candidate"
>
>
> Key: FLINK-23984
> URL: https://issues.apache.org/jira/browse/FLINK-23984
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.14.0
>Reporter: Xintong Song
>Assignee: Dian Fu
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=22862=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=070ff179-953e-5bda-71fa-d6599415701c=4201
> {code}
> Aug 26 03:34:14 Step 1/9 : FROM test_kubernetes_application-1
> Aug 26 03:34:14 ---> 95da2424deaa
> Aug 26 03:34:14 Step 2/9 : RUN apt-get update -y && apt-get install -y
> python3.7 python3-pip python3.7-dev && rm -rf /var/lib/apt/lists/*
> Aug 26 03:34:17 ---> Running in 4751135e4612
> Aug 26 03:34:17 Get:1 http://deb.debian.org/debian bullseye InRelease [113 kB]
> Aug 26 03:34:17 Get:2 http://security.debian.org/debian-security
> bullseye-security InRelease [44.1 kB]
> Aug 26 03:34:17 Get:3 http://deb.debian.org/debian bullseye-updates InRelease
> [36.8 kB]
> Aug 26 03:34:17 Get:4 http://security.debian.org/debian-security
> bullseye-security/main amd64 Packages [27.5 kB]
> Aug 26 03:34:17 Get:5 http://deb.debian.org/debian bullseye/main amd64
> Packages [8178 kB]
> Aug 26 03:34:19 Fetched 8399 kB in 2s (5266 kB/s)
> Aug 26 03:34:19 Reading package lists...
> Aug 26 03:34:20 Reading package lists...
> Aug 26 03:34:20 Building dependency tree...
> Aug 26 03:34:20 Reading state information...
> Aug 26 03:34:20 Package python3.7 is not available, but is referred to by
> another package.
> Aug 26 03:34:20 This may mean that the package is missing, has been
> obsoleted, or
> Aug 26 03:34:20 is only available from another source
> Aug 26 03:34:20
> Aug 26 03:34:20 E: Package 'python3.7' has no installation candidate
> Aug 26 03:34:20 E: Unable to locate package python3.7-dev
> Aug 26 03:34:20 E: Couldn't find any package by glob 'python3.7-dev'
> Aug 26 03:34:20 E: Couldn't find any package by regex 'python3.7-dev'
> The command '/bin/sh -c apt-get update -y && apt-get install -y python3.7
> python3-pip python3.7-dev && rm -rf /var/lib/apt/lists/*' returned a non-zero
> code: 100
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (FLINK-23943) "/jobs/:jobid/stop" in REST API can't stop the target job.
[ https://issues.apache.org/jira/browse/FLINK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405519#comment-17405519 ] Roc Marshal edited comment on FLINK-23943 at 8/27/21, 1:45 AM: --- [~trohrmann] [~chesnay] Yes. the problem reproducible. I'm trying to locate the problem. The log level of 'org.apache.flink' was set as 'DEBUG' in the attach logs. was (Author: rocmarshal): [~trohrmann] [~chesnay] Yes. I'm trying to locate the problem. I will upload more fine-grained log information later . > "/jobs/:jobid/stop" in REST API can't stop the target job. > -- > > Key: FLINK-23943 > URL: https://issues.apache.org/jira/browse/FLINK-23943 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing >Affects Versions: 1.13.2 >Reporter: Roc Marshal >Priority: Major > Labels: REST_API > Attachments: flink-roc-standalonesession-0-MacBook-Pro.local.log, > flink-roc-taskexecutor-0-MacBook-Pro.local.log > > > * "/jobs/:jobid/stop" in REST API can't stop the target job. > * It can trigger a savepoint with the parameters. > * The interface document link > https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-stop -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] zstraw commented on pull request #13446: [FLINK-18779][table sql/planner]Support the SupportsFilterPushDown for LookupTableSource
zstraw commented on pull request #13446: URL: https://github.com/apache/flink/pull/13446#issuecomment-906854613 hi @fsk119 , why did you close this pr? any problem? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17000: [FLINK-23946][clients] Application mode should shutdown gracefully on…
flinkbot edited a comment on pull request #17000: URL: https://github.com/apache/flink/pull/17000#issuecomment-906394364 ## CI report: * de4a6c2f21154e961bc1f56de1379f0b69bd7b40 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22922) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22914) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16999: [FLINK-23995][hive]fix hive dialect issue when run query like `insert…
flinkbot edited a comment on pull request #16999: URL: https://github.com/apache/flink/pull/16999#issuecomment-906394199 ## CI report: * a3c121977ca621df33c61c8a5f2c9947acb65976 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22899) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22926) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16984: [FLINK-23917][table-planner] Project metadata before push-down even if projection push-down is not supported
flinkbot edited a comment on pull request #16984: URL: https://github.com/apache/flink/pull/16984#issuecomment-905502739 ## CI report: * 87e78fe8d922c0703722d8076c4bd2376b7eb2c4 UNKNOWN * 30c48b00d7aead0208dacf6e5747c2f652e142b4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22921) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22903) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] mas-chen commented on pull request #16992: [FLINK-23519][metrics] Expose state name as varibale if enable state latency tracking
mas-chen commented on pull request #16992: URL: https://github.com/apache/flink/pull/16992#issuecomment-906851416 LGTM, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17007: [FLINK-17495][metrics] Add additional variables config for metric reporters
flinkbot commented on pull request #17007: URL: https://github.com/apache/flink/pull/17007#issuecomment-906849776 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit c687d9d4027634a0a7877472a3ddec14d533291b (Fri Aug 27 01:20:15 UTC 2021) ✅no warnings Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-17495) Add support for custom variables
[
https://issues.apache.org/jira/browse/FLINK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405523#comment-17405523
]
Mason Chen commented on FLINK-17495:
[~chesnay] Finally got approval! Here's the PR:
[https://github.com/apache/flink/pull/17007.] Saw some users asking about
adding some identifiers to their metrics, maybe this would help.
> Add support for custom variables
>
>
> Key: FLINK-17495
> URL: https://issues.apache.org/jira/browse/FLINK-17495
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Metrics
>Reporter: jinhai
>Assignee: Mason Chen
>Priority: Minor
> Labels: auto-deprioritized-major, pull-request-available,
> stale-assigned
>
> Allow users to configure additional labels, presumably via a new config
> option {{metrics.scope.variables.add.}}
> E.g.,
> {code:java}
> metrics.scope.variables.add: key1:value1;key2:value2 {code}
> Configured variables should be added to the variables map of the root metric
> group; this may allow us in the future (once we have generalized scope
> formats a bit) to include them there as well.
>
> Original description:
> {quote}We need to add some custom labels on Prometheus, so we can query by
> them.?? ??
> Now we can add jobName\groupingKey to PrometheusPushGatewayReporter in
> version 1.10, but not in PrometheusReporter.
> Can we add AbstractPrometheusReporter#addDimension method to support this, so
> they will be no differences except for the metrics exposing mechanism
> pulling/pushing.
> {quote}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] mas-chen opened a new pull request #17007: [FLINK-17495][metrics] Add additional variables config for metric reporters
mas-chen opened a new pull request #17007: URL: https://github.com/apache/flink/pull/17007 ## What is the purpose of the change To add a configuration for additional variables reported by the metric reporters, in a generic fashion. ## Brief change log * ReporterSetup and FrontMetricGroup have enhanced logic to parse and apply the configuration, respectively. ## Verifying this change Functionality verification is covered by unit tests. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (yes / **no**) - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (yes / **no**) - The serializers: (yes / **no** / don't know) - The runtime per-record code paths (performance sensitive): (yes / **no** / don't know) - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / **no** / don't know) - The S3 file system connector: (yes / **no** / don't know) ## Documentation - Does this pull request introduce a new feature? (yes / **no**) - If yes, how is the feature documented? (**not applicable** / docs / JavaDocs / not documented) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] luoyuxia commented on pull request #16999: [FLINK-23995][hive]fix hive dialect issue when run query like `insert…
luoyuxia commented on pull request #16999: URL: https://github.com/apache/flink/pull/16999#issuecomment-906846233 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
flinkbot edited a comment on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906772069 ## CI report: * 14d745f31aabde8af1f4339a2c3a5f674feb3998 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22923) * 36ccac3234861161b841d6d5a1706dde542a99fa Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22925) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] RocMarshal commented on a change in pull request #16723: [FLINK-22885][table] Supports 'SHOW COLUMNS' syntax.
RocMarshal commented on a change in pull request #16723:
URL: https://github.com/apache/flink/pull/16723#discussion_r697070855
##
File path:
flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/utils/SQLLikeUtils.java
##
@@ -0,0 +1,83 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.operations.utils;
+
+import java.util.regex.Pattern;
+
+/** Utility class for 'like' function in sql like-clause. */
+public enum SQLLikeUtils {
Review comment:
I used `sql like function` of `calcite-core` dependency, but there were
some thorny dependency conflicts.
And I'll try to solve this problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] RocMarshal commented on a change in pull request #16723: [FLINK-22885][table] Supports 'SHOW COLUMNS' syntax.
RocMarshal commented on a change in pull request #16723: URL: https://github.com/apache/flink/pull/16723#discussion_r697067431 ## File path: flink-table/flink-sql-parser/src/main/codegen/data/Parser.tdd ## @@ -107,6 +108,7 @@ "CATALOGS" "CHANGELOG_MODE" "COMMENT" +"COLUMNS" Review comment: Done. ## File path: docs/content/docs/dev/table/sql/show.md ## @@ -39,6 +39,7 @@ Flink SQL supports the following SHOW statements for now: - SHOW FUNCTIONS - SHOW MODULES - SHOW JARS +- SHOW COLUMNS Review comment: Done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] RocMarshal commented on pull request #16723: [FLINK-22885][table] Supports 'SHOW COLUMNS' syntax.
RocMarshal commented on pull request #16723: URL: https://github.com/apache/flink/pull/16723#issuecomment-906835824 Hi, @wuchong Thank you so much for your comments. And I make some changes based on your suggestions. Could you help me to review it again if you have time ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23943) "/jobs/:jobid/stop" in REST API can't stop the target job.
[ https://issues.apache.org/jira/browse/FLINK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405519#comment-17405519 ] Roc Marshal commented on FLINK-23943: - [~trohrmann] [~chesnay] Yes. I'm trying to locate the problem. I will upload more fine-grained log information later . > "/jobs/:jobid/stop" in REST API can't stop the target job. > -- > > Key: FLINK-23943 > URL: https://issues.apache.org/jira/browse/FLINK-23943 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing >Affects Versions: 1.13.2 >Reporter: Roc Marshal >Priority: Major > Labels: REST_API > Attachments: flink-roc-standalonesession-0-MacBook-Pro.local.log, > flink-roc-taskexecutor-0-MacBook-Pro.local.log > > > * "/jobs/:jobid/stop" in REST API can't stop the target job. > * It can trigger a savepoint with the parameters. > * The interface document link > https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-stop -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #17006: [FLINK-24010][connector/common] HybridSourceReader delegates checkpoint notifications
flinkbot edited a comment on pull request #17006: URL: https://github.com/apache/flink/pull/17006#issuecomment-906820328 ## CI report: * 669cf9eb96190a6e9f7fa22c9c5a14bc337c9250 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22924) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
flinkbot edited a comment on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906772069 ## CI report: * 14d745f31aabde8af1f4339a2c3a5f674feb3998 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22923) * 36ccac3234861161b841d6d5a1706dde542a99fa UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] djkevincr edited a comment on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
djkevincr edited a comment on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906774540 @zentol Thank you for the message. Here s the exact change-list from upgrading 20 to 24. There are some version upgrades in maven plugins plus, minimum java and maven build versions, added checksum plugin in creating source release checksums, reproduceable builds property. Please check [1] for more details. [1] https://github.com/apache/maven-apache-parent/compare/apache-20...apache-24 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17006: [FLINK-24010][connector/common] HybridSourceReader delegates checkpoint notifications
flinkbot commented on pull request #17006: URL: https://github.com/apache/flink/pull/17006#issuecomment-906820328 ## CI report: * 669cf9eb96190a6e9f7fa22c9c5a14bc337c9250 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] djkevincr removed a comment on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
djkevincr removed a comment on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906817354 @flinkbot run travis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] djkevincr commented on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
djkevincr commented on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906817354 @flinkbot run travis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (FLINK-24011) SET 'sql-client.verbose' = 'true'; on Flink SQL client does not give full stack trace
James Kim created FLINK-24011: - Summary: SET 'sql-client.verbose' = 'true'; on Flink SQL client does not give full stack trace Key: FLINK-24011 URL: https://issues.apache.org/jira/browse/FLINK-24011 Project: Flink Issue Type: Bug Components: Connectors / Common, Table SQL / Client Affects Versions: 1.12.1 Environment: Ubuntu 18.04 Reporter: James Kim I'm trying to have Flink SQL client to read data from S3 Compatible Storage but I've been getting this error "[ERROR] Could not execute SQL statement. Reason: org.apache.flink.util.SerializedThrowable: Unsupported or unrecognized SSL message" But this did not help me to drop hints to start debugging so I tried SET 'sql-client.verbose' = 'true'; but I did not get a verbose stack trace of the issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot commented on pull request #17006: [FLINK-24010][connector/common] HybridSourceReader delegates checkpoint notifications
flinkbot commented on pull request #17006: URL: https://github.com/apache/flink/pull/17006#issuecomment-906798401 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit 669cf9eb96190a6e9f7fa22c9c5a14bc337c9250 (Thu Aug 26 23:01:40 UTC 2021) **Warnings:** * No documentation files were touched! Remember to keep the Flink docs up to date! Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-24010) HybridSourceReader needs to forward checkpoint notifications
[ https://issues.apache.org/jira/browse/FLINK-24010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-24010: --- Labels: pull-request-available (was: ) > HybridSourceReader needs to forward checkpoint notifications > > > Key: FLINK-24010 > URL: https://issues.apache.org/jira/browse/FLINK-24010 > Project: Flink > Issue Type: Bug >Reporter: Thomas Weise >Assignee: Thomas Weise >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0, 1.13.3 > > > Since the reader currently swallows notifyCheckpointComplete, offset commit > in contained Kafka consumer doesn't happen. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] tweise opened a new pull request #17006: [FLINK-24010][connector/common] HybridSourceReader delegates checkpoint notifications
tweise opened a new pull request #17006: URL: https://github.com/apache/flink/pull/17006 ## What is the purpose of the change This change will ensure that the sources that are contained in `HybridSource` can receive `notifyCheckpointComplete` and `notifyCheckpointAborted`. Found this issue with `KafkaSouce` which would not commit offsets. ## Verifying this change I verified this change with an internal deployment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-18574) DownloadPipelineArtifact failes occasionally
[
https://issues.apache.org/jira/browse/FLINK-18574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-18574:
---
Labels: auto-deprioritized-critical test-stability (was: stale-critical
test-stability)
Priority: Major (was: Critical)
This issue was labeled "stale-critical" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Critical,
please raise the priority and ask a committer to assign you the issue or revive
the public discussion.
> DownloadPipelineArtifact failes occasionally
>
>
> Key: FLINK-18574
> URL: https://issues.apache.org/jira/browse/FLINK-18574
> Project: Flink
> Issue Type: Bug
> Components: Build System / Azure Pipelines
>Reporter: Dian Fu
>Priority: Major
> Labels: auto-deprioritized-critical, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=4414=logs=bdd9ea51-4de2-506a-d4d9-f3930e4d2355=c1dcc74d-b153-580b-95a4-73d5cd91b503
> {code}
> 2020-07-11T20:38:15.9784577Z ##[section]Starting: DownloadPipelineArtifact
> 2020-07-11T20:38:15.9799212Z
> ==
> 2020-07-11T20:38:15.9799811Z Task : Download Pipeline Artifacts
> 2020-07-11T20:38:15.9800305Z Description : Download build and pipeline
> artifacts
> 2020-07-11T20:38:15.9800753Z Version : 2.3.1
> 2020-07-11T20:38:15.9801328Z Author : Microsoft Corporation
> 2020-07-11T20:38:15.9801942Z Help :
> https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/download-pipeline-artifact
> 2020-07-11T20:38:15.9802614Z
> ==
> 2020-07-11T20:38:16.5226960Z Download from the specified build: #4414
> 2020-07-11T20:38:16.5246147Z Download artifact to:
> /home/agent07/myagent/_work/2/flink_artifact
> 2020-07-11T20:38:20.6397951Z Information, ApplicationInsightsTelemetrySender
> will correlate events with X-TFS-Session 38415228-535b-4652-8afc-41e3fcfa5c67
> 2020-07-11T20:38:20.6546003Z Information, DedupManifestArtifactClient will
> correlate http requests with X-TFS-Session
> 38415228-535b-4652-8afc-41e3fcfa5c67
> 2020-07-11T20:38:20.6563787Z Information, Minimatch patterns: [**]
> 2020-07-11T20:38:20.7577072Z Information,
> ArtifactHttpRetryMessageHandler.SendAsync:
> https://vsblobprodsu6weu.vsblob.visualstudio.com/A2d3c0ac8-fecf-45be-8407-6d87302181a9/_apis/dedup/nodes/4C7343B40F7AB12049F6929A6A4ECD738EFADAC85D010AF5877ACD0682CC6C5802
> attempt 1/6 failed with StatusCode RedirectMethod, IsRetryableResponse False
> 2020-07-11T20:38:35.8527079Z Information, Filtered 130283 files from the
> Minimatch filters supplied.
> 2020-07-11T20:38:35.8865820Z Information, Downloaded 0.0 MB out of 1,170.3 MB
> (0%).
> 2020-07-11T20:38:40.8869716Z Information, Downloaded 4.6 MB out of 1,170.3 MB
> (0%).
> 2020-07-11T20:38:45.9379430Z Information, Downloaded 24.5 MB out of 1,170.3
> MB (2%).
> 2020-07-11T20:38:50.9539945Z Information, Downloaded 41.8 MB out of 1,170.3
> MB (4%).
> 2020-07-11T20:38:53.5482129Z Warning,
> [https://nsevsblobprodsu6weus42.blob.core.windows.net/db2d3c0ac8fecf45be84076d87302181a9/454487F48A36900D2D7FE8928376FDB49F9F3BF90B3A5474B7EF8D9ABE8BDC7201?sv=2019-02-02=b=HGudFZh7Cd3TOBUMGO7rIq0DJxPQORzHkSVs3iYeDPc%3D=https=2020-07-12T21%3A16%3A18Z=r=x-e2eid-e61f9696-89054b42-93868ec3-c0739ba7-session-38415228-535b4652-8afc41e3-fcfa5c67]
> Try 1/5, retryable exception caught. Retrying in 00:00:01.
> System.Net.Http.HttpRequestException: An error occurred while sending the
> request.
> 2020-07-11T20:38:53.5484031Z ---> System.Net.Http.CurlException: Couldn't
> connect to server
> 2020-07-11T20:38:53.5484420Zat
> System.Net.Http.CurlHandler.ThrowIfCURLEError(CURLcode error)
> 2020-07-11T20:38:53.5484929Zat
> System.Net.Http.CurlHandler.MultiAgent.FinishRequest(StrongToWeakReference`1
> easyWrapper, CURLcode messageResult)
> 2020-07-11T20:38:53.5485733Z--- End of inner exception stack trace ---
> 2020-07-11T20:38:53.5486394Zat
> System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask,
> HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
> 2020-07-11T20:38:53.5487612Zat
> Microsoft.VisualStudio.Services.Common.TaskCancellationExtensions.EnforceCancellation[TResult](Task`1
> task, CancellationToken cancellationToken, Func`1 makeMessage, String file,
> String member, Int32 line)
> 2020-07-11T20:38:53.5488656Zat
> Microsoft.VisualStudio.Services.BlobStore.WebApi.DedupStoreHttpClient.<>c__DisplayClass57_0.d.MoveNext()
> 2020-07-11T20:38:53.5489700Z --- End of stack trace from previous location
> where exception was thrown ---
>
[jira] [Updated] (FLINK-22644) Translate "Native Kubernetes" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-22644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-22644: --- Labels: auto-deprioritized-major auto-unassigned pull-request-available (was: auto-unassigned pull-request-available stale-major) Priority: Minor (was: Major) This issue was labeled "stale-major" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Translate "Native Kubernetes" page into Chinese > --- > > Key: FLINK-22644 > URL: https://issues.apache.org/jira/browse/FLINK-22644 > Project: Flink > Issue Type: Improvement > Components: Documentation >Reporter: Yuchen Cheng >Priority: Minor > Labels: auto-deprioritized-major, auto-unassigned, > pull-request-available > > The page url is > https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/resource-providers/native_kubernetes/ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24010) HybridSourceReader needs to forward checkpoint notifications
Thomas Weise created FLINK-24010: Summary: HybridSourceReader needs to forward checkpoint notifications Key: FLINK-24010 URL: https://issues.apache.org/jira/browse/FLINK-24010 Project: Flink Issue Type: Bug Reporter: Thomas Weise Assignee: Thomas Weise Fix For: 1.14.0, 1.13.3 Since the reader currently swallows notifyCheckpointComplete, offset commit in contained Kafka consumer doesn't happen. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
flinkbot edited a comment on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906772069 ## CI report: * 14d745f31aabde8af1f4339a2c3a5f674feb3998 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=22923) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] djkevincr edited a comment on pull request #17005: [FLINK-24009] Upgrade to Apache pom parent 24
djkevincr edited a comment on pull request #17005: URL: https://github.com/apache/flink/pull/17005#issuecomment-906774540 @zentol Thank you for the message. Here s the exact change-list from upgrading 20 to 24. There are some version upgrades in maven plugins plus, minimum java and maven build versions, added checksum plugin in creating source release checksums. Please check [1] for more details. [1] https://github.com/apache/maven-apache-parent/compare/apache-20...apache-24 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
