[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18523: --- Labels: auto-deprioritized-major auto-deprioritized-minor (was: auto-deprioritized-major stale-minor) Priority: Not a Priority (was: Minor) This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Not a Priority > Labels: auto-deprioritized-major, auto-deprioritized-minor > > In the case of window calculations and eventTime scenarios, watermark cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18523: --- Labels: auto-deprioritized-major stale-minor (was: auto-deprioritized-major) I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Minor but is unassigned and neither itself nor its Sub-Tasks have been updated for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is still Minor, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized. > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Minor > Labels: auto-deprioritized-major, stale-minor > > In the case of window calculations and eventTime scenarios, watermark cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18523: --- Priority: Minor (was: Major) > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Minor > Labels: auto-deprioritized-major > > In the case of window calculations and eventTime scenarios, watermark cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18523: --- Labels: auto-deprioritized-major (was: stale-major) > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Major > Labels: auto-deprioritized-major > > In the case of window calculations and eventTime scenarios, watermark cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18523: --- Labels: stale-major (was: ) > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Major > Labels: stale-major > > In the case of window calculations and eventTime scenarios, watermark cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-18523: -- Description: In the case of window calculations and eventTime scenarios, watermark cannot update because the source does not have data for some reason, and the last Windows cannot trigger the calculations. One parameter, table.exec.source. Idle -timeout, can only solve the problem of ignoring parallelism of watermark alignment that does not occur.But when there is no watermark in each parallel degree, you still cannot update the watermark. Is it possible to add a lock-timeout parameter (which should be larger than maxOutOfOrderness with default of "-1 ms") and if the watermark is not updated beyond this time (i.e., there is no data), then the current time is taken and sent downstream as the watermark. thanks! was: In the case of window calculations and eventTime scenarios, watermar cannot update because the source does not have data for some reason, and the last Windows cannot trigger the calculations. One parameter, table.exec.source. Idle -timeout, can only solve the problem of ignoring parallelism of watermark alignment that does not occur.But when there is no watermark in each parallel degree, you still cannot update the watermark. Is it possible to add a lock-timeout parameter (which should be larger than maxOutOfOrderness with default of "-1 ms") and if the watermark is not updated beyond this time (i.e., there is no data), then the current time is taken and sent downstream as the watermark. thanks! > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Major > > In the case of window calculations and eventTime scenarios, watermark cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-18523: - Component/s: (was: API / DataStream) > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Major > > In the case of window calculations and eventTime scenarios, watermar cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-18523: Component/s: API / DataStream > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: API / DataStream >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Major > > In the case of window calculations and eventTime scenarios, watermar cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-18523: Summary: Advance watermark if there is no data in all of the partitions after some time (was: The watermark could be updated without data for some time) > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Major > > In the case of window calculations and eventTime scenarios, watermar cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18523) Advance watermark if there is no data in all of the partitions after some time
[ https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-18523: Component/s: Table SQL / API > Advance watermark if there is no data in all of the partitions after some time > -- > > Key: FLINK-18523 > URL: https://issues.apache.org/jira/browse/FLINK-18523 > Project: Flink > Issue Type: New Feature > Components: API / DataStream, Table SQL / API >Affects Versions: 1.11.0 >Reporter: chen yong >Priority: Major > > In the case of window calculations and eventTime scenarios, watermar cannot > update because the source does not have data for some reason, and the last > Windows cannot trigger the calculations. > One parameter, table.exec.source. Idle -timeout, can only solve the problem > of ignoring parallelism of watermark alignment that does not occur.But when > there is no watermark in each parallel degree, you still cannot update the > watermark. > Is it possible to add a lock-timeout parameter (which should be larger than > maxOutOfOrderness with default of "-1 ms") and if the watermark is not > updated beyond this time (i.e., there is no data), then the current time is > taken and sent downstream as the watermark. > > thanks! -- This message was sent by Atlassian Jira (v8.3.4#803005)
