[jira] [Updated] (FLINK-28727) Flink Source supports SupportsLimitPushDown

2022-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28727: --- Labels: pull-request-available (was: ) > Flink Source supports SupportsLimitPushDown >

[GitHub] [flink-table-store] SteNicholas opened a new pull request, #255: [FLINK-28727] Flink Source supports `SupportsLimitPushDown`

2022-07-28 Thread GitBox
SteNicholas opened a new pull request, #255: URL: https://github.com/apache/flink-table-store/pull/255 `FileStoreSource` could support for the `SupportsLimitPushDown` interface. **The brief change log** - `FileStoreSource` implements the `SupportsLimitPushDown` interface. -- This

[GitHub] [flink] rkhachatryan merged pull request #20306: [FLINK-28602][state/changelog] Close stream of StateChangeFsUploader normally while enabling compression

2022-07-28 Thread GitBox
rkhachatryan merged PR #20306: URL: https://github.com/apache/flink/pull/20306 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Closed] (FLINK-28566) Adds materialization support to eliminate the non determinism generated by lookup join node

2022-07-28 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee closed FLINK-28566. --- Resolution: Abandoned the new FLINK-28570 will cover this part, and no need to expose a new  'table

[jira] [Updated] (FLINK-28570) Introduces a StreamNonDeterministicPlanResolver to validate and try to solve (lookup join only) the non-deterministic updates problem which may cause wrong result or err

2022-07-28 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-28570: Summary: Introduces a StreamNonDeterministicPlanResolver to validate and try to solve (lookup join

[jira] [Comment Edited] (FLINK-27849) Harden correctness for non-deterministic updates present in the changelog pipeline

2022-07-28 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572773#comment-17572773 ] lincoln lee edited comment on FLINK-27849 at 7/29/22 6:45 AM:

[jira] [Comment Edited] (FLINK-27849) Harden correctness for non-deterministic updates present in the changelog pipeline

2022-07-28 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572773#comment-17572773 ] lincoln lee edited comment on FLINK-27849 at 7/29/22 6:44 AM:

[jira] [Commented] (FLINK-27849) Harden correctness for non-deterministic updates present in the changelog pipeline

2022-07-28 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572773#comment-17572773 ] lincoln lee commented on FLINK-27849: - Thanks to [~jark]  [~godfrey]  [~jinsong] for

[jira] [Created] (FLINK-28738) [doc] Add a user doc about the correctness for non-deterministic updates

2022-07-28 Thread lincoln lee (Jira)
lincoln lee created FLINK-28738: --- Summary: [doc] Add a user doc about the correctness for non-deterministic updates Key: FLINK-28738 URL: https://issues.apache.org/jira/browse/FLINK-28738 Project: Flink

[jira] [Updated] (FLINK-27849) Harden correctness for non-deterministic updates present in the changelog pipeline

2022-07-28 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-27849: Description: There commonly exists updates(which means not only RowKind.INSERT messages) in a str

[jira] [Updated] (FLINK-27849) Harden correctness for non-deterministic updates present in the changelog pipeline

2022-07-28 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-27849: Description: There commonly exists updates(which means not only RowKind.INSERT messages) in a str

[GitHub] [flink] wsry commented on a diff in pull request #20351: [FLINK-28380][runtime] Produce one intermediate dataset for multiple consumer job vertices consuming the same data

2022-07-28 Thread GitBox
wsry commented on code in PR #20351: URL: https://github.com/apache/flink/pull/20351#discussion_r932910043 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java: ## @@ -963,6 +975,61 @@ private void setVertexConfig( v

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932906285 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexTaskManagersHandler.java: ## @@ -182,30 +188,32 @@ private static JobVertexTaskManagersI

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932905277 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobExceptionsHandler.java: ## @@ -127,22 +128,24 @@ private static JobExceptionsInfoWithHistory

[GitHub] [flink] pltbkd commented on pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on PR #20296: URL: https://github.com/apache/flink/pull/20296#issuecomment-1198920178 Hi @zhuzhurk and @gaoyunhaii , Thanks for the reviewing again! A new fixup commit has been pushed. It's resolving most of the comments. I'll separate and squash the fixes into origina

[jira] [Commented] (FLINK-26590) Triggered checkpoints can be delayed by discarding shared state

2022-07-28 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572762#comment-17572762 ] Hangxiang Yu commented on FLINK-26590: -- Do we have some plans about the ticket? I t

[GitHub] [flink] masteryhx commented on a diff in pull request #20346: [FLINK-28647] Remove separate error handling and adjust documentation for CLAIM mode + RocksDB native savepoint

2022-07-28 Thread GitBox
masteryhx commented on code in PR #20346: URL: https://github.com/apache/flink/pull/20346#discussion_r932898907 ## docs/content/docs/ops/state/savepoints.md: ## @@ -255,10 +255,8 @@ of the old job will not be deleted by Flink 2. [Native](#savepoint-format) format supports inc

[GitHub] [flink] masteryhx commented on a diff in pull request #20313: [FLINK-28597][state] Discard initial checkpoints without a delay in common cases

2022-07-28 Thread GitBox
masteryhx commented on code in PR #20313: URL: https://github.com/apache/flink/pull/20313#discussion_r932892479 ## flink-runtime/src/test/java/org/apache/flink/runtime/state/SharedStateRegistryTest.java: ## @@ -182,20 +194,113 @@ public void testRegisterChangelogStateBackendHand

[jira] [Commented] (FLINK-28736) Add APPROX_PERCENTILE function

2022-07-28 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572756#comment-17572756 ] Martijn Visser commented on FLINK-28736: I would prefer to wait with this implem

[jira] [Updated] (FLINK-28736) Add APPROX_PERCENTILE function

2022-07-28 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-28736: --- Component/s: Table SQL / API > Add APPROX_PERCENTILE function >

[jira] [Created] (FLINK-28737) FlinkRelMdUpsertKeys should consider the case when the condition of a calc node is non-deterministic

2022-07-28 Thread lincoln lee (Jira)
lincoln lee created FLINK-28737: --- Summary: FlinkRelMdUpsertKeys should consider the case when the condition of a calc node is non-deterministic Key: FLINK-28737 URL: https://issues.apache.org/jira/browse/FLINK-28737

[jira] [Closed] (FLINK-28715) Throw better exception when file not found in reading

2022-07-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28715. Resolution: Fixed master: 487b05e6d9162d65c1d83d42286d735061864dc1 release-0.2: 82d35ea7cff686967d

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932890270 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexDetailsHandler.java: ## @@ -120,9 +120,24 @@ private static JobVertexDetailsInfo create

[GitHub] [flink-table-store] JingsongLi merged pull request #250: [FLINK-28715] Throw better exception when file not found in reading

2022-07-28 Thread GitBox
JingsongLi merged PR #250: URL: https://github.com/apache/flink-table-store/pull/250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932889525 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/SubtaskExecutionAttemptDetailsInfo.java: ## @@ -261,6 +261,53 @@ public static SubtaskExecutionA

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932886544 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/legacy/metrics/MetricStore.java: ## @@ -391,4 +476,36 @@ private static TaskMetricStore unmodifiable

[GitHub] [flink] MartijnVisser commented on pull request #19995: [FLINK-28060][BP 1.15][Connector/Kafka] Updated Kafka Clients to 3.1.1

2022-07-28 Thread GitBox
MartijnVisser commented on PR #19995: URL: https://github.com/apache/flink/pull/19995#issuecomment-1198901631 Are you sure that is related to this patch? This patch is only updating the Kafka Clients and the CI is passing. The stacktrace makes it appear that there's something wrong with you

[GitHub] [flink] leozhangsr commented on pull request #20387: [FLINK-28475] [Connector/kafka] stopping offset can be 0.

2022-07-28 Thread GitBox
leozhangsr commented on PR #20387: URL: https://github.com/apache/flink/pull/20387#issuecomment-1198900364 It has a Compilation failure here,I will modified it later -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [flink] zhuzhurk commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
zhuzhurk commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932883301 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexTaskManagersHandler.java: ## @@ -182,30 +188,32 @@ private static JobVertexTaskManager

[jira] [Commented] (FLINK-28151) Allow to cancel the Operation for the HiveServer2 Endpoint

2022-07-28 Thread WeiNan Zhao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572748#comment-17572748 ] WeiNan Zhao commented on FLINK-28151: - hi, [~fsk119] . I want to contribute this iss

[GitHub] [flink] xintongsong commented on a diff in pull request #20371: [FLINK-27908][network] Introduce HsResultPartition and HsSubpartitionView

2022-07-28 Thread GitBox
xintongsong commented on code in PR #20371: URL: https://github.com/apache/flink/pull/20371#discussion_r932828188 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsMemoryDataManager.java: ## @@ -68,10 +70,16 @@ public HsMemoryDataManager(

[jira] [Assigned] (FLINK-28601) Add Transformer for FeatureHasher

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang reassigned FLINK-28601: - Assignee: weibo zhao > Add Transformer for FeatureHasher >

[jira] [Updated] (FLINK-28601) Add Transformer for FeatureHasher

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang updated FLINK-28601: -- Summary: Add Transformer for FeatureHasher (was: Support FeatureHasher in FlinkML) > Add Tra

[jira] [Updated] (FLINK-28601) Support FeatureHasher in FlinkML

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang updated FLINK-28601: -- Fix Version/s: ml-2.2.0 > Support FeatureHasher in FlinkML >

[jira] [Updated] (FLINK-28563) Add Transformer for VectorSlicer

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang updated FLINK-28563: -- Fix Version/s: ml-2.2.0 > Add Transformer for VectorSlicer >

[jira] [Assigned] (FLINK-28563) Add Transformer for VectorSlicer

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang reassigned FLINK-28563: - Assignee: weibo zhao > Add Transformer for VectorSlicer > -

[jira] [Updated] (FLINK-28611) Add Transformer for ElementwiseProduct

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang updated FLINK-28611: -- Fix Version/s: ml-2.2.0 > Add Transformer for ElementwiseProduct > ---

[jira] [Assigned] (FLINK-28611) Add Transformer for ElementwiseProduct

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang reassigned FLINK-28611: - Assignee: weibo zhao > Add Transformer for ElementwiseProduct > ---

[jira] [Updated] (FLINK-28611) Add Transformer for ElementwiseProduct

2022-07-28 Thread Zhipeng Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhipeng Zhang updated FLINK-28611: -- Summary: Add Transformer for ElementwiseProduct (was: Support ElementwiseProduct in FlinkML)

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932851211 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexBackPressureHandler.java: ## @@ -100,26 +106,73 @@ private JobVertexBackPressureInfo cr

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932843818 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexTaskManagersHandler.java: ## @@ -131,18 +132,23 @@ private static JobVertexTaskManagersI

[GitHub] [flink-ml] weibozhao commented on a diff in pull request #131: [FLINK-28563] Add Transformer for VectorSlicer

2022-07-28 Thread GitBox
weibozhao commented on code in PR #131: URL: https://github.com/apache/flink-ml/pull/131#discussion_r932842847 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/vectorslicer/VectorSlicerParams.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #131: [FLINK-28563] Add Transformer for VectorSlicer

2022-07-28 Thread GitBox
zhipeng93 commented on code in PR #131: URL: https://github.com/apache/flink-ml/pull/131#discussion_r932840786 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/vectorslicer/VectorSlicerParams.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] [flink] zhuzhurk commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
zhuzhurk commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932838778 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexBackPressureHandler.java: ## @@ -100,26 +106,73 @@ private JobVertexBackPressureInfo

[GitHub] [flink] zhuzhurk commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
zhuzhurk commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932838778 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexBackPressureHandler.java: ## @@ -100,26 +106,73 @@ private JobVertexBackPressureInfo

[jira] [Commented] (FLINK-28488) KafkaMetricWrapper does incorrect cast

2022-07-28 Thread cyc (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572729#comment-17572729 ] cyc commented on FLINK-28488: - I kown how to fix this. and  I want to try , how can I commit

[jira] [Updated] (FLINK-28488) KafkaMetricWrapper does incorrect cast

2022-07-28 Thread cyc (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyc updated FLINK-28488: Attachment: image-2022-07-29-11-32-05-733.png > KafkaMetricWrapper does incorrect cast > -

[GitHub] [flink] flinkbot commented on pull request #20390: [FLINK-28481][k8s] Bump the fabric8 k8s-client to 5.12.3

2022-07-28 Thread GitBox
flinkbot commented on PR #20390: URL: https://github.com/apache/flink/pull/20390#issuecomment-1198841815 ## CI report: * 089a229ba07288b929fd7779a9be9946e4f68449 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] zhuzhurk commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
zhuzhurk commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932835599 ## flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/threadinfo/JobVertexThreadInfoTracker.java: ## @@ -257,18 +258,19 @@ private Map> groupExecutio

[GitHub] [flink] bzhaoopenstack opened a new pull request, #20390: [FLINK-28481][k8s] Bump the fabric8 k8s-client to 5.12.3

2022-07-28 Thread GitBox
bzhaoopenstack opened a new pull request, #20390: URL: https://github.com/apache/flink/pull/20390 community hits FLINK-28481 mentioned issue, which will cause a Multiple K8S-server lose the leadership in fabric8 5.5.0. So plan to bump the fabric8 version from 5.5.0 to 5.12.3

[jira] [Updated] (FLINK-28481) Bump the fabric8 kubernetes-client to 5.12.3

2022-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28481: --- Labels: pull-request-available (was: ) > Bump the fabric8 kubernetes-client to 5.12.3 > ---

[GitHub] [flink] zhuzhurk commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
zhuzhurk commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932833249 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexTaskManagersHandler.java: ## @@ -131,18 +132,23 @@ private static JobVertexTaskManager

[GitHub] [flink] zhuzhurk commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
zhuzhurk commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932832522 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/ArchivedExecutionVertex.java: ## @@ -79,6 +96,11 @@ public ArchivedExecution getCurrentExecutionA

[GitHub] [flink] leonardBang commented on pull request #20376: [FLINK-27384] solve the problem that the latest data cannot be read under the creat…

2022-07-28 Thread GitBox
leonardBang commented on PR #20376: URL: https://github.com/apache/flink/pull/20376#issuecomment-1198836912 @empcl Could you also backport the fix to `release-1.4` and `release-1.15` branch ? -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [flink] leonardBang merged pull request #20376: [FLINK-27384] solve the problem that the latest data cannot be read under the creat…

2022-07-28 Thread GitBox
leonardBang merged PR #20376: URL: https://github.com/apache/flink/pull/20376 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.a

[jira] [Commented] (FLINK-27384) In the Hive dimension table, when the data is changed on the original partition, the create_time configuration does not take effect

2022-07-28 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572727#comment-17572727 ] Leonard Xu commented on FLINK-27384: Fixed in master(1.16): d97b94d4b723aaa403f5849

[GitHub] [flink] gaoyunhaii commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
gaoyunhaii commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932819448 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/SubtaskExecutionAttemptDetailsInfo.java: ## @@ -261,6 +261,53 @@ public static SubtaskExecut

[GitHub] [flink] gaoyunhaii commented on a diff in pull request #20351: [FLINK-28380][runtime] Produce one intermediate dataset for multiple consumer job vertices consuming the same data

2022-07-28 Thread GitBox
gaoyunhaii commented on code in PR #20351: URL: https://github.com/apache/flink/pull/20351#discussion_r932824303 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java: ## @@ -963,6 +975,61 @@ private void setVertexConfig(

[GitHub] [flink] gaoyunhaii commented on a diff in pull request #20351: [FLINK-28380][runtime] Produce one intermediate dataset for multiple consumer job vertices consuming the same data

2022-07-28 Thread GitBox
gaoyunhaii commented on code in PR #20351: URL: https://github.com/apache/flink/pull/20351#discussion_r932824303 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java: ## @@ -963,6 +975,61 @@ private void setVertexConfig(

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #132: [FLINK-28571] Add AlgoOperator for Chi-squared test

2022-07-28 Thread GitBox
zhipeng93 commented on code in PR #132: URL: https://github.com/apache/flink-ml/pull/132#discussion_r932822729 ## flink-ml-lib/src/main/java/org/apache/flink/ml/stats/chisqtest/ChiSqTest.java: ## @@ -0,0 +1,655 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[jira] [Commented] (FLINK-28727) Flink Source supports SupportsLimitPushDown

2022-07-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572718#comment-17572718 ] Jingsong Lee commented on FLINK-28727: -- [~nicholasjiang] Thanks, assigned > Flink

[jira] [Assigned] (FLINK-28727) Flink Source supports SupportsLimitPushDown

2022-07-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned FLINK-28727: Assignee: Nicholas Jiang > Flink Source supports SupportsLimitPushDown >

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #250: [FLINK-28715] Throw better exception when file not found in reading

2022-07-28 Thread GitBox
JingsongLi commented on code in PR #250: URL: https://github.com/apache/flink-table-store/pull/250#discussion_r932820891 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/utils/FileUtils.java: ## @@ -182,4 +180,20 @@ public static Stream listVersionedFile

[jira] [Closed] (FLINK-28730) Add Tez execution engine test for Table Store Hive connector

2022-07-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28730. Fix Version/s: (was: table-store-0.3.0) Assignee: Caizhi Weng Resolution: Fixed

[GitHub] [flink-table-store] JingsongLi merged pull request #254: [FLINK-28730] Add Tez execution engine test for Table Store Hive connector

2022-07-28 Thread GitBox
JingsongLi merged PR #254: URL: https://github.com/apache/flink-table-store/pull/254 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[GitHub] [flink] fredia commented on a diff in pull request #20217: [FLINK-27693][state] Support local recovery for non-materialized part

2022-07-28 Thread GitBox
fredia commented on code in PR #20217: URL: https://github.com/apache/flink/pull/20217#discussion_r930908557 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/changelog/ChangelogStateBackendLocalHandle.java: ## @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Softwar

[jira] [Commented] (FLINK-28727) Flink Source supports SupportsLimitPushDown

2022-07-28 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572716#comment-17572716 ] Nicholas Jiang commented on FLINK-28727: [~lzljs3620320], could you please assig

[GitHub] [flink-ml] weibozhao commented on a diff in pull request #135: [FLINK-28611] Support ElementwiseProduct in FlinkML

2022-07-28 Thread GitBox
weibozhao commented on code in PR #135: URL: https://github.com/apache/flink-ml/pull/135#discussion_r932814503 ## flink-ml-core/src/main/java/org/apache/flink/ml/param/VectorParam.java: ## @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

[GitHub] [flink] gaoyunhaii commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
gaoyunhaii commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r931909030 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/legacy/metrics/MetricStore.java: ## @@ -391,4 +476,36 @@ private static TaskMetricStore unmodifi

[jira] [Updated] (FLINK-28057) LD_PRELOAD is hardcoded to x64 on flink-docker

2022-07-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-28057: - Fix Version/s: 1.16.0 1.15.2 1.14.6 > LD_PRELOAD is hardcoded to x

[jira] [Commented] (FLINK-28057) LD_PRELOAD is hardcoded to x64 on flink-docker

2022-07-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572715#comment-17572715 ] Yun Tang commented on FLINK-28057: -- merged dev-1.15: ff2d07865f2f0d4a0adfda3525a42a5d7

[GitHub] [flink-ml] weibozhao commented on a diff in pull request #135: [FLINK-28611] Support ElementwiseProduct in FlinkML

2022-07-28 Thread GitBox
weibozhao commented on code in PR #135: URL: https://github.com/apache/flink-ml/pull/135#discussion_r932814503 ## flink-ml-core/src/main/java/org/apache/flink/ml/param/VectorParam.java: ## @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

[GitHub] [flink-docker] Myasuka merged pull request #125: Fix LD_PRELOAD on ARM images for 1.15 release

2022-07-28 Thread GitBox
Myasuka merged PR #125: URL: https://github.com/apache/flink-docker/pull/125 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

[GitHub] [flink-docker] Myasuka merged pull request #126: Fix LD_PRELOAD on ARM images for 1.14 release

2022-07-28 Thread GitBox
Myasuka merged PR #126: URL: https://github.com/apache/flink-docker/pull/126 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

[jira] [Closed] (FLINK-28152) Introduce the statement-related API for HiveServer2 Endpoint

2022-07-28 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang closed FLINK-28152. - Resolution: Implemented Merged into master:   6a95672db9cf23c9110ec9b0d4701e9c1e3acfa1 f477a4

[GitHub] [flink] swuferhong commented on pull request #20388: [FLINK-28708][table-planner] Introduce planner rules to optimize dpp pattern

2022-07-28 Thread GitBox
swuferhong commented on PR #20388: URL: https://github.com/apache/flink/pull/20388#issuecomment-1198804835 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [flink] fsk119 closed pull request #20298: [FLINK-28152][sql-gateway][hive] Allow executing statement for the HiveServer2Endpoint

2022-07-28 Thread GitBox
fsk119 closed pull request #20298: [FLINK-28152][sql-gateway][hive] Allow executing statement for the HiveServer2Endpoint URL: https://github.com/apache/flink/pull/20298 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [flink] fsk119 commented on pull request #20298: [FLINK-28152][sql-gateway][hive] Allow executing statement for the HiveServer2Endpoint

2022-07-28 Thread GitBox
fsk119 commented on PR #20298: URL: https://github.com/apache/flink/pull/20298#issuecomment-1198804456 Merged into master: 6a95672db9cf23c9110ec9b0d4701e9c1e3acfa1 f477a43ff23576cd2e1f8c632f78458948245df4 1fb5875ae6e2536266275c28e6260019706c28f2 27cecdebccc95e9acf6ba38616b14e5

[GitHub] [flink] LinMingQiang commented on pull request #19995: [FLINK-28060][BP 1.15][Connector/Kafka] Updated Kafka Clients to 3.1.1

2022-07-28 Thread GitBox
LinMingQiang commented on PR #19995: URL: https://github.com/apache/flink/pull/19995#issuecomment-1198803992 After modification, only another error will be thrown. `Caused by: java.lang.NullPointerException: timestamp must to be set before retrieving it. at org.apache.flink.u

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #132: [FLINK-28571] Add AlgoOperator for Chi-squared test

2022-07-28 Thread GitBox
zhipeng93 commented on code in PR #132: URL: https://github.com/apache/flink-ml/pull/132#discussion_r932805286 ## flink-ml-lib/src/main/java/org/apache/flink/ml/stats/chisqtest/ChiSqTest.java: ## @@ -0,0 +1,492 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[jira] [Commented] (FLINK-27951) Translate the "Debugging Classloading" page into Chinese

2022-07-28 Thread Zili Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572709#comment-17572709 ] Zili Sun commented on FLINK-27951: -- [~martijnvisser] I have updated pr, can you help to

[jira] [Updated] (FLINK-27951) Translate the "Debugging Classloading" page into Chinese

2022-07-28 Thread Zili Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zili Sun updated FLINK-27951: - Labels: pull-request-available (was: pull-request-available stale-assigned) > Translate the "Debugging

[GitHub] [flink] rkhachatryan commented on a diff in pull request #20152: [FLINK-27155][changelog] Reduce multiple reads to the same Changelog …

2022-07-28 Thread GitBox
rkhachatryan commented on code in PR #20152: URL: https://github.com/apache/flink/pull/20152#discussion_r932793015 ## flink-dstl/flink-dstl-dfs/src/main/java/org/apache/flink/changelog/fs/ChangelogHandleReaderWithCache.java: ## @@ -0,0 +1,184 @@ +/* + * Licensed to the Apache So

[GitHub] [flink-ml] weibozhao commented on a diff in pull request #133: [FLINK-28601] Add Transformer for FeatureHasher

2022-07-28 Thread GitBox
weibozhao commented on code in PR #133: URL: https://github.com/apache/flink-ml/pull/133#discussion_r932782217 ## flink-ml-python/pyflink/ml/lib/feature/tests/test_feature_hasher.py: ## @@ -0,0 +1,77 @@ +###

[jira] [Updated] (FLINK-25442) HBaseConnectorITCase.testTableSink failed on azure

2022-07-28 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-25442: --- Labels: auto-deprioritized-critical test-stability (was: auto-deprioritized-critical stal

[jira] [Updated] (FLINK-26402) MinioTestContainerTest.testS3EndpointNeedsToBeSpecifiedBeforeInitializingFileSyste failed due to Container startup failed

2022-07-28 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-26402: --- Labels: auto-deprioritized-critical pull-request-available test-stability (was: pull-requ

[jira] [Updated] (FLINK-22234) Read savepoint before creating ExecutionGraph

2022-07-28 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-22234: --- Labels: auto-deprioritized-major auto-deprioritized-minor pull-request-available (was: au

[jira] [Updated] (FLINK-20020) Make UnsuccessfulExecutionException part of the JobClient.getJobExecutionResult() contract.

2022-07-28 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-20020: --- Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned pull-request-ava

[jira] [Updated] (FLINK-28234) Infinite or NaN exception for power(-1, 0.5)

2022-07-28 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-28234: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the [Flink

[jira] [Updated] (FLINK-28424) JdbcExactlyOnceSinkE2eTest hangs on Azure

2022-07-28 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-28424: --- Labels: auto-deprioritized-critical test-stability (was: stale-critical test-stability)

[jira] [Commented] (FLINK-24229) [FLIP-171] DynamoDB implementation of Async Sink

2022-07-28 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572640#comment-17572640 ] Danny Cranmer commented on FLINK-24229: --- [~Gusev] the FLIP has been accepted and t

[jira] [Commented] (FLINK-28057) LD_PRELOAD is hardcoded to x64 on flink-docker

2022-07-28 Thread Nicolas Ferrario (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572626#comment-17572626 ] Nicolas Ferrario commented on FLINK-28057: -- Hi [~yunta] [https://github.com/ap

[jira] [Comment Edited] (FLINK-14101) Introduce SqlServerDialect

2022-07-28 Thread Lim Qing Wei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572590#comment-17572590 ] Lim Qing Wei edited comment on FLINK-14101 at 7/28/22 5:59 PM: ---

[jira] [Commented] (FLINK-14101) Introduce SqlServerDialect

2022-07-28 Thread Lim Qing Wei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572590#comment-17572590 ] Lim Qing Wei commented on FLINK-14101: -- Hi [~maver1ck] I've opened a PR, it has 1 a

[GitHub] [flink] reswqa commented on a diff in pull request #20351: [FLINK-28380][runtime] Produce one intermediate dataset for multiple consumer job vertices consuming the same data

2022-07-28 Thread GitBox
reswqa commented on code in PR #20351: URL: https://github.com/apache/flink/pull/20351#discussion_r932475298 ## flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/BlockingResultPartitionReleaseTest.java: ## @@ -0,0 +1,152 @@ +/* + * Licensed to the Apache Softwa

[GitHub] [flink] reswqa commented on a diff in pull request #20351: [FLINK-28380][runtime] Produce one intermediate dataset for multiple consumer job vertices consuming the same data

2022-07-28 Thread GitBox
reswqa commented on code in PR #20351: URL: https://github.com/apache/flink/pull/20351#discussion_r932475298 ## flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/BlockingResultPartitionReleaseTest.java: ## @@ -0,0 +1,152 @@ +/* + * Licensed to the Apache Softwa

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932469341 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexBackPressureHandler.java: ## @@ -100,26 +106,73 @@ private JobVertexBackPressureInfo cr

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932469098 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/job/JobVertexTaskManagersHandler.java: ## @@ -182,30 +188,32 @@ private static JobVertexTaskManagersI

[GitHub] [flink] pltbkd commented on a diff in pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-28 Thread GitBox
pltbkd commented on code in PR #20296: URL: https://github.com/apache/flink/pull/20296#discussion_r932468662 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/handler/legacy/metrics/MetricStore.java: ## @@ -177,7 +221,9 @@ public void add(MetricDump metric) {

[GitHub] [flink] reswqa commented on a diff in pull request #20371: [FLINK-27908][network] Introduce HsResultPartition and HsSubpartitionView

2022-07-28 Thread GitBox
reswqa commented on code in PR #20371: URL: https://github.com/apache/flink/pull/20371#discussion_r932464517 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsDiskDataView.java: ## @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software Found

  1   2   3   >