[GitHub] [flink] flinkbot edited a comment on pull request #13602: [FLINK-19346][coordination] Generate and put ClusterPartitionDescriptor of ClusterPartition in JobResult when job finishes

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13602: URL: https://github.com/apache/flink/pull/13602#issuecomment-70743 ## CI report: * 1850d83aad0ad29a1a47646e24de20f5698d89f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13590: [FLINK-19570][tests] Avoid directly creating ExecutionJobVertex and ExecutionVertex via constructors in tests

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13590: URL: https://github.com/apache/flink/pull/13590#issuecomment-707004337 ## CI report: * 6b1f237058c155dfea2ba5afc56fdaf072d5fb73 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13605: [FLINK-19599][table] Introduce BulkFormatFactory&BulkWriterFactory to integrate new FileSource to table

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13605: URL: https://github.com/apache/flink/pull/13605#issuecomment-707521684 ## CI report: * a9df8a1384eb6306656b4fd952edd4be5d7a857d UNKNOWN * 8beabe2e1b04afe449610c44f4c376909b463e10 UNKNOWN Bot commands The @flinkbo

[GitHub] [flink] flinkbot commented on pull request #13606: [FLINK-19554][e2e] Implement a unified testing framework for connectors

2020-10-13 Thread GitBox
flinkbot commented on pull request #13606: URL: https://github.com/apache/flink/pull/13606#issuecomment-707535989 ## CI report: * 318c5906e851cdccd7027150e9e213db9e52d565 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[jira] [Commented] (FLINK-19584) HBaseSinkFunction no needs to create thread to flush when bufferFlushMaxMutations = 1

2020-10-13 Thread hailong wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212880#comment-17212880 ] hailong wang commented on FLINK-19584: -- Yes [~jark] , Thank you for assigning to me

[jira] [Commented] (FLINK-19587) Error result when casting binary type as varchar

2020-10-13 Thread hailong wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212879#comment-17212879 ] hailong wang commented on FLINK-19587: -- Yes [~jark] , Thank you for assigning to me

[jira] [Assigned] (FLINK-19125) Avoid memory fragmentation when running flink docker image

2020-10-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-19125: Assignee: Yun Tang > Avoid memory fragmentation when running flink docker image > ---

[GitHub] [flink] shuiqiangchen opened a new pull request #13607: [FLINK-19484][kubernetes] Set longer timeout for jobmanager pod availability detection in PyFlink native kubernetes application test.

2020-10-13 Thread GitBox
shuiqiangchen opened a new pull request #13607: URL: https://github.com/apache/flink/pull/13607 ## What is the purpose of the change The image size for native k8s pyflink application is a bit large, it might take some time to start up the pod. Currently, the timeout for wait

[jira] [Updated] (FLINK-19484) Kubernetes pyflink application test failed with "error executing jsonpath "{range .items[*]}{.metadata.name}{\"\\n\"}{end}": Error executing template: not in rang"

2020-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-19484: --- Labels: pull-request-available test-stability (was: test-stability) > Kubernetes pyflink ap

[GitHub] [flink] flinkbot commented on pull request #13607: [FLINK-19484][kubernetes] Set longer timeout for jobmanager pod availability detection in PyFlink native kubernetes application test.

2020-10-13 Thread GitBox
flinkbot commented on pull request #13607: URL: https://github.com/apache/flink/pull/13607#issuecomment-707542284 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[jira] [Assigned] (FLINK-19587) Error result when casting binary type as varchar

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-19587: --- Assignee: hailong wang > Error result when casting binary type as varchar > ---

[jira] [Assigned] (FLINK-19584) HBaseSinkFunction no needs to create thread to flush when bufferFlushMaxMutations = 1

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-19584: --- Assignee: hailong wang > HBaseSinkFunction no needs to create thread to flush when > bufferFlushMa

[GitHub] [flink] kl0u commented on pull request #13558: [FLINK-19511] Rename the 'SinkTransformation' to 'LegacySinkTransformation'

2020-10-13 Thread GitBox
kl0u commented on pull request #13558: URL: https://github.com/apache/flink/pull/13558#issuecomment-707548093 Hi @guoweiM ! Could you rebase this PR on the current master and then I will merge. Feel free of course to squash the commits here into a single commit. --

[GitHub] [flink] flinkbot edited a comment on pull request #13590: [FLINK-19570][tests] Avoid directly creating ExecutionJobVertex and ExecutionVertex via constructors in tests

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13590: URL: https://github.com/apache/flink/pull/13590#issuecomment-707004337 ## CI report: * 6b1f237058c155dfea2ba5afc56fdaf072d5fb73 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13504: [FLINK-19404][python] Support Pandas Stream Over Window Aggregation

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13504: URL: https://github.com/apache/flink/pull/13504#issuecomment-700556506 ## CI report: * 5e9643b76e1c28968baa3cf41492d55bc8ed9ad0 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13507: [FLINK-19231][python] Support ListState and ListView for Python UDAF.

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13507: URL: https://github.com/apache/flink/pull/13507#issuecomment-700666447 ## CI report: * de6024d84022ada3b5bbdbf4c6e82a47c8459d98 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13606: [FLINK-19554][e2e] Implement a unified testing framework for connectors

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13606: URL: https://github.com/apache/flink/pull/13606#issuecomment-707535989 ## CI report: * 318c5906e851cdccd7027150e9e213db9e52d565 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13605: [FLINK-19599][table] Introduce BulkFormatFactory&BulkWriterFactory to integrate new FileSource to table

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13605: URL: https://github.com/apache/flink/pull/13605#issuecomment-707521684 ## CI report: * a9df8a1384eb6306656b4fd952edd4be5d7a857d UNKNOWN * 8beabe2e1b04afe449610c44f4c376909b463e10 Azure: [FAILURE](https://dev.azure.com/apache-fl

[GitHub] [flink] kl0u commented on a change in pull request #13576: [FLINK-19512] Introduce the new sink API

2020-10-13 Thread GitBox
kl0u commented on a change in pull request #13576: URL: https://github.com/apache/flink/pull/13576#discussion_r503729631 ## File path: flink-core/src/main/java/org/apache/flink/api/connector/sink/Committer.java ## @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [flink] kl0u commented on a change in pull request #13576: [FLINK-19512] Introduce the new sink API

2020-10-13 Thread GitBox
kl0u commented on a change in pull request #13576: URL: https://github.com/apache/flink/pull/13576#discussion_r503729631 ## File path: flink-core/src/main/java/org/apache/flink/api/connector/sink/Committer.java ## @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [flink] aljoscha commented on a change in pull request #13596: [FLINK-19475] Implement a time service for the batch execution mode

2020-10-13 Thread GitBox
aljoscha commented on a change in pull request #13596: URL: https://github.com/apache/flink/pull/13596#discussion_r503729515 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/sorted/state/BatchExecutionInternalTimeService.java ## @@ -0,0

[jira] [Commented] (FLINK-19553) The format of checkpoint Completion Time and Failure Time should be changed from HH:mm:ss to yyyy-MM-dd HH:mm:ss

2020-10-13 Thread liufangliang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212893#comment-17212893 ] liufangliang commented on FLINK-19553: -- [~yunta] Thanks for your reply. assign to m

[GitHub] [flink] rkhachatryan commented on a change in pull request #13565: [FLINK-17073][checkpointing] Backpressure checkpointing on slow cleanup

2020-10-13 Thread GitBox
rkhachatryan commented on a change in pull request #13565: URL: https://github.com/apache/flink/pull/13565#discussion_r503730533 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/PendingCheckpoint.java ## @@ -531,6 +527,30 @@ private void dispose(bo

[jira] [Created] (FLINK-19603) Introduce shuffle data compression to sort-merge based blocking shuffle

2020-10-13 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-19603: --- Summary: Introduce shuffle data compression to sort-merge based blocking shuffle Key: FLINK-19603 URL: https://issues.apache.org/jira/browse/FLINK-19603 Project: Flink

[GitHub] [flink] dawidwys commented on a change in pull request #13596: [FLINK-19475] Implement a time service for the batch execution mode

2020-10-13 Thread GitBox
dawidwys commented on a change in pull request #13596: URL: https://github.com/apache/flink/pull/13596#discussion_r503730798 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/sorted/state/BatchExecutionInternalTimeService.java ## @@ -0,0

[GitHub] [flink] aljoscha commented on a change in pull request #13583: [FLINK-19154] ApplicationDispatcherBootstrap clean up HA data only when necessary.

2020-10-13 Thread GitBox
aljoscha commented on a change in pull request #13583: URL: https://github.com/apache/flink/pull/13583#discussion_r503731517 ## File path: flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherGatewayServiceFactory.java ## @@ -92,6 +91

[jira] [Assigned] (FLINK-19553) The format of checkpoint Completion Time and Failure Time should be changed from HH:mm:ss to yyyy-MM-dd HH:mm:ss

2020-10-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-19553: Assignee: liufangliang > The format of checkpoint Completion Time and Failure Time should be chan

[GitHub] [flink] pnowojski commented on pull request #13562: [FLINK-18662][metrics][checkpointing] Provide processed/persisted bytes metrics and update alignment time metric.

2020-10-13 Thread GitBox
pnowojski commented on pull request #13562: URL: https://github.com/apache/flink/pull/13562#issuecomment-707555681 Yes, it was generated. I think previously I modified just the Web UI definitions, not the docs. And I guess the generate docs script, is not updating the Web UI definitions.

[jira] [Commented] (FLINK-19582) Introduce sort-merge based blocking shuffle to Flink

2020-10-13 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212898#comment-17212898 ] Dawid Wysakowicz commented on FLINK-19582: -- Hi [~kevin.cyj], Can you point me t

[jira] [Commented] (FLINK-19553) The format of checkpoint Completion Time and Failure Time should be changed from HH:mm:ss to yyyy-MM-dd HH:mm:ss

2020-10-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212897#comment-17212897 ] Yun Tang commented on FLINK-19553: -- [~liufangliang] Already assign to you, please go ah

[jira] [Updated] (FLINK-19553) The format of checkpoint Completion Time and Failure Time should be changed from HH:mm:ss to yyyy-MM-dd HH:mm:ss

2020-10-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-19553: - Fix Version/s: 1.12.0 > The format of checkpoint Completion Time and Failure Time should be changed > f

[jira] [Assigned] (FLINK-19589) Expose extra options in the S3 FileSystem

2020-10-13 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-19589: --- Assignee: Padarn Wilson > Expose extra options in the S3 FileSystem > -

[GitHub] [flink] guoweiM commented on a change in pull request #13576: [FLINK-19512] Introduce the new sink API

2020-10-13 Thread GitBox
guoweiM commented on a change in pull request #13576: URL: https://github.com/apache/flink/pull/13576#discussion_r503741117 ## File path: flink-core/src/main/java/org/apache/flink/api/connector/sink/Committer.java ## @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [flink] flinkbot edited a comment on pull request #13507: [FLINK-19231][python] Support ListState and ListView for Python UDAF.

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13507: URL: https://github.com/apache/flink/pull/13507#issuecomment-700666447 ## CI report: * 32df357f8334410a819301bb1a1425681185a48e Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/resul

[GitHub] [flink] zhijiangW commented on pull request #13523: [FLINK-15981][network] Implement FileRegion way to shuffle file-based blocking partition in network stack

2020-10-13 Thread GitBox
zhijiangW commented on pull request #13523: URL: https://github.com/apache/flink/pull/13523#issuecomment-707562596 FYI, the last four commits separation is only for easy review, will be squashed finally before merging. This

[GitHub] [flink] shuiqiangchen commented on a change in pull request #13572: [FLINK-19416][python] Support Python datetime object in from_collection of Python DataStream

2020-10-13 Thread GitBox
shuiqiangchen commented on a change in pull request #13572: URL: https://github.com/apache/flink/pull/13572#discussion_r503742983 ## File path: flink-python/src/main/java/org/apache/flink/api/common/python/PythonBridgeUtils.java ## @@ -74,6 +75,20 @@ return unp

[GitHub] [flink] flinkbot commented on pull request #13607: [FLINK-19484][kubernetes] Set longer timeout for jobmanager pod availability detection in PyFlink native kubernetes application test.

2020-10-13 Thread GitBox
flinkbot commented on pull request #13607: URL: https://github.com/apache/flink/pull/13607#issuecomment-707563347 ## CI report: * 0523bbc1cd02addf3327dd8f0c4d817f9d7a247e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[jira] [Created] (FLINK-19604) FLIP-145: Support SQL windowing table-valued function

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19604: --- Summary: FLIP-145: Support SQL windowing table-valued function Key: FLINK-19604 URL: https://issues.apache.org/jira/browse/FLINK-19604 Project: Flink Issue Type: New F

[jira] [Created] (FLINK-19605) Implement cumulative windowing for window aggregate operator

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19605: --- Summary: Implement cumulative windowing for window aggregate operator Key: FLINK-19605 URL: https://issues.apache.org/jira/browse/FLINK-19605 Project: Flink Issue Typ

[jira] [Created] (FLINK-19607) Implement streaming window TopN operator

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19607: --- Summary: Implement streaming window TopN operator Key: FLINK-19607 URL: https://issues.apache.org/jira/browse/FLINK-19607 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19606) Implement streaming window join operator

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19606: --- Summary: Implement streaming window join operator Key: FLINK-19606 URL: https://issues.apache.org/jira/browse/FLINK-19606 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19608) Support window TVF based window aggreagte in planner

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19608: --- Summary: Support window TVF based window aggreagte in planner Key: FLINK-19608 URL: https://issues.apache.org/jira/browse/FLINK-19608 Project: Flink Issue Type: Sub-ta

[jira] [Assigned] (FLINK-16428) Fine-grained network buffer management for backpressure

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang reassigned FLINK-16428: Assignee: (was: Zhijiang) > Fine-grained network buffer management for backpressure > ---

[GitHub] [flink] StephanEwen commented on pull request #13479: [FLINK-19414][parquet] Introduce ParquetColumnarRowInputFormat

2020-10-13 Thread GitBox
StephanEwen commented on pull request #13479: URL: https://github.com/apache/flink/pull/13479#issuecomment-707569225 @JingsongLi I think we merged something here that has a problem: We should not have a `test-jar` for the `flink-connector-files` project, because the module it is not scala

[jira] [Created] (FLINK-19609) Support streaming window join in planner

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19609: --- Summary: Support streaming window join in planner Key: FLINK-19609 URL: https://issues.apache.org/jira/browse/FLINK-19609 Project: Flink Issue Type: Sub-task

[GitHub] [flink] shuiqiangchen commented on a change in pull request #13572: [FLINK-19416][python] Support Python datetime object in from_collection of Python DataStream

2020-10-13 Thread GitBox
shuiqiangchen commented on a change in pull request #13572: URL: https://github.com/apache/flink/pull/13572#discussion_r503749442 ## File path: flink-python/pyflink/datastream/tests/test_stream_execution_environment.py ## @@ -226,50 +227,55 @@ def test_execute(self):

[jira] [Closed] (FLINK-13493) BoundedBlockingSubpartition only notifies onConsumedSubpartition when all the readers are empty

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-13493. Resolution: Later Close this issue for cleanup since it is not really important ATM and we can reopen it

[jira] [Created] (FLINK-19610) Support streaming window TopN in planner

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19610: --- Summary: Support streaming window TopN in planner Key: FLINK-19610 URL: https://issues.apache.org/jira/browse/FLINK-19610 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-19605) Implement cumulative windowing for window aggregate operator

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-19605: Fix Version/s: 1.12.0 > Implement cumulative windowing for window aggregate operator > ---

[jira] [Assigned] (FLINK-19608) Support window TVF based window aggreagte in planner

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-19608: --- Assignee: Jark Wu > Support window TVF based window aggreagte in planner >

[jira] [Assigned] (FLINK-19605) Implement cumulative windowing for window aggregate operator

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-19605: --- Assignee: Jark Wu > Implement cumulative windowing for window aggregate operator >

[jira] [Created] (FLINK-19611) Introduce WindowProperties MetadataHandler to propagate window properties

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19611: --- Summary: Introduce WindowProperties MetadataHandler to propagate window properties Key: FLINK-19611 URL: https://issues.apache.org/jira/browse/FLINK-19611 Project: Flink

[jira] [Updated] (FLINK-19606) Implement streaming window join operator

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-19606: Fix Version/s: 1.12.0 > Implement streaming window join operator > ---

[jira] [Assigned] (FLINK-19609) Support streaming window join in planner

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-19609: --- Assignee: Danny Chen > Support streaming window join in planner > -

[jira] [Updated] (FLINK-19608) Support window TVF based window aggreagte in planner

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-19608: Fix Version/s: 1.12.0 > Support window TVF based window aggreagte in planner > ---

[jira] [Assigned] (FLINK-19606) Implement streaming window join operator

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-19606: --- Assignee: Danny Chen > Implement streaming window join operator > -

[jira] [Assigned] (FLINK-19611) Introduce WindowProperties MetadataHandler to propagate window properties

2020-10-13 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-19611: --- Assignee: Jark Wu > Introduce WindowProperties MetadataHandler to propagate window properties > ---

[GitHub] [flink] HuangXingBo opened a new pull request #13608: [FLINK-18836][python] Support Python UDTF return type is Row

2020-10-13 Thread GitBox
HuangXingBo opened a new pull request #13608: URL: https://github.com/apache/flink/pull/13608 ## What is the purpose of the change *This pull request will support Python UDTF return type is Row* ## Brief change log - *Add the support of UDTF return type is Row*

[jira] [Closed] (FLINK-13478) Decouple two different release strategies in BoundedBlockingSubpartition

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-13478. Resolution: Won't Fix This issue is out of date since partition release logics have changed a lot before.

[jira] [Updated] (FLINK-18836) Python UDTF doesn't work well when the return type isn't generator

2020-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-18836: --- Labels: pull-request-available (was: ) > Python UDTF doesn't work well when the return type

[GitHub] [flink] flinkbot edited a comment on pull request #13523: [FLINK-15981][network] Implement FileRegion way to shuffle file-based blocking partition in network stack

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13523: URL: https://github.com/apache/flink/pull/13523#issuecomment-701325670 ## CI report: * a4198d83d630c6efa49d0153142e201426bc6507 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot commented on pull request #13608: [FLINK-18836][python] Support Python UDTF return type is Row

2020-10-13 Thread GitBox
flinkbot commented on pull request #13608: URL: https://github.com/apache/flink/pull/13608#issuecomment-707573135 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[jira] [Closed] (FLINK-7282) Credit-based Network Flow Control

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-7282. --- Resolution: Fixed > Credit-based Network Flow Control > - > >

[GitHub] [flink] StephanEwen commented on pull request #13479: [FLINK-19414][parquet] Introduce ParquetColumnarRowInputFormat

2020-10-13 Thread GitBox
StephanEwen commented on pull request #13479: URL: https://github.com/apache/flink/pull/13479#issuecomment-707573526 One more comment: I am not sure that it is good to reuse the `FileSourceTextLinesITCase` for other tests. That is an ITCase that is rather heavy and not very targeted. It is

[GitHub] [flink] flinkbot edited a comment on pull request #13572: [FLINK-19416][python] Support Python datetime object in from_collection of Python DataStream

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13572: URL: https://github.com/apache/flink/pull/13572#issuecomment-706203264 ## CI report: * a598a13d463908f3ffe49a201f0f0fb863592c0c UNKNOWN * 5744e4aaf4df85dd1b080c3fed2cf5fe944133cd Azure: [FAILURE](https://dev.azure.com/apache-fl

[GitHub] [flink] qinghui-xu opened a new pull request #13609: FLINK-19523: Hide sensitive info from log

2020-10-13 Thread GitBox
qinghui-xu opened a new pull request #13609: URL: https://github.com/apache/flink/pull/13609 Sensitive informations from configuration files are already masked. Port the same behaviour to the logging of program arguments. ## What is the purpose of the change *(For exam

[jira] [Created] (FLINK-19612) Support CUMULATE window table function in planner

2020-10-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-19612: --- Summary: Support CUMULATE window table function in planner Key: FLINK-19612 URL: https://issues.apache.org/jira/browse/FLINK-19612 Project: Flink Issue Type: Sub-task

[GitHub] [flink] flinkbot edited a comment on pull request #13607: [FLINK-19484][kubernetes] Set longer timeout for jobmanager pod availability detection in PyFlink native kubernetes application test.

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13607: URL: https://github.com/apache/flink/pull/13607#issuecomment-707563347 ## CI report: * 0523bbc1cd02addf3327dd8f0c4d817f9d7a247e Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13603: [FLINK-19591][jdbc] Add missing @Internal annotation SimpleJdbcConnec…

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13603: URL: https://github.com/apache/flink/pull/13603#issuecomment-707466377 ## CI report: * 69a5eb85f05732ff9066905b825fcda9c517a9e8 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13595: [FLINK-19582][network] Introduce sort-merge based blocking shuffle to Flink

2020-10-13 Thread GitBox
flinkbot edited a comment on pull request #13595: URL: https://github.com/apache/flink/pull/13595#issuecomment-707168234 ## CI report: * 96fc01e7f199429da15dbcae89762c9314e6780a Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[jira] [Updated] (FLINK-19523) Secrets should be filtered out from logs

2020-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-19523: --- Labels: pull-request-available (was: ) > Secrets should be filtered out from logs > ---

[jira] [Commented] (FLINK-19582) Introduce sort-merge based blocking shuffle to Flink

2020-10-13 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212928#comment-17212928 ] Yingjie Cao commented on FLINK-19582: - [~dwysakowicz] Thanks for your interests. The

[GitHub] [flink] flinkbot commented on pull request #13609: FLINK-19523: Hide sensitive info from log

2020-10-13 Thread GitBox
flinkbot commented on pull request #13609: URL: https://github.com/apache/flink/pull/13609#issuecomment-707576366 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[jira] [Commented] (FLINK-9253) Make buffer count per InputGate always #channels*buffersPerChannel + ExclusiveBuffers

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212929#comment-17212929 ] Zhijiang commented on FLINK-9253: - [~NicoK] I just closed the parent umbrella ticket for

[jira] [Updated] (FLINK-14551) Unaligned checkpoints

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang updated FLINK-14551: - Fix Version/s: (was: 1.12.0) 1.11.0 > Unaligned checkpoints > ---

[GitHub] [flink] guoweiM commented on pull request #13558: [FLINK-19511] Rename the 'SinkTransformation' to 'LegacySinkTransformation'

2020-10-13 Thread GitBox
guoweiM commented on pull request #13558: URL: https://github.com/apache/flink/pull/13558#issuecomment-707578729 ok np. This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[jira] [Closed] (FLINK-14551) Unaligned checkpoints

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-14551. Resolution: Fixed > Unaligned checkpoints > - > > Key: FLINK-14551 >

[jira] [Updated] (FLINK-17741) Create integration or e2e test for out of order (savepoint) barriers

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang updated FLINK-17741: - Parent: (was: FLINK-14551) Issue Type: Task (was: Sub-task) > Create integration or e2e tes

[jira] [Closed] (FLINK-15187) Reuse LocalBufferPool for FileBufferReader in blocking partition

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-15187. Resolution: Fixed Resolved in FLINK-15981 > Reuse LocalBufferPool for FileBufferReader in blocking partit

[GitHub] [flink] tillrohrmann commented on a change in pull request #13583: [FLINK-19154] ApplicationDispatcherBootstrap clean up HA data only when necessary.

2020-10-13 Thread GitBox
tillrohrmann commented on a change in pull request #13583: URL: https://github.com/apache/flink/pull/13583#discussion_r503761015 ## File path: flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherGatewayServiceFactory.java ## @@ -92,6

[jira] [Updated] (FLINK-17741) Create integration or e2e test for out of order (savepoint) barriers

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang updated FLINK-17741: - Parent: FLINK-19442 Issue Type: Sub-task (was: Task) > Create integration or e2e test for out o

[jira] [Closed] (FLINK-16739) PrestoS3FileSystemITCase#testSimpleFileWriteAndRead fails with no such key

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-16739. Resolution: Cannot Reproduce Close it for cleanup since it was not reproduced in recent half a year. > Pr

[GitHub] [flink] tillrohrmann commented on a change in pull request #13590: [FLINK-19570][tests] Avoid directly creating ExecutionJobVertex and ExecutionVertex via constructors in tests

2020-10-13 Thread GitBox
tillrohrmann commented on a change in pull request #13590: URL: https://github.com/apache/flink/pull/13590#discussion_r503764323 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/jobmanager/scheduler/ScheduleWithCoLocationHintTest.java ## @@ -306,25 +306,25 @@

[jira] [Updated] (FLINK-19589) Expose extra options in the S3 FileSystem

2020-10-13 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19589: Affects Version/s: 1.12.0 > Expose extra options in the S3 FileSystem > --

[GitHub] [flink] tillrohrmann commented on a change in pull request #13590: [FLINK-19570][tests] Avoid directly creating ExecutionJobVertex and ExecutionVertex via constructors in tests

2020-10-13 Thread GitBox
tillrohrmann commented on a change in pull request #13590: URL: https://github.com/apache/flink/pull/13590#discussion_r503764531 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/ExecutionTest.java ## @@ -282,61 +278,6 @@ public void testSlotAl

[jira] [Closed] (FLINK-15963) Reuse the same ByteBuf while writing the BufferResponse header

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-15963. Resolution: Later Close it for cleanup since it is not really critical by now and nobody has time to work

[jira] [Closed] (FLINK-19155) ResultPartitionTest is unstable

2020-10-13 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijiang closed FLINK-19155. Resolution: Won't Fix Close it since this ut has already been removed in another refactoring work. > Resu

[GitHub] [flink] tillrohrmann commented on a change in pull request #13553: [FLINK-19306][coordination] Add DeclarativeSlotManager

2020-10-13 Thread GitBox
tillrohrmann commented on a change in pull request #13553: URL: https://github.com/apache/flink/pull/13553#discussion_r503766650 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/ResourceManager.java ## @@ -861,6 +884,8 @@ protected void closeJ

[GitHub] [flink] zhijiangW closed pull request #13482: test

2020-10-13 Thread GitBox
zhijiangW closed pull request #13482: URL: https://github.com/apache/flink/pull/13482 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [flink] zhijiangW closed pull request #7197: [FLINK-12909][flink-runtime][network] continue trying to find a suitable spilling channel even in case of exceptions

2020-10-13 Thread GitBox
zhijiangW closed pull request #7197: URL: https://github.com/apache/flink/pull/7197 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink] zhijiangW commented on pull request #7197: [FLINK-12909][flink-runtime][network] continue trying to find a suitable spilling channel even in case of exceptions

2020-10-13 Thread GitBox
zhijiangW commented on pull request #7197: URL: https://github.com/apache/flink/pull/7197#issuecomment-707585212 Close this PR for cleanup since we can not reach @maqingxiang for further feedback for a long time. This is an

[GitHub] [flink] zentol commented on a change in pull request #13561: [FLINK-19315][coordination] Add AllocatedSlotPool

2020-10-13 Thread GitBox
zentol commented on a change in pull request #13561: URL: https://github.com/apache/flink/pull/13561#discussion_r503767564 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/slotpool/DefaultAllocatedSlotPoolTest.java ## @@ -0,0 +1,315 @@ +/* + * Licen

[GitHub] [flink] JingsongLi opened a new pull request #13610: [FLINK-19414][file connector] Revert "Extract FileSourceTextLinesITCase to AbstractFileSourceITCase"

2020-10-13 Thread GitBox
JingsongLi opened a new pull request #13610: URL: https://github.com/apache/flink/pull/13610 ## What is the purpose of the change From @StephanEwen We should not have a test-jar for the flink-connector-files project, because the module it is not scala-versioned. Thus we cannot re

[GitHub] [flink] rmetzger commented on a change in pull request #13520: [FLINK-19450][python][AZP] Optimize the Python CI Test

2020-10-13 Thread GitBox
rmetzger commented on a change in pull request #13520: URL: https://github.com/apache/flink/pull/13520#discussion_r503768738 ## File path: tools/azure-pipelines/jobs-template.yml ## @@ -142,7 +142,7 @@ jobs: source ./tools/azure-pipelines/debug_files_utils.sh prep

[GitHub] [flink] rmetzger commented on a change in pull request #13520: [FLINK-19450][python][AZP] Optimize the Python CI Test

2020-10-13 Thread GitBox
rmetzger commented on a change in pull request #13520: URL: https://github.com/apache/flink/pull/13520#discussion_r503769029 ## File path: tools/ci/test_controller.sh ## @@ -101,7 +102,7 @@ fi # = i

[GitHub] [flink] zhijiangW commented on pull request #8756: [FLINK-12406] [Runtime] Report BLOCKING_PERSISTENT result partition meta back to client

2020-10-13 Thread GitBox
zhijiangW commented on pull request #8756: URL: https://github.com/apache/flink/pull/8756#issuecomment-707586440 @Xpray what is the status of this PR? I found it inactive for more than a year. Do we need to close it for cleanup? --

[jira] [Commented] (FLINK-19358) when submit job on application mode with HA,the jobid will be 0000000000

2020-10-13 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212945#comment-17212945 ] Till Rohrmann commented on FLINK-19358: --- >From the existing alternatives, I would

[GitHub] [flink] flinkbot commented on pull request #13610: [FLINK-19414][file connector] Revert "Extract FileSourceTextLinesITCase to AbstractFileSourceITCase"

2020-10-13 Thread GitBox
flinkbot commented on pull request #13610: URL: https://github.com/apache/flink/pull/13610#issuecomment-707586868 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[GitHub] [flink] zentol commented on a change in pull request #13561: [FLINK-19315][coordination] Add AllocatedSlotPool

2020-10-13 Thread GitBox
zentol commented on a change in pull request #13561: URL: https://github.com/apache/flink/pull/13561#discussion_r503769706 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/DefaultAllocatedSlotPool.java ## @@ -0,0 +1,218 @@ +/* + * Licensed

[jira] [Reopened] (FLINK-19414) Introduce ParquetColumnarRowInputFormat

2020-10-13 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reopened FLINK-19414: -- Reopen this ticket. We need add format test (Extends FileSource abstract class) for parquet. > I

  1   2   3   4   5   6   >