[jira] [Created] (FLINK-21180) Move the state module from 'pyflink.common' to 'pyflink.datastream'

2021-01-27 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-21180: - Summary: Move the state module from 'pyflink.common' to 'pyflink.datastream' Key: FLINK-21180 URL: https://issues.apache.org/jira/browse/FLINK-21180 Project: Flink

[GitHub] [flink] KarmaGYZ commented on pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on pull request #14647: URL: https://github.com/apache/flink/pull/14647#issuecomment-768869214 @zentol I also glad to have a unified SlotManager. As the feature is not stable. I tend to put it out of the scope of this PR.

[GitHub] [flink] flinkbot edited a comment on pull request #14783: [FLINK-21169][kafka] flink-connector-base dependency should be scope compile

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14783: URL: https://github.com/apache/flink/pull/14783#issuecomment-768767423 ## CI report: * ea0fa2c3a97b2d2082b40732850ccc960ba7a09e Azure:

[GitHub] [flink] KarmaGYZ commented on pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on pull request #14647: URL: https://github.com/apache/flink/pull/14647#issuecomment-768868239 Thanks for the review @xintongsong . All your comments have been addressed. This is an automated message from

[jira] [Commented] (FLINK-20838) Implement SlotRequestAdapter for the FineGrainedSlotManager

2021-01-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273388#comment-17273388 ] Xintong Song commented on FLINK-20838: -- There a todo item from FLINK-20835, that should be

[jira] [Updated] (FLINK-21174) Optimize the performance of ResourceAllocationStrategy

2021-01-27 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yangze Guo updated FLINK-21174: --- Parent: FLINK-14187 Issue Type: Sub-task (was: Improvement) > Optimize the performance of

[jira] [Updated] (FLINK-21177) Introduce the counterpart of slotmanager.number-of-slots.max in fine-grained resource management

2021-01-27 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yangze Guo updated FLINK-21177: --- Parent: FLINK-14187 Issue Type: Sub-task (was: New Feature) > Introduce the counterpart of

[GitHub] [flink] flinkbot edited a comment on pull request #14787: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14787: URL: https://github.com/apache/flink/pull/14787#issuecomment-768849685 ## CI report: * 43d7e4e3c23451fd7cf18cfaa7ba91d8ee47bd60 Azure:

[GitHub] [flink] flinkbot commented on pull request #14787: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
flinkbot commented on pull request #14787: URL: https://github.com/apache/flink/pull/14787#issuecomment-768849685 ## CI report: * 43d7e4e3c23451fd7cf18cfaa7ba91d8ee47bd60 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot edited a comment on pull request #14786: [FLINK-19592] [Table SQL / Runtime] MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction emit messages to prevent too early

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14786: URL: https://github.com/apache/flink/pull/14786#issuecomment-768805034 ## CI report: * 0d544bd5e5eb4b7fa39a82da9aad46758d994faf Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14774: [FLINK-21163][python] Fix the issue that Python dependencies specified via CLI override the dependencies specified in configuration

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14774: URL: https://github.com/apache/flink/pull/14774#issuecomment-768234538 ## CI report: * 54a8354c03402cedbfe56f8e8e7336f2d9072e34 Azure:

[jira] [Updated] (FLINK-21179) Make sure that the open/close methods of the Python DataStream Function are not implemented when using in ReducingState and AggregatingState

2021-01-27 Thread Wei Zhong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhong updated FLINK-21179: -- Description: As the ReducingState and AggregatingState only support non-rich functions, we need to

[GitHub] [flink] flinkbot commented on pull request #14787: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
flinkbot commented on pull request #14787: URL: https://github.com/apache/flink/pull/14787#issuecomment-768845020 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] leonardBang opened a new pull request #14787: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
leonardBang opened a new pull request #14787: URL: https://github.com/apache/flink/pull/14787 ## What is the purpose of the change * This pull request aims to fix Blink planner does not ingest the row time timestamp into `StreamRecord` when leaving Table/SQL ## Brief change

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-01-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273372#comment-17273372 ] Xintong Song commented on FLINK-18634: --

[GitHub] [flink] pengkangjing edited a comment on pull request #14779: [FLINK-21158][Runtime/Web Frontend] wrong jvm metaspace and overhead size show in taskmanager metric page

2021-01-27 Thread GitBox
pengkangjing edited a comment on pull request #14779: URL: https://github.com/apache/flink/pull/14779#issuecomment-768836183 @xintongsong Another error seems to be not related to this change

[jira] [Commented] (FLINK-21138) KvStateServerHandler is not invoked with user code classloader

2021-01-27 Thread Maciej Prochniak (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273371#comment-17273371 ] Maciej Prochniak commented on FLINK-21138: -- I think using original.getClass().getClassLoader()

[jira] [Assigned] (FLINK-21134) Reactive mode: Introduce execution mode configuration key and check for supported ClusterEntrypoint type

2021-01-27 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-21134: -- Assignee: Robert Metzger > Reactive mode: Introduce execution mode configuration key

[GitHub] [flink] flinkbot edited a comment on pull request #14786: [FLINK-19592] [Table SQL / Runtime] MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction emit messages to prevent too early

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14786: URL: https://github.com/apache/flink/pull/14786#issuecomment-768805034 ## CI report: * 0d544bd5e5eb4b7fa39a82da9aad46758d994faf Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14774: [FLINK-21163][python] Fix the issue that Python dependencies specified via CLI override the dependencies specified in configuration

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14774: URL: https://github.com/apache/flink/pull/14774#issuecomment-768234538 ## CI report: * 54a8354c03402cedbfe56f8e8e7336f2d9072e34 Azure:

[jira] [Created] (FLINK-21179) Split the base class of Python DataStream Function to 'Function' and 'RichFunction'

2021-01-27 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-21179: - Summary: Split the base class of Python DataStream Function to 'Function' and 'RichFunction' Key: FLINK-21179 URL: https://issues.apache.org/jira/browse/FLINK-21179

[GitHub] [flink] CPS794 commented on pull request #14786: [FLINK-19592] [Table SQL / Runtime] MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction emit messages to prevent too early state evi

2021-01-27 Thread GitBox
CPS794 commented on pull request #14786: URL: https://github.com/apache/flink/pull/14786#issuecomment-768836986 @flinkbot run azure This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [flink] pengkangjing commented on pull request #14779: [FLINK-21158][Runtime/Web Frontend] wrong jvm metaspace and overhead size show in taskmanager metric page

2021-01-27 Thread GitBox
pengkangjing commented on pull request #14779: URL: https://github.com/apache/flink/pull/14779#issuecomment-768836183 @xintongsong Another error seem to be not related to this change

[jira] [Created] (FLINK-21178) Task failure will not trigger master hook's reset()

2021-01-27 Thread Brian Zhou (Jira)
Brian Zhou created FLINK-21178: -- Summary: Task failure will not trigger master hook's reset() Key: FLINK-21178 URL: https://issues.apache.org/jira/browse/FLINK-21178 Project: Flink Issue Type:

[GitHub] [flink] PatrickRen commented on pull request #14783: [FLINK-21169][kafka] flink-connector-base dependency should be scope compile

2021-01-27 Thread GitBox
PatrickRen commented on pull request #14783: URL: https://github.com/apache/flink/pull/14783#issuecomment-768833202 Hello @tweise and @becketqin ~ I think putting flink-connector-base JAR under lib directory of Flink distribution might be a better choice. After eventually all connectors

[GitHub] [flink] flinkbot edited a comment on pull request #14774: [FLINK-21163][python] Fix the issue that Python dependencies specified via CLI override the dependencies specified in configuration

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14774: URL: https://github.com/apache/flink/pull/14774#issuecomment-768234538 ## CI report: * 54a8354c03402cedbfe56f8e8e7336f2d9072e34 Azure:

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565849050 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/FineGrainedSlotManager.java ## @@ -0,0 +1,790 @@ +/* + *

[jira] [Created] (FLINK-21177) Introduce the counterpart of slotmanager.number-of-slots.max in fine-grained resource management

2021-01-27 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21177: -- Summary: Introduce the counterpart of slotmanager.number-of-slots.max in fine-grained resource management Key: FLINK-21177 URL: https://issues.apache.org/jira/browse/FLINK-21177

[jira] [Updated] (FLINK-21177) Introduce the counterpart of slotmanager.number-of-slots.max in fine-grained resource management

2021-01-27 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yangze Guo updated FLINK-21177: --- Issue Type: New Feature (was: Improvement) > Introduce the counterpart of

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565846698 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/ResourceAllocationResult.java ## @@ -0,0 +1,121 @@ +/* +

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565846698 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/ResourceAllocationResult.java ## @@ -0,0 +1,121 @@ +/* +

[jira] [Assigned] (FLINK-21172) canal-json format include es field

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-21172: --- Assignee: Nicholas Jiang > canal-json format include es field > --

[jira] [Commented] (FLINK-21172) canal-json format include es field

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273356#comment-17273356 ] Jark Wu commented on FLINK-21172: - What metadata key do you want to propose? [~nicholasjiang] >

[jira] [Created] (FLINK-21176) Translate updates on Confluent Avro Format page

2021-01-27 Thread Jark Wu (Jira)
Jark Wu created FLINK-21176: --- Summary: Translate updates on Confluent Avro Format page Key: FLINK-21176 URL: https://issues.apache.org/jira/browse/FLINK-21176 Project: Flink Issue Type: Task

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565845168 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DefaultResourceAllocationStrategy.java ## @@ -0,0 +1,233

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565845168 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DefaultResourceAllocationStrategy.java ## @@ -0,0 +1,233

[jira] [Closed] (FLINK-20999) Confluent Avro Format should document how to serialize kafka keys

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-20999. --- Resolution: Fixed Fixed in master: 2596c12f7fe6b55bfc8708e1f61d3521703225b3 > Confluent Avro Format should

[GitHub] [flink] wuchong merged pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
wuchong merged pull request #14764: URL: https://github.com/apache/flink/pull/14764 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (FLINK-20659) YARNSessionCapacitySchedulerITCase.perJobYarnClusterOffHeap test failed with NPE

2021-01-27 Thread Guowei Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273349#comment-17273349 ] Guowei Ma commented on FLINK-20659: ---

[jira] [Created] (FLINK-21175) OneInputStreamTaskTest.testWatermarkMetrics:914 expected:<1> but was:<-9223372036854775808>

2021-01-27 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21175: - Summary: OneInputStreamTaskTest.testWatermarkMetrics:914 expected:<1> but was:<-9223372036854775808> Key: FLINK-21175 URL: https://issues.apache.org/jira/browse/FLINK-21175

[jira] [Created] (FLINK-21174) Optimize the performance of ResourceAllocationStrategy

2021-01-27 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21174: -- Summary: Optimize the performance of ResourceAllocationStrategy Key: FLINK-21174 URL: https://issues.apache.org/jira/browse/FLINK-21174 Project: Flink Issue

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565842059 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DefaultResourceAllocationStrategy.java ## @@ -0,0 +1,233

[jira] [Commented] (FLINK-21172) canal-json format include es field

2021-01-27 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273347#comment-17273347 ] Nicholas Jiang commented on FLINK-21172: I agree with the point of [~jiabao.sun][~jark].

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-01-27 Thread Guowei Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273344#comment-17273344 ] Guowei Ma commented on FLINK-18634: ---

[jira] [Commented] (FLINK-20329) Elasticsearch7DynamicSinkITCase hangs

2021-01-27 Thread Guowei Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273341#comment-17273341 ] Guowei Ma commented on FLINK-20329: ---

[jira] [Created] (FLINK-21173) "Streaming SQL end-to-end test (Old planner)" e2e test failed

2021-01-27 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21173: - Summary: "Streaming SQL end-to-end test (Old planner)" e2e test failed Key: FLINK-21173 URL: https://issues.apache.org/jira/browse/FLINK-21173 Project: Flink

[jira] [Updated] (FLINK-21173) "Streaming SQL end-to-end test (Old planner)" e2e test failed

2021-01-27 Thread Guowei Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guowei Ma updated FLINK-21173: -- Labels: test-stability (was: ) > "Streaming SQL end-to-end test (Old planner)" e2e test failed >

[GitHub] [flink] flinkbot edited a comment on pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14764: URL: https://github.com/apache/flink/pull/14764#issuecomment-767576041 ## CI report: * 038ad0d6915e874ca32cce0da55184a436737a53 Azure:

[jira] [Commented] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-27 Thread Guowei Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273339#comment-17273339 ] Guowei Ma commented on FLINK-21104: ---

[GitHub] [flink] flinkbot edited a comment on pull request #14786: [FLINK-19592] [Table SQL / Runtime] MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction emit messages to prevent too early

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14786: URL: https://github.com/apache/flink/pull/14786#issuecomment-768805034 ## CI report: * 0d544bd5e5eb4b7fa39a82da9aad46758d994faf Azure:

[GitHub] [flink] flinkbot commented on pull request #14786: [FLINK-19592] [Table SQL / Runtime] MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction emit messages to prevent too early state e

2021-01-27 Thread GitBox
flinkbot commented on pull request #14786: URL: https://github.com/apache/flink/pull/14786#issuecomment-768805034 ## CI report: * 0d544bd5e5eb4b7fa39a82da9aad46758d994faf UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot edited a comment on pull request #14779: [FLINK-21158][Runtime/Web Frontend] wrong jvm metaspace and overhead size show in taskmanager metric page

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14779: URL: https://github.com/apache/flink/pull/14779#issuecomment-768302027 ## CI report: * 9863d9e8363e2c6bf2e32394f04579ace32a88fc Azure:

[GitHub] [flink] flinkbot commented on pull request #14786: [FLINK-19592] [Table SQL / Runtime] MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction emit messages to prevent too early state e

2021-01-27 Thread GitBox
flinkbot commented on pull request #14786: URL: https://github.com/apache/flink/pull/14786#issuecomment-768802041 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[jira] [Updated] (FLINK-19592) MiniBatchGroupAggFunction should emit messages to prevent too early state eviction of downstream operators

2021-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-19592: --- Labels: pull-request-available (was: ) > MiniBatchGroupAggFunction should emit messages to

[GitHub] [flink] CPS794 opened a new pull request #14786: [FLINK-19592] [Table SQL / Runtime] MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction emit messages to prevent too early state evi

2021-01-27 Thread GitBox
CPS794 opened a new pull request #14786: URL: https://github.com/apache/flink/pull/14786 … of downstream operators when state cleaning is enabled ## What is the purpose of the change This pull request makes MiniBatchGroupAggFunction and MiniBatchGlobalGroupAggFunction

[GitHub] [flink] flinkbot edited a comment on pull request #14785: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14785: URL: https://github.com/apache/flink/pull/14785#issuecomment-768793784 ## CI report: * e101240afc9b86f44866e6ea126e3686182677e9 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14764: URL: https://github.com/apache/flink/pull/14764#issuecomment-767576041 ## CI report: * 72b7c0d03d710be89bc6e7bdcff7c6a27980323c Azure:

[GitHub] [flink] flinkbot commented on pull request #14785: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
flinkbot commented on pull request #14785: URL: https://github.com/apache/flink/pull/14785#issuecomment-768793784 ## CI report: * e101240afc9b86f44866e6ea126e3686182677e9 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot edited a comment on pull request #14784: [FLINK-21160][connector/kafka] Fix bug of referencing uninitialized deserializer when using KafkaRecordDeserializer#valueOnly

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14784: URL: https://github.com/apache/flink/pull/14784#issuecomment-768786978 ## CI report: * c327e27872f782274cab4e10692ef1d913f85c5d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14764: URL: https://github.com/apache/flink/pull/14764#issuecomment-767576041 ## CI report: * e5106da1732cba93446aa63fc61cdf7e74b29271 Azure:

[jira] [Updated] (FLINK-21172) canal-json format include es field

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-21172: Component/s: Table SQL / Ecosystem > canal-json format include es field >

[jira] [Commented] (FLINK-21172) canal-json format include es field

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273299#comment-17273299 ] Jark Wu commented on FLINK-21172: - We can support this by a new metadata column. What do you think

[GitHub] [flink] wuchong commented on a change in pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
wuchong commented on a change in pull request #14764: URL: https://github.com/apache/flink/pull/14764#discussion_r565813102 ## File path: docs/dev/table/connectors/formats/avro-confluent.zh.md ## @@ -52,20 +52,126 @@ Avro Schema Registry 格式只能与[Apache Kafka SQL连接器]({% link

[jira] [Commented] (FLINK-21045) Support 'load module' and 'unload module' SQL syntax

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273295#comment-17273295 ] Jark Wu commented on FLINK-21045: - It seems that we still have many different thoughts on this topic.

[GitHub] [flink] sv3ndk commented on pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
sv3ndk commented on pull request #14764: URL: https://github.com/apache/flink/pull/14764#issuecomment-768791368 Thanks for the feed-back @wuchong . I copied the code examples to the Chinese version of the documentation, although they contain some English sentences at the moment, which

[jira] [Updated] (FLINK-21172) canal-json format include es field

2021-01-27 Thread jiabao sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiabao sun updated FLINK-21172: --- Description: Canal flat message json format has an 'es' field extracted from mysql binlog which

[jira] [Updated] (FLINK-21172) canal-json format include es field

2021-01-27 Thread jiabao sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiabao sun updated FLINK-21172: --- Description: Canal flat message json format has an 'es' field extracted from mysql binlog which

[jira] [Updated] (FLINK-21172) canal-json format include es field

2021-01-27 Thread jiabao sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiabao sun updated FLINK-21172: --- Description: Canal flat message json format has an 'es' field extracted from mysql binlog which

[jira] [Commented] (FLINK-21045) Support 'load module' and 'unload module' SQL syntax

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273292#comment-17273292 ] Jark Wu commented on FLINK-21045: - Good points [~lirui], I also found it's really hard to use "load" +

[jira] [Created] (FLINK-21172) canal-json format include es field

2021-01-27 Thread jiabao sun (Jira)
jiabao sun created FLINK-21172: -- Summary: canal-json format include es field Key: FLINK-21172 URL: https://issues.apache.org/jira/browse/FLINK-21172 Project: Flink Issue Type: Improvement

[GitHub] [flink] flinkbot commented on pull request #14785: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
flinkbot commented on pull request #14785: URL: https://github.com/apache/flink/pull/14785#issuecomment-768788506 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[jira] [Updated] (FLINK-21013) Blink planner does not ingest timestamp into StreamRecord

2021-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-21013: --- Labels: pull-request-available (was: ) > Blink planner does not ingest timestamp into

[GitHub] [flink] leonardBang opened a new pull request #14785: [FLINK-21013][table-planner-blink] Ingest row time into StreamRecord in Blink planner

2021-01-27 Thread GitBox
leonardBang opened a new pull request #14785: URL: https://github.com/apache/flink/pull/14785 ## What is the purpose of the change * This pull request aims to fix Blink planner does not ingest the row time timestamp into `StreamRecord` when leaving Table/SQL ## Brief change

[GitHub] [flink] wuchong commented on a change in pull request #14748: [FLINK-20894][Table SQL / API] Introduce SupportsAggregatePushDown interface

2021-01-27 Thread GitBox
wuchong commented on a change in pull request #14748: URL: https://github.com/apache/flink/pull/14748#discussion_r565805854 ## File path: flink-table/flink-table-common/src/main/java/org/apache/flink/table/connector/source/abilities/SupportsAggregatePushDown.java ## @@ -0,0

[GitHub] [flink] flinkbot commented on pull request #14784: [FLINK-21160][connector/kafka] Fix bug of referencing uninitialized deserializer when using KafkaRecordDeserializer#valueOnly

2021-01-27 Thread GitBox
flinkbot commented on pull request #14784: URL: https://github.com/apache/flink/pull/14784#issuecomment-768786978 ## CI report: * c327e27872f782274cab4e10692ef1d913f85c5d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot edited a comment on pull request #14779: [FLINK-21158][Runtime/Web Frontend] wrong jvm metaspace and overhead size show in taskmanager metric page

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14779: URL: https://github.com/apache/flink/pull/14779#issuecomment-768302027 ## CI report: * 87fab35cbddf22b2479969188eca5a9a3767c098 Azure:

[GitHub] [flink] sv3ndk commented on a change in pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
sv3ndk commented on a change in pull request #14764: URL: https://github.com/apache/flink/pull/14764#discussion_r565808097 ## File path: docs/dev/table/connectors/formats/avro-confluent.md ## @@ -45,29 +45,132 @@ Dependencies connector=connector %} -How to create a

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565806651 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DefaultSlotStatusSyncer.java ## @@ -0,0 +1,258 @@ +/* +

[jira] [Updated] (FLINK-21171) Introduce TypedValue to the StateFun request-reply protocol

2021-01-27 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-21171: Description: Currently, all values being passed around via the request-reply

[jira] [Updated] (FLINK-21171) Introduce TypedValue to the StateFun request-reply protocol

2021-01-27 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-21171: Description: Currently, all values being passed around via the request-reply

[jira] [Commented] (FLINK-21045) Support 'load module' and 'unload module' SQL syntax

2021-01-27 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273285#comment-17273285 ] Rui Li commented on FLINK-21045: Thanks for looping me in. I don't have a strong opinion regarding

[jira] [Updated] (FLINK-20740) Use managed memory (network memory) to avoid direct memory OOM error for sort-merge shuffle

2021-01-27 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-20740: Summary: Use managed memory (network memory) to avoid direct memory OOM error for sort-merge

[GitHub] [flink] flinkbot commented on pull request #14784: [FLINK-21160][connector/kafka] Fix bug of referencing uninitialized deserializer when using KafkaRecordDeserializer#valueOnly

2021-01-27 Thread GitBox
flinkbot commented on pull request #14784: URL: https://github.com/apache/flink/pull/14784#issuecomment-768782077 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] flinkbot edited a comment on pull request #14779: [FLINK-21158][Runtime/Web Frontend] wrong jvm metaspace and overhead size show in taskmanager metric page

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14779: URL: https://github.com/apache/flink/pull/14779#issuecomment-768302027 ## CI report: * 87fab35cbddf22b2479969188eca5a9a3767c098 Azure:

[jira] [Updated] (FLINK-21160) ValueDeserializerWrapper throws NullPointerException when getProducedType is invoked

2021-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-21160: --- Labels: pull-request-available (was: ) > ValueDeserializerWrapper throws

[GitHub] [flink] wuchong commented on a change in pull request #14764: [Flink-20999][docs] - adds usage examples to the Kafka Avro Confluent connector format

2021-01-27 Thread GitBox
wuchong commented on a change in pull request #14764: URL: https://github.com/apache/flink/pull/14764#discussion_r565802781 ## File path: docs/dev/table/connectors/formats/avro-confluent.md ## @@ -45,29 +45,132 @@ Dependencies connector=connector %} -How to create a

[GitHub] [flink] KarmaGYZ commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
KarmaGYZ commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565802712 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/slotmanager/FineGrainedTaskManagerTrackerTest.java ## @@ -0,0 +1,254

[GitHub] [flink] PatrickRen opened a new pull request #14784: [FLINK-21160][connector/kafka] Fix bug of referencing uninitialized deserializer when using KafkaRecordDeserializer#valueOnly

2021-01-27 Thread GitBox
PatrickRen opened a new pull request #14784: URL: https://github.com/apache/flink/pull/14784 ## What is the purpose of the change This pull request fixes bug of referencing uninitialized deserializer in ```ValueDeserializerWrapper``` when using

[jira] [Created] (FLINK-21171) Introduce TypedValue to the StateFun request-reply protocol

2021-01-27 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-21171: --- Summary: Introduce TypedValue to the StateFun request-reply protocol Key: FLINK-21171 URL: https://issues.apache.org/jira/browse/FLINK-21171 Project:

[jira] [Created] (FLINK-21170) Add internal state hierarchy in PyFlink

2021-01-27 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-21170: Summary: Add internal state hierarchy in PyFlink Key: FLINK-21170 URL: https://issues.apache.org/jira/browse/FLINK-21170 Project: Flink Issue Type: Sub-task

[GitHub] [flink] xintongsong commented on a change in pull request #14647: [FLINK-20835] Implement FineGrainedSlotManager

2021-01-27 Thread GitBox
xintongsong commented on a change in pull request #14647: URL: https://github.com/apache/flink/pull/14647#discussion_r565798745 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/PendingTaskManagerId.java ## @@ -0,0 +1,30 @@ +/* + *

[jira] [Commented] (FLINK-20416) Need a cached catalog for HiveCatalog

2021-01-27 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273279#comment-17273279 ] Rui Li commented on FLINK-20416: [~shared_ptr] Thanks for the update. LGTM, please go ahead with the PR

[GitHub] [flink] flinkbot edited a comment on pull request #14783: [FLINK-21169][kafka] flink-connector-base dependency should be scope compile

2021-01-27 Thread GitBox
flinkbot edited a comment on pull request #14783: URL: https://github.com/apache/flink/pull/14783#issuecomment-768767423 ## CI report: * ea0fa2c3a97b2d2082b40732850ccc960ba7a09e Azure:

[jira] [Commented] (FLINK-21005) Introduce new provider for unified Sink API and implement in planner

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273278#comment-17273278 ] Jark Wu commented on FLINK-21005: - Sure. Assigned to you [~nicholasjiang] > Introduce new provider for

[jira] [Assigned] (FLINK-21005) Introduce new provider for unified Sink API and implement in planner

2021-01-27 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-21005: --- Assignee: Nicholas Jiang (was: Huajie Wang) > Introduce new provider for unified Sink API and

[GitHub] [flink] xintongsong edited a comment on pull request #14591: FLINK-20359 Added Owner Reference to Job Manager in native kubernetes

2021-01-27 Thread GitBox
xintongsong edited a comment on pull request #14591: URL: https://github.com/apache/flink/pull/14591#issuecomment-768770142 Sorry, closed the PR by mistake. @blublinsky, you have not addressed my comment. > * Why is the owner reference only set for JobManager. Are other

[GitHub] [flink] blublinsky opened a new pull request #14591: FLINK-20359 Added Owner Reference to Job Manager in native kubernetes

2021-01-27 Thread GitBox
blublinsky opened a new pull request #14591: URL: https://github.com/apache/flink/pull/14591 ## What is the purpose of the change Flink implementation is often a part of the larger application. As a result a synchronized management - clean up of Flink resources, when a main

[GitHub] [flink] xintongsong commented on pull request #14591: FLINK-20359 Added Owner Reference to Job Manager in native kubernetes

2021-01-27 Thread GitBox
xintongsong commented on pull request #14591: URL: https://github.com/apache/flink/pull/14591#issuecomment-768770142 @blublinsky, This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink] xintongsong closed pull request #14591: FLINK-20359 Added Owner Reference to Job Manager in native kubernetes

2021-01-27 Thread GitBox
xintongsong closed pull request #14591: URL: https://github.com/apache/flink/pull/14591 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink] flinkbot commented on pull request #14783: [FLINK-21169][kafka] flink-connector-base dependency should be scope compile

2021-01-27 Thread GitBox
flinkbot commented on pull request #14783: URL: https://github.com/apache/flink/pull/14783#issuecomment-768767423 ## CI report: * ea0fa2c3a97b2d2082b40732850ccc960ba7a09e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

  1   2   3   4   5   >