aitozi created FLINK-9534:
-
Summary: CEP
Key: FLINK-9534
URL: https://issues.apache.org/jira/browse/FLINK-9534
Project: Flink
Issue Type: Bug
Reporter: aitozi
--
This message
aitozi created FLINK-9533:
-
Summary: CEP
Key: FLINK-9533
URL: https://issues.apache.org/jira/browse/FLINK-9533
Project: Flink
Issue Type: Bug
Reporter: aitozi
--
This message
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6124
@dawidwys please help review this pr when you free,thx
---
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/6124
[FLINK-8914][CEP]Fix wrong semantic when greedy pattern is the head of the
pattern
## What is the purpose of the change
As described in the jira
[FLINK-8914](https://issues.apache.org/jira
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6104
@dawidwys fix the flaw according to your suggestion ;-)
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6111
thanks @StephanEwen for review. As you mentioned, I only set the log level
in state backends to `debug` , is there something wrong with my pull request or
misunderstand what your meaning ?
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6104
thx, can help merge this @dawidwys
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6059
@dawidwys I'm sorry, I don't have a systematic testing tool. I'm working on
the inner dynamic cep and `CEPOperator` can process serveral `NFA` when receive
an element. Then i encounter
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/6109#discussion_r192628465
--- Diff: docs/start/building.md ---
@@ -50,7 +50,11 @@ mvn clean install -DskipTests
This instructs [Maven](http://maven.apache.org) (`mvn
[
https://issues.apache.org/jira/browse/FLINK-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499467#comment-16499467
]
aitozi commented on FLINK-9507:
---
Hi [~kkl0u]
Thanks for your quick answer, I have apply the patch
[https
aitozi created FLINK-9507:
-
Summary: Introduce ReduceFunction to CEP to minor the cost for
IterativeCondition
Key: FLINK-9507
URL: https://issues.apache.org/jira/browse/FLINK-9507
Project: Flink
[
https://issues.apache.org/jira/browse/FLINK-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi updated FLINK-9507:
--
Description:
When we use the cep to describe a condition about the events that has been
matched, we have
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6059
After go through the whole change, i think it is extremely a good feature
ð, and i will apply this patch to our inner library to test how much the
performance improved.
A little question: why
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/6111
[FLINK-9504]Change the log level of checkpoint duration to debug
Now, every time checkpoint it will log with the OperatorStateBackend and
KeyedStateBackend with per partition/parallel time cost
aitozi created FLINK-9504:
-
Summary: Change checkpoint duration log level to debug to avoid
too much log
Key: FLINK-9504
URL: https://issues.apache.org/jira/browse/FLINK-9504
Project: Flink
Issue
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/6059#discussion_r192558813
--- Diff:
flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/sharedbuffer/EventWrapper.java
---
@@ -0,0 +1,188 @@
+/*
+ * Licensed
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/6104#discussion_r192428502
--- Diff:
flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/CEPITCase.java ---
@@ -383,6 +386,100 @@ public String select(Map>
patt
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/6104#discussion_r192428178
--- Diff:
flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/PatternStream.java
---
@@ -54,6 +54,12 @@
// comparator to sort events
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/6104#discussion_r192428106
--- Diff: docs/dev/libs/cep.md ---
@@ -1524,7 +1524,52 @@ In `CEP` the order in which elements are processed
matters. To guarantee that el
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/6104#discussion_r192428038
--- Diff: docs/dev/libs/cep.md ---
@@ -1524,7 +1524,52 @@ In `CEP` the order in which elements are processed
matters. To guarantee that el
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6104
@bowenli86 thanks for review, i have fix the error according to the comment
and add the unit test in CEPITCase, please help review it again. cc @kl0u
---
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/6104
[FLINK-9476]Emit late elements in CEP as sideOutPut
Now, when use with Eventtime in CEP library, elements come later than
watermark will be dropped,we can put it in side Output with outPutTag
You
aitozi created FLINK-9476:
-
Summary: Lost sideOutPut Late Elements in CEP Operator
Key: FLINK-9476
URL: https://issues.apache.org/jira/browse/FLINK-9476
Project: Flink
Issue Type: Improvement
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/6080
@aljoscha please help review this ,thanks
---
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/6080
[Flink-9443]Remove unused parameter in generateNodeLocalHash
After Flink1.2 it used StreamGraphHasherV2 to generate hashes, The method
generateNodeLocalHash dont use the information like (parallel
aitozi created FLINK-9443:
-
Summary: Remove unused parameter in StreamGraphHasherV2
Key: FLINK-9443
URL: https://issues.apache.org/jira/browse/FLINK-9443
Project: Flink
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/FLINK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488734#comment-16488734
]
aitozi edited comment on FLINK-9431 at 5/24/18 10:00 AM:
-
[~dawidwys] Three thing
[
https://issues.apache.org/jira/browse/FLINK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488734#comment-16488734
]
aitozi edited comment on FLINK-9431 at 5/24/18 9:57 AM:
[~dawidwys] Three thing
[
https://issues.apache.org/jira/browse/FLINK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488734#comment-16488734
]
aitozi edited comment on FLINK-9431 at 5/24/18 9:56 AM:
[~dawidwys] Three thing
[
https://issues.apache.org/jira/browse/FLINK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488734#comment-16488734
]
aitozi edited comment on FLINK-9431 at 5/24/18 9:56 AM:
[~dawidwys] Three thing
[
https://issues.apache.org/jira/browse/FLINK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488734#comment-16488734
]
aitozi commented on FLINK-9431:
---
[~dawidwys]two thing:
# 1. if i use
{code:java}Pattern.begin
aitozi created FLINK-9431:
-
Summary: Introduce TimeEnd State to flink cep
Key: FLINK-9431
URL: https://issues.apache.org/jira/browse/FLINK-9431
Project: Flink
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/FLINK-9418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488660#comment-16488660
]
aitozi commented on FLINK-9418:
---
Hi, can you share some detail about how to reach this "so that
[
https://issues.apache.org/jira/browse/FLINK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423762#comment-16423762
]
aitozi commented on FLINK-9122:
---
thanks [~aljoscha] ，still have two question
1. Why the exception appear
aitozi created FLINK-9122:
-
Summary: NFASerialize deserailze failed and cause other exception
Key: FLINK-9122
URL: https://issues.apache.org/jira/browse/FLINK-9122
Project: Flink
Issue Type: Bug
[
https://issues.apache.org/jira/browse/FLINK-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi reassigned FLINK-8914:
-
Assignee: aitozi
> CEP's greedy() modifier doesn't w
[
https://issues.apache.org/jira/browse/FLINK-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421652#comment-16421652
]
aitozi commented on FLINK-8914:
---
I am woking with issue, can i take over this issue?
> CEP's gre
[
https://issues.apache.org/jira/browse/FLINK-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396500#comment-16396500
]
aitozi commented on FLINK-8914:
---
Yes, i run into this bug too, greedy only works when it has a ending flag
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/3105
why it is closed ? Is it has been merged in?
---
aitozi created FLINK-8893:
-
Summary: NPE when netty try to allocate directBuffer
Key: FLINK-8893
URL: https://issues.apache.org/jira/browse/FLINK-8893
Project: Flink
Issue Type: Bug
aitozi created FLINK-8869:
-
Summary: Kafka restore from checkpoint without react to the new
add partition to kafka server
Key: FLINK-8869
URL: https://issues.apache.org/jira/browse/FLINK-8869
Project: Flink
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/5405
Hi @aljoscha , you have mentioned two points :
1. The events arrived may out of order in event-time processing
2. We can use windowFunction or ProcessWindowFunction to filter serverl
window
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/5405
ping @aljoscha
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/5405
cc @aljoscha please help review this patch.
see the picture above, when user
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/5405
[FLINK-8477][Window]Add api to support user to skip serval broken window
In production, some application like monitor type , it need the accuarcy
data,but in this scenario: if we start a job at 10
[
https://issues.apache.org/jira/browse/FLINK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350468#comment-16350468
]
aitozi commented on FLINK-6109:
---
[~tzulitai] you mentioned that the calculate of the lag is overwhelming
[
https://issues.apache.org/jira/browse/FLINK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350437#comment-16350437
]
aitozi commented on FLINK-6109:
---
OK， i will see the pr later .
> Add "consumer lag"
[
https://issues.apache.org/jira/browse/FLINK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350403#comment-16350403
]
aitozi commented on FLINK-8477:
---
[~aljoscha]In production, some application like monitor type , it need
[
https://issues.apache.org/jira/browse/FLINK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336981#comment-16336981
]
aitozi commented on FLINK-7129:
---
Hi，can i ask the progress of this feature ?
> Dynamically chang
aitozi created FLINK-8477:
-
Summary: Add api to support for user to skip the first incomplete
window data
Key: FLINK-8477
URL: https://issues.apache.org/jira/browse/FLINK-8477
Project: Flink
Issue
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4935
Hi, @tzulitai
After i read kafkaConsumer code again, i found that the per partition kafka
lag metric is register in method `FetchManagerMetrics#recordPartitionLag` But
the when the client get
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4935
ping @tzulitai ~
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4960
ð
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4935
Hi @tzulitai , could you take look at this again :-) ?
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4935
update the code according to the comment. ping @tzulitai
---
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4935#discussion_r148738495
--- Diff:
flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/KafkaConsumerThread.java
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4935#discussion_r148738023
--- Diff:
flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/KafkaConsumerThread.java
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4935#discussion_r148530767
--- Diff:
flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/KafkaConsumerThread.java
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4935
cc @zentol @tzulitai please help review the code.
---
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/4935
[Flink-7945][Metrics]Fix per partition-lag metric lost in kafka
connector
## What is the purpose of the change
*When used KafkaConnector, we cant get per partition lag metric. But it has
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi updated FLINK-7945:
--
Summary: Per partition-lag metric lost in kafka connector (was:
kafka-connector11 use kafkaConsumer0.9 caused
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234932#comment-16234932
]
aitozi commented on FLINK-7945:
---
Before I think the losed metric is caused by the kafka client is used wrong
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi updated FLINK-7945:
--
Affects Version/s: 1.3.2
> kafka-connector11 use kafkaConsumer0.9 caused it lost the important met
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi updated FLINK-7945:
--
Affects Version/s: (was: 1.3.2)
(was: 1.2.1)
1.4.0
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224796#comment-16224796
]
aitozi commented on FLINK-7945:
---
This may be can partly address https://issues.apache.org/jira/browse/FLINK
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi updated FLINK-7945:
--
Comment: was deleted
(was: This may be can partly address
https://issues.apache.org/jira/browse/FLINK-6109
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224782#comment-16224782
]
aitozi edited comment on FLINK-7945 at 10/30/17 11:55 AM:
--
This may be can partly
[
https://issues.apache.org/jira/browse/FLINK-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224782#comment-16224782
]
aitozi commented on FLINK-7945:
---
This may be can address https://issues.apache.org/jira/browse/FLINK-6109
aitozi created FLINK-7945:
-
Summary: kafka-connector10 use kafkaConsumer0.9 caused it lost the
important metric in kafka clients10
Key: FLINK-7945
URL: https://issues.apache.org/jira/browse/FLINK-7945
[
https://issues.apache.org/jira/browse/FLINK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi reassigned FLINK-6109:
-
Assignee: aitozi
> Add "consumer lag" report metric to Flink
[
https://issues.apache.org/jira/browse/FLINK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi reassigned FLINK-6109:
-
Assignee: aitozi
> Add "consumer lag" report metric to Flink
[
https://issues.apache.org/jira/browse/FLINK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi reassigned FLINK-6109:
-
Assignee: (was: aitozi)
> Add "consumer lag" report metric to Flink
[
https://issues.apache.org/jira/browse/FLINK-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224395#comment-16224395
]
aitozi commented on FLINK-6109:
---
Is anyone working on this issue, Now in version 1.3.2 we can only see
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4665
Hi @zentol , can you help merge this pr ? Is this be forgetten
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4878
Yes, i will close this one ~
---
Github user Aitozi closed the pull request at:
https://github.com/apache/flink/pull/4878
---
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/4878
[FLINK-7895][hotfix][docs]Fix error in example in get late message in
window doc
* getSideOutput api is only available in SingleOutputOperator class, and is
not the part of the base class
aitozi created FLINK-7895:
-
Summary: Error in the example in SideOutput usage example that
show how to get late message of window
Key: FLINK-7895
URL: https://issues.apache.org/jira/browse/FLINK-7895
Project
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4665
is there still anything wrong @zentol
---
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4665
is this ok to be merged in @bowenli86 @zentol @aljoscha ? ð
---
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r140635202
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/EvictingWindowOperator.java
---
@@ -231,6 +231,8
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r140634868
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java
---
@@ -405,6 +411,8 @@ public void
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r139933981
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java
---
@@ -405,6 +411,8 @@ public void
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r139742368
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java
---
@@ -405,6 +411,8 @@ public void
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4665
Hello,Is it can be merged in @aljoscha @zentol ?
---
[
https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168852#comment-16168852
]
aitozi commented on FLINK-7608:
---
i am doubt that why it need to access the value of p50,p95,p99. i think
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4665
@aljoscha yes, i review the code this day, it will jude each window whether
late , so the previous method i use will counts more lost data than the actual
situation , i have fix the error and re
Github user Aitozi commented on the issue:
https://github.com/apache/flink/pull/4665
@aljoscha i agree that the name set to be "numLateElementsDropped", and do
you mean that my result should minus the num of element that go to side output
which is skipped and lateElement?
---
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r138789377
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java
---
@@ -132,6 +133,13
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r138778844
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java
---
@@ -132,6 +133,13
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r138515752
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java
---
@@ -132,6 +133,13
Github user Aitozi commented on a diff in the pull request:
https://github.com/apache/flink/pull/4665#discussion_r138515541
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java
---
@@ -132,6 +133,13
[
https://issues.apache.org/jira/browse/FLINK-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164008#comment-16164008
]
aitozi commented on FLINK-7611:
---
i have add the pr, https://github.com/apache/flink/pull/4665 , anyone
GitHub user Aitozi opened a pull request:
https://github.com/apache/flink/pull/4665
[Flink-7611]add metrics to measure the num of data dropped due to the data
arrived late
## What is the purpose of the change
1. add metrics to measure the num of data dropped due
[
https://issues.apache.org/jira/browse/FLINK-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi updated FLINK-7611:
--
Affects Version/s: 1.3.0
> add metrics to measure the data drop by waterm
[
https://issues.apache.org/jira/browse/FLINK-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
aitozi updated FLINK-7611:
--
Affects Version/s: 1.2.0
> add metrics to measure the data drop by waterm
aitozi created FLINK-7611:
-
Summary: add metrics to measure the data drop by watermark
Key: FLINK-7611
URL: https://issues.apache.org/jira/browse/FLINK-7611
Project: Flink
Issue Type: Improvement
801 - 897 of 897 matches
Mail list logo
