[jira] [Created] (FLINK-5295) Migrate the AlignedWindowOperators to the WindowOperator and make it backwards compatible.
Kostas Kloudas created FLINK-5295: - Summary: Migrate the AlignedWindowOperators to the WindowOperator and make it backwards compatible. Key: FLINK-5295 URL: https://issues.apache.org/jira/browse/FLINK-5295 Project: Flink Issue Type: Bug Components: Windowing Operators Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5296) Expose the old AlignedWindowOperators to the user through explicit commands.
Kostas Kloudas created FLINK-5296: - Summary: Expose the old AlignedWindowOperators to the user through explicit commands. Key: FLINK-5296 URL: https://issues.apache.org/jira/browse/FLINK-5296 Project: Flink Issue Type: Bug Components: Windowing Operators Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5316) Make the GenericWriteAheadSink backwards compatible.
Kostas Kloudas created FLINK-5316: - Summary: Make the GenericWriteAheadSink backwards compatible. Key: FLINK-5316 URL: https://issues.apache.org/jira/browse/FLINK-5316 Project: Flink Issue Type: Sub-task Components: Cassandra Connector Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5317) Make the continuous file processing code backwards compatible,
Kostas Kloudas created FLINK-5317: - Summary: Make the continuous file processing code backwards compatible, Key: FLINK-5317 URL: https://issues.apache.org/jira/browse/FLINK-5317 Project: Flink Issue Type: Sub-task Components: filesystem-connector Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 This includes the ContinuousFileMonitoringFunction and the ContinuousFileReaderOperator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5318) Make the Rolling/Bucketing sink backwards compatible.
Kostas Kloudas created FLINK-5318: - Summary: Make the Rolling/Bucketing sink backwards compatible. Key: FLINK-5318 URL: https://issues.apache.org/jira/browse/FLINK-5318 Project: Flink Issue Type: Sub-task Components: filesystem-connector Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5420) Make the CEP library rescalable.
Kostas Kloudas created FLINK-5420: - Summary: Make the CEP library rescalable. Key: FLINK-5420 URL: https://issues.apache.org/jira/browse/FLINK-5420 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5422) Check for name collisions in the Rolling/BucketingSink
Kostas Kloudas created FLINK-5422: - Summary: Check for name collisions in the Rolling/BucketingSink Key: FLINK-5422 URL: https://issues.apache.org/jira/browse/FLINK-5422 Project: Flink Issue Type: Bug Components: filesystem-connector Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5443) Create a path to migrate from the Rolling to the BucketingSink.
Kostas Kloudas created FLINK-5443: - Summary: Create a path to migrate from the Rolling to the BucketingSink. Key: FLINK-5443 URL: https://issues.apache.org/jira/browse/FLINK-5443 Project: Flink Issue Type: Bug Components: filesystem-connector Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5502) Add documentation about migrating from 1.1 to 1.2
Kostas Kloudas created FLINK-5502: - Summary: Add documentation about migrating from 1.1 to 1.2 Key: FLINK-5502 URL: https://issues.apache.org/jira/browse/FLINK-5502 Project: Flink Issue Type: Bug Components: Documentation Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5532) Make the marker windowassignes for the fast aligned windows non-extendable.
Kostas Kloudas created FLINK-5532: - Summary: Make the marker windowassignes for the fast aligned windows non-extendable. Key: FLINK-5532 URL: https://issues.apache.org/jira/browse/FLINK-5532 Project: Flink Issue Type: Bug Components: Windowing Operators Affects Versions: 1.2.0 Reporter: Kostas Kloudas Fix For: 1.2.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-5762) Execute initializeState() and open() "atomically"
Kostas Kloudas created FLINK-5762: - Summary: Execute initializeState() and open() "atomically" Key: FLINK-5762 URL: https://issues.apache.org/jira/browse/FLINK-5762 Project: Flink Issue Type: Bug Components: DataStream API Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 Currently the initializeState() of all operators in a task is called without the checkpoint lock, and before the open(). This may lead to problematic situations as the following: In the case that we retrieve timers from a checkpoint, e.g. WindowOperator and (future) CEP, if we re-register them in the initializeState(), then if they fire before the open() of the downstream operators is called, we will have a task failure, as the downstream channels are not open. To avoid this, we can put the initializeState() in the same lock as the open(), and the two operations will happen while being protected by the same lock, which also keeps timers from firing. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-5845) CEP: unify key and non-keyed operators
Kostas Kloudas created FLINK-5845:
-
Summary: CEP: unify key and non-keyed operators
Key: FLINK-5845
URL: https://issues.apache.org/jira/browse/FLINK-5845
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
Currently the keyed and non-keyed operators in the CEP library have different
implementations. This issue targets to unify them into one.
This new implementation will always be applied on a keyed stream, and in the
case of non-keyed usecases, the input stream will be keyed on a dummy keye, as
done in the case of the {{DataStream.windowAll()}} method, where the input
stream is keyed using the {{NullByteKeySelector}}.
This is a first step towards making the CEP operators rescalable.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-5846) CEP: make the operators backwards compatible.
Kostas Kloudas created FLINK-5846: - Summary: CEP: make the operators backwards compatible. Key: FLINK-5846 URL: https://issues.apache.org/jira/browse/FLINK-5846 Project: Flink Issue Type: Sub-task Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 This targets making the new CEP operators compatible with their previous versions from Flink 1.1 and Flink 1.2. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-5864) CEP: fix duplicate output patterns problem.
Kostas Kloudas created FLINK-5864:
-
Summary: CEP: fix duplicate output patterns problem.
Key: FLINK-5864
URL: https://issues.apache.org/jira/browse/FLINK-5864
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Fix For: 1.3.0
Currently when searching for a pattern {{a,b,c}} and we have input elements {{a
-> b1 -> b2 ->c}} where {{b1}} and {{b2}} are both valid elements for the
position b, then instead of having an output of 2 matched patterns: {{a, b1,
c}} and {{a, b2, c}}, we have 4, with 2 copies of each valid pattern.
The problem is that currently the graph of valid patterns that is created
creates two nodes for c, with each one connected to both b1 and b2. This leads
to each of the instances of c having 2 valid matched patterns.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-5871) Enforce uniqueness of pattern names in CEP.
Kostas Kloudas created FLINK-5871:
-
Summary: Enforce uniqueness of pattern names in CEP.
Key: FLINK-5871
URL: https://issues.apache.org/jira/browse/FLINK-5871
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
Currently, although required, the {{NFACompiler}} does not impose uniqueness of
the chosen pattern names. This issue addresses that, and the proposed strategy
is to throw an exception whenever a malformed pattern like this is encountered.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-5932) Order of legacy vs new state initialization in the AbstractStreamOperator.
Kostas Kloudas created FLINK-5932: - Summary: Order of legacy vs new state initialization in the AbstractStreamOperator. Key: FLINK-5932 URL: https://issues.apache.org/jira/browse/FLINK-5932 Project: Flink Issue Type: Bug Components: DataStream API Affects Versions: 1.2.0 Reporter: Kostas Kloudas Fix For: 1.3.0 Currently in the `AbstractStreamOperator::initializeState(OperatorStateHandles stateHandles)`, the `restoreStreamCheckpointed` which is responsible for restoring state from previous Flink versions, (backwards compatibility) is called before the `initializeState(StateInitializationContext context)` which is responsible for initializing the state in Flink 1.2. This has the negative side effect that when implementing the backwards compatibility strategy for a given operator, we have to restore the old state, store it in local variables, and register it with the new state abstractions in the `initializeState()` or the `open()`. This creates a lot of unnecessary code in the operators, and potential memory leaks if the local variables are not "null-ified". This issue proposes to call the `restoreStreamCheckpointed` after the `initializeState(StateInitializationContext context)`. This way, the new operator state will have been initialized (e.g. keyed state), and the `restoreStreamCheckpointed` will be able to register its state directly with the new abstractions, instead of putting it in local variables and wait for the `initializeState` or the `open()` to re-register it. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-5937) Add documentation about the task lifecycle.
Kostas Kloudas created FLINK-5937: - Summary: Add documentation about the task lifecycle. Key: FLINK-5937 URL: https://issues.apache.org/jira/browse/FLINK-5937 Project: Flink Issue Type: Bug Components: Documentation Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-5951) Register legacy windowOp timers with timer service in the restoreState().
Kostas Kloudas created FLINK-5951: - Summary: Register legacy windowOp timers with timer service in the restoreState(). Key: FLINK-5951 URL: https://issues.apache.org/jira/browse/FLINK-5951 Project: Flink Issue Type: Bug Components: DataStream API Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6007) ConcurrentModificationException in WatermarkCallbackService
Kostas Kloudas created FLINK-6007:
-
Summary: ConcurrentModificationException in
WatermarkCallbackService
Key: FLINK-6007
URL: https://issues.apache.org/jira/browse/FLINK-6007
Project: Flink
Issue Type: Bug
Components: DataStream API
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
Currently, if an attempt is made to call
{{InternalWatermarkCallbackService.unregisterKeyFromWatermarkCallback()}} from
within the {{OnWatermarkCallback}}, a {{ConcurrentModificationException}} is
thrown. The reason is that the {{invokeOnWatermarkCallback}} iterates over the
list of keys and calls the callback for each one of them.
To fix this, the deleted keys are put into a separate list, and the deletion
happens after the iteration over all keys has finished.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6032) CEP-Clean up the operator state when not needed.
Kostas Kloudas created FLINK-6032: - Summary: CEP-Clean up the operator state when not needed. Key: FLINK-6032 URL: https://issues.apache.org/jira/browse/FLINK-6032 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6123) Add support for the NOT pattern.
Kostas Kloudas created FLINK-6123:
-
Summary: Add support for the NOT pattern.
Key: FLINK-6123
URL: https://issues.apache.org/jira/browse/FLINK-6123
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
This proposes that addition of patterns like {{followedByNot(...)}} or
{{nextNot(...)}}. This will allow a partially matched pattern to stop when it
encounters the specified event.
This addition may require the addition of an additional {{StateType}} called
{{ABORT}} that will signal a state transition to an "invalid pattern" state.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6197) Add support for iterative conditions.
Kostas Kloudas created FLINK-6197:
-
Summary: Add support for iterative conditions.
Key: FLINK-6197
URL: https://issues.apache.org/jira/browse/FLINK-6197
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
So far, the {{where}} clause only supported simple {{FilterFunction}}
conditions.
With this, we want to add support for conditions where the an event is accepted
not only based on its own properties, e.g. name, as it was before, but also
based on some statistic computed over previously accepted events in the
pattern, e.g. if the price is higher than the average of the prices of the
previously accepted events.
This in combination with the recently added quantifiers will allow for a lot
more expressive patterns.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6198) Update the documentation of the CEP library to include all the new features.
Kostas Kloudas created FLINK-6198: - Summary: Update the documentation of the CEP library to include all the new features. Key: FLINK-6198 URL: https://issues.apache.org/jira/browse/FLINK-6198 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6205) Put late elements in side output.
Kostas Kloudas created FLINK-6205:
-
Summary: Put late elements in side output.
Key: FLINK-6205
URL: https://issues.apache.org/jira/browse/FLINK-6205
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
Currently the CEP library had a somehow fuzzy way to handle late events.
Essentially:
1) it accepts all events (late and early)
2) it sorts them based on event time
3) whenever a watermark arrives, it feeds them into the NFA.
This does not respecting event time.
In addition, given that the order in which elements are processed matters, this
could lead to wrong results as events may be processed by the NFA out-of-order
with respect to their timestamps.
This issue proposes to assume correctness of the watermark and consider as
late, events that arrive having a timestamp smaller than that of the last seen
watermark. In addition, late events are not silently dropped, but the user can
specify to send them to a side output, as done in the case of the
{{WindowOperator}}.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6215) Make the StatefulSequenceSource scalable.
Kostas Kloudas created FLINK-6215:
-
Summary: Make the StatefulSequenceSource scalable.
Key: FLINK-6215
URL: https://issues.apache.org/jira/browse/FLINK-6215
Project: Flink
Issue Type: Bug
Components: DataStream API
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Fix For: 1.3.0
Currently the {{StatefulSequenceSource}} instantiates all the elements to emit
first and keeps them in memory. This is not scalable as for large sequences of
elements this can lead to out of memory exceptions.
To solve this, we can pre-partition the sequence of elements based on the
{{maxParallelism}} parameter, and just keep state (to checkpoint) per such
partition.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6245) Fix late side output documentation in Window documents.
Kostas Kloudas created FLINK-6245:
-
Summary: Fix late side output documentation in Window documents.
Key: FLINK-6245
URL: https://issues.apache.org/jira/browse/FLINK-6245
Project: Flink
Issue Type: Bug
Components: Documentation
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Priority: Minor
Fix For: 1.3.0
There are two things that need to be done:
1) in the syntax description in the beginning of the page, we should also
include the {{getSideOutput()}}
2) in the "Getting late data as a side output" section and for the Java
example, it should not be a {{DataStream result ...}} but a
{{SingleOutputStreamOperator}}, if we want to get the late event side output.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6248) Make the optional() available to all offered patterns.
Kostas Kloudas created FLINK-6248:
-
Summary: Make the optional() available to all offered patterns.
Key: FLINK-6248
URL: https://issues.apache.org/jira/browse/FLINK-6248
Project: Flink
Issue Type: Improvement
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Fix For: 1.3.0
Currently the {{optional()}} quantifier is available as a separate pattern.
This issue proposes to make it available as a flag to all patterns.
This implies that:
1) a singleton pattern with {{optional=true}} will become the current
{{OPTIONAL}},
2) a {{oneToMany}} will become {{zeroToMany}},
3) the {{zeroToMany}} will not exist as a direct option in the {{Pattern}}
class, and
4) the {{times()}} will require some changes in the {{NFACompiler}}.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6256) Fix documentation of ProcessFunction.
Kostas Kloudas created FLINK-6256:
-
Summary: Fix documentation of ProcessFunction.
Key: FLINK-6256
URL: https://issues.apache.org/jira/browse/FLINK-6256
Project: Flink
Issue Type: Bug
Components: Documentation
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Priority: Blocker
Fix For: 1.3.0
In the code example on how to define an {{OutputTag}} and how to use it to
extract the side-output stream, the name of the defined output tag and that of
the one used in the {{getSideOutput()}} differ.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6265) Fix consecutive() for times() pattern.
Kostas Kloudas created FLINK-6265:
-
Summary: Fix consecutive() for times() pattern.
Key: FLINK-6265
URL: https://issues.apache.org/jira/browse/FLINK-6265
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
When using {{next()}} with {{times()}} and {{times()}} is not
{{consecutive()}}, the library ignores that relaxed continuity within the
pattern.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6356) Make times() eager and enable allowing combinations.
Kostas Kloudas created FLINK-6356: - Summary: Make times() eager and enable allowing combinations. Key: FLINK-6356 URL: https://issues.apache.org/jira/browse/FLINK-6356 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6371) Return matched patterns as Map> instead of Map
Kostas Kloudas created FLINK-6371: - Summary: Return matched patterns as Map> instead of Map Key: FLINK-6371 URL: https://issues.apache.org/jira/browse/FLINK-6371 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6445) Fix behavior when condition is null.
Kostas Kloudas created FLINK-6445: - Summary: Fix behavior when condition is null. Key: FLINK-6445 URL: https://issues.apache.org/jira/browse/FLINK-6445 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Priority: Blocker Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6458) Support NOT patterns with preceding OPTIONALS
Kostas Kloudas created FLINK-6458: - Summary: Support NOT patterns with preceding OPTIONALS Key: FLINK-6458 URL: https://issues.apache.org/jira/browse/FLINK-6458 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Fix For: 1.3.0 Currently pattern sequences that have an optional pattern immediately preceding a NOT are not supported by the CEP library. This issue targets the addition of support for these patterns. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6463) Throw exception when NOT-NEXT is after OPTIONAL
Kostas Kloudas created FLINK-6463: - Summary: Throw exception when NOT-NEXT is after OPTIONAL Key: FLINK-6463 URL: https://issues.apache.org/jira/browse/FLINK-6463 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6536) Improve error message in SharedBuffer::put()
Kostas Kloudas created FLINK-6536: - Summary: Improve error message in SharedBuffer::put() Key: FLINK-6536 URL: https://issues.apache.org/jira/browse/FLINK-6536 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.2.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Priority: Minor Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6538) Emit late elements as Side Outputs
Kostas Kloudas created FLINK-6538:
-
Summary: Emit late elements as Side Outputs
Key: FLINK-6538
URL: https://issues.apache.org/jira/browse/FLINK-6538
Project: Flink
Issue Type: Improvement
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Fix For: 1.3.0
Currently in the {{select/flatSelect}} there is a {{map/flatMap}} after the
returned stream. These should go inside the {{CEPOperator}} so that we are
allowed to call {{getSideOutput}} directly on the returned stream.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6578) SharedBuffer creates self-loops when having elements with same value/timestamp.
Kostas Kloudas created FLINK-6578:
-
Summary: SharedBuffer creates self-loops when having elements with
same value/timestamp.
Key: FLINK-6578
URL: https://issues.apache.org/jira/browse/FLINK-6578
Project: Flink
Issue Type: Bug
Components: CEP
Affects Versions: 1.3.0
Reporter: Kostas Kloudas
Assignee: Kostas Kloudas
Fix For: 1.3.0
This is a test that fails with the current implementation due to the fact that
the looping state accepts the two {{middleEvent1}} elements but the shared
buffer cannot distinguish between them and gets trapped in an infinite loop
leading to running out of memory.
{code}
@Test
public void testEagerZeroOrMoreSameElement() {
List> inputEvents = new ArrayList<>();
Event startEvent = new Event(40, "c", 1.0);
Event middleEvent1 = new Event(41, "a", 2.0);
Event middleEvent2 = new Event(42, "a", 3.0);
Event middleEvent3 = new Event(43, "a", 4.0);
Event end1 = new Event(44, "b", 5.0);
inputEvents.add(new StreamRecord<>(startEvent, 1));
inputEvents.add(new StreamRecord<>(middleEvent1, 3));
inputEvents.add(new StreamRecord<>(middleEvent1, 3));
inputEvents.add(new StreamRecord<>(middleEvent1, 3));
inputEvents.add(new StreamRecord<>(middleEvent2, 4));
inputEvents.add(new StreamRecord<>(new Event(50, "d", 6.0), 5));
inputEvents.add(new StreamRecord<>(middleEvent3, 6));
inputEvents.add(new StreamRecord<>(middleEvent3, 6));
inputEvents.add(new StreamRecord<>(end1, 7));
Pattern pattern =
Pattern.begin("start").where(new SimpleCondition() {
private static final long serialVersionUID =
5726188262756267490L;
@Override
public boolean filter(Event value) throws Exception {
return value.getName().equals("c");
}
}).followedBy("middle").where(new SimpleCondition() {
private static final long serialVersionUID =
5726188262756267490L;
@Override
public boolean filter(Event value) throws Exception {
return value.getName().equals("a");
}
}).oneOrMore().optional().followedBy("end1").where(new
SimpleCondition() {
private static final long serialVersionUID =
5726188262756267490L;
@Override
public boolean filter(Event value) throws Exception {
return value.getName().equals("b");
}
});
NFA nfa = NFACompiler.compile(pattern,
Event.createTypeSerializer(), false);
final List> resultingPatterns =
feedNFA(inputEvents, nfa);
compareMaps(resultingPatterns, Lists.>newArrayList(
Lists.newArrayList(startEvent, middleEvent1,
middleEvent1, middleEvent1, middleEvent2, middleEvent3, middleEvent3, end1),
Lists.newArrayList(startEvent, middleEvent1,
middleEvent1, middleEvent1, middleEvent2, middleEvent3, end1),
Lists.newArrayList(startEvent, middleEvent1,
middleEvent1, middleEvent1, middleEvent2, end1),
Lists.newArrayList(startEvent, middleEvent1,
middleEvent1, middleEvent1, end1),
Lists.newArrayList(startEvent, middleEvent1,
middleEvent1, end1),
Lists.newArrayList(startEvent, middleEvent1,
end1),
Lists.newArrayList(startEvent, end1)
));
}
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (FLINK-6604) Remove Java Serialization from the CEP library.
Kostas Kloudas created FLINK-6604: - Summary: Remove Java Serialization from the CEP library. Key: FLINK-6604 URL: https://issues.apache.org/jira/browse/FLINK-6604 Project: Flink Issue Type: Bug Components: CEP Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6634) NFA serializer does not serialize the ValueTimeWrapper counter.
Kostas Kloudas created FLINK-6634: - Summary: NFA serializer does not serialize the ValueTimeWrapper counter. Key: FLINK-6634 URL: https://issues.apache.org/jira/browse/FLINK-6634 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6656) Migrate CEP PriorityQueue to MapState
Kostas Kloudas created FLINK-6656: - Summary: Migrate CEP PriorityQueue to MapState Key: FLINK-6656 URL: https://issues.apache.org/jira/browse/FLINK-6656 Project: Flink Issue Type: Bug Components: CEP Reporter: Kostas Kloudas Assignee: Kostas Kloudas Fix For: 1.3.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6897) Re-add support for Java 8 lambdas.
Kostas Kloudas created FLINK-6897: - Summary: Re-add support for Java 8 lambdas. Key: FLINK-6897 URL: https://issues.apache.org/jira/browse/FLINK-6897 Project: Flink Issue Type: Bug Components: CEP Affects Versions: 1.3.0 Reporter: Kostas Kloudas -- This message was sent by Atlassian JIRA (v6.4.14#64029)
