[jira] [Commented] (FLINK-1793) Streaming jobs can't be canceled

2015-04-08 Thread Stephan Ewen (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485339#comment-14485339
 ] 

Stephan Ewen commented on FLINK-1793:
-

Okay, this looks like the source is actually not canceled, but just waits for 
the input to be finished... and then regularly exists...

That is actually a real problem

> Streaming jobs can't be canceled
> 
>
> Key: FLINK-1793
> URL: https://issues.apache.org/jira/browse/FLINK-1793
> Project: Flink
>  Issue Type: Bug
>  Components: Streaming
>Affects Versions: 0.9
>Reporter: Maximilian Michels
> Fix For: 0.9
>
>
> The streaming WordCount gets stuck in the "CANCELED" state after it has been 
> canceled using either the web interface or the command line interface.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (FLINK-1793) Streaming jobs can't be canceled

2015-04-08 Thread Maximilian Michels (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485320#comment-14485320
 ] 

Maximilian Michels commented on FLINK-1793:
---

Here's an example of a cancellation which takes 28 minutes:

{code}
104.155.72.196] out: 04/08/2015 14:14:17File Source -> Flat Map(1/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(2/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(3/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(4/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(5/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(6/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(7/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(8/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(9/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(10/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(11/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(12/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(13/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(14/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(15/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(16/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(17/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(18/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(19/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   File Source -> Flat Map(20/20) 
switched to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(1/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(2/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(3/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(4/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(5/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(6/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(7/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(8/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(9/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(10/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(11/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(12/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(13/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(14/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(15/20) switched 
to CANCELING 
[104.155.72.196] out: 04/08/2015 14:14:17   StreamDiscretizer -> 
SlidingCountGroupedPreReducer -> Window Flatten -> Stream Sink(16/20) switched 
to CANCELING 
[

[jira] [Commented] (FLINK-1793) Streaming jobs can't be canceled

2015-03-27 Thread JIRA

[ 
https://issues.apache.org/jira/browse/FLINK-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383878#comment-14383878
 ] 

Márton Balassi commented on FLINK-1793:
---

Just cancelled a streaming job successfully after running it for 10 minutes on 
10 taskmanagers. Cancellation took around 8-10 seconds in this case (the use 
case is the infamous chained mapper though).

> Streaming jobs can't be canceled
> 
>
> Key: FLINK-1793
> URL: https://issues.apache.org/jira/browse/FLINK-1793
> Project: Flink
>  Issue Type: Bug
>  Components: Streaming
>Affects Versions: 0.9
>Reporter: Maximilian Michels
> Fix For: 0.9
>
>
> The streaming WordCount gets stuck in the "CANCELED" state after it has been 
> canceled using either the web interface or the command line interface.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (FLINK-1793) Streaming jobs can't be canceled

2015-03-27 Thread Maximilian Michels (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383850#comment-14383850
 ] 

Maximilian Michels commented on FLINK-1793:
---

Some minutes. Can't give you an exact time period though. The parallelism was 
set to 20 in the experiments. 10 task managers with two task slots each.

> Streaming jobs can't be canceled
> 
>
> Key: FLINK-1793
> URL: https://issues.apache.org/jira/browse/FLINK-1793
> Project: Flink
>  Issue Type: Bug
>  Components: Streaming
>Affects Versions: 0.9
>Reporter: Maximilian Michels
> Fix For: 0.9
>
>
> The streaming WordCount gets stuck in the "CANCELED" state after it has been 
> canceled using either the web interface or the command line interface.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (FLINK-1793) Streaming jobs can't be canceled

2015-03-27 Thread Robert Metzger (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383829#comment-14383829
 ] 

Robert Metzger commented on FLINK-1793:
---

How long did you wait after cancelling the Job?
With higher parallelism, this can take minutes :(

> Streaming jobs can't be canceled
> 
>
> Key: FLINK-1793
> URL: https://issues.apache.org/jira/browse/FLINK-1793
> Project: Flink
>  Issue Type: Bug
>  Components: Streaming
>Affects Versions: 0.9
>Reporter: Maximilian Michels
> Fix For: 0.9
>
>
> The streaming WordCount gets stuck in the "CANCELED" state after it has been 
> canceled using either the web interface or the command line interface.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)