[jira] [Commented] (BEAM-485) Can't set Flink runner in code

2016-12-02 Thread Emanuele Cesena (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15716711#comment-15716711
 ] 

Emanuele Cesena commented on BEAM-485:
--

I didn’t really had the chance to try, but if it’s resolved, I trust that.



-- 
Emanuele Cesena 
http://www.theneeds.com

Il corpo non ha ideali



> Can't set Flink runner in code
> --
>
> Key: BEAM-485
> URL: https://issues.apache.org/jira/browse/BEAM-485
> Project: Beam
>  Issue Type: Bug
>  Components: runner-flink
>Reporter: Emanuele Cesena
> Fix For: Not applicable
>
>
> Calling:
> options.setRunner(FlinkRunner.class);
> doesn't seem to properly set the runner.
> Running --runner=FlinkRunner from the command line works.
> Both approaches were working on 0.1.0, but options.setRunner doesn't seem to 
> work on master anymore.
> I noticed there are tests that only cover the command line case:
> https://github.com/apache/incubator-beam/blob/master/runners/flink/runner/src/test/java/org/apache/beam/runners/flink/FlinkRunnerRegistrarTest.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (BEAM-485) Can't set Flink runner in code

2016-07-24 Thread Emanuele Cesena (JIRA) 
Emanuele Cesena created BEAM-485:


 Summary: Can't set Flink runner in code
 Key: BEAM-485
 URL: https://issues.apache.org/jira/browse/BEAM-485
 Project: Beam
  Issue Type: Bug
  Components: runner-flink
Reporter: Emanuele Cesena


Calling:
options.setRunner(FlinkRunner.class);
doesn't seem to properly set the runner.

Running --runner=FlinkRunner from the command line works.

Both approaches were working on 0.1.0, but options.setRunner doesn't seem to 
work on master anymore.

I noticed there are tests that only cover the command line case:
https://github.com/apache/incubator-beam/blob/master/runners/flink/runner/src/test/java/org/apache/beam/runners/flink/FlinkRunnerRegistrarTest.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (BEAM-333) Support "stop" for streaming pipelines

2016-06-10 Thread Emanuele Cesena (JIRA) 

 [ 
https://issues.apache.org/jira/browse/BEAM-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Emanuele Cesena updated BEAM-333:
-
Description: 
Run:
{code}
$ flink run -c 
org.apache.beam.runners.flink.examples.streaming.KafkaWindowedWordCountExample 
/path/to/fat.jar
{code}

The job properly runs. Trying to stop it fails. (Cancelling works fine.)

{code}
$ flink list
-- Running/Restarting Jobs ---
10.06.2016 06:24:46 : cf004f703cb3d4f89254eedbc04718cc : KafkaExample - 
WindowSize: 10 seconds (RUNNING)
--
No scheduled jobs.


$ flink stop cf004f703cb3d4f89254eedbc04718cc


 The program finished with the following exception:

java.lang.Exception: Stopping the job with ID cf004f703cb3d4f89254eedbc04718cc 
failed.
at org.apache.flink.client.CliFrontend.stop(CliFrontend.java:629)
at 
org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1201)
at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1243)
Caused by: java.lang.IllegalStateException: Job with ID 
cf004f703cb3d4f89254eedbc04718cc is not stoppable.
at 
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:483)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
at 
org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
at 
org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
at 
org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118)
at 
org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at 
org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:107)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke(ActorCell.scala:487)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)
at akka.dispatch.Mailbox.run(Mailbox.scala:221)
at akka.dispatch.Mailbox.exec(Mailbox.scala:231)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at 
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at 
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at 
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
{code}

  was:
Run:
```
$ flink run -c 
org.apache.beam.runners.flink.examples.streaming.KafkaWindowedWordCountExample 
/path/to/fat.jar
```

The job properly runs. Trying to stop it fails. (Cancelling works fine.)

```
$ flink list
-- Running/Restarting Jobs ---
10.06.2016 06:24:46 : cf004f703cb3d4f89254eedbc04718cc : KafkaExample - 
WindowSize: 10 seconds (RUNNING)
--
No scheduled jobs.


$ flink stop cf004f703cb3d4f89254eedbc04718cc


 The program finished with the following exception:

java.lang.Exception: Stopping the job with ID cf004f703cb3d4f89254eedbc04718cc 
failed.
at org.apache.flink.client.CliFrontend.stop(CliFrontend.java:629)
at 
org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1201)
at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1243)
Caused by: java.lang.IllegalStateException: Job with ID 
cf004f703cb3d4f89254eedbc04718cc is not stoppable.
at 
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:483)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
at 
org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at

[jira] [Created] (BEAM-333) Support "stop" for streaming pipelines

2016-06-10 Thread Emanuele Cesena (JIRA) 
Emanuele Cesena created BEAM-333:


 Summary: Support "stop" for streaming pipelines
 Key: BEAM-333
 URL: https://issues.apache.org/jira/browse/BEAM-333
 Project: Beam
  Issue Type: Bug
  Components: runner-flink
Reporter: Emanuele Cesena


Run:
```
$ flink run -c 
org.apache.beam.runners.flink.examples.streaming.KafkaWindowedWordCountExample 
/path/to/fat.jar
```

The job properly runs. Trying to stop it fails. (Cancelling works fine.)

```
$ flink list
-- Running/Restarting Jobs ---
10.06.2016 06:24:46 : cf004f703cb3d4f89254eedbc04718cc : KafkaExample - 
WindowSize: 10 seconds (RUNNING)
--
No scheduled jobs.


$ flink stop cf004f703cb3d4f89254eedbc04718cc


 The program finished with the following exception:

java.lang.Exception: Stopping the job with ID cf004f703cb3d4f89254eedbc04718cc 
failed.
at org.apache.flink.client.CliFrontend.stop(CliFrontend.java:629)
at 
org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1201)
at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1243)
Caused by: java.lang.IllegalStateException: Job with ID 
cf004f703cb3d4f89254eedbc04718cc is not stoppable.
at 
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:483)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
at 
org.apache.flink.runtime.LeaderSessionMessageFilter$$anonfun$receive$1.applyOrElse(LeaderSessionMessageFilter.scala:36)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
at 
scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
at 
org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
at 
org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118)
at 
org.apache.flink.runtime.LogMessages$$anon$1.applyOrElse(LogMessages.scala:28)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at 
org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:107)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke(ActorCell.scala:487)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)
at akka.dispatch.Mailbox.run(Mailbox.scala:221)
at akka.dispatch.Mailbox.exec(Mailbox.scala:231)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at 
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at 
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at 
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
```



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)