Amir -- this sounds like a general Flink usage question not related to Beam? If so, you might want to try the Flink user's list.
On Thu, May 19, 2016 at 4:22 PM, amir bahmanyari <[email protected]> wrote: > Hi Colleagues, > Pls let me know this is not related to StreamingMode so I can create a > separate thread for it. > I thought it might be relevant. > > I am trying to run a Storm app in a flink-1.0.0 Cluster following this > link. > Apache Flink 0.10.2 Documentation: Storm Compatibility > <https://ci.apache.org/projects/flink/flink-docs-release-0.10/apis/storm_compatibility.html> > > Apache Flink 0.10.2 Documentation: Storm Compatibility > > <https://ci.apache.org/projects/flink/flink-docs-release-0.10/apis/storm_compatibility.html> > > > I have everything i.e. fat jar cleanly built & packaged. > I have not added any jars to flink's lib folder. Just the default jars > there. > Following is the only dependency in pom.xml & everything gets compiled & > packaged by this dependency. > <dependency> > <groupId>org.apache.flink</groupId> > <artifactId>flink-storm</artifactId> > <version>0.10.2</version> > </dependency> > > When I try to run it in Flink Cluster, I get a StreamingMode related > MethodNotFound exception. > I see from Maven report that flink runtime jar has been included in the > packaged fat jar. > > java.lang.*NoSuchMethodError*: > org.apache.flink.runtime.minicluster.LocalFlinkMiniCluster.<init>(Lorg/apache/flink/configuration/Configuration;ZLorg/apache/flink/runtime/ > *StreamingMode*;)V > at > org.apache.flink.storm.api.FlinkLocalCluster.<init>(FlinkLocalCluster.java:54) > at com.myco.flinkstorm.SimpleTopology.main(SimpleTopology.java:102) > I appreciate any idea/suggestions pls. > Thanks for your help. > Amir- > ------------------------------ > *From:* Aljoscha Krettek <[email protected]> > *To:* [email protected] > *Sent:* Thursday, May 19, 2016 10:31 AM > *Subject:* Re: Problem with Pipeline In Flink Runner > > Hi, > as an addition, there are plans to get rid of the "streaming" flag for all > runners and determine the mode from the job. > > -Aljoscha > > On Thu, 19 May 2016 at 18:52 Maximilian Michels <[email protected]> wrote: > > Hi Ismaël, > > There is a pull request which enables Windows on batch. It will be > merged soon. In the meantime, please use the streaming execution mode > of the Flink Runner. > > Use setStreaming(true) to enable it on the FlinkPipelineOptions. > > Cheers, > Max > > On Thu, May 19, 2016 at 6:32 PM, Ismaël Mejía <[email protected]> wrote: > > I was trying to run a local Pipeline we have (basically a batch one we > > rewrote from TPC-H) in all the possible runners, for the moment I had > > success with the DirectPipelineRunner, InProcessPipelineRunner and > > SparkPipelineRunner. However when I executed it in the > FlinkPipelineRunner I > > got this exception: > > > > java.lang.UnsupportedOperationException: The transform Window.Into() is > > currently not supported. > > > > I thought it was probably a configuration error since I remember that in > the > > flink runner we had to explicitly define if it was a batch or streaming > job, > > but when I checked the options: > > > > Current Settings: > > appName: TestQ08Task > > filesToStage: ... > > flinkMaster: [auto] > > parallelism: 1 > > runner: class org.apache.beam.runners.flink.FlinkPipelineRunner > > stableUniqueNames: WARNING > > streaming: false > > > > I noticed I was in batch mode, is there something missing in the options > > configuration, or is it that the UnsoppertedOperation is a WIP or not > > supported at all by Flink ? > > > > And extra question, this option to define if it is in batch or stream > mode > > is going to stay for long, can't be this inferred some how ? > > > > Thanks, > > -Ismaël > > > > > >
