Re: Exception in thread main: No such exception errpr

2016-06-03 Thread Debaditya Roy 
Hello,

Thank you for the advice.
I have done that simulation and have successfully got correct results. But
there is some problem which I have already raised before.

My program basically reads an image file does facial detection (with the
help of open cv library) and writes it back to disk. I have not used the
open cv library from the maven central repository rather I have added it
locally to the .m2 repository (by mvn install command) and updated the
pom.xml and done rest of the program. In IDE the program was already
executing correctly. However when I was trying to execute through cli or
web frontend, the fat jar generated by *mvn clean install -Pbuild-jar * is
unable to run on the local flink node as it gives an Java linking error
(when I concluded the fat jar could not link the path to my native library
for the open cv). Hence I manually built the fat jar and uploaded it in the
web frontend, after submitting the job it is correctly executing and giving
me the desired results but with an exception (cannot show the plan)

org.apache.flink.client.program.ProgramInvocationException: The
program plan could not be fetched - the program aborted
pre-maturely.System.out: (none)


at 
org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:105)
at 
org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:215)
at 
org.apache.flink.runtime.webmonitor.handlers.JarActionHandler.getJobGraphAndClassLoader(JarActionHandler.java:95)
at 
org.apache.flink.runtime.webmonitor.handlers.JarPlanHandler.handleRequest(JarPlanHandler.java:42)
at 
org.apache.flink.runtime.webmonitor.RuntimeMonitorHandler.respondAsLeader(RuntimeMonitorHandler.java:135)
at 
org.apache.flink.runtime.webmonitor.RuntimeMonitorHandler.channelRead0(RuntimeMonitorHandler.java:112)
at 
org.apache.flink.runtime.webmonitor.RuntimeMonitorHandler.channelRead0(RuntimeMonitorHandler.java:60)
at 
io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
at io.netty.handler.codec.http.router.Handler.routed(Handler.java:62)
at 
io.netty.handler.codec.http.router.DualAbstractHandler.channelRead0(DualAbstractHandler.java:57)
at 
io.netty.handler.codec.http.router.DualAbstractHandler.channelRead0(DualAbstractHandler.java:20)
at 
io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
at 
org.apache.flink.runtime.webmonitor.HttpRequestHandler.channelRead0(HttpRequestHandler.java:104)
at 
org.apache.flink.runtime.webmonitor.HttpRequestHandler.channelRead0(HttpRequestHandler.java:65)
at 
io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
at 
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:242)
at 
io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:147)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
at 
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:847)
at 
io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
at 
io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
at 
io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at 
io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at 
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
at 
io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745).

  From CLI there is no exception. So one question still remains: Is
there any way of linking native library files so that the

 fat jar file created by mvn clean install -Pbuild-jar runs without
giving the

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy 
Yeah i will do that as a last resort. But the strange fact is in IDE it is
working fine. Although I am not entirely aware of the mechanics on how
flink is simulated on IDE.

On Thu, 2 Jun 2016 17:35 Kostas Kloudas, 
wrote:

> The reason seems to be that somehow an older version of Flink is still in
> your dependencies.
>
> As you can see here:
> https://issues.apache.org/jira/browse/FLINK-3306
> at 0.10 the method you cannot find had 2 arguments and after this commit
> it has 3.
> This is the reason why you cannot find the method.
>
> It can be that you forgot to clean some directory or forgot to rebuild
> after updating versions.
> What you could do is delete and clean everything and
> reinstall/re-download/rebuild them.
>
> I hope this is not too much of a hassle.
>
> Kostas
>
> On Jun 2, 2016, at 4:36 PM, Debaditya Roy  wrote:
>
> Yeah I think so. Here is a part of log file.
>
> 2016-06-02 18:37:27,376 INFO
> org.apache.flink.runtime.jobmanager.JobManager-
> 
> 2016-06-02 18:37:27,377 INFO
> org.apache.flink.runtime.jobmanager.JobManager-  Starting
> JobManager (Version: 1.0.3, Rev:f3a6b5f, Date:06.05.2016 @ 12:58:02 UTC)
> 2016-06-02 18:37:27,377 INFO
> org.apache.flink.runtime.jobmanager.JobManager-  Current
> user: royd1990
> 2016-06-02 18:37:27,377 INFO
> org.apache.flink.runtime.jobmanager.JobManager-  JVM: Java
> HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.74-b02
> 2016-06-02 18:37:27,377 INFO
> org.apache.flink.runtime.jobmanager.JobManager-  Maximum
> heap size: 736 MiBytes
> 2016-06-02 18:37:27,377 INFO
> org.apache.flink.runtime.jobmanager.JobManager-  JAVA_HOME:
> /usr/lib/jvm/java-8-oracle/jre
> 2016-06-02 18:37:27,385 INFO
> org.apache.flink.runtime.jobmanager.JobManager-  Hadoop
> version: 1.2.1
> 2016-06-02 18:37:27,385 INFO
> org.apache.flink.runtime.jobmanager.JobManager-  JVM
> Options:
> 2016-06-02 18:37:27,385 INFO
> org.apache.flink.runtime.jobmanager.JobManager- -Xms768m
> 2016-06-02 18:37:27,385 INFO
> org.apache.flink.runtime.jobmanager.JobManager- -Xmx768m
> 2016-06-02 18:37:27,385 INFO
> org.apache.flink.runtime.jobmanager.JobManager-
> -Dlog.file=/home/royd1990/Downloads/flink-1.0.3/log/flink-royd1990-jobmanager-0-royd1990-HP-ENVY-Notebook.log
>
>
> On Thu, Jun 2, 2016 at 4:32 PM, Kostas Kloudas <
> k.klou...@data-artisans.com> wrote:
>
>> Form the Flink logs you see that the version is the correct right (1.0.3)?
>>
>> On Jun 2, 2016, at 4:19 PM, Debaditya Roy  wrote:
>>
>> Hello,
>>
>> I updated the artifact Id and regenerated the jar, but it is giving the
>> same error. It is somehow trying to access the method which is not there in
>> the updated version.
>>
>> Warm Regards,
>> Debaditya
>>
>> On Thu, Jun 2, 2016 at 4:10 PM, Robert Metzger 
>> wrote:
>>
>>> The correct artifact id is flink-yarn-tests_2.10.
>>>
>>> On Thu, Jun 2, 2016 at 3:54 PM, Debaditya Roy 
>>> wrote:
>>>
 Hi Kostas,

 Doing this throws an error in the pom.

 
org.apache.flink
flink-yarn-tests
${flink.version}
 

 'org.apache.flink:flink-yarn-tests:1.0.3' not found.

 Warm Regards,
 Debaditya

 On Thu, Jun 2, 2016 at 3:32 PM, Kostas Kloudas <
 k.klou...@data-artisans.com> wrote:

> Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?
>
> Thanks,
> Kostas
>
> On Jun 2, 2016, at 3:13 PM, Debaditya Roy  wrote:
>
> 0.10-SNAPSHOT
>
>
>

>>>
>>
>>
>
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Kostas Kloudas 
The reason seems to be that somehow an older version of Flink is still in your 
dependencies.

As you can see here:
https://issues.apache.org/jira/browse/FLINK-3306 

at 0.10 the method you cannot find had 2 arguments and after this commit it has 
3.
This is the reason why you cannot find the method.

It can be that you forgot to clean some directory or forgot to rebuild after 
updating versions. 
What you could do is delete and clean everything and 
reinstall/re-download/rebuild them.

I hope this is not too much of a hassle.

Kostas

> On Jun 2, 2016, at 4:36 PM, Debaditya Roy  wrote:
> 
> Yeah I think so. Here is a part of log file. 
> 
> 2016-06-02 18:37:27,376 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   - 
> 
> 2016-06-02 18:37:27,377 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   -  Starting JobManager (Version: 1.0.3, Rev:f3a6b5f, 
> Date:06.05.2016 @ 12:58:02 UTC)
> 2016-06-02 18:37:27,377 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   -  Current user: royd1990
> 2016-06-02 18:37:27,377 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   -  JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation 
> - 1.8/25.74-b02
> 2016-06-02 18:37:27,377 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   -  Maximum heap size: 736 MiBytes
> 2016-06-02 18:37:27,377 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   -  JAVA_HOME: /usr/lib/jvm/java-8-oracle/jre
> 2016-06-02 18:37:27,385 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   -  Hadoop version: 1.2.1
> 2016-06-02 18:37:27,385 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   -  JVM Options:
> 2016-06-02 18:37:27,385 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   - -Xms768m
> 2016-06-02 18:37:27,385 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   - -Xmx768m
> 2016-06-02 18:37:27,385 INFO  org.apache.flink.runtime.jobmanager.JobManager  
>   - 
> -Dlog.file=/home/royd1990/Downloads/flink-1.0.3/log/flink-royd1990-jobmanager-0-royd1990-HP-ENVY-Notebook.log
> 
> 
> On Thu, Jun 2, 2016 at 4:32 PM, Kostas Kloudas  > wrote:
> Form the Flink logs you see that the version is the correct right (1.0.3)?
> 
>> On Jun 2, 2016, at 4:19 PM, Debaditya Roy > > wrote:
>> 
>> Hello,
>> 
>> I updated the artifact Id and regenerated the jar, but it is giving the same 
>> error. It is somehow trying to access the method which is not there in the 
>> updated version.
>> 
>> Warm Regards,
>> Debaditya
>> 
>> On Thu, Jun 2, 2016 at 4:10 PM, Robert Metzger > > wrote:
>> The correct artifact id is flink-yarn-tests_2.10.
>> 
>> On Thu, Jun 2, 2016 at 3:54 PM, Debaditya Roy > > wrote:
>> Hi Kostas,
>> 
>> Doing this throws an error in the pom.
>> 
>>org.apache.flink
>>flink-yarn-tests
>>${flink.version}
>> 
>> 
>> 'org.apache.flink:flink-yarn-tests:1.0.3' not found.
>> 
>> Warm Regards,
>> Debaditya
>> 
>> On Thu, Jun 2, 2016 at 3:32 PM, Kostas Kloudas > > wrote:
>> Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?
>> 
>> Thanks,
>> Kostas
>> 
>>> On Jun 2, 2016, at 3:13 PM, Debaditya Roy >> > wrote:
>>> 
>>> 0.10-SNAPSHOT
>> 
>> 
>> 
>> 
> 
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy 
Yeah I think so. Here is a part of log file.

2016-06-02 18:37:27,376 INFO
org.apache.flink.runtime.jobmanager.JobManager-

2016-06-02 18:37:27,377 INFO
org.apache.flink.runtime.jobmanager.JobManager-  Starting
JobManager (Version: 1.0.3, Rev:f3a6b5f, Date:06.05.2016 @ 12:58:02 UTC)
2016-06-02 18:37:27,377 INFO
org.apache.flink.runtime.jobmanager.JobManager-  Current
user: royd1990
2016-06-02 18:37:27,377 INFO
org.apache.flink.runtime.jobmanager.JobManager-  JVM: Java
HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.74-b02
2016-06-02 18:37:27,377 INFO
org.apache.flink.runtime.jobmanager.JobManager-  Maximum
heap size: 736 MiBytes
2016-06-02 18:37:27,377 INFO
org.apache.flink.runtime.jobmanager.JobManager-  JAVA_HOME:
/usr/lib/jvm/java-8-oracle/jre
2016-06-02 18:37:27,385 INFO
org.apache.flink.runtime.jobmanager.JobManager-  Hadoop
version: 1.2.1
2016-06-02 18:37:27,385 INFO
org.apache.flink.runtime.jobmanager.JobManager-  JVM
Options:
2016-06-02 18:37:27,385 INFO
org.apache.flink.runtime.jobmanager.JobManager- -Xms768m
2016-06-02 18:37:27,385 INFO
org.apache.flink.runtime.jobmanager.JobManager- -Xmx768m
2016-06-02 18:37:27,385 INFO
org.apache.flink.runtime.jobmanager.JobManager-
-Dlog.file=/home/royd1990/Downloads/flink-1.0.3/log/flink-royd1990-jobmanager-0-royd1990-HP-ENVY-Notebook.log


On Thu, Jun 2, 2016 at 4:32 PM, Kostas Kloudas 
wrote:

> Form the Flink logs you see that the version is the correct right (1.0.3)?
>
> On Jun 2, 2016, at 4:19 PM, Debaditya Roy  wrote:
>
> Hello,
>
> I updated the artifact Id and regenerated the jar, but it is giving the
> same error. It is somehow trying to access the method which is not there in
> the updated version.
>
> Warm Regards,
> Debaditya
>
> On Thu, Jun 2, 2016 at 4:10 PM, Robert Metzger 
> wrote:
>
>> The correct artifact id is flink-yarn-tests_2.10.
>>
>> On Thu, Jun 2, 2016 at 3:54 PM, Debaditya Roy 
>> wrote:
>>
>>> Hi Kostas,
>>>
>>> Doing this throws an error in the pom.
>>>
>>> 
>>>org.apache.flink
>>>flink-yarn-tests
>>>${flink.version}
>>> 
>>>
>>> 'org.apache.flink:flink-yarn-tests:1.0.3' not found.
>>>
>>> Warm Regards,
>>> Debaditya
>>>
>>> On Thu, Jun 2, 2016 at 3:32 PM, Kostas Kloudas <
>>> k.klou...@data-artisans.com> wrote:
>>>
 Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?

 Thanks,
 Kostas

 On Jun 2, 2016, at 3:13 PM, Debaditya Roy  wrote:

 0.10-SNAPSHOT



>>>
>>
>
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Kostas Kloudas 
Form the Flink logs you see that the version is the correct right (1.0.3)?

> On Jun 2, 2016, at 4:19 PM, Debaditya Roy  wrote:
> 
> Hello,
> 
> I updated the artifact Id and regenerated the jar, but it is giving the same 
> error. It is somehow trying to access the method which is not there in the 
> updated version.
> 
> Warm Regards,
> Debaditya
> 
> On Thu, Jun 2, 2016 at 4:10 PM, Robert Metzger  > wrote:
> The correct artifact id is flink-yarn-tests_2.10.
> 
> On Thu, Jun 2, 2016 at 3:54 PM, Debaditya Roy  > wrote:
> Hi Kostas,
> 
> Doing this throws an error in the pom.
> 
>org.apache.flink
>flink-yarn-tests
>${flink.version}
> 
> 
> 'org.apache.flink:flink-yarn-tests:1.0.3' not found.
> 
> Warm Regards,
> Debaditya
> 
> On Thu, Jun 2, 2016 at 3:32 PM, Kostas Kloudas  > wrote:
> Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?
> 
> Thanks,
> Kostas
> 
>> On Jun 2, 2016, at 3:13 PM, Debaditya Roy > > wrote:
>> 
>> 0.10-SNAPSHOT
> 
> 
> 
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy 
Hello,

I updated the artifact Id and regenerated the jar, but it is giving the
same error. It is somehow trying to access the method which is not there in
the updated version.

Warm Regards,
Debaditya

On Thu, Jun 2, 2016 at 4:10 PM, Robert Metzger  wrote:

> The correct artifact id is flink-yarn-tests_2.10.
>
> On Thu, Jun 2, 2016 at 3:54 PM, Debaditya Roy  wrote:
>
>> Hi Kostas,
>>
>> Doing this throws an error in the pom.
>>
>> 
>>org.apache.flink
>>flink-yarn-tests
>>${flink.version}
>> 
>>
>> 'org.apache.flink:flink-yarn-tests:1.0.3' not found.
>>
>> Warm Regards,
>> Debaditya
>>
>> On Thu, Jun 2, 2016 at 3:32 PM, Kostas Kloudas <
>> k.klou...@data-artisans.com> wrote:
>>
>>> Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?
>>>
>>> Thanks,
>>> Kostas
>>>
>>> On Jun 2, 2016, at 3:13 PM, Debaditya Roy  wrote:
>>>
>>> 0.10-SNAPSHOT
>>>
>>>
>>>
>>
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Robert Metzger 
The correct artifact id is flink-yarn-tests_2.10.

On Thu, Jun 2, 2016 at 3:54 PM, Debaditya Roy  wrote:

> Hi Kostas,
>
> Doing this throws an error in the pom.
>
> 
>org.apache.flink
>flink-yarn-tests
>${flink.version}
> 
>
> 'org.apache.flink:flink-yarn-tests:1.0.3' not found.
>
> Warm Regards,
> Debaditya
>
> On Thu, Jun 2, 2016 at 3:32 PM, Kostas Kloudas <
> k.klou...@data-artisans.com> wrote:
>
>> Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?
>>
>> Thanks,
>> Kostas
>>
>> On Jun 2, 2016, at 3:13 PM, Debaditya Roy  wrote:
>>
>> 0.10-SNAPSHOT
>>
>>
>>
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy 
Hi Kostas,

Doing this throws an error in the pom.


   org.apache.flink
   flink-yarn-tests
   ${flink.version}


'org.apache.flink:flink-yarn-tests:1.0.3' not found.

Warm Regards,
Debaditya

On Thu, Jun 2, 2016 at 3:32 PM, Kostas Kloudas 
wrote:

> Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?
>
> Thanks,
> Kostas
>
> On Jun 2, 2016, at 3:13 PM, Debaditya Roy  wrote:
>
> 0.10-SNAPSHOT
>
>
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Kostas Kloudas 
Could you replace 0.10-SNAPSHOT with ${flink.version} in the pom?

Thanks,
Kostas

> On Jun 2, 2016, at 3:13 PM, Debaditya Roy  wrote:
> 
> 0.10-SNAPSHOT

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy 
Hello Kostas,

Here is the pom


http://maven.apache.org/POM/4.0.0;
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
   xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xsd/maven-4.0.0.xsd;>
   4.0.0

   org.myorg.quickstart
   quickstart
   0.1
   jar

   Flink Quickstart Job
   http://www.myorganization.org

   
  UTF-8
  1.0.3
   

   
  
 apache.snapshots
 Apache Development Snapshot Repository
 
https://repository.apache.org/content/repositories/snapshots/
 
false
 
 
true
 
  
   

   

   
  
 org.apache.flink
 flink-java
 ${flink.version}
  
  
 org.opencv
 opencv
 3.1.0
  
  
 org.apache.flink
 flink-streaming-java_2.10
 ${flink.version}
  
  
 org.apache.flink
 flink-clients_2.10
 ${flink.version}
  
  
 org.apache.flink
 flink-yarn-tests
 0.10-SNAPSHOT
  
   

   
  
 
 build-jar
 
false
 
 

   org.apache.flink
   flink-java
   ${flink.version}
   provided


   org.apache.flink
   flink-streaming-java_2.10
   ${flink.version}
   provided


   org.apache.flink
   flink-clients_2.10
   ${flink.version}
   provided

 

 

   
   
  org.apache.maven.plugins
  maven-shade-plugin
  2.4.1
  
 
package

   shade


   
  
   

 
  
   

 
  
   

   
  
 
 
org.apache.maven.plugins
maven-shade-plugin
2.4.1

   
   
  package
  
 shade
  
  
 

   
   org.apache.flink:flink-annotations

org.apache.flink:flink-shaded-hadoop1

org.apache.flink:flink-shaded-hadoop2

org.apache.flink:flink-shaded-curator-recipes
   org.apache.flink:flink-core
   org.apache.flink:flink-java
   org.apache.flink:flink-scala_2.10

org.apache.flink:flink-runtime_2.10

org.apache.flink:flink-optimizer_2.10

org.apache.flink:flink-clients_2.10
   org.apache.flink:flink-avro_2.10

org.apache.flink:flink-examples-batch_2.10

org.apache.flink:flink-examples-streaming_2.10

org.apache.flink:flink-streaming-java_2.10

   
   org.scala-lang:scala-library
   org.scala-lang:scala-compiler
   org.scala-lang:scala-reflect
   com.amazonaws:aws-java-sdk
   com.typesafe.akka:akka-actor_*
   com.typesafe.akka:akka-remote_*
   com.typesafe.akka:akka-slf4j_*
   io.netty:netty-all
   io.netty:netty

commons-fileupload:commons-fileupload
   org.apache.avro:avro

commons-collections:commons-collections

org.codehaus.jackson:jackson-core-asl

org.codehaus.jackson:jackson-mapper-asl

com.thoughtworks.paranamer:paranamer
   org.xerial.snappy:snappy-java

org.apache.commons:commons-compress
   org.tukaani:xz
   com.esotericsoftware.kryo:kryo
   com.esotericsoftware.minlog:minlog
   org.objenesis:objenesis
   com.twitter:chill_*
   com.twitter:chill-java
   com.twitter:chill-avro_*
   com.twitter:chill-bijection_*
   com.twitter:bijection-core_*
   com.twitter:bijection-avro_*
   commons-lang:commons-lang
   junit:junit
   de.javakaffee:kryo-serializers
   joda-time:joda-time
   org.apache.commons:commons-lang3
   org.slf4j:slf4j-api
   org.slf4j:slf4j-log4j12
   log4j:log4j

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy 
Hi Kostas,

I followed this
https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/java_api_quickstart.html
.
Just for your information, in IDE the program is running fine, it is only
in the command line when I try to submit it throws me the error.

Warm Regards,
Debaditya

On Thu, Jun 2, 2016 at 2:17 PM, Kostas Kloudas 
wrote:

> Hi Debaditya,
>
> When creating your application, did you follow the steps described in:
>
> https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/local_execution.html
> (of course adjusted to the release you are currently using) ?
>
> Kostas
>
> On Jun 2, 2016, at 2:01 PM, Debaditya Roy  wrote:
>
> Hello Kostas,
>
> Thanks for you reply.
>
> I don't think that is the case because I am running the application on the
> jvm of my local machine, not on a distributed cluster. Any other input?
>
> Warm Regards,
> Debaditya
>
>
>
> On Thu, Jun 2, 2016 at 1:27 PM, Kostas Kloudas <
> k.klou...@data-artisans.com> wrote:
>
>> Hello Debaditya,
>>
>> From the exception message you posted it seems that it is a linkage error.
>>
>> Could it be that you are combining different versions of Flink when
>> running your application?
>> E.g. you have version X running on your cluster and you create your jar
>> against version Y on your local machine?
>> In this case, Flink version Y may have a method that is no longer there
>> in version X, and this causes the
>> exception.
>>
>> Kostas
>>
>> On Jun 2, 2016, at 12:02 PM, Debaditya Roy  wrote:
>>
>> Hi,
>>
>> I am trying to run a simple flink program, which reads an image from disk
>> and does some image processing and stores it back to the disk. For the
>> purpose I have a custom defined class, which I am using in dataset and
>> passing it onwards to flatmap function. However the experiment encountered
>> an error which I am clueless about. Any help will be highly appreciated.
>> Pasting the error below.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *Exception in thread "main" java.lang.NoSuchMethodError:
>> org.apache.flink.api.java.typeutils.runtime.kryo.Serializers.recursivelyRegisterType(Ljava/lang/Class;Lorg/apache/flink/api/common/ExecutionConfig;)V
>> at
>> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:985)
>> at
>> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:977)
>> at
>> org.apache.flink.api.common.operators.SingleInputOperator.accept(SingleInputOperator.java:198)
>> at
>> org.apache.flink.api.common.operators.GenericDataSinkBase.accept(GenericDataSinkBase.java:223)
>> at org.apache.flink.api.common.Plan.accept(Plan.java:348)at
>> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:977)
>> at
>> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:938)
>> at
>> org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:80)
>> at
>> org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:834)
>> at org.apache.flink.api.java.DataSet.collect(DataSet.java:408)at
>> org.myorg.quickstart.Job.main(Job.java:51)*
>>
>> Warm Regards,
>> Debaditya
>>
>>
>>
>
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Kostas Kloudas 
Hi Debaditya,

When creating your application, did you follow the steps described in:
https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/local_execution.html
 

(of course adjusted to the release you are currently using) ?

Kostas

> On Jun 2, 2016, at 2:01 PM, Debaditya Roy  wrote:
> 
> Hello Kostas,
> 
> Thanks for you reply.
> 
> I don't think that is the case because I am running the application on the 
> jvm of my local machine, not on a distributed cluster. Any other input? 
> 
> Warm Regards,
> Debaditya
> 
> 
> 
> On Thu, Jun 2, 2016 at 1:27 PM, Kostas Kloudas  > wrote:
> Hello Debaditya,
> 
> From the exception message you posted it seems that it is a linkage error.
> 
> Could it be that you are combining different versions of Flink when running 
> your application? 
> E.g. you have version X running on your cluster and you create your jar 
> against version Y on your local machine?
> In this case, Flink version Y may have a method that is no longer there in 
> version X, and this causes the 
> exception.
> 
> Kostas
> 
>> On Jun 2, 2016, at 12:02 PM, Debaditya Roy > > wrote:
>> 
>> Hi,
>> 
>> I am trying to run a simple flink program, which reads an image from disk 
>> and does some image processing and stores it back to the disk. For the 
>> purpose I have a custom defined class, which I am using in dataset and 
>> passing it onwards to flatmap function. However the experiment encountered 
>> an error which I am clueless about. Any help will be highly appreciated. 
>> Pasting the error below.
>> 
>> Exception in thread "main" java.lang.NoSuchMethodError: 
>> org.apache.flink.api.java.typeutils.runtime.kryo.Serializers.recursivelyRegisterType(Ljava/lang/Class;Lorg/apache/flink/api/common/ExecutionConfig;)V
>> at 
>> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:985)
>> at 
>> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:977)
>> at 
>> org.apache.flink.api.common.operators.SingleInputOperator.accept(SingleInputOperator.java:198)
>> at 
>> org.apache.flink.api.common.operators.GenericDataSinkBase.accept(GenericDataSinkBase.java:223)
>> at org.apache.flink.api.common.Plan.accept(Plan.java:348)
>> at 
>> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:977)
>> at 
>> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:938)
>> at 
>> org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:80)
>> at 
>> org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:834)
>> at org.apache.flink.api.java.DataSet.collect(DataSet.java:408)
>> at org.myorg.quickstart.Job.main(Job.java:51)
>> 
>> Warm Regards,
>> Debaditya
> 
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy 
Hello Kostas,

Thanks for you reply.

I don't think that is the case because I am running the application on the
jvm of my local machine, not on a distributed cluster. Any other input?

Warm Regards,
Debaditya



On Thu, Jun 2, 2016 at 1:27 PM, Kostas Kloudas 
wrote:

> Hello Debaditya,
>
> From the exception message you posted it seems that it is a linkage error.
>
> Could it be that you are combining different versions of Flink when
> running your application?
> E.g. you have version X running on your cluster and you create your jar
> against version Y on your local machine?
> In this case, Flink version Y may have a method that is no longer there in
> version X, and this causes the
> exception.
>
> Kostas
>
> On Jun 2, 2016, at 12:02 PM, Debaditya Roy  wrote:
>
> Hi,
>
> I am trying to run a simple flink program, which reads an image from disk
> and does some image processing and stores it back to the disk. For the
> purpose I have a custom defined class, which I am using in dataset and
> passing it onwards to flatmap function. However the experiment encountered
> an error which I am clueless about. Any help will be highly appreciated.
> Pasting the error below.
>
>
>
>
>
>
>
>
>
>
>
>
> *Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.flink.api.java.typeutils.runtime.kryo.Serializers.recursivelyRegisterType(Ljava/lang/Class;Lorg/apache/flink/api/common/ExecutionConfig;)V
> at
> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:985)
> at
> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:977)
> at
> org.apache.flink.api.common.operators.SingleInputOperator.accept(SingleInputOperator.java:198)
> at
> org.apache.flink.api.common.operators.GenericDataSinkBase.accept(GenericDataSinkBase.java:223)
> at org.apache.flink.api.common.Plan.accept(Plan.java:348)at
> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:977)
> at
> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:938)
> at
> org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:80)
> at
> org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:834)
> at org.apache.flink.api.java.DataSet.collect(DataSet.java:408)at
> org.myorg.quickstart.Job.main(Job.java:51)*
>
> Warm Regards,
> Debaditya
>
>
>

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Kostas Kloudas 
Hello Debaditya,

From the exception message you posted it seems that it is a linkage error.

Could it be that you are combining different versions of Flink when running 
your application? 
E.g. you have version X running on your cluster and you create your jar against 
version Y on your local machine?
In this case, Flink version Y may have a method that is no longer there in 
version X, and this causes the 
exception.

Kostas

> On Jun 2, 2016, at 12:02 PM, Debaditya Roy  wrote:
> 
> Hi,
> 
> I am trying to run a simple flink program, which reads an image from disk and 
> does some image processing and stores it back to the disk. For the purpose I 
> have a custom defined class, which I am using in dataset and passing it 
> onwards to flatmap function. However the experiment encountered an error 
> which I am clueless about. Any help will be highly appreciated. Pasting the 
> error below.
> 
> Exception in thread "main" java.lang.NoSuchMethodError: 
> org.apache.flink.api.java.typeutils.runtime.kryo.Serializers.recursivelyRegisterType(Ljava/lang/Class;Lorg/apache/flink/api/common/ExecutionConfig;)V
> at 
> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:985)
> at 
> org.apache.flink.api.java.ExecutionEnvironment$1.preVisit(ExecutionEnvironment.java:977)
> at 
> org.apache.flink.api.common.operators.SingleInputOperator.accept(SingleInputOperator.java:198)
> at 
> org.apache.flink.api.common.operators.GenericDataSinkBase.accept(GenericDataSinkBase.java:223)
> at org.apache.flink.api.common.Plan.accept(Plan.java:348)
> at 
> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:977)
> at 
> org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:938)
> at 
> org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:80)
> at 
> org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:834)
> at org.apache.flink.api.java.DataSet.collect(DataSet.java:408)
> at org.myorg.quickstart.Job.main(Job.java:51)
> 
> Warm Regards,
> Debaditya