downloading dependency in apache flink
i am trying to write a job, using maven project. Job is working fine in my editor , but when i am running that job through flink command line its giving ClassNotFoundException exception . Its not to find dependency. If i will create a jar , will flink download all its dependency before executing that jar. if not that how can we run one-jar. Thanks
Re: downloading dependency in apache flink
Hi Till , I was able to make fat jar, but i am not able to execute this jar through flink command line. On Wed, Feb 24, 2016 at 4:31 PM, Till Rohrmann wrote: > Hi Pankaj, > > are you creating a fat jar when you create your use code jar? This can be > done using maven's shade plugin or the assembly plugin. We provide a maven > archetype to set up a pom file which will make sure that a fat jar is built > [1]. > > [1] > https://ci.apache.org/projects/flink/flink-docs-master/quickstart/java_api_quickstart.html > > Cheers, > Till > > On Wed, Feb 24, 2016 at 11:31 AM, Pankaj Kumar > wrote: > >> i am trying to write a job, using maven project. >> >> Job is working fine in my editor , but when i am running that job through >> flink command line its giving ClassNotFoundException exception . Its not >> to find dependency. >> >> If i will create a jar , will flink download all its dependency before >> executing that jar. if not that how can we run one-jar. >> >> >> Thanks >> > >
Re: downloading dependency in apache flink
I was using wrong method to create fat jar, after using mvn clean install -Pbuild-jar i was able to execute code through flink command line. On Wed, Feb 24, 2016 at 7:12 PM, Till Rohrmann wrote: > What is the error message you receive? > > On Wed, Feb 24, 2016 at 1:49 PM, Pankaj Kumar > wrote: > >> Hi Till , >> >> I was able to make fat jar, but i am not able to execute this jar through >> flink command line. >> >> On Wed, Feb 24, 2016 at 4:31 PM, Till Rohrmann >> wrote: >> >>> Hi Pankaj, >>> >>> are you creating a fat jar when you create your use code jar? This can >>> be done using maven's shade plugin or the assembly plugin. We provide a >>> maven archetype to set up a pom file which will make sure that a fat jar is >>> built [1]. >>> >>> [1] >>> https://ci.apache.org/projects/flink/flink-docs-master/quickstart/java_api_quickstart.html >>> >>> Cheers, >>> Till >>> >>> On Wed, Feb 24, 2016 at 11:31 AM, Pankaj Kumar >>> wrote: >>> >>>> i am trying to write a job, using maven project. >>>> >>>> Job is working fine in my editor , but when i am running that job >>>> through flink command line its giving ClassNotFoundException exception >>>> . Its not to find dependency. >>>> >>>> If i will create a jar , will flink download all its dependency before >>>> executing that jar. if not that how can we run one-jar. >>>> >>>> >>>> Thanks >>>> >>> >>> >> >
kafka and flink integration issue
I am trying to integrate kafka and flink. my pom file is where {flink.version} is 0.10.2 org.apache.flink flink-java ${flink.version} org.apache.flink flink-streaming-java ${flink.version} org.apache.flink flink-clients ${flink.version} com.fasterxml.jackson.core jackson-databind 2.6.4 org.projectlombok lombok 1.16.6 provided org.springframework spring-web 4.2.4.RELEASE org.apache.flink flink-connector-kafka ${flink.version} when i am running my jar with flink command line using command bin/flink run ~/apache_flink/target/Application-0.0.1.jar I am getting error tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED. java.lang.NoSuchMethodError: org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55) I am building final jar using command *mvn clean package -Pbuild-jar*
Re: kafka and flink integration issue
Yes Robert , i was trying to start Flink on cluster 0.10.1. But after changing flink version to 0.10.1 , also i am getting the same error. On Sat, Feb 27, 2016 at 2:47 PM, Robert Metzger wrote: > Hi Pankaj, > > I suspect you are trying to start Flink on a cluster with Flink 0.10.1 > installed? > > On Sat, Feb 27, 2016 at 9:20 AM, Pankaj Kumar > wrote: > >> I am trying to integrate kafka and flink. >> my pom file is where {flink.version} is 0.10.2 >> >> >> org.apache.flink >> flink-java >> ${flink.version} >> >> >> org.apache.flink >> flink-streaming-java >> ${flink.version} >> >> >> org.apache.flink >> flink-clients >> ${flink.version} >> >> >> com.fasterxml.jackson.core >> jackson-databind >> 2.6.4 >> >> >> org.projectlombok >> lombok >> 1.16.6 >> provided >> >> >> org.springframework >> spring-web >> 4.2.4.RELEASE >> >> >> org.apache.flink >> flink-connector-kafka >> ${flink.version} >> >> >> when i am running my jar with flink command line using command >> >> bin/flink run ~/apache_flink/target/Application-0.0.1.jar >> >> I am getting error >> >> tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED. >> java.lang.NoSuchMethodError: >> org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z >> at >> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387) >> at >> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58) >> at >> org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55) >> >> >> I am building final jar using command *mvn clean package -Pbuild-jar* >> >> >
Re: kafka and flink integration issue
yes versioning was issue . Job is working fine on flink 0.10.2. On Mon, Feb 29, 2016 at 3:15 PM, Stephan Ewen wrote: > Hi! > > A "NoSuchMethodError" is always a sign of a version mixup. Please make > sure both versions (cluster and client) are exactly the same. > > Stephan > > > On Sat, Feb 27, 2016 at 11:05 AM, Pankaj Kumar > wrote: > >> Yes Robert , >> i was trying to start Flink on cluster 0.10.1. >> >> But after changing flink version to 0.10.1 , also i am getting the same >> error. >> >> On Sat, Feb 27, 2016 at 2:47 PM, Robert Metzger >> wrote: >> >>> Hi Pankaj, >>> >>> I suspect you are trying to start Flink on a cluster with Flink 0.10.1 >>> installed? >>> >>> On Sat, Feb 27, 2016 at 9:20 AM, Pankaj Kumar >>> wrote: >>> >>>> I am trying to integrate kafka and flink. >>>> my pom file is where {flink.version} is 0.10.2 >>>> >>>> >>>> org.apache.flink >>>> flink-java >>>> ${flink.version} >>>> >>>> >>>> org.apache.flink >>>> flink-streaming-java >>>> ${flink.version} >>>> >>>> >>>> org.apache.flink >>>> flink-clients >>>> ${flink.version} >>>> >>>> >>>> com.fasterxml.jackson.core >>>> jackson-databind >>>> 2.6.4 >>>> >>>> >>>> org.projectlombok >>>> lombok >>>> 1.16.6 >>>> provided >>>> >>>> >>>> org.springframework >>>> spring-web >>>> 4.2.4.RELEASE >>>> >>>> >>>> org.apache.flink >>>> flink-connector-kafka >>>> ${flink.version} >>>> >>>> >>>> when i am running my jar with flink command line using command >>>> >>>> bin/flink run ~/apache_flink/target/Application-0.0.1.jar >>>> >>>> I am getting error >>>> >>>> tatus of job d20986a31f2a8166986d7db354de0ff7 changed to FAILED. >>>> java.lang.NoSuchMethodError: >>>> org.apache.flink.streaming.api.operators.StreamingRuntimeContext.isCheckpointingEnabled()Z >>>>at >>>> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:387) >>>>at >>>> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58) >>>>at >>>> org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:55) >>>> >>>> >>>> I am building final jar using command *mvn clean package -Pbuild-jar* >>>> >>>> >>> >> >