Re: job failed while initiating Transport client for Elasticsearch

2015-11-02 Thread santosh_rajaguru
Hi Till, While going through the verbose of the logs, i figured out that i dint include one dependent jar file for elasticsearch while created the elasticsearch sdk plugin. Thanks for the help Till and Chesnay. Thanks and Regards, Santosh -- View this message in context: http://apache-flin

Re: job failed while initiating Transport client for Elasticsearch

2015-11-02 Thread santosh_rajaguru
Hello Chesnay, I have checked the elastic search bundle. It is bundled with lucene jars which are available in elasticsearch 1.7.1, which contains 4.10.4 version of lucene jars. -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/job-failed-while-init

job failed while initiating Transport client for Elasticsearch

2015-11-02 Thread santosh_rajaguru
Hi Flink-Devs, I have created an outputformat for elasticsearch, which connnects through the transport client. While running the job from eclipse-IDE, it works fine. But, while running the job from command line or Flink web interface, i am getting different error. if i deploy the jar for first tim

Re: Apache flink with Elastic Search

2015-10-16 Thread santosh_rajaguru
Thanks Martin for the input. -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Apache-flink-with-Elastic-Search-tp8435p8474.html Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.

Re: Apache flink with Elastic Search

2015-10-14 Thread santosh_rajaguru
Thanks flavio. -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Apache-flink-with-Elastic-Search-tp8435p8445.html Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.

Apache flink with Elastic Search

2015-10-13 Thread santosh_rajaguru
Hi all, Is there any possibility to query Elastic search using flink? Thanks and Regards, Santosh -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Apache-flink-with-Elastic-Search-tp8435.html Sent from the Apache Flink Mailing List archive. mail

Re: Running the job in Flink webInterface

2015-10-09 Thread santosh_rajaguru
Yes i have included the files in the jar. It throws the same error while executing from command prompt -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Running-the-job-in-Flink-webInterface-tp8358p8422.html Sent from the Apache Flink Mailing List a

Running the job in Flink webInterface

2015-10-07 Thread santosh_rajaguru
Hi all, I am experiencing some problem while writing to the jena-hbase. I am using a custom OutPutformat for writing. This reads a configuration file from the classpath. it works while running the job from eclipse. but it throws an exception (hbaserdf.ttl file cannot found) while running it from f

Re: Read XML from HDFS

2015-07-15 Thread santosh_rajaguru
Thanks Fabian Kostas for info. Using XMLInputFormat, I am able to read a xml file from HDFS. Cheers, Santosh -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Read-XML-from-HDFS-tp7023p7035.html Sent from the Apache Flink Mailing List archive. ma

Read XML from HDFS

2015-07-15 Thread santosh_rajaguru
Hi, Is there any way to read the complete XML string or file from HDFS using flink? Thanks and Regards, Santosh -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Read-XML-from-HDFS-tp7023.html Sent from the Apache Flink Mailing List archive. mail

Re: Hadoop 2.5.2 compatible - flink

2015-07-15 Thread santosh_rajaguru
Thanks Robert. I will try that too -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Hadoop-2-5-2-compatible-flink-tp7018p7020.html Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.

Hadoop 2.5.2 compatible - flink

2015-07-15 Thread santosh_rajaguru
Hi, which version of flink is compatible with hadoop-2.5.2? The releases in 0.9.0 explicitly mentioned the compatibility with 2.2.0, 2.6.0, 2.7.0, but not 2.5.x Regards, Santosh -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Hadoop-2-5-2-compa

Re: Running Flink Job with dependencies

2015-06-25 Thread santosh_rajaguru
Yes. I have configured a product file and specified the required plugins. It generates the jar files and i deploy them into lib folder. and deployed the main class jar into webclient. Ran the job. -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Ru

Re: Running Flink Job with dependencies

2015-06-25 Thread santosh_rajaguru
Thanks Flavio. Previously i packaged all the Jars into Fat Jar. Despite of specifying the Main class, it was unable to load some of the classes. Now, its running. As i have created Plugins jar and deployed those to Flink library and just created a simple jar for the main class plugin. Now, its loo

Re: Running Flink Job with dependencies

2015-06-24 Thread santosh_rajaguru
Yes, i am packaging all the dependencies to a Fat jar. -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Running-Flink-Job-with-dependencies-tp6653p6669.html Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.

Running Flink Job with dependencies

2015-06-24 Thread santosh_rajaguru
Hi, I am trying to run a Flink job, which uses the eclipse extension mechanism, from command prompt as well as from the webclient. The job runs successfully from eclipse as a java application when i configure the classpath to include the dependencies. However, how to do that while running from web

Integration : Flink with OSGI

2015-06-09 Thread santosh_rajaguru
Hi guys, how can i run flink in OSGI container? Is there any way to deploy the osgi bundles in flink and execute the job. Regards, Santosh -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Integration-Flink-with-OSGI-tp6278.html Sent from the A

Re: ClassNotFoundException : org.apache.flink.api.common.operators.util.UserCodeObjectWrapper, while trying to run locally

2015-06-04 Thread santosh_rajaguru
I am using eclipse kepler I tried to replicate the same problem in another workspace. When i try to test the plugin using Junit PlugIn Test it throws me the classNotFoundException. However, when i try to test it as JunitTest,it works fine. Am i missing something here? -- View this message in

Re: ClassNotFoundException : org.apache.flink.api.common.operators.util.UserCodeObjectWrapper, while trying to run locally

2015-06-03 Thread santosh_rajaguru
sorry for the mistake. that is referred to plugin development. So i had to manage the flink dependencies as plugins to make it work. but due to some reason it cannot find that particular class. -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Class

Re: ClassNotFoundException : org.apache.flink.api.common.operators.util.UserCodeObjectWrapper, while trying to run locally

2015-06-02 Thread santosh_rajaguru
Thanks Robert and Stephan. I executed the program in maven environment. It works fine. However, in Plugin environment, though i have included all the dependencies and dependent jars, it says classnotfoundexception while executing the env. -- View this message in context: http://apache-flink

ClassNotFoundException : org.apache.flink.api.common.operators.util.UserCodeObjectWrapper, while trying to run locally

2015-05-30 Thread santosh_rajaguru
Hi, I am trying to execute a flatmapFunction for a xmlString(byte array) using plugin development. I have added the required dependencies for flink. I am using Flink-0.8.1. The stack trace of the execution is as follows: org.apache.flink.runtime.client.JobExecutionException: java.lang.Exception:

Re: difference between reducefunction and GroupReduceFunction

2015-05-22 Thread santosh_rajaguru
Thanks Maximilian. My use case is similar to the example given in the graph analysis. In graph analysis, the reduce function used is a normal reduce function. I executed that with both scenarios and your justification is right. the normal reduce function have a combiner before sorting unlike the G

difference between reducefunction and GroupReduceFunction

2015-05-21 Thread santosh_rajaguru
i am new to flink and map reduce. My query is Apart from incrementally combing 2 elements, what are the merits of using reduceFunction over GroupReduceFunction. which usecases suits what functions the most!!! -- View this message in context: http://apache-flink-mailing-list-archive.1008284

Hbase OutputFormat examples

2015-04-08 Thread santosh_rajaguru
is there any link or code samples or any sortf of pointers for TableOutPutFormat for Hbase like HbaseReadExample? -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Hbase-OutputFormat-examples-tp5004.html Sent from the Apache Flink (Incuba

Re: Apache Flink connection with Hbase

2015-03-31 Thread santosh_rajaguru
Hi flavio, I got to manage the connection. The problem was with versioning of hbase client. i was using 0.8.1 version for flink-hbase. when i changed the version to 0.8.0 it is working fine. The hbase server is 0.98.11 . One more question flavio, is there any particular mechanism to follow while

Apache Flink connection with Hbase

2015-03-31 Thread santosh_rajaguru
Hi guys, I am facing problem while connecting remote hbase from Apache flink. I am able to connect successfully through simple hbase java program. However, when i try to connect and scan the table it says "java.lang.NoSuchMethodError: org.apache.hadoop.net.NetUtils.getInputStream(Ljava/net/Socke

Queries regarding RDFs with Flink

2015-02-27 Thread santosh_rajaguru
Hello, how can flink be useful for processing the data to RDFs and build the ontology? Regards, Santosh -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Queries-regarding-RDFs-with-Flink-tp4130.html Sent from the Apache Flink (Incub