What I'm trying to say is that to get submit the flink topology to flink, I
had to do an invocation of the mainMethod(which contain the actaul topology) of
my topology with the class java.lang.reflect.Method.That is if you a take look
at the following the topology the mainMethod is buildTopolog
Yijie Shen created FLINK-3754:
-
Summary: Add a validation phase before construct RelNode using
TableAPI
Key: FLINK-3754
URL: https://issues.apache.org/jira/browse/FLINK-3754
Project: Flink
Issue
Ted Yu created FLINK-3753:
-
Summary: KillerWatchDog should not use kill on toKill thread
Key: FLINK-3753
URL: https://issues.apache.org/jira/browse/FLINK-3753
Project: Flink
Issue Type: Bug
I cannot follow completely in your last step when you fail. What do you
mean by "I'm stuck at the level when I want to copy that from the jar to
submit it to flink"?
Btw: I copied the code from the SO question and it works for me on the
current master (which includes Till's hotfix).
-Matthias
O
@Stephan,
I have try using RemoteStreamEnvironment but I have another exception which is
java.lang.IllegalStateException: No operators defined in streaming topology.
Cannot execute.
Le Mercredi 13 avril 2016 20h40, star jlong a
écrit :
Thanks Matthias for the reply.
Maybe I shou
Thanks Matthias for the reply.
Maybe I should explain what I want to do better.My objective is to deploy a
flink topology on flink using java but in the production mode. For that here
are the step that I have taken.
1-Convert a sample wordcount storm topology to a flink topology as indicated
he
Hi!
For a Storm program, you would need a "RemoteStreamEnvironment" - the
"RemoteEnvironment" is for batch programs.
Stephan
On Wed, Apr 13, 2016 at 6:23 PM, star jlong
wrote:
> Thanks for the reply.
> @Stephen, I try using RemoteEnvironment to submit my topology to flink.
> Here is the try th
Stephan Ewen created FLINK-3752:
---
Summary: Add Per-Kafka-Partition Watermark Generation to the docs
Key: FLINK-3752
URL: https://issues.apache.org/jira/browse/FLINK-3752
Project: Flink
Issue Ty
Hi jstar,
I need to have a close look. But I am wondering why you use reflection
in the first place? Is there any specific reason for that?
Furthermore, the example provided in project maven-example also covers
the case to submit a topology to Flink via Java. Have a look at
org.apache.flink.storm
Thanks for the reply.
@Stephen, I try using RemoteEnvironment to submit my topology to flink.
Here is the try that I did RemoteEnvironment remote = new
RemoteEnvironment(ipJobManager, 6123, jarPath); remote.execute();
While running the program, this is the exception that I got.
java.lang.RuntimeE
I think this is not the problem here since the problem is still happening
on the client side when the FlinkTopology tries to copy the registered
spouts. This happens before the job is submitted to the cluster. Maybe
Mathias could chime in here.
Cheers,
Till
On Wed, Apr 13, 2016 at 5:39 PM, Stepha
Hello again:
Any news about this problem with enriched MapPartition function?
Thank you
On 06/04/16 17:01, Sergio Ramírez wrote:
Hello,
Ok, please find enclosed the test code and the input data.
Cheers
On 31/03/16 10:07, Till Rohrmann wrote:
Hi Sergio,
could you please provide a complete
Hi!
For flink standalone programs, you would use a "RemoteEnvironment"
For Storm, I would use the "FlinkClient" in "org.apache.flink.storm.api".
That one should deal with jars, classloaders, etc for you.
Stephan
On Wed, Apr 13, 2016 at 3:43 PM, star jlong
wrote:
> Thanks for the suggestion.
Chesnay Schepler created FLINK-3751:
---
Summary: default Operator names are inconsistent
Key: FLINK-3751
URL: https://issues.apache.org/jira/browse/FLINK-3751
Project: Flink
Issue Type: Bug
Flavio Pompermaier created FLINK-3750:
-
Summary: Make JDBCInputFormat a parallel source
Key: FLINK-3750
URL: https://issues.apache.org/jira/browse/FLINK-3750
Project: Flink
Issue Type: Im
Thanks for the suggestion. Sure those examples are interesting and I have
deploy them successfully on flink. The deployment is done the command line that
is doing something like
bin/flink run example.jarBut what I want is to submit the topology to flink
using a java program.
Thanks.
Le Me
you can find examples here:
https://github.com/apache/flink/tree/master/flink-contrib/flink-storm-examples
we haven't established yet that it is an API issue; it could very well
be caused by the reflection magic you're using...
On 13.04.2016 14:57, star jlong wrote:
Ok, it seems like there a
Ok, it seems like there an issue with the api. So please does anybody has a
working example for deploying a topology using the flink dependency
flink-storm_2.11 or any other will be welcoming.
Thanks,
jstar
Le Mercredi 13 avril 2016 13h44, star jlong a
écrit :
Hi Schepler,
Thanks fo
I've updated the master. Could you check it out and run your program with
the latest master? I would expect to see a ClassNotFoundException.
On Wed, Apr 13, 2016 at 2:54 PM, Till Rohrmann wrote:
> Yes that is true. I'll commit a hotfix for that.
>
> My suspicion is that we use the wrong class lo
Yes that is true. I'll commit a hotfix for that.
My suspicion is that we use the wrong class loader in the
FlinkTopology.copyObject method to load the RandomSentenceSpout class. We
can see that once I removed the exception swallowing in the current master.
On Wed, Apr 13, 2016 at 2:40 PM, star jl
Hi Schepler,
Thanks for the concerned. Yes I'm actaully having the same issue as indicated
on that post because I'm the one that posted that issue.
Le Mercredi 13 avril 2016 13h35, Chesnay Schepler a
écrit :
http://stackoverflow.com/questions/36584784/issues-while-submitting-a-topolo
I think the following is the interesting part of the stack-trace:
|Causedby:java.lang.RuntimeException:Failedto copy object.at
org.apache.flink.storm.api.FlinkTopology.copyObject(FlinkTopology.java:145)at
org.apache.flink.storm.api.FlinkTopology.getPrivateField(FlinkTopology.java:132)at
org.ap
http://stackoverflow.com/questions/36584784/issues-while-submitting-a-topology-to-apache-flink-using-the-flink-api
On 13.04.2016 14:28, Till Rohrmann wrote:
Hi jstar,
what's exactly the problem you're observing?
Cheers,
Till
On Wed, Apr 13, 2016 at 2:23 PM, star jlong
wrote:
Hi there,
I'm
Timo Walther created FLINK-3749:
---
Summary: Improve decimal handling
Key: FLINK-3749
URL: https://issues.apache.org/jira/browse/FLINK-3749
Project: Flink
Issue Type: Bug
Components: Ta
Hi Till,
Thank for the quick reply. I'm unable to copy the mainMethod of my topology
using the instruction
(FlinkTopology) method.invoke(null, new Object[] {});
where method is variable of type java.lang.reflect.Method
Le Mercredi 13 avril 2016 13h28, Till Rohrmann a
écrit :
Hi jstar,
Hi jstar,
what's exactly the problem you're observing?
Cheers,
Till
On Wed, Apr 13, 2016 at 2:23 PM, star jlong
wrote:
> Hi there,
>
> I'm jstar. I have been playing around with flink. I'm very much interested
> in submitting a topoloy to flink using its api. As indicated
> on stackoverflow,
Hi there,
I'm jstar. I have been playing around with flink. I'm very much interested in
submitting a topoloy to flink using its api. As indicated on stackoverflow,
that is the try that I have given. But I was stuck with some exception. Please
any help will be welcoming.
Thanks.
jstar
Timo Walther created FLINK-3748:
---
Summary: Add CASE function to Table API
Key: FLINK-3748
URL: https://issues.apache.org/jira/browse/FLINK-3748
Project: Flink
Issue Type: Sub-task
Com
Hi to all,
we've recently migrated our sqoop[1] import process to a Flink job, using
an improved version of the Flink JDBC Input Format[2] that is able to
exploit the parallelism of the cluster (the current Flink version
implements NonParallelInput).
Still need to improve the mapping part of sql t
+1 to add this to 1.0.2
On Wed, Apr 13, 2016 at 1:57 AM, Andrew Palumbo wrote:
>
> Hi,
>
> Great! Do you think that this is something that you'll be enabling in your
> upcoming 1.0.2 release? We plan on putting out a maintenance Mahout
> Release relatively soon and this would allow us to speed
Aljoscha Krettek created FLINK-3747:
---
Summary: Consolidate TimestampAssigner Methods in Kafka Consumer
Key: FLINK-3747
URL: https://issues.apache.org/jira/browse/FLINK-3747
Project: Flink
I
31 matches
Mail list logo
