Nice! Looking forward to working with the Flink community on supporting this
effort in any way we can help.
Bikas
-Original Message-
From: Kostas Tzoumas [mailto:ktzou...@apache.org]
Sent: Friday, November 07, 2014 10:03 AM
To: dev@flink.incubator.apache.org; d...@tez.apache.org
Subject:
Hi,
Flink will be very useful if it is embeddable in applications and can
discover other nodes and cluster without relying on YARN or Hadoop. So it
would be an idea to make it stand alone.
Suminda
--
View this message in context:
http://apache-flink-incubator-mailing-list-archive.1008284.n3.n
Okay, I got it working :)
Turns out I only needed the client from the contextenvironment to get it
working.
Thanks for the help :)
On Fri, Nov 7, 2014 at 4:26 PM, Aljoscha Krettek
wrote:
> Ah ok, maybe you can expose methods for direct execution in the
> regular ExecutionEnvironment and then us
This is great news!
Awesome work everyeone... super excited to see this!
Arun
On Fri, Nov 7, 2014 at 10:03 AM, Kostas Tzoumas wrote:
> Hello Flink and Tez,
>
> I would like to point you to a first version of Flink running on
> Tez. This is a Flink subproject (to be initially contributed
> to
HI Kostas,
Thanks for the reply, yep you were right it is in current master already.
But as Marton has mentioned before, I believe there was no
documentation on how it suppose to work and the git commit comment
does not have much details on the impl details.
Some questions from the meetup on how
Hi Henry,
Afaik this is already in the current master, see ExecutionGraph.restart().
The goal is now to make fault tolerance more fine grained by restarting
from checkpointed intermediate data sets, not from the base data.
Kostas
On Fri, Nov 7, 2014 at 6:49 PM, Henry Saputra
wrote:
> Stephan,
Hello Flink and Tez,
I would like to point you to a first version of Flink running on
Tez. This is a Flink subproject (to be initially contributed
to flink-addons) that allows you to run unmodified Flink programs on
top of Apache Tez.
You can get the code here:
https://github.com/ktzoumas/incubat
Stephan,
Could you share your thoughts and design/ plan to implement this new
coarse grained fault tolerant?
>From last talk in Palo Alto seemed some interests about it.
- Henry
On Tue, Nov 4, 2014 at 12:14 AM, Márton Balassi
wrote:
> Stephan,
>
> Could you please summarize how the new coarse
Timo Walther created FLINK-1225:
---
Summary: Quickstart does not work
Key: FLINK-1225
URL: https://issues.apache.org/jira/browse/FLINK-1225
Project: Flink
Issue Type: Bug
Reporter: Ti
Ah ok, maybe you can expose methods for direct execution in the
regular ExecutionEnvironment and then use them from you wrapper.
On Fri, Nov 7, 2014 at 4:18 PM, Gyula Fóra wrote:
> Hey,
>
> Okay, I think this is something that I might be able to use :)
>
> The problem is that the StreamingExecuti
Hey,
Okay, I think this is something that I might be able to use :)
The problem is that the StreamingExecutionEnvironment has nothing to do
with the ExecutionEnvironment (only the name is similar) because we are
completely skipping the optimizer stuff at the execution. And it seemed
that the cont
Hi,
ExecutionEnvironment has a static field contextEnvironment. When you
call getExecutionEnvironment it checks whether this is null. If it is
null it will return a LocalEnvironment, otherwise it will return the
context environment.
In Client.run() the Client creates a ContextEnvironment and calls
Gyula Fora created FLINK-1224:
-
Summary: Fix .getExecutionEnvironment of the
StreamingExecutionEnvironment to return proper context
Key: FLINK-1224
URL: https://issues.apache.org/jira/browse/FLINK-1224
Pr
Hey Guys,
The .getExecutionEnvironment() method for the StreamingexecutionEnvironment
does not work properly because we always return LocalEnvironment for
running on the minicluster.
I was trying to figure out how to fix this but I got lost in the code
trying to find how you determine whether the
I fixed also the profile for Cloudera CDH5.1.3. You can build it with the
command:
mvn clean install -Dmaven.test.skip=true -Dhadoop.profile=2
-Pvendor-repos,cdh5.1.3
However, it would be good to generate the specific jar when
releasing..(e.g. flink-addons:flink-hbase:0.8.0-hadoop2-cdh5.1.3
I've just updated the code on my fork (synch with current master and
applied improvements coming from comments on related PR).
I still have to understand how to write results back to an HBase
Sink/OutputFormat...
On Mon, Nov 3, 2014 at 12:05 PM, Flavio Pompermaier
wrote:
> Thanks for the detaile
Hi,
Thanks for the suggestions, some of these ideas are already present in Flink,
and we will work on these for streaming as well.
Gyula
> On 07 Nov 2014, at 11:30, sirinath wrote:
>
> Hi,
>
> In response to the message exchanged in LinkedIn I am shooting a few ideas.
>
> To make Flink a gr
Hi,
In response to the message exchanged in LinkedIn I am shooting a few ideas.
To make Flink a great product in the Financial as well as real time, low
latency, high throughput analytics following features would be a great help:
- Move object allocation to off heap GC does not get triggered - t
Thank you for your suggestions. We are planning to extend connector support to
many other systems.
In the meantime, any contribution regarding this is warmly welcome.
> On 07 Nov 2014, at 07:02, sirinath wrote:
>
> What I ment was to have stream connectors for Java Streams, Rx
> (http://reactiv
19 matches
Mail list logo
