+1
Let's encourage the use of component tags, I don't see the need for
enforcing it. For commits that affect one component, I expect people will
use it.
On Wed, Jan 7, 2015 at 3:40 PM, Fabian Hueske fhue...@apache.org wrote:
+1 for the guide and JIRA references.
I'd keep the component tags
From what I have been overhearing from the Graph API development, some
hurdles were type extractor errors that could not be deciphered easily, and
the inability to bring back data easily back to the client.
But it would be great if Vasia could elaborate!
On Tue, Jan 6, 2015 at 10:39 AM, Aljoscha
Would it also make sense to file an issue to Scala IDE 4.0.0?
On Tue, Jan 6, 2015 at 10:03 AM, Stephan Ewen se...@apache.org wrote:
Brilliant, thanks a lot.
I am adding a how-to guide for setting up eclipse to the docs. And the
ReadMe
Stephan
On Tue, Jan 6, 2015 at 12:09 AM, Gyula Fóra
+1
On Sat, Jan 3, 2015 at 6:46 PM, Aljoscha Krettek aljos...@apache.org
wrote:
And also combine flink-java and flink-scala?
P. S. Happy new year, everyone.
On Jan 2, 2015 3:53 PM, Stephan Ewen se...@apache.org wrote:
Hi everyone!
I think that by now, quite a bit of the maven project
Hi everyone,
Just a reminder, the community vote for the talks that will be accepted at
the 2015 Hadoop Summit Europe is open and lasts until January 16.
There are 4 submitted talks related to Flink on The Future of Apache
Hadoop track [1] and one on the Applications of Hadoop and the Data
This VOTE passes with 27 (!) +1s and 0 -1s.
+1 (binding)
Kostas Tzoumas
Robert Metzger
Fabian Hueske
Sebastian Schelter
Aljoscha Krettek
Gyula Fora
Marton Balassi
Stephan Ewen
Till Rohrmann
Ufuk Celebi
Henry Saputra
Alan Gates
+1 (non-binding)
Flavio Pompermaier
Vasiliki Kalavri
Alexander
This VOTE passes with 27 (!) +1s and 0 -1s.
+1 (binding)
Kostas Tzoumas
Robert Metzger
Fabian Hueske
Sebastian Schelter
Aljoscha Krettek
Gyula Fora
Marton Balassi
Stephan Ewen
Till Rohrmann
Ufuk Celebi
Henry Saputra
Alan Gates
+1 (non-binding)
Flavio Pompermaier
Vasiliki Kalavri
Alexander
+1
On Mon, Dec 8, 2014 at 11:26 PM, Paris Carbone par...@kth.se wrote:
+1
It will certainly bring all teams closer
On 08 Dec 2014, at 23:17, Fabian Hueske fhue...@apache.org wrote:
+1
2014-12-08 23:05 GMT+01:00 Ufuk Celebi u...@apache.org:
+1 great idea
On Monday, December
their
thoughts about the work they are doing?
Would love to give some feedbacks.
- Henry
On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas ktzou...@apache.org
wrote:
Super!
Paris and Jonas have been doing a lot of silent work (= not very
visible
in the mailing list) recently
at 6:22 PM, Kostas Tzoumas ktzou...@apache.org
wrote:
Thanks a lot for all the comments! I am integrating most of them and
will
commit soon
On Mon, Dec 1, 2014 at 7:09 PM, Henry Saputra henry.sapu...@gmail.com
wrote:
I like the new bold layout =)
Instead
...@apache.org
* Till Rohrmann trohrm...@apache.org
* Henry Saputrahsapu...@apache.org
* Sebastian Schelters...@apache.org
* Kostas Tzoumasktzou...@apache.org
* Timo Walther apache email to be set up
* Daniel Warneke
Hey,
I have noticed that when I search for an issue (e.g., Google search for
FLINK-1281) the issues.apache.org/jira/... page does not typically show up
(the mailing list archives do).
For me it is actually more convenient to use Google search than the search
in JIRA :-)
Does anyone have any
Super!
Paris and Jonas have been doing a lot of silent work (= not very visible
in the mailing list) recently. Looking forward to seeing this coming in.
On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra henry.sapu...@gmail.com
wrote:
Nice! Looking forward to it
On Fri, Dec 5, 2014 at 9:34 AM,
Hi everyone,
Ufuk, Robert, and I worked on a new layout for the Flink website, and added
some content to the frontpage to (hopefully) convey more clearly what Flink
is all about and what are Flink's differentiating features (a point of
criticism to the old website was often that it is very
can sort out aesthetic concerns even after the website is up, so
I would like to focus this discussion more on the content.
On Thu, Nov 27, 2014 at 7:48 PM, Kostas Tzoumas ktzou...@apache.org wrote:
Hi everyone,
Ufuk, Robert, and I worked on a new layout for the Flink website, and
added some
Kostas Tzoumas created FLINK-1283:
-
Summary: Update website layout and frontpage content
Key: FLINK-1283
URL: https://issues.apache.org/jira/browse/FLINK-1283
Project: Flink
Issue Type: Sub
?
- Henry
On Fri, Nov 7, 2014 at 10:03 AM, Kostas Tzoumas ktzou...@apache.org
wrote:
Hello Flink and Tez,
I would like to point you to a first version of Flink running on
Tez. This is a Flink subproject (to be initially contributed
to flink-addons) that allows you to run unmodified Flink
Just to clarify, the Flink engine is not going anywhere :-) Flink should
IMO always have its own execution engine, which is currently under very
active development.
Tez and Java collections are two additional backends that users will be
able to enable depending on their needs.
On Saturday,
Flavio, see my first post in this thread.
If these differences are fine print for your application/requirements, then
yes, both backends will do the same thing (distribute computation). In that
case, the suggestion would be to use Flink in the normal way, as it is
much more mature
Hello Flink and Tez,
I would like to point you to a first version of Flink running on
Tez. This is a Flink subproject (to be initially contributed
to flink-addons) that allows you to run unmodified Flink programs on
top of Apache Tez.
You can get the code here:
Hi Henry,
Afaik this is already in the current master, see ExecutionGraph.restart().
The goal is now to make fault tolerance more fine grained by restarting
from checkpointed intermediate data sets, not from the base data.
Kostas
On Fri, Nov 7, 2014 at 6:49 PM, Henry Saputra
Hi everyone,
As some of you already know, there is a regular Flink meetup in Berlin:
http://www.meetup.com/Apache-Flink-Meetup/
The next meeting is November 18:
http://www.meetup.com/Apache-Flink-Meetup/events/217541712/
Feel free to share!
Best,
Kostas
I updated the blog with a blog post for the 0.7.0 release:
http://flink.incubator.apache.org/news/2014/11/04/release-0.7.0.html
Feel free to share!
Let me know if you contributed and your name is missing.
Kostas Tzoumas created FLINK-1201:
-
Summary: Graph API for Flink
Key: FLINK-1201
URL: https://issues.apache.org/jira/browse/FLINK-1201
Project: Flink
Issue Type: New Feature
Kostas Tzoumas created FLINK-1200:
-
Summary: Add count() aggregate function to Java and Scala APIs
Key: FLINK-1200
URL: https://issues.apache.org/jira/browse/FLINK-1200
Project: Flink
Issue
+1
On Mon, Oct 20, 2014 at 1:27 PM, Fabian Hueske fhue...@apache.org wrote:
+1
- Checked all signatures and hashes
- Built from source archive (mvn clean install)
- Ran all examples with provided data locally on previous build
2014-10-18 22:38 GMT+02:00 Robert Metzger
No, you don't need to install HDFS. You can use Flink without HDFS.
On Thu, Oct 16, 2014 at 12:17 PM, Robert Metzger rmetz...@apache.org
wrote:
Hi,
good to hear that you are using Flink.
HDFS is a distributed file system for reliably storing huge amounts of
data. Many users of Flink use
I think this is the one Marton meant:
https://www.dropbox.com/s/cjgbrrnen2mvi0f/streaming-throughput.pdf?dl=0
He can tell more about the setup.
Kostas
On Wed, Oct 8, 2014 at 12:45 AM, Henry Saputra henry.sapu...@gmail.com
wrote:
Thanks for the response, Márton! It is great news.
+1
On Wed, Oct 8, 2014 at 2:42 PM, Stephan Ewen se...@apache.org wrote:
Sounds reasonable...
Am 08.10.2014 12:43 schrieb Fabian Hueske fhue...@apache.org:
+1
2014-10-08 12:38 GMT+02:00 Robert Metzger rmetz...@apache.org:
Hi guys,
I noticed that we are doing the versioning of
Yes, the goal is to get rid of the Pact and Nephele references, as they do
not reflect the current state in most cases.
On Tue, Sep 30, 2014 at 9:31 AM, Ufuk Celebi u...@apache.org wrote:
Hey Henry,
On 30 Sep 2014, at 07:38, Henry Saputra henry.sapu...@gmail.com wrote:
Do we want to keep
If we allow out-of-sync APIs (and backends) until the time of a release,
aren't we just postponing the syncing problem to the time of the release,
which is a pretty bad time to have such a problem?
On Fri, Sep 26, 2014 at 8:49 PM, Robert Metzger rmetz...@apache.org wrote:
Hi,
I'm also in
Wow so cool!
On Sat, Sep 27, 2014 at 2:52 PM, Stephan Ewen se...@apache.org wrote:
Wow, amazing :-) And so quickly done!
Am 27.09.2014 11:14 schrieb Ufuk Celebi u...@apache.org:
On 27 Sep 2014, at 08:00, Márton Balassi mbala...@apache.org wrote:
I hope I could get you excited too :)
+1
I think a standalone docs site with a different nav bar will be more
usable.
On Fri, Sep 19, 2014 at 11:03 AM, Aljoscha Krettek aljos...@apache.org
wrote:
However, this would make the documentation even more complicated.
Exactly, that's what I'm trying to avoid.
If nobody has anything
/aljoscha/incubator-flink/tree/scala-rework
cd docs
./build_docs.sh -p
On Fri, Sep 19, 2014 at 11:50 AM, Kostas Tzoumas ktzou...@apache.org
wrote:
+1
I think a standalone docs site with a different nav bar will be more
usable.
On Fri, Sep 19, 2014 at 11:03 AM, Aljoscha
) on the
website.
On Thu, Sep 18, 2014 at 2:35 AM, Edward J. Yoon edwardy...@apache.org
javascript:;
wrote:
awesome :o
On Wed, Sep 17, 2014 at 2:03 AM, Kostas Tzoumas ktzou...@apache.org
javascript:;
wrote:
Hi everyone,
Linda Gavin, an amazing Berlin-based designer (
https
- Vasia Kalavri
- Martin Neumann
- Stephan Ewen
- Kostas Tzoumas
Anyone who is interested, let us know!
Greetings,
Stephan
+1 for COLORED
On Thu, Sep 18, 2014 at 12:31 PM, Ufuk Celebi u...@apache.org wrote:
+1 for COLORED
On Thu, Sep 18, 2014 at 12:30 PM, Gyula Fora gyf...@apache.org wrote:
+COLORED
On 18 Sep 2014, at 12:28, Fabian Hueske fhue...@apache.org wrote:
Please vote on which style of Flink's
)
Those are unclaimed (if I'm not mistaken):
- The relational Stuff
- LinearRegression
Cheers,
Aljoscha
On Wed, Sep 10, 2014 at 4:23 PM, Kostas
Tzoumas
ktzou...@apache.org
wrote
):
- The relational Stuff
- LinearRegression
Cheers,
Aljoscha
On Wed, Sep 10, 2014 at 4:23 PM, Kostas Tzoumas ktzou...@apache.org
wrote:
Transitive closure here, I also added a termination criterion in the
Java
version:
https://github.com/ktzoumas/incubator-flink
ComputeEdgeDegrees for me!
On Fri, Sep 5, 2014 at 11:44 AM, Márton Balassi
balassi.mar...@gmail.com
wrote:
+1
BatchGradientDescent for me :)
On Fri, Sep 5, 2014 at 11:15 AM, Kostas Tzoumas
ktzou...@apache.org
(Fabian)
- BatchGradientDescent (Márton)
- ComputeEdgeDegrees (Hermann)
Those are unclaimed (if I'm not mistaken):
- TransitiveClosure
- The relational Stuff
- LinearRegression
Cheers,
Aljoscha
On Tue, Sep 9, 2014 at 5:21 PM, Kostas Tzoumas ktzou...@apache.org
wrote:
WebLog here
Marton, Gyula, welcome!
On Sat, Sep 6, 2014 at 10:16 PM, Fabian Hueske fhue...@apache.org wrote:
Wecome guys and congrats!
2014-09-06 21:51 GMT+02:00 Gyula Fóra gyula.f...@gmail.com:
Thank you guys, we really appreciate it!
We will do our best to keep this project awesome and to make
Looks awesome!
It would also be great to have one non-trivial piece of example code in the
docs that connects to a streaming source, does some transformations, and
prints the output to a file (or forwards to a streaming sink). I think this
is a common use case that people have in mind, so showing
+1
I go for WebLogAnalysis.
My experience with Scala consists of going through a tutorial so this will
be a good stress test both for me and the new API :-)
On Thu, Sep 4, 2014 at 9:09 PM, Vasiliki Kalavri vasilikikala...@gmail.com
wrote:
+1 for having other people implement the examples!
Hi Daniel,
+1 on the argument about attracting developers being irrelevant, the
argument can work both ways and is very brittle
The reasons for using Akka as a library (irrespective of the programming
language) have been clearly articulated in my opinion by Stephan and Till
in this thread.
The
+1 for refactoring using Akka, the arguments are overwhelming.
On Fri, Sep 5, 2014 at 2:04 PM, Robert Metzger rmetz...@apache.org wrote:
I agree with using Akka for RPC. It is ASF 2.0 licensed, seems to have a
big community [1] and users [2] that depend on the system.
The YARN client is
+1 for not requiring a vote thread unless someone asks for it
On Fri, Sep 5, 2014 at 1:51 PM, Robert Metzger rmetz...@apache.org wrote:
I agree with Stephan: If somebody wants to do a major change and is
uncertain if the community is willing to accept the change, they can ask on
the mailing
Henry, thank you *very much* for this input!
I agree, let us not put more structure/rules than needed at this point.
On Fri, Sep 5, 2014 at 6:58 PM, Henry Saputra henry.sapu...@gmail.com
wrote:
+1 for commits small changes directly, which is the perk of being
committers of open source
+1
On Thu, Sep 4, 2014 at 10:30 AM, Aljoscha Krettek aljos...@apache.org
wrote:
+1
I think it's good to outsource functionality that is not our main
competency. Because of the origins of Flink in research we suffered a
bit from NIH in the beginning. I'm happy to see this reduced piece by
+1
On Wed, Sep 3, 2014 at 10:12 PM, Márton Balassi balassi.mar...@gmail.com
wrote:
+1
On Wed, Sep 3, 2014 at 9:54 PM, Till Rohrmann trohrm...@apache.org
wrote:
+1 Sounds good to me.
On Wed, Sep 3, 2014 at 1:58 PM, Robert Metzger rmetz...@apache.org
wrote:
Hi,
sorry,
in discovery which is
greatest
when
they express the exact nature of a thing briefly and, as it were,
picture
it; then indeed the labor of thought is wonderfully diminished --
Gottfried
Wilhelm Leibniz
On Thu, Aug 28, 2014 at 12:57 PM, Kostas Tzoumas
ktzou
is taking a route that makes sure that the runtime is very robust,
memory wise. We pay currently a few CPU cycles overhead for that, but we
have an effort gong to bring that down.
It would be interesting to rerun the experiments then...
Greetings,
Stephan
On Sat, Aug 30, 2014 at 9:16 AM, Kostas
Hi Anirvan,
Yes, I am familiar with this thesis. I think that this comparison is by now
quite old (1 year if I am not mistaken), and both systems have evolved
substantially since then.
Kostas
On Fri, Aug 29, 2014 at 7:01 PM, Robert Metzger rmetz...@apache.org wrote:
Forwarding the message to
This is awesome, looking forward to trying it out!
Leonidas, do you have any feedback for the Flink community? How easy was to
implement the translation? Anything you struggled with?
Kostas
On Thu, Aug 28, 2014 at 12:06 AM, Ufuk Celebi u...@apache.org wrote:
Awesome, indeed! Looking
+1 to stick to the names without prefix. Most projects do it this way, and
it makes names smaller, which is good.
On Fri, Aug 8, 2014 at 10:39 AM, Ufuk Celebi u.cel...@fu-berlin.de wrote:
On 08 Aug 2014, at 09:38, Ufuk Celebi u.cel...@fu-berlin.de wrote:
There is one additional issue I
Wow! Incredible :-) Can you share more details about the experiments you
ran (cluster setup, jobs, etc)?
On Fri, Aug 8, 2014 at 3:53 PM, Gyula Fóra gyula.f...@gmail.com wrote:
Hey All,
Quick weekely update on the streaming project:
It was a good week we implemented a lot of new features
Hi Gyula,
Sorry for not giving you a heads up for this. We changed the API to work on
the interfaces that contain one abstract method rather than the rich
functions in order to support Java 8 lambdas down the road (this is not
done yet). We did this now in order to bundle as many breaking changes
+1
Let us tackle the big things one at a time (and the first Apache release is
a big thing by itself)
On Wed, Jul 16, 2014 at 6:48 PM, Stephan Ewen se...@apache.org wrote:
Hi everyone!
We just had a hangout discussion (see previous mails for minutes and
recording) where we talked about
balassi.mar...@gmail.com
javascript:;
wrote:
Thanks for the write-up, I do agree with the streaming notes.
Cheers,
Marton
On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas
kostas.tzou...@tu-berlin.de javascript:;
wrote:
Hi everyone,
I tried to record
...@gmail.com
wrote:
Thanks for the write-up, I do agree with the streaming notes.
Cheers,
Marton
On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas
kostas.tzou...@tu-berlin.de
wrote:
Hi everyone,
I tried to record the first hangout on youtube but we had several
problems
Till, welcome!
On Thu, Jul 10, 2014 at 1:06 PM, Márton Balassi balassi.mar...@gmail.com
wrote:
Congrats, Till! :)
On Thu, Jul 10, 2014 at 12:24 PM, Stephan Ewen se...@apache.org wrote:
Hi everyone!
I would like to announce that the mentors and current committers voted to
add Till
and made
publicly available for later playback.
So I think the recording works.
On Wed, Jul 2, 2014 at 5:32 PM, Kostas Tzoumas
kostas.tzou...@tu-berlin.de
wrote:
Hey folks,
I hope this works. Joining the following hangout should have YouTube
recording enabled:
https
Hi everyone,
I tried to record the first hangout on youtube but we had several problems
with sound and video. Below are some rough notes.
If you participated in the meeting, please feel free to add notes
Kostas
Website:
- Documentation contains lots of broken links
- Frontpage -
+1
I have contacted the trademarks team with relevant data.
On Thu, Jun 26, 2014 at 6:20 PM, Stephan Ewen se...@apache.org wrote:
+1
You could add that we have a legal name search running with first responses
coming back, so we should be able to make progress there.
On Thu, Jun 26, 2014
at 9:25 AM, Kostas Tzoumas
kostas.tzou...@tu-berlin.de wrote:
Hi Folks,
After talking with Stephan, Fabian, Robert, and Ufuk, we gathered a few
project ideas that people have been throwing around. These do not
immediately classify as issues as they are major extensions of Flink
(some
Stephan, great work, thank you! I am interested
Kostas
On Tue, Jun 24, 2014 at 3:09 PM, Stephan Ewen se...@apache.org wrote:
@everyone interested in the Tez work:
I created a JIRA Issue with a brief summary of the current status and
plans: https://issues.apache.org/jira/browse/FLINK-972
I will work on this for the planned documentation port.
On Wed, Jun 18, 2014 at 10:51 PM, Henry Saputra henry.sapu...@gmail.com
wrote:
Awesome, thanks Robert!
On Wed, Jun 11, 2014 at 2:36 PM, Robert Metzger rmetz...@apache.org
wrote:
I filed a JIRA to add the page to the documentation
Hi Folks,
After talking with Stephan, Fabian, Robert, and Ufuk, we gathered a few
project ideas that people have been throwing around. These do not
immediately classify as issues as they are major extensions of Flink (some
might classify as completely different projects). These would make nice
Hi Yingjun,
What you describe actually does happen: The website ranks and the
transition probabilities between websites are indeed partitioned across
machines and the operators in the Stratosphere program that implements
pagerank operate on partitioned data sets. The individual partitions of the
[
https://issues.apache.org/jira/browse/FLINK-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029129#comment-14029129
]
Kostas Tzoumas commented on FLINK-926:
--
Cool, can you assign it to me?
Add
70 matches
Mail list logo