Hi All,
How does Flink maintain the Scala and Java consistencies and check
whether new API in Java also expose or implemented in Scala?
Thanks,
Henry
(bcc to dev@brooklyn, dev@fleece, dev@flink, dev@slider)
Greetings,
Four podlings who are still in the initial "monthly" reporting phase did not
receive emailed report reminders today because of various bookkeeping
glitches:
* Brooklyn
* Fleece
* Flink
* Slider
Please file your reports
In Pig we created a separate section of the repository (called
piggybank) where we stored user contributed user defined functinos
(UDFs). The contract was that users needed to provide unit tests so
that as changes were made to Pig the committers could make sure that the
UDFs in piggybank still
Github user twalthr commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47162498
I don't think that I can review and test it this week. But next week would
be possible.
---
If your project is set up for it, you can reply to this email and hav
GitHub user qmlmoon opened a pull request:
https://github.com/apache/incubator-flink/pull/48
[FLINK-938] Automatically configure the jobmanager address when using
start-cluster.sh
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/
@Sebastian, Thanks for the correction!
I thought the code was already merged.
Cheers, Fabian
2014-06-25 20:18 GMT+02:00 Sebastian Kunert :
> Hi,
>
> @Fabian: Are you sure that is the case? I don't think that the annotations
> are set correctly automatically at the moment. There is a pullrequest
Hi Fabian and Sebastian, thanks for the comments and corrections.
On Wed, Jun 25, 2014 at 8:18 PM, Sebastian Kunert
wrote:
> Hi,
>
> @Fabian: Are you sure that is the case? I don't think that the annotations
> are set correctly automatically at the moment. There is a pullrequest open,
> but i
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47146152
Hey, everything is okay now, according to this page:
https://travis-ci.org/apache/incubator-flink/builds/28399204 (You can ignore
the one failed build, its not y
Github user atsikiridis commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47141587
Hey @rmetzger I think I made a fix for hadoop 2.2.0 dependencies. But I'm
not sure I understand why it is still failing. Can you take a look please? :)
---
I
Hi,
@Fabian: Are you sure that is the case? I don't think that the annotations
are set correctly automatically at the moment. There is a pullrequest open,
but it was not yet merged.
Your UDF looks like field 1 of the first tuple input is also constant:
@ConstantFieldsFirst("1->1;2 -> 2")
@Const
GitHub user qmlmoon opened a pull request:
https://github.com/apache/incubator-flink/pull/47
[FLINK-933] Add primitive input format to read a sequence of primitives
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/qmlmoon/incubato
Hi Janani,
You can also use the projection join as:
ds1.join(ds2).where(0).equalTo(0).projectFirst(0).projectSecond(1,2).types(Long.class,
Long.class, Long.class)
That should also automatically set the correct annotations.
Best, Fabian
On Jun 25, 2014 7:41 PM, "Janani Chakkaradhari"
wrote:
>
Cool! Thanks Ufuk
- Henry
On Wed, Jun 25, 2014 at 2:25 AM, Ufuk Celebi wrote:
> Hey guys,
>
> I've now updated the old README in
> https://github.com/stratosphere/stratosphere.
>
> -- Ufuk
>
> On 24 Jun 2014, at 19:48, Henry Saputra wrote:
>
>> Hi Stephan,
>>
>> For now we could add huge warni
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/45#discussion_r14200819
--- Diff:
stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/wordcount/WordCountPLOJO.java
---
@@ -0,0 +1,1
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/45#discussion_r14200697
--- Diff:
stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/wordcount/WordCountPLOJO.java
---
@@ -0,0 +1,1
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/45#discussion_r14200705
--- Diff:
stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/wordcount/WordCountPLOJO.java
---
@@ -0,0 +1,1
Hi,
Can someone check the following UDF for constantFileds setup?
In simple, I wanted to do :
First Input of Join :Tuple3 first,
Second Input of Join: Tuple2 second
Output: Tuple3
UDF:
@ConstantFieldsFirst("2 -> 2")
@ConstantFieldsSecond("0 -> 0")
public stat
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/45#issuecomment-47134091
Hey, I think you got the name POJO wrong, when I explained you the task:
https://en.wikipedia.org/wiki/Plain_Old_Java_Object
---
If your project is set up for
Hangout is ok too =)
The key is we need to get history or summary of Google hangout meeting
to share with dev@ list. That is why I want to use IRC instead bc
INFRA have support for it.
As for biweekly meets, we should do two different times to allow 2
sides of the world can participate.
Like Step
GitHub user JonathanH5 opened a pull request:
https://github.com/apache/incubator-flink/pull/46
Fixed Bug Flink-978
https://issues.apache.org/jira/browse/FLINK-978
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JonathanH5/incubat
Github user tobwiens commented on the pull request:
https://github.com/apache/incubator-flink/pull/44#issuecomment-47127623
When the VM casts dynamically the values the type specific equals method is
called. That was the idea behind the test case. If the types are not correct
that tes
Github user JonathanH5 commented on the pull request:
https://github.com/apache/incubator-flink/pull/43#issuecomment-47126851
Ok, But I will do this after I know what is wrong with
https://issues.apache.org/jira/browse/FLINK-978
---
If your project is set up for it, you can reply to
Github user fhueske commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14196207
--- Diff:
stratosphere-compiler/src/main/java/eu/stratosphere/compiler/dag/MapPartitionNode.java
---
@@ -0,0 +1,56 @@
+/
Stephan Ewen created FLINK-985:
--
Summary: Update config.md of teh user docs
Key: FLINK-985
URL: https://issues.apache.org/jira/browse/FLINK-985
Project: Flink
Issue Type: Bug
Affects Version
Github user tobwiens commented on the pull request:
https://github.com/apache/incubator-flink/pull/45#issuecomment-47122697
FLINK-827
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
GitHub user tobwiens opened a pull request:
https://github.com/apache/incubator-flink/pull/45
ISSUE #827 fix
Adding WordCountPLOJO example. It demonstrates how to use KeySelectors
in a word count example.
Removing comments and adding file support so that this example is
e
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/43#issuecomment-47120257
Okay, I tried it out. Can you change some stuff?
In general, it looks good.
The title should be "Task Managers", change "Internet Adress" to "Node", i
Github user uce commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14194572
--- Diff:
stratosphere-compiler/src/main/java/eu/stratosphere/compiler/dag/MapPartitionNode.java
---
@@ -0,0 +1,56 @@
+/
Github user uce commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/44#discussion_r14194380
--- Diff:
stratosphere-java/src/test/java/eu/stratosphere/api/java/tuple/Tuple2Test.java
---
@@ -0,0 +1,55 @@
+/
Github user uce commented on the pull request:
https://github.com/apache/incubator-flink/pull/44#issuecomment-47119600
I suggest to create a new Tuple2 for the swap, because your current
solution only works because of type erasure.
The following would not work:
```jav
Github user JonathanH5 commented on the pull request:
https://github.com/apache/incubator-flink/pull/43#issuecomment-47117560
The Taskmanagers are shown in the configuration section (at the bottom)
---
If your project is set up for it, you can reply to this email and have your
reply a
Github user kfleischmann commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14192094
--- Diff:
stratosphere-compiler/src/main/java/eu/stratosphere/compiler/dag/MapPartitionNode.java
---
@@ -0,0 +1,56 @@
+/***
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/43#issuecomment-47113486
Thank you.
I'll test your code.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proje
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/43#discussion_r14190922
--- Diff:
stratosphere-runtime/src/main/java/eu/stratosphere/nephele/jobmanager/web/ConfigurationServlet.java
---
@@ -71,7 +88,37 @@ protected void
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/43#discussion_r14190720
--- Diff:
stratosphere-runtime/src/main/java/eu/stratosphere/nephele/jobmanager/web/ConfigurationServlet.java
---
@@ -71,7 +88,37 @@ protected void
Github user markus-h commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14190037
--- Diff:
stratosphere-compiler/src/main/java/eu/stratosphere/compiler/dag/MapPartitionNode.java
---
@@ -0,0 +1,56 @@
+/***
Hi,
our current repository contains a set of examples that show different
aspects of the system.
We recently got a pull request to add a graph centrality/closeness
implementation to Flink (
https://github.com/stratosphere/stratosphere/pull/904). The program is too
complex to be added as an example
GitHub user tobwiens opened a pull request:
https://github.com/apache/incubator-flink/pull/44
FIX-FLINK-888-swapValues() for Tuple2
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tobwiens/incubator-flink FIX-FLINK-888
Alternati
GitHub user JonathanH5 opened a pull request:
https://github.com/apache/incubator-flink/pull/43
Finished Flink-928
Taskmanagers are now displayed in the web interface @rmetzger
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Jonat
Github user uce commented on the pull request:
https://github.com/apache/incubator-flink/pull/42#issuecomment-47105893
I think this will be a nice addition to the API.
Would it make sense to rename the operator to flatMapPartition? It might be
confusing in relation to the exis
Ufuk Celebi created FLINK-984:
-
Summary: Distinct operator for POJO DataSets without KeySelector
and on UnsortedGrouping
Key: FLINK-984
URL: https://issues.apache.org/jira/browse/FLINK-984
Project: Flink
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14186251
--- Diff:
stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/wordcount/WordCountWithMapPartition.java
---
@
You can also do
mvn checkstyle:check
if you only want to run checkstyle.
On 25 Jun 2014, at 15:51, rmetzger wrote:
> Github user rmetzger commented on a diff in the pull request:
>
>https://github.com/apache/incubator-flink/pull/42#discussion_r14186130
>
>--- Diff:
> strato
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14186207
--- Diff:
stratosphere-examples/stratosphere-java-examples/src/main/java/eu/stratosphere/example/java/wordcount/WordCount.java
---
@@ -59,8 +59,11 @
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14186130
--- Diff:
stratosphere-compiler/src/main/java/eu/stratosphere/compiler/PactCompiler.java
---
@@ -23,52 +23,19 @@
import java.util.Map;
imp
Github user rmetzger commented on a diff in the pull request:
https://github.com/apache/incubator-flink/pull/42#discussion_r14186141
--- Diff:
stratosphere-compiler/src/main/java/eu/stratosphere/compiler/PactCompiler.java
---
@@ -665,6 +632,9 @@ else if (c instanceof GenericDataSo
GitHub user kfleischmann opened a pull request:
https://github.com/apache/incubator-flink/pull/42
New operator map partition function
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kfleischmann/incubator-flink
new_operator_MapP
Stephan Ewen created FLINK-983:
--
Summary: WebClient makes names of functions unreadable
Key: FLINK-983
URL: https://issues.apache.org/jira/browse/FLINK-983
Project: Flink
Issue Type: Bug
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-flink/pull/38
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-flink/pull/39
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Robert Metzger created FLINK-981:
Summary: Support for generated Cloudera Hadoop configuration
Key: FLINK-981
URL: https://issues.apache.org/jira/browse/FLINK-981
Project: Flink
Issue Type:
Bastian Köcher created FLINK-982:
Summary: Convert DataSet back into Collection
Key: FLINK-982
URL: https://issues.apache.org/jira/browse/FLINK-982
Project: Flink
Issue Type: Wish
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-flink/pull/33
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-flink/pull/28
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
We should be able to find a time slot that is suitable for PST as well.
Something that is 6pm CET / 9am PST or 7pm CET / 10am PST.
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-flink/pull/17
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Hey guys,
I've now updated the old README in https://github.com/stratosphere/stratosphere.
-- Ufuk
On 24 Jun 2014, at 19:48, Henry Saputra wrote:
> Hi Stephan,
>
> For now we could add huge warning message in the stratosphere's Github
> readme file to indicate it is deprecated and already mov
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-flink/pull/40
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-flink/pull/41
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Okay, it seems like the majority wants a biweekly hangout (Sorry Henry).
I have started a Doodle to find a suitable date:
http://doodle.com/d4xyg6weikkicn55
I told Doodle to enable time-zone support. Lets see how that works out.
On Mon, Jun 23, 2014 at 9:33 PM, Henry Saputra
wrote:
> I am inte
What do you exactly mean by dataset size? Is that the size of the input
data or the size of the data that is being held in-memory by the iterations?
The exception is not caused by the input data size. I think you are working
on the graph closeness algorithms. In this case, the exception is probabl
Very good idea.
We'll add a link to the issues tagged with "starter" to the new website.
On Wed, Jun 25, 2014 at 2:11 AM, Henry Saputra
wrote:
> Cool, if no objection I will start tagging the JIRAs that Fabian's had
> sent out as starter issues.
>
> Thanks,
>
> Henry
>
> On Tue, Jun 24, 2014 at
Github user mariemayadi commented on the pull request:
https://github.com/apache/incubator-flink/pull/40#issuecomment-47068686
Great.
On Wed, Jun 25, 2014 at 9:28 AM, Robert Metzger
wrote:
> Great!
> I think its good to merge.
>
> â
> Reply
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/40#issuecomment-47068580
Great!
I think its good to merge.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/41#issuecomment-47067902
I think its good to merge.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does n
Github user rmetzger commented on the pull request:
https://github.com/apache/incubator-flink/pull/37#issuecomment-47066734
Thank you for the pull request. I know it was a lot of work.
It fails to build with hadoop 2.2.0 dependencies:
https://travis-ci.org/apache/incubator-flink/bu
66 matches
Mail list logo
