[GitHub] flink pull request: Rename coGroupDataSet.scala to CoGroupDataSet....

2015-01-19 Thread hsaputra
Github user hsaputra commented on the pull request: https://github.com/apache/flink/pull/324#issuecomment-70600130 FYI @aljoscha --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-1376] [runtime] Add proper shared slot ...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/318#discussion_r23195339 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/instance/SharedSlot.java --- @@ -0,0 +1,154 @@ +/* + * Licensed to the Apache Soft

[GitHub] flink pull request: Rename coGroupDataSet.scala to CoGroupDataSet....

2015-01-19 Thread hsaputra
GitHub user hsaputra opened a pull request: https://github.com/apache/flink/pull/324 Rename coGroupDataSet.scala to CoGroupDataSet.scala, and crossDataSet.scala to CrossDataSet.scala This PR contains changes to follow Scala style: -) Rename coGroupDataSet.scala to CoGroupDataSet

[GitHub] flink pull request: [FLINK-1372] [runtime] Fix akka logging

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/321#discussion_r23188009 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/akka/AkkaUtils.scala --- @@ -204,12 +192,16 @@ object AkkaUtils { |

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/292#issuecomment-70559819 Thank you for reviewing the code. I hope I have time tomorrow to address all remarks. --- If your project is set up for it, you can reply to this email and have your rep

[jira] [Resolved] (FLINK-1420) Small cleanup on code after 0.8 release

2015-01-19 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra resolved FLINK-1420. -- Resolution: Fixed > Small cleanup on code after 0.8 release > --

[GitHub] flink pull request: FLINK-1420 Small cleanup on code after branch ...

2015-01-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/302 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282950#comment-14282950 ] Robert Metzger commented on FLINK-1421: --- +10. Very nice that you started working on

[jira] [Created] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-01-19 Thread Paris Carbone (JIRA)
Paris Carbone created FLINK-1421: Summary: Implement a SAMOA Adapter for Flink Streaming Key: FLINK-1421 URL: https://issues.apache.org/jira/browse/FLINK-1421 Project: Flink Issue Type: New F

[jira] [Updated] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-01-19 Thread Paris Carbone (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paris Carbone updated FLINK-1421: - Description: Yahoo's Samoa is an experimental incremental machine learning library that builds on

[jira] [Updated] (FLINK-1420) Small cleanup on code after 0.8 release

2015-01-19 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra updated FLINK-1420: - Issue Type: Improvement (was: Bug) > Small cleanup on code after 0.8 release > --

[jira] [Created] (FLINK-1420) Small cleanup on code after 0.8 release

2015-01-19 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1420: Summary: Small cleanup on code after 0.8 release Key: FLINK-1420 URL: https://issues.apache.org/jira/browse/FLINK-1420 Project: Flink Issue Type: Bug

[GitHub] flink pull request: [FLINK-1372] [runtime] Fix akka logging

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/321#discussion_r23177318 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/akka/AkkaUtils.scala --- @@ -204,12 +192,16 @@ object AkkaUtils { |

[GitHub] flink pull request: Implement the convenience methods count and co...

2015-01-19 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/210#discussion_r23176867 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/AbstractIDTest.java --- @@ -23,8 +23,8 @@ import static org.junit.Assert.fail; impor

[GitHub] flink pull request: Update incubator-flink name in the merge pull ...

2015-01-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/292#issuecomment-70536571 As far as I can tell without running tests on the cluster it looks good to me. Only some minor remarks as in-code comments. --- If your project is set up for it, you

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23176494 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/YarnTaskManager.scala --- @@ -31,6 +31,7 @@ trait YarnTaskManager extends ActorLogMessages {

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23176437 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/ApplicationMaster.scala --- @@ -153,15 +159,24 @@ object ApplicationMaster{ output.clos

[GitHub] flink pull request: Implement the convenience methods count and co...

2015-01-19 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/210#discussion_r23176327 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/AbstractIDTest.java --- @@ -23,8 +23,8 @@ import static org.junit.Assert.fail; impor

[jira] [Comment Edited] (FLINK-655) Add support for both single and set of broadcast values

2015-01-19 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14281923#comment-14281923 ] Henry Saputra edited comment on FLINK-655 at 1/19/15 6:00 PM: --

[jira] [Comment Edited] (FLINK-655) Add support for both single and set of broadcast values

2015-01-19 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14281923#comment-14281923 ] Henry Saputra edited comment on FLINK-655 at 1/19/15 6:00 PM: --

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23176016 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/ApplicationMaster.scala --- @@ -41,9 +41,9 @@ object ApplicationMaster{ val MODIFIED_CONF

[GitHub] flink pull request: Implement the convenience methods count and co...

2015-01-19 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/210#issuecomment-70534961 I fixed the proposed changes and rebased to the current master. The changes are only reflected in the Java API and need to be added to the Scala API as well. --- If your pro

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23175611 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnCluster.java --- @@ -0,0 +1,363 @@ +/* + * Licensed to the Apache Software Found

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23175580 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnCluster.java --- @@ -0,0 +1,363 @@ +/* + * Licensed to the Apache Software Found

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23175486 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnCluster.java --- @@ -0,0 +1,363 @@ +/* + * Licensed to the Apache Software Found

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23175364 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnCluster.java --- @@ -0,0 +1,363 @@ +/* + * Licensed to the Apache Software Found

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282739#comment-14282739 ] Till Rohrmann commented on FLINK-1372: -- I think, it should work now with my latest PR

[jira] [Commented] (FLINK-1303) HadoopInputFormat does not work with Scala API

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282734#comment-14282734 ] Stephan Ewen commented on FLINK-1303: - Ah, I have seen another user telling me about t

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282729#comment-14282729 ] Stephan Ewen commented on FLINK-1372: - The logging of startup options would happen in

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23173266 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnClient.java --- @@ -0,0 +1,653 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23173179 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnClient.java --- @@ -0,0 +1,653 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23173072 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnClient.java --- @@ -0,0 +1,653 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] flink pull request: [FLINK-1395] Add support for JodaTime in KryoS...

2015-01-19 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/304#issuecomment-70527831 My point is that we cannot make all types anyone would ever use work out of the box. Any sample of types that work out of the box is incomplete and sort of arbitrary a

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172930 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnClient.java --- @@ -0,0 +1,653 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172849 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnClient.java --- @@ -0,0 +1,653 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Commented] (FLINK-1418) Make 'print()' output on the client command line, rather than on the task manager sysout

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282706#comment-14282706 ] Stephan Ewen commented on FLINK-1418: - It also breaks existing programs, because {{pri

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172541 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software Founda

[jira] [Commented] (FLINK-1098) flatArray() operator that converts arrays to elements

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282699#comment-14282699 ] Fabian Hueske commented on FLINK-1098: -- Timo proposed to add a {{colectEach()}} metho

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172407 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software Fo

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172490 --- Diff: flink-yarn-tests/src/test/resources/log4j-test.properties --- @@ -0,0 +1,25 @@ +

[GitHub] flink pull request: [FLINK-1395] Add support for JodaTime in KryoS...

2015-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/304#issuecomment-70526481 Maybe I'm missing something but in my understanding if a user is using `DateTime` in a POJO, we would be able to serialize that efficiently with Kryo (without writing any

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172386 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software Fo

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172243 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software Fo

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172158 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software Founda

[GitHub] flink pull request: [FLINK-1395] Add support for JodaTime in KryoS...

2015-01-19 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/304#issuecomment-70525444 JodaTime alone has about 20 classes. Not for all of them are serializers available, it would be quite a bit of work to add all those. Adding a big set of commo

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172012 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software Fo

[GitHub] flink pull request: [FLINK-1372] [runtime] Fix akka logging

2015-01-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/321#discussion_r23171851 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/akka/AkkaUtils.scala --- @@ -204,12 +192,16 @@ object AkkaUtils { | | l

[jira] [Commented] (FLINK-1400) In local mode, the default TaskManager won't listen on the data port.

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282690#comment-14282690 ] Stephan Ewen commented on FLINK-1400: - Good point. The Webfrontend could write {{-1}}

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23171500 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/net/NetUtils.java --- @@ -86,7 +86,7 @@ public static InetAddress resolveAddress(InetSocke

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23171462 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/net/NetUtils.java --- @@ -76,7 +76,7 @@ public static InetAddress resolveAddress(InetSocke

[GitHub] flink pull request: [FLINK-1391] Add support for using Avro-POJOs ...

2015-01-19 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/323 [FLINK-1391] Add support for using Avro-POJOs and Avro types with Kryo With this change, users can use POJOs generated from Avro Schemas with Flink. Either the entire POJO as a GenericType or wi

[jira] [Commented] (FLINK-1098) flatArray() operator that converts arrays to elements

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282679#comment-14282679 ] Stephan Ewen commented on FLINK-1098: - Can we do this with a special flatMapFunction,

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23170666 --- Diff: flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java --- @@ -860,8 +910,50 @@ protected Properties getYarnProperties() throws IOExc

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23170694 --- Diff: flink-clients/src/main/java/org/apache/flink/client/FlinkYarnSessionCli.java --- @@ -0,0 +1,429 @@ +/* + * Licensed to the Apache Software F

[jira] [Commented] (FLINK-1297) Add support for tracking statistics of intermediate results

2015-01-19 Thread Alexander Alexandrov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282660#comment-14282660 ] Alexander Alexandrov commented on FLINK-1297: - We have a new master student (F

[jira] [Updated] (FLINK-1297) Add support for tracking statistics of intermediate results

2015-01-19 Thread Alexander Alexandrov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Alexandrov updated FLINK-1297: Due Date: 15/Mar/15 (was: 31/Jan/15) > Add support for tracking statistics of inter

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23169866 --- Diff: flink-clients/src/main/java/org/apache/flink/client/FlinkYarnSessionCli.java --- @@ -0,0 +1,429 @@ +/* + * Licensed to the Apache Softwa

[GitHub] flink pull request: [FLINK-1392] Add Kryo serializer for Protobuf

2015-01-19 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/322 [FLINK-1392] Add Kryo serializer for Protobuf I've checked the added dependencies and its not overriding any versions and no transitive dependencies are added. You can merge this pull request into

[GitHub] flink pull request: [FLINK-1406] update Flink compatibility notice

2015-01-19 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/314#issuecomment-70519951 Good to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23169293 --- Diff: flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java --- @@ -860,8 +910,50 @@ protected Properties getYarnProperties() throws I

[GitHub] flink pull request: [FLINK-1328] Reworked semantic annotations

2015-01-19 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/311#issuecomment-70517390 IMO, users should only be allowed to set semantic properties though field expression strings. There should be no need to implement an own SemanticProperty class or manuall

[GitHub] flink pull request: [FLINK-1372] [runtime] Fix akka logging

2015-01-19 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/321 [FLINK-1372] [runtime] Fix akka logging Fixes logging settings. The logging is now exclusively controlled by the logging properties provided to the system and thus removes akka.loglevel config

[jira] [Updated] (FLINK-1296) Add support for very large record for sorting

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1296: -- Fix Version/s: (was: 0.8) 0.9 > Add support for very large record for sor

[jira] [Updated] (FLINK-938) Change start-cluster.sh script so that users don't have to configure the JobManager address

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-938: - Fix Version/s: (was: 0.8) 0.9 > Change start-cluster.sh script so that users

[jira] [Updated] (FLINK-967) Make intermediate results a first-class citizen in the JobGraph

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-967: - Fix Version/s: (was: 0.8) 0.9 > Make intermediate results a first-class citi

[jira] [Updated] (FLINK-1303) HadoopInputFormat does not work with Scala API

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1303: -- Fix Version/s: (was: 0.8) 0.9 > HadoopInputFormat does not work with Scal

[jira] [Updated] (FLINK-1297) Add support for tracking statistics of intermediate results

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1297: -- Fix Version/s: (was: 0.8) 0.9 > Add support for tracking statistics of in

[jira] [Updated] (FLINK-1240) We cannot use sortGroup on a global reduce

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1240: -- Fix Version/s: (was: 0.8) 0.9 > We cannot use sortGroup on a global reduc

[jira] [Updated] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-937: - Fix Version/s: (was: 0.8) 0.9 > Change the YARN Client to allocate all clust

[jira] [Updated] (FLINK-987) Extend TypeSerializers and -Comparators to work directly on Memory Segments

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-987: - Fix Version/s: (was: 0.8) 0.9 > Extend TypeSerializers and -Comparators to w

[jira] [Updated] (FLINK-1278) Remove the Record special code paths

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1278: -- Fix Version/s: (was: 0.8) 0.9 > Remove the Record special code paths > --

[jira] [Updated] (FLINK-1129) The Plan Visualizer Cuts of the Lower Part of Certain Operators

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1129: -- Fix Version/s: (was: 0.8) 0.9 > The Plan Visualizer Cuts of the Lower Par

[jira] [Commented] (FLINK-1303) HadoopInputFormat does not work with Scala API

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282600#comment-14282600 ] Robert Metzger commented on FLINK-1303: --- Whats the status of this issue? > HadoopIn

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282593#comment-14282593 ] Till Rohrmann commented on FLINK-1372: -- It always depends on the location from where

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282585#comment-14282585 ] Ufuk Celebi commented on FLINK-1372: Thanks for the explanation and looking into it. :

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282577#comment-14282577 ] Till Rohrmann commented on FLINK-1372: -- I don't think that it is good to directly use

[GitHub] flink pull request: [FLINK-1328] Reworked semantic annotations

2015-01-19 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/311#discussion_r23163896 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/operators/DualInputSemanticProperties.java --- @@ -56,218 +56,135 @@ pub

[GitHub] flink pull request: [FLINK-1328] Reworked semantic annotations

2015-01-19 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/311#discussion_r23163889 --- Diff: flink-compiler/src/main/java/org/apache/flink/compiler/dag/AbstractPartialSolutionNode.java --- @@ -86,8 +87,8 @@ public void computeInterestingPro

[GitHub] flink pull request: [FLINK-1376] [runtime] Add proper shared slot ...

2015-01-19 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/318#discussion_r23163714 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/instance/SharedSlot.java --- @@ -0,0 +1,154 @@ +/* + * Licensed to the Apache Software Foun

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282554#comment-14282554 ] Ufuk Celebi commented on FLINK-1372: [~till.rohrmann] do you have something to add? Co

[jira] [Commented] (FLINK-1409) Connected datastream functionality broken since the introduction of intermediate results

2015-01-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282536#comment-14282536 ] Ufuk Celebi commented on FLINK-1409: Fixed in 95fece8. Travis is currently running int

[GitHub] flink pull request: [FLINK-1406] update Flink compatibility notice

2015-01-19 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/314#issuecomment-70492395 :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] flink pull request: [FLINK-1406] update Flink compatibility notice

2015-01-19 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/314#issuecomment-70490230 @fhueske I updated the documentation to include the link. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] flink pull request: [FLINK-1165] No createCollectionsEnvironment i...

2015-01-19 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/320#issuecomment-70487388 Thanks :) Personally, I'm fine with both variants, but if the Scala variant is already called Collections environment, I would go for the same name and leave the Scala API as

[GitHub] flink pull request: [FLINK-1165] No createCollectionsEnvironment i...

2015-01-19 Thread ajaybhat
Github user ajaybhat commented on the pull request: https://github.com/apache/flink/pull/320#issuecomment-70484376 Fixed the typos. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[jira] [Assigned] (FLINK-1003) Spread out scheduling strategy

2015-01-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reassigned FLINK-1003: Assignee: (was: Till Rohrmann) > Spread out scheduling strategy > -

[GitHub] flink pull request: [FLINK-1003] Added spread out scheduling strat...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann closed the pull request at: https://github.com/apache/flink/pull/60 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-1003] Added spread out scheduling strat...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/60#issuecomment-70477464 I agree, too much has changed since the PR was opened. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (FLINK-1419) DistributedCache doesn't preserver files for subsequent operations

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282393#comment-14282393 ] Fabian Hueske commented on FLINK-1419: -- I think it is fine to make files in the DC im

[GitHub] flink pull request: [FLINK-1165] No createCollectionsEnvironment i...

2015-01-19 Thread ajaybhat
GitHub user ajaybhat opened a pull request: https://github.com/apache/flink/pull/320 [FLINK-1165] No createCollectionsEnvironment in Java API This commit adds a new method to ExecutionEnvironment to create a CollectionEnvironment, and applies the method to cases where a Colle

[jira] [Assigned] (FLINK-1419) DistributedCache doesn't preserver files for subsequent operations

2015-01-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-1419: --- Assignee: Chesnay Schepler > DistributedCache doesn't preserver files for subsequent

[jira] [Commented] (FLINK-1418) Make 'print()' output on the client command line, rather than on the task manager sysout

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282360#comment-14282360 ] Fabian Hueske commented on FLINK-1418: -- I agree, printing to the TMs std-out is prett

[jira] [Commented] (FLINK-655) Add support for both single and set of broadcast values

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282334#comment-14282334 ] Fabian Hueske commented on FLINK-655: - If we add support to read a scalar value from th

[GitHub] flink pull request: [FLINK-1296] Add sorter support for very large...

2015-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/249#issuecomment-70470401 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Created] (FLINK-1419) DistributedCache doesn't preserver files for subsequent operations

2015-01-19 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-1419: --- Summary: DistributedCache doesn't preserver files for subsequent operations Key: FLINK-1419 URL: https://issues.apache.org/jira/browse/FLINK-1419 Project: Flink

[jira] [Commented] (FLINK-1400) In local mode, the default TaskManager won't listen on the data port.

2015-01-19 Thread Sergey Dudoladov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282314#comment-14282314 ] Sergey Dudoladov commented on FLINK-1400: - Thanks, Stephan. This solves my probl

[GitHub] flink pull request: [FLINK-1395] Add support for JodaTime in KryoS...

2015-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/304#issuecomment-70467240 I guess you are referring to this commit? https://github.com/apache/flink/commit/020b282bdc5468aa51b231e9ae8d4d3a1a76e696 I don't see a reason NOT to add commonly

[jira] [Commented] (FLINK-1098) flatArray() operator that converts arrays to elements

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282286#comment-14282286 ] Fabian Hueske commented on FLINK-1098: -- I like the idea +1 > flatArray() operator t