[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/643#issuecomment-98964566 Do you think these interfaces will work if at any point we want to do incremental snapshots? --- If your project is set up for it, you can reply to this email and have you

[GitHub] flink pull request: [FLINK-1792] TM Monitoring: CPU utilization, h...

2015-05-04 Thread bhatsachin
Github user bhatsachin commented on a diff in the pull request: https://github.com/apache/flink/pull/553#discussion_r29636725 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -129,6 +130,41 @@ class TaskManager(val connectionInfo

[jira] [Commented] (FLINK-1792) Improve TM Monitoring: CPU utilization, hide graphs by default and show summary only

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527621#comment-14527621 ] ASF GitHub Bot commented on FLINK-1792: --- Github user bhatsachin commented on a diff

[jira] [Commented] (FLINK-1792) Improve TM Monitoring: CPU utilization, hide graphs by default and show summary only

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527617#comment-14527617 ] ASF GitHub Bot commented on FLINK-1792: --- Github user bhatsachin commented on a diff

[GitHub] flink pull request: [FLINK-1792] TM Monitoring: CPU utilization, h...

2015-05-04 Thread bhatsachin
Github user bhatsachin commented on a diff in the pull request: https://github.com/apache/flink/pull/553#discussion_r29636610 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -129,6 +130,41 @@ class TaskManager(val connectionInfo

[jira] [Commented] (FLINK-1792) Improve TM Monitoring: CPU utilization, hide graphs by default and show summary only

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527609#comment-14527609 ] ASF GitHub Bot commented on FLINK-1792: --- Github user bhatsachin commented on a diff

[GitHub] flink pull request: [FLINK-1792] TM Monitoring: CPU utilization, h...

2015-05-04 Thread bhatsachin
Github user bhatsachin commented on a diff in the pull request: https://github.com/apache/flink/pull/553#discussion_r29636451 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -129,6 +130,41 @@ class TaskManager(val connectionInfo

[jira] [Commented] (FLINK-1953) Rework Checkpoint Coordinator

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527536#comment-14527536 ] ASF GitHub Bot commented on FLINK-1953: --- GitHub user StephanEwen opened a pull reque

[GitHub] flink pull request: [FLINK-1953] [runtime] Integrate new snapshot ...

2015-05-04 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/651 [FLINK-1953] [runtime] Integrate new snapshot checkpoint coordinator with jobgraph and execution graph The core commit is https://github.com/apache/flink/commit/abd5ac7d78c5231e95bbbaaf15dad8f8c

[jira] [Created] (FLINK-1973) JobManager log does not contain state change messages on INFO level

2015-05-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1973: --- Summary: JobManager log does not contain state change messages on INFO level Key: FLINK-1973 URL: https://issues.apache.org/jira/browse/FLINK-1973 Project: Flink

[GitHub] flink pull request: [PATCH] Correct a exmample code in gelly doc.

2015-05-04 Thread joey001
GitHub user joey001 opened a pull request: https://github.com/apache/flink/pull/650 [PATCH] Correct a exmample code in gelly doc. I just correct a little error in gelly doc, the Neighborhood Methods section. The return of groupReduceOnNeighbors should be consistent with that de

[jira] [Commented] (FLINK-1707) Add an Affinity Propagation Library Method

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527275#comment-14527275 ] ASF GitHub Bot commented on FLINK-1707: --- GitHub user joey001 opened a pull request:

[GitHub] flink pull request: [FLINK-1707][WIP]Add an Affinity Propagation L...

2015-05-04 Thread joey001
GitHub user joey001 opened a pull request: https://github.com/apache/flink/pull/649 [FLINK-1707][WIP]Add an Affinity Propagation Library Method I just finished the initial version of AP implementation and pass some preliminary test. The input of the program include two files: 1

[jira] [Created] (FLINK-1972) Remove instanceID in streaming tasks

2015-05-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1972: --- Summary: Remove instanceID in streaming tasks Key: FLINK-1972 URL: https://issues.apache.org/jira/browse/FLINK-1972 Project: Flink Issue Type: Bug Co

[jira] [Commented] (FLINK-1951) NullPointerException in DeltaIteration when no ForwardedFileds

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526873#comment-14526873 ] ASF GitHub Bot commented on FLINK-1951: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-1682) Port Record-API based optimizer tests to new Java API

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526871#comment-14526871 ] ASF GitHub Bot commented on FLINK-1682: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-1682] Ported optimizer unit tests from ...

2015-05-04 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/627#issuecomment-98781884 Any objections against merging this PR? Otherwise, I'll do that tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] flink pull request: [FLINK-1951] Fix NullPointerException in delta...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/641#issuecomment-98782588 Looks very good. +1 to merge as is --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] flink pull request: [FLINK-1951] Fix NullPointerException in delta...

2015-05-04 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/641#issuecomment-98781618 I added a test to cover the bug. I'll merge tomorrow, if nobody raises a flag. --- If your project is set up for it, you can reply to this email and have your reply ap

[jira] [Commented] (FLINK-1951) NullPointerException in DeltaIteration when no ForwardedFileds

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526866#comment-14526866 ] ASF GitHub Bot commented on FLINK-1951: --- Github user fhueske commented on the pull r

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526784#comment-14526784 ] ASF GitHub Bot commented on FLINK-1807: --- Github user thvasilo commented on a diff in

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread thvasilo
Github user thvasilo commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29597434 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/LossFunction.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to the Apa

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/643#issuecomment-98760015 Concerning synchronous/asynchronous checkpointing, you are right. For asynchronous checkpointing, you may also use some copy-on-write techniques, rather than doing an

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread senorcarbone
Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/643#issuecomment-98757999 I like the interfaces, they are quite precise. To sum up (and see if I get this right), with `Checkpointed` we simply guarantee that an operator will not get invoked

[jira] [Commented] (FLINK-1673) Colocate Flink Kafka consumer

2015-05-04 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526737#comment-14526737 ] Tamás Krutki commented on FLINK-1673: - Hi, I'm new to Flink, I've talked with [~gaborh

[jira] [Created] (FLINK-1971) Add user function type to StreamOperator

2015-05-04 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-1971: --- Summary: Add user function type to StreamOperator Key: FLINK-1971 URL: https://issues.apache.org/jira/browse/FLINK-1971 Project: Flink Issue Type: Impr

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526695#comment-14526695 ] ASF GitHub Bot commented on FLINK-1807: --- Github user thvasilo commented on a diff in

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread thvasilo
Github user thvasilo commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29590147 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/RegularizationType.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed to t

[jira] [Created] (FLINK-1970) how can implemented subquery in flink

2015-05-04 Thread hagersaleh (JIRA)
hagersaleh created FLINK-1970: - Summary: how can implemented subquery in flink Key: FLINK-1970 URL: https://issues.apache.org/jira/browse/FLINK-1970 Project: Flink Issue Type: Bug Rep

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526682#comment-14526682 ] ASF GitHub Bot commented on FLINK-1807: --- Github user thvasilo commented on a diff in

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread thvasilo
Github user thvasilo commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29588896 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/LossFunction.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to the Apa

[jira] [Commented] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526642#comment-14526642 ] ASF GitHub Bot commented on FLINK-1968: --- Github user StephanEwen closed the pull req

[GitHub] flink pull request: [FLINK-1672] [runtime] Unify Task and RuntimeE...

2015-05-04 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/646 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526641#comment-14526641 ] ASF GitHub Bot commented on FLINK-1968: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-1969) Remove old profile code

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526638#comment-14526638 ] ASF GitHub Bot commented on FLINK-1969: --- Github user StephanEwen closed the pull req

[jira] [Commented] (FLINK-1969) Remove old profile code

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526637#comment-14526637 ] ASF GitHub Bot commented on FLINK-1969: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-1969] [runtime] Remove deprecated profi...

2015-05-04 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/647 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-1672] [runtime] Unify Task and RuntimeE...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/646#issuecomment-98707668 Subsumed by #648 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] flink pull request: [FLINK-19698[FLINK-1672][FLINK-1969] Various m...

2015-05-04 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/648 [FLINK-19698[FLINK-1672][FLINK-1969] Various major fixes Cleaning up the Distributed Cache - Gives a proper exception when a non-cached file is accessed - Forwards I/O exceptions that

[GitHub] flink pull request: [FLINK-1969] [runtime] Remove deprecated profi...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/647#issuecomment-98707653 Subsumed by #648 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[jira] [Commented] (FLINK-1672) Refactor task registration/unregistration

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526639#comment-14526639 ] ASF GitHub Bot commented on FLINK-1672: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-1968] [runtime] Clean up and improve th...

2015-05-04 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/645 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-1968] [runtime] Clean up and improve th...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/645#issuecomment-98707687 Subsumed by #648 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[jira] [Commented] (FLINK-1672) Refactor task registration/unregistration

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526640#comment-14526640 ] ASF GitHub Bot commented on FLINK-1672: --- Github user StephanEwen closed the pull req

[GitHub] flink pull request: [FLINK-1968] [runtime] Clean up and improve th...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/645#issuecomment-98705536 This Pull Request does, unfortunately, not build standalone, but intermingles with #646 I just opened it to give an isolated view at what I proposed to change

[jira] [Commented] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526631#comment-14526631 ] ASF GitHub Bot commented on FLINK-1968: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-1967) Introduce (Event)time in Streaming

2015-05-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526626#comment-14526626 ] Stephan Ewen commented on FLINK-1967: - We also need to make sure the sources are in sy

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/643#issuecomment-98703915 @aljoscha I think this is orthogonal to the changes here. What you suggest is a more elaborate version of the `StateHandle`. For that, I totally agree. --- If your pr

[jira] [Commented] (FLINK-1672) Refactor task registration/unregistration

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526619#comment-14526619 ] ASF GitHub Bot commented on FLINK-1672: --- GitHub user StephanEwen opened a pull reque

[jira] [Commented] (FLINK-1969) Remove old profile code

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526622#comment-14526622 ] ASF GitHub Bot commented on FLINK-1969: --- GitHub user StephanEwen opened a pull reque

[jira] [Commented] (FLINK-1962) Add Gelly Scala API

2015-05-04 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526620#comment-14526620 ] Vasia Kalavri commented on FLINK-1962: -- I'm personally not sure about your concerns.

[jira] [Commented] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526617#comment-14526617 ] ASF GitHub Bot commented on FLINK-1968: --- GitHub user StephanEwen opened a pull reque

[GitHub] flink pull request: [FLINK-1969] [runtime] Remove deprecated profi...

2015-05-04 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/647 [FLINK-1969] [runtime] Remove deprecated profiler code You can merge this pull request into a Git repository by running: $ git pull https://github.com/StephanEwen/incubator-flink remove_pro

[GitHub] flink pull request: [FLINK-1672] [runtime] Unify Task and RuntimeE...

2015-05-04 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/646 [FLINK-1672] [runtime] Unify Task and RuntimeEnvironment into one class. - This simplifies and hardens the failure handling during task startup - Guarantees that no actor system threads are

[GitHub] flink pull request: [FLINK-1968] [runtime] Clean up and improve th...

2015-05-04 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/645 [FLINK-1968] [runtime] Clean up and improve the distributed cache. - Gives a proper exception when a non-cached file is accessed - Forwards I/O exceptions that happen during file transfer, r

[jira] [Created] (FLINK-1969) Remove old profile code

2015-05-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1969: --- Summary: Remove old profile code Key: FLINK-1969 URL: https://issues.apache.org/jira/browse/FLINK-1969 Project: Flink Issue Type: Bug Components: Dis

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526616#comment-14526616 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/613#issuecomment-98702926 The refactoring looks really good @thvasilo. I had only two comments: 1. Why do we limit the optimization framework to linear models? 2. Why do we calculat

[jira] [Commented] (FLINK-1672) Refactor task registration/unregistration

2015-05-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526611#comment-14526611 ] Stephan Ewen commented on FLINK-1672: - I have fixed that during a recent refactoring,

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526610#comment-14526610 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29583038 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/LossFunction.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to the

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29582777 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/RegularizationType.scala --- @@ -0,0 +1,143 @@ +/* + * Licensed

[jira] [Commented] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526607#comment-14526607 ] Stephan Ewen commented on FLINK-1968: - I stumbled across this on the weekend and have

[jira] [Updated] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-1968: Fix Version/s: 0.9 > Make Distributed Cache more robust > -- > >

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526606#comment-14526606 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on a dif

[jira] [Updated] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-1968: Component/s: Local Runtime > Make Distributed Cache more robust > --

[jira] [Updated] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-1968: Affects Version/s: 0.9 > Make Distributed Cache more robust > -- > >

[jira] [Assigned] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen reassigned FLINK-1968: --- Assignee: Stephan Ewen > Make Distributed Cache more robust > ---

[jira] [Created] (FLINK-1968) Make Distributed Cache more robust

2015-05-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1968: --- Summary: Make Distributed Cache more robust Key: FLINK-1968 URL: https://issues.apache.org/jira/browse/FLINK-1968 Project: Flink Issue Type: Bug Re

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526600#comment-14526600 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/643#discussion_r29582495 --- Diff: flink-staging/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/checkpoint/Checkpointed.java --- @@ -0,0 +1,53 @

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29582464 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/LossFunction.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526599#comment-14526599 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29582355 --- Diff: flink-staging/flink-ml/src/test/scala/org/apache/flink/ml/optimization/RegularizationITSuite.scala --- @@ -0,0 +1,56 @@ +/* + * License

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/643#discussion_r29582309 --- Diff: flink-staging/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/checkpoint/Checkpointed.java --- @@ -0,0 +1,53 @

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29582076 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/LossFunction.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to the

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/643#discussion_r29582102 --- Diff: flink-staging/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/functions/source/StreamSource.java --- @@ -0,0 +

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526595#comment-14526595 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526596#comment-14526596 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29582072 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/LossFunction.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-1807) Stochastic gradient descent optimizer for ML library

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526589#comment-14526589 ] ASF GitHub Bot commented on FLINK-1807: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [WIP] - [FLINK-1807/1889] - Optimization frame...

2015-05-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/613#discussion_r29581488 --- Diff: flink-staging/flink-ml/pom.xml --- @@ -43,7 +43,7 @@ org.scalanlp breeze_2.10

[jira] [Created] (FLINK-1967) Introduce (Event)time in Streaming

2015-05-04 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-1967: --- Summary: Introduce (Event)time in Streaming Key: FLINK-1967 URL: https://issues.apache.org/jira/browse/FLINK-1967 Project: Flink Issue Type: Improvemen

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/643#issuecomment-98690522 Also, the key would be a property of a DataStream, and other operations could also use this. --- If your project is set up for it, you can reply to this email and have y

[GitHub] flink pull request: [streaming] New Source and state checkpointing...

2015-05-04 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/643#issuecomment-98690440 I'm afraid we need to be a bit more strict here. We need to partition the state by key, to make it more manageable. Therefore, we should only allow the user to use state

[jira] [Commented] (FLINK-1595) Add a complex integration test for Streaming API

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526565#comment-14526565 ] ASF GitHub Bot commented on FLINK-1595: --- Github user szape commented on the pull req

[GitHub] flink pull request: [FLINK-1595] [streaming] Complex integration t...

2015-05-04 Thread szape
Github user szape commented on the pull request: https://github.com/apache/flink/pull/520#issuecomment-98689457 Of course, I'm on it. I agree, separate tests would be much better. I'll try MiltipleProgramsTestBase for that purpose. Peter 2015-05-04 10:21 GMT+02

[jira] [Commented] (FLINK-1962) Add Gelly Scala API

2015-05-04 Thread PJ Van Aeken (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526557#comment-14526557 ] PJ Van Aeken commented on FLINK-1962: - In terms of maintainability, you are undoubtedl

[jira] [Closed] (FLINK-1670) Collect method for streaming

2015-05-04 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márton Balassi closed FLINK-1670. - Resolution: Implemented Fix Version/s: 0.9 Implemented via c9c9450 > Collect method for st

[jira] [Closed] (FLINK-1855) SocketTextStreamWordCount example cannot be run from the webclient

2015-05-04 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márton Balassi closed FLINK-1855. - Resolution: Fixed Fix Version/s: 0.9 Fixed via ae867ef > SocketTextStreamWordCount exampl

[jira] [Commented] (FLINK-1670) Collect method for streaming

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526463#comment-14526463 ] ASF GitHub Bot commented on FLINK-1670: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-1855) SocketTextStreamWordCount example cannot be run from the webclient

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526462#comment-14526462 ] ASF GitHub Bot commented on FLINK-1855: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-1855] SocketTextStreamWordCount example...

2015-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/644 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] flink pull request: [FLINK-1670] Made DataStream iterable

2015-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/581 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Created] (FLINK-1966) Add support for predictive model markup language (PMML)

2015-05-04 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1966: Summary: Add support for predictive model markup language (PMML) Key: FLINK-1966 URL: https://issues.apache.org/jira/browse/FLINK-1966 Project: Flink Issue T

[GitHub] flink pull request: [FLINK-1855] SocketTextStreamWordCount example...

2015-05-04 Thread mbalassi
Github user mbalassi commented on the pull request: https://github.com/apache/flink/pull/644#issuecomment-98644180 Thanks, merging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[jira] [Commented] (FLINK-1855) SocketTextStreamWordCount example cannot be run from the webclient

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526443#comment-14526443 ] ASF GitHub Bot commented on FLINK-1855: --- Github user mbalassi commented on the pull

[jira] [Commented] (FLINK-1962) Add Gelly Scala API

2015-05-04 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526437#comment-14526437 ] Vasia Kalavri commented on FLINK-1962: -- Yes, it should be easier for you to implement

[GitHub] flink pull request: [FLINK-1792] TM Monitoring: CPU utilization, h...

2015-05-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/553#issuecomment-98640261 I tried our your changes and looked at the change. - The pull request includes commits which are probably not part of the change. Maybe some merging/rebasing went

[jira] [Commented] (FLINK-1792) Improve TM Monitoring: CPU utilization, hide graphs by default and show summary only

2015-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526430#comment-14526430 ] ASF GitHub Bot commented on FLINK-1792: --- Github user rmetzger commented on the pull

  1   2   >