[jira] [Resolved] (FLINK-1107) Document how to use Avro files and the Hadoop Input Format Wrappers

2015-02-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1107. --- Resolution: Fixed > Document how to use Avro files and the Hadoop Input Format Wrappers >

[jira] [Comment Edited] (FLINK-1542) Test case at BlobUtilsTest should not assume user could not create new item in root directory

2015-02-13 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320815#comment-14320815 ] Henry Saputra edited comment on FLINK-1542 at 2/13/15 9:59 PM: -

[jira] [Commented] (FLINK-1542) Test case at BlobUtilsTest should not assume user could not create new item in root directory

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320815#comment-14320815 ] ASF GitHub Bot commented on FLINK-1542: --- GitHub user hsaputra opened a pull request:

[GitHub] flink pull request: [FLINK-1542] Test case at BlobUtilsTest should...

2015-02-13 Thread hsaputra
GitHub user hsaputra opened a pull request: https://github.com/apache/flink/pull/396 [FLINK-1542] Test case at BlobUtilsTest should not assume user could not create new item in root directory [FLINK-1542] Test case at BlobUtilsTest should not assume user could not create new item i

[jira] [Updated] (FLINK-1538) GSoC project: Spatial Data Processing Library

2015-02-13 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1538: - Summary: GSoC project: Spatial Data Processing Library (was: Spatial Data Processing Library) >

[jira] [Commented] (FLINK-1543) Proper exception handling in actors

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320688#comment-14320688 ] ASF GitHub Bot commented on FLINK-1543: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-1543] Adds better exception handling in...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/394#discussion_r24693247 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/taskmanager/TaskManagerTest.java --- @@ -486,7 +489,8 @@ protected void run() {

[jira] [Commented] (FLINK-1176) Add operator for global reduce/aggregations

2015-02-13 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320664#comment-14320664 ] Gyula Fora commented on FLINK-1176: --- This feature amongst several others is introduced h

[jira] [Commented] (FLINK-1539) Runtime context not initialized when running streaming PojoExample

2015-02-13 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320659#comment-14320659 ] Gyula Fora commented on FLINK-1539: --- Fix: https://github.com/mbalassi/flink/commit/592a6

[GitHub] flink pull request: StreamWindow abstraction + modular window comp...

2015-02-13 Thread gyfora
GitHub user gyfora opened a pull request: https://github.com/apache/flink/pull/395 StreamWindow abstraction + modular window computations This PR introduces a rework to the current windowing semantics, by major API and Runtime improvements. The core new abstraction is the S

[jira] [Commented] (FLINK-1543) Proper exception handling in actors

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320633#comment-14320633 ] ASF GitHub Bot commented on FLINK-1543: --- Github user hsaputra commented on a diff in

[GitHub] flink pull request: [FLINK-1543] Adds better exception handling in...

2015-02-13 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/394#discussion_r24690375 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/taskmanager/TaskManagerTest.java --- @@ -486,7 +489,8 @@ protected void run() {

[jira] [Commented] (FLINK-1543) Proper exception handling in actors

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320621#comment-14320621 ] ASF GitHub Bot commented on FLINK-1543: --- Github user hsaputra commented on a diff in

[GitHub] flink pull request: [FLINK-1543] Adds better exception handling in...

2015-02-13 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/394#discussion_r24689680 --- Diff: flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java --- @@ -517,67 +521,83 @@ protected int list(String[] args) {

[jira] [Commented] (FLINK-1543) Proper exception handling in actors

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320620#comment-14320620 ] ASF GitHub Bot commented on FLINK-1543: --- Github user hsaputra commented on a diff in

[GitHub] flink pull request: [FLINK-1543] Adds better exception handling in...

2015-02-13 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/394#discussion_r24689710 --- Diff: flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java --- @@ -517,67 +521,83 @@ protected int list(String[] args) {

[GitHub] flink pull request: [FLINK-1543] Adds better exception handling in...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/394#issuecomment-74311404 +1 Nice work and a critical fix. Prevents the root actors from failing on user code problems. --- If your project is set up for it, you can reply to this email and ha

[jira] [Commented] (FLINK-1543) Proper exception handling in actors

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320615#comment-14320615 ] ASF GitHub Bot commented on FLINK-1543: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-1179) Add button to JobManager web interface to request stack trace of a TaskManager

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320610#comment-14320610 ] ASF GitHub Bot commented on FLINK-1179: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-1179] Add button to JobManager web inte...

2015-02-13 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/374#issuecomment-74310825 I'll probably merge this change tomorrow because I'm working on a bigger change on the web frontend. --- If your project is set up for it, you can reply to this email an

[jira] [Created] (FLINK-1544) Extend streaming aggregation tests to include POJOs

2015-02-13 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-1544: - Summary: Extend streaming aggregation tests to include POJOs Key: FLINK-1544 URL: https://issues.apache.org/jira/browse/FLINK-1544 Project: Flink Issue Type: Impro

[jira] [Assigned] (FLINK-1539) Runtime context not initialized when running streaming PojoExample

2015-02-13 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-1539: - Assignee: Gyula Fora (was: Márton Balassi) > Runtime context not initialized when running stream

[jira] [Commented] (FLINK-1543) Proper exception handling in actors

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320451#comment-14320451 ] ASF GitHub Bot commented on FLINK-1543: --- GitHub user tillrohrmann opened a pull requ

[GitHub] flink pull request: [FLINK-1543] Adds better exception handling in...

2015-02-13 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/394 [FLINK-1543] Adds better exception handling in actors Adds try and catch blocks around exception throwing methods in the JobManager and TaskManager. This PR is based on #384. You can merge this

[jira] [Commented] (FLINK-1417) Automatically register nested types at Kryo

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320437#comment-14320437 ] ASF GitHub Bot commented on FLINK-1417: --- GitHub user rmetzger opened a pull request:

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-13 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/393 [FLINK-1417] Automatically register types with Kryo This pull request also contains code from old pull requests for FLINK-1391, FLINK-1392, FLINK-1395. You can merge this pull request into a

[GitHub] flink pull request: [FLINK-1508] Removes AkkaUtil.ask

2015-02-13 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/384#issuecomment-74289063 I'll merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[jira] [Commented] (FLINK-1508) Remove AkkaUtils.ask to encourage explicit future handling

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320392#comment-14320392 ] ASF GitHub Bot commented on FLINK-1508: --- Github user tillrohrmann commented on the p

[jira] [Commented] (FLINK-1542) Test case at BlobUtilsTest should not assume user could not create new item in root directory

2015-02-13 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320384#comment-14320384 ] Henry Saputra commented on FLINK-1542: -- Per discussion in dev list: How about constr

[jira] [Assigned] (FLINK-1542) Test case at BlobUtilsTest should not assume user could not create new item in root directory

2015-02-13 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra reassigned FLINK-1542: Assignee: Henry Saputra > Test case at BlobUtilsTest should not assume user could not creat

[jira] [Commented] (FLINK-1520) Read edges and vertices from CSV files

2015-02-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320365#comment-14320365 ] Robert Metzger commented on FLINK-1520: --- Hey [~cebe], I've just checked the JIRA per

[jira] [Created] (FLINK-1543) Proper exception handling in actors

2015-02-13 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1543: Summary: Proper exception handling in actors Key: FLINK-1543 URL: https://issues.apache.org/jira/browse/FLINK-1543 Project: Flink Issue Type: Improvement

[jira] [Resolved] (FLINK-1529) Improve JobManager startup robustness

2015-02-13 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-1529. - Resolution: Fixed Fixed in 1dafd810b7fc185a85d2e8b7666a2b8ab28d7787 > Improve JobManager startup

[jira] [Resolved] (FLINK-1532) AggregatorsITCase fails spuriously

2015-02-13 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-1532. - Resolution: Fixed Fix Version/s: 0.9 Assignee: Stephan Ewen Fixed in 0a22b71c88774

[jira] [Commented] (FLINK-1529) Improve JobManager startup robustness

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320358#comment-14320358 ] ASF GitHub Bot commented on FLINK-1529: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-1529] [jobmanager] Improve error handli...

2015-02-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/385 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Created] (FLINK-1542) Test case at BlobUtilsTest should not assume user could not create new item in root directory

2015-02-13 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1542: Summary: Test case at BlobUtilsTest should not assume user could not create new item in root directory Key: FLINK-1542 URL: https://issues.apache.org/jira/browse/FLINK-1542

[jira] [Updated] (FLINK-1541) GSoC project: Distributed profiling

2015-02-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-1541: - Issue Type: New Feature (was: Improvement) > GSoC project: Distributed profiling > --

[jira] [Updated] (FLINK-1537) GSoC project: Machine learning with Apache Flink

2015-02-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-1537: - Issue Type: New Feature (was: Improvement) > GSoC project: Machine learning with Apache Flink > -

[jira] [Created] (FLINK-1540) JobManagerFailsITCase Startup timed out on travis

2015-02-13 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1540: - Summary: JobManagerFailsITCase Startup timed out on travis Key: FLINK-1540 URL: https://issues.apache.org/jira/browse/FLINK-1540 Project: Flink Issue Type:

[jira] [Created] (FLINK-1541) GSoC project: Distributed profiling

2015-02-13 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1541: Summary: GSoC project: Distributed profiling Key: FLINK-1541 URL: https://issues.apache.org/jira/browse/FLINK-1541 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-1539) Runtime context not initialized when running streaming PojoExample

2015-02-13 Thread JIRA
Márton Balassi created FLINK-1539: - Summary: Runtime context not initialized when running streaming PojoExample Key: FLINK-1539 URL: https://issues.apache.org/jira/browse/FLINK-1539 Project: Flink

[jira] [Created] (FLINK-1538) Spatial Data Processing Library

2015-02-13 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1538: Summary: Spatial Data Processing Library Key: FLINK-1538 URL: https://issues.apache.org/jira/browse/FLINK-1538 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-1537) GSoC project: Machine learning with Apache Flink

2015-02-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-1537: - Priority: Minor (was: Major) > GSoC project: Machine learning with Apache Flink > ---

[jira] [Closed] (FLINK-1517) Modify inputiterator for streaming so the channel index of the last record is accessible

2015-02-13 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márton Balassi closed FLINK-1517. - Resolution: Fixed Implemented via cba7866 > Modify inputiterator for streaming so the channel ind

[jira] [Created] (FLINK-1537) GSoC project: Machine learning with Apache Flink

2015-02-13 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1537: Summary: GSoC project: Machine learning with Apache Flink Key: FLINK-1537 URL: https://issues.apache.org/jira/browse/FLINK-1537 Project: Flink Issue Type: Im

[jira] [Commented] (FLINK-785) Add Chained operators for AllReduce and AllGroupReduce

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320023#comment-14320023 ] ASF GitHub Bot commented on FLINK-785: -- Github user StephanEwen commented on the pull

[GitHub] flink pull request: [FLINK-785] Chained AllReduce / AllGroupReduce...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/370#issuecomment-74247815 Then it is worse then the chained variant, because you save nothing and need buffer space. The chained variant forwards records/fragments as they are produces. --- I

[jira] [Commented] (FLINK-785) Add Chained operators for AllReduce and AllGroupReduce

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320017#comment-14320017 ] ASF GitHub Bot commented on FLINK-785: -- Github user zentol commented on the pull reque

[GitHub] flink pull request: [FLINK-785] Chained AllReduce / AllGroupReduce...

2015-02-13 Thread zentol
Github user zentol commented on the pull request: https://github.com/apache/flink/pull/370#issuecomment-74247290 i know, so could we not do the same, except skipping the sorting part. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] flink pull request: [FLINK-785] Chained AllReduce / AllGroupReduce...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/370#issuecomment-74247098 The synchronous combine driver stores them in the sort buffer in serialized fashion, which is save. --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-785) Add Chained operators for AllReduce and AllGroupReduce

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320013#comment-14320013 ] ASF GitHub Bot commented on FLINK-785: -- Github user StephanEwen commented on the pull

[GitHub] flink pull request: [FLINK-785] Chained AllReduce / AllGroupReduce...

2015-02-13 Thread zentol
Github user zentol commented on the pull request: https://github.com/apache/flink/pull/370#issuecomment-74240805 the SynchronouesChainedCombineDriver stores multiple records as well doesn't it? except up to a fixed size instead of # of elements. could we not do the same here? --- If

[jira] [Commented] (FLINK-785) Add Chained operators for AllReduce and AllGroupReduce

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319971#comment-14319971 ] ASF GitHub Bot commented on FLINK-785: -- Github user zentol commented on the pull reque

[jira] [Updated] (FLINK-1520) Read edges and vertices from CSV files

2015-02-13 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasia Kalavri updated FLINK-1520: - Assignee: Carsten Brandt > Read edges and vertices from CSV files > --

[jira] [Commented] (FLINK-1520) Read edges and vertices from CSV files

2015-02-13 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319970#comment-14319970 ] Vasia Kalavri commented on FLINK-1520: -- Perfect! It's all yours :) > Read edges and

[GitHub] flink pull request: [FLINK-1508] Removes AkkaUtil.ask

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/384#issuecomment-74240301 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Commented] (FLINK-1508) Remove AkkaUtils.ask to encourage explicit future handling

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319969#comment-14319969 ] ASF GitHub Bot commented on FLINK-1508: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-1532) AggregatorsITCase fails spuriously

2015-02-13 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319966#comment-14319966 ] Stephan Ewen commented on FLINK-1532: - There is a random element in the program that g

[jira] [Commented] (FLINK-1520) Read edges and vertices from CSV files

2015-02-13 Thread Carsten Brandt (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319956#comment-14319956 ] Carsten Brandt commented on FLINK-1520: --- [~vkalavri] you can assign me to this, will

[jira] [Commented] (FLINK-1521) Some Chained Drivers do not respect object-reuse/non-reuse flag

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319949#comment-14319949 ] ASF GitHub Bot commented on FLINK-1521: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-1521] Chained operators respect reuse

2015-02-13 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/392#issuecomment-74237302 I agree with Stephan to not copy records for chained mappers. However, we should clearly document the behavior of the different modes or at least the behavior of the de

[jira] [Commented] (FLINK-1529) Improve JobManager startup robustness

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319943#comment-14319943 ] ASF GitHub Bot commented on FLINK-1529: --- Github user tillrohrmann commented on the p

[jira] [Commented] (FLINK-1529) Improve JobManager startup robustness

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319944#comment-14319944 ] ASF GitHub Bot commented on FLINK-1529: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-1529] [jobmanager] Improve error handli...

2015-02-13 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/385#issuecomment-74236977 I think you have to add ```archive ! PoisonPill``` to the ```postStop``` method of the JobManager to shutdown the archive actor. --- If your project is set up for it

[GitHub] flink pull request: [FLINK-1529] [jobmanager] Improve error handli...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/385#discussion_r24657012 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -530,54 +515,109 @@ Actor with ActorLogMessages with Ac

[jira] [Commented] (FLINK-785) Add Chained operators for AllReduce and AllGroupReduce

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319940#comment-14319940 ] ASF GitHub Bot commented on FLINK-785: -- Github user StephanEwen commented on the pull

[GitHub] flink pull request: [FLINK-785] Chained AllReduce / AllGroupReduce...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/370#issuecomment-74236667 The chained reducer variant makes more sense. The question is, what is cheaper - serialized exchange through the in-mem-channel, or the copying. My gut feeling is that

[jira] [Commented] (FLINK-785) Add Chained operators for AllReduce and AllGroupReduce

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319938#comment-14319938 ] ASF GitHub Bot commented on FLINK-785: -- Github user StephanEwen commented on the pull

[GitHub] flink pull request: [FLINK-785] Chained AllReduce / AllGroupReduce...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/370#issuecomment-74236482 I think for the combiner, we cannot do this. The way it is done here easily blows up the memory, by collecting so many records. Bear in mind that a record is not neces

[jira] [Commented] (FLINK-1529) Improve JobManager startup robustness

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319844#comment-14319844 ] ASF GitHub Bot commented on FLINK-1529: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-1529] [jobmanager] Improve error handli...

2015-02-13 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/385#discussion_r24655790 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -530,54 +515,109 @@ Actor with ActorLogMessages with A

[jira] [Commented] (FLINK-1521) Some Chained Drivers do not respect object-reuse/non-reuse flag

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319842#comment-14319842 ] ASF GitHub Bot commented on FLINK-1521: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-1521] Chained operators respect reuse

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/392#issuecomment-74234126 While this change makes it technically more correct, I think it will have a massive negative impact on performance. Nobody can be expected to turn on the object reuse

[jira] [Commented] (FLINK-1531) Custom Kryo Serializer fails in itertation scenario

2015-02-13 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319835#comment-14319835 ] Stephan Ewen commented on FLINK-1531: - [~jkirsch] Exceptions are used rarely, only at

[jira] [Commented] (FLINK-1529) Improve JobManager startup robustness

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319813#comment-14319813 ] ASF GitHub Bot commented on FLINK-1529: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1529) Improve JobManager startup robustness

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319810#comment-14319810 ] ASF GitHub Bot commented on FLINK-1529: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-1529] [jobmanager] Improve error handli...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/385#discussion_r24653930 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -530,54 +515,109 @@ Actor with ActorLogMessages with Ac

[GitHub] flink pull request: [FLINK-1529] [jobmanager] Improve error handli...

2015-02-13 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/385#discussion_r24653915 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -530,54 +515,109 @@ Actor with ActorLogMessages with Ac

[jira] [Commented] (FLINK-1508) Remove AkkaUtils.ask to encourage explicit future handling

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319754#comment-14319754 ] ASF GitHub Bot commented on FLINK-1508: --- Github user uce commented on the pull reque

[GitHub] flink pull request: [FLINK-1508] Removes AkkaUtil.ask

2015-02-13 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/384#issuecomment-74222367 Looks good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[jira] [Updated] (FLINK-1483) Temporary channel files are not properly deleted when Flink is terminated

2015-02-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1483: -- Component/s: TaskManager > Temporary channel files are not properly deleted when Flink is termin

[jira] [Updated] (FLINK-1483) Temporary channel files are not properly deleted when Flink is terminated

2015-02-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1483: -- Affects Version/s: 0.9 0.8 > Temporary channel files are not properly del

[jira] [Resolved] (FLINK-1339) Adding a latest symbolic link to current doc version

2015-02-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1339. --- Resolution: Fixed Assignee: Ufuk Celebi Resolved in http://svn.apache.org/r1657113. > A

[jira] [Commented] (FLINK-1444) Add data properties for data sources

2015-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319731#comment-14319731 ] ASF GitHub Bot commented on FLINK-1444: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-1444][api-extending] Add support for sp...

2015-02-13 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/379#issuecomment-74219481 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena