[jira] [Commented] (FLINK-2997) Support range partition with user customized data distribution.

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188787#comment-15188787 ] ASF GitHub Bot commented on FLINK-2997: --- Github user ChengXiangLi commented on the p

[GitHub] flink pull request: [FLINK-2997] Support range partition with user...

2016-03-09 Thread ChengXiangLi
Github user ChengXiangLi commented on the pull request: https://github.com/apache/flink/pull/1776#issuecomment-194697700 Just a minor comment, mostly looks good to me. @fhueske , do you want to take a look at this PR? --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-2997) Support range partition with user customized data distribution.

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188785#comment-15188785 ] ASF GitHub Bot commented on FLINK-2997: --- Github user ChengXiangLi commented on a dif

[GitHub] flink pull request: [FLINK-2997] Support range partition with user...

2016-03-09 Thread ChengXiangLi
Github user ChengXiangLi commented on a diff in the pull request: https://github.com/apache/flink/pull/1776#discussion_r55639603 --- Diff: flink-tests/src/test/java/org/apache/flink/test/javaApiOperators/CustomDistributionITCase.java --- @@ -0,0 +1,137 @@ +/* + * Licensed

[jira] [Commented] (FLINK-3589) Allow setting Operator parallelism to default value

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187859#comment-15187859 ] ASF GitHub Bot commented on FLINK-3589: --- GitHub user greghogan opened a pull request

[jira] [Commented] (FLINK-3589) Allow setting Operator parallelism to default value

2016-03-09 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187857#comment-15187857 ] Greg Hogan commented on FLINK-3589: --- I had a go at implementing this across the codebase

[GitHub] flink pull request: [FLINK-3589] Allow setting Operator parallelis...

2016-03-09 Thread greghogan
GitHub user greghogan opened a pull request: https://github.com/apache/flink/pull/1778 [FLINK-3589] Allow setting Operator parallelism to default value Adds the public field ExecutionConfig.PARALLELISM_UNKNOWN as a flag value to indicate that the default parallelism should be use

[jira] [Created] (FLINK-3597) Table API operator names should reflect relational expression

2016-03-09 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3597: Summary: Table API operator names should reflect relational expression Key: FLINK-3597 URL: https://issues.apache.org/jira/browse/FLINK-3597 Project: Flink

[jira] [Commented] (FLINK-1707) Add an Affinity Propagation Library Method

2016-03-09 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187494#comment-15187494 ] Josep Rubió commented on FLINK-1707: Thanks Vasia! I'll try to start with the impleme

[GitHub] flink pull request: [FLINK-3322] MemoryManager creates too much GC...

2016-03-09 Thread Xazax-hun
Github user Xazax-hun commented on the pull request: https://github.com/apache/flink/pull/1769#issuecomment-194419456 I think the soft references solution is not worth investigating, and I agree that the best way to solve the problem is to make the operators smarter for the iterative

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187493#comment-15187493 ] ASF GitHub Bot commented on FLINK-3322: --- Github user Xazax-hun commented on the pull

[jira] [Commented] (FLINK-3596) DataSet RelNode refactoring

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187358#comment-15187358 ] ASF GitHub Bot commented on FLINK-3596: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-3596] DataSet RelNode refactoring

2016-03-09 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1777#discussion_r55546208 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/nodes/dataset/DataSetCalc.scala --- @@ -0,0 +1,165 @@ +/* + * Li

[GitHub] flink pull request: [FLINK-3596] DataSet RelNode refactoring

2016-03-09 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1777#discussion_r55545944 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/nodes/dataset/DataSetCalc.scala --- @@ -0,0 +1,165 @@ +/* + * Li

[jira] [Commented] (FLINK-3596) DataSet RelNode refactoring

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187355#comment-15187355 ] ASF GitHub Bot commented on FLINK-3596: --- Github user fhueske commented on a diff in

[jira] [Commented] (FLINK-3596) DataSet RelNode refactoring

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187351#comment-15187351 ] ASF GitHub Bot commented on FLINK-3596: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-3596] DataSet RelNode refactoring

2016-03-09 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1777#discussion_r55545155 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/nodes/dataset/DataSetAggregate.scala --- @@ -69,37 +72,55 @@ class DataS

[GitHub] flink pull request: [FLINK-3596] DataSet RelNode refactoring

2016-03-09 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1777#discussion_r55544962 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/nodes/dataset/DataSetAggregate.scala --- @@ -69,37 +72,55 @@ class DataS

[jira] [Commented] (FLINK-3596) DataSet RelNode refactoring

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187349#comment-15187349 ] ASF GitHub Bot commented on FLINK-3596: --- Github user fhueske commented on a diff in

[jira] [Updated] (FLINK-3594) Unstable KafkaConsumerTestBase

2016-03-09 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-3594: Labels: test-stability (was: ) > Unstable KafkaConsumerTestBase > -

[GitHub] flink pull request: [FLINK-3596] DataSet RelNode refactoring

2016-03-09 Thread vasia
GitHub user vasia opened a pull request: https://github.com/apache/flink/pull/1777 [FLINK-3596] DataSet RelNode refactoring This PR refactors the current table API code so that - the intermediate flink relnode layer and the dataset rules are removed - code generation is

[jira] [Commented] (FLINK-3596) DataSet RelNode refactoring

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187179#comment-15187179 ] ASF GitHub Bot commented on FLINK-3596: --- GitHub user vasia opened a pull request:

[jira] [Created] (FLINK-3596) DataSet RelNode refactoring

2016-03-09 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-3596: Summary: DataSet RelNode refactoring Key: FLINK-3596 URL: https://issues.apache.org/jira/browse/FLINK-3596 Project: Flink Issue Type: Improvement C

[jira] [Commented] (FLINK-2997) Support range partition with user customized data distribution.

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187129#comment-15187129 ] ASF GitHub Bot commented on FLINK-2997: --- Github user gallenvara commented on the pul

[GitHub] flink pull request: [FLINK-2997] Support range partition with user...

2016-03-09 Thread gallenvara
Github user gallenvara commented on the pull request: https://github.com/apache/flink/pull/1776#issuecomment-194310643 @fhueske @ChengXiangLi Can you please help me with review work? The error of CI build failure is not relevant. --- If your project is set up for it, you can reply t

[jira] [Updated] (FLINK-3595) Kafka09 consumer thread does not interrupt when stuck in record emission

2016-03-09 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-3595: Assignee: Ufuk Celebi (was: Stephan Ewen) > Kafka09 consumer thread does not interrupt when stuck i

[jira] [Commented] (FLINK-3595) Kafka09 consumer thread does not interrupt when stuck in record emission

2016-03-09 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187094#comment-15187094 ] Stephan Ewen commented on FLINK-3595: - Had a discussion with [~uce], the second option

[jira] [Created] (FLINK-3595) Kafka09 consumer thread does not interrupt when stuck in record emission

2016-03-09 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3595: --- Summary: Kafka09 consumer thread does not interrupt when stuck in record emission Key: FLINK-3595 URL: https://issues.apache.org/jira/browse/FLINK-3595 Project: Flink

[jira] [Commented] (FLINK-3311) Add a connector for streaming data into Cassandra

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187082#comment-15187082 ] ASF GitHub Bot commented on FLINK-3311: --- Github user alkagin commented on the pull r

[GitHub] flink pull request: [FLINK-3311/FLINK-3332] Add Cassandra connecto...

2016-03-09 Thread alkagin
Github user alkagin commented on the pull request: https://github.com/apache/flink/pull/1771#issuecomment-194294832 Great work :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[jira] [Commented] (FLINK-3444) env.fromElements relies on the first input element for determining the DataSet/DataStream type

2016-03-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186975#comment-15186975 ] Maximilian Michels commented on FLINK-3444: --- +1 > env.fromElements relies on th

[jira] [Commented] (FLINK-3589) Allow setting Operator parallelism to default value

2016-03-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186973#comment-15186973 ] Maximilian Michels commented on FLINK-3589: --- I guess the main issue is that the

[jira] [Commented] (FLINK-3207) Add a Pregel iteration abstraction to Gelly

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186970#comment-15186970 ] ASF GitHub Bot commented on FLINK-3207: --- Github user s1ck commented on the pull requ

[GitHub] flink pull request: [FLINK-3207] [gelly] adds the vertex-centric i...

2016-03-09 Thread s1ck
Github user s1ck commented on the pull request: https://github.com/apache/flink/pull/1575#issuecomment-194251517 Ok, I will keep that in mind. Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] flink pull request: [FLINK-3322] MemoryManager creates too much GC...

2016-03-09 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1769#issuecomment-194250033 I think the right way to solve that would actually not be in the MemoryManager (to cache), but in the operators that know that they will need the memory again and ag

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186966#comment-15186966 ] ASF GitHub Bot commented on FLINK-3322: --- Github user StephanEwen commented on the pu

[jira] [Closed] (FLINK-3396) Job submission Savepoint restore logic flawed

2016-03-09 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-3396. -- Resolution: Fixed Fix Version/s: (was: 1.0.0) 1.1.0 Fixed in cdc8f0a (mast

[jira] [Commented] (FLINK-3396) Job submission Savepoint restore logic flawed

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186961#comment-15186961 ] ASF GitHub Bot commented on FLINK-3396: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-3396] [runtime] Suppress job restart if...

2016-03-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1657 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (FLINK-3594) Unstable KafkaConsumerTestBase

2016-03-09 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-3594: --- Summary: Unstable KafkaConsumerTestBase Key: FLINK-3594 URL: https://issues.apache.org/jira/browse/FLINK-3594 Project: Flink Issue Type: Bug

[GitHub] flink pull request: [FLINK-3207] [gelly] adds the vertex-centric i...

2016-03-09 Thread vasia
Github user vasia commented on the pull request: https://github.com/apache/flink/pull/1575#issuecomment-194236417 Hey @s1ck, thanks a lot for the thorough review! I will address your comments in the following days. The PR is quite old and needs a rebase, too. For future reviews

[jira] [Commented] (FLINK-3207) Add a Pregel iteration abstraction to Gelly

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186936#comment-15186936 ] ASF GitHub Bot commented on FLINK-3207: --- Github user vasia commented on the pull req

[jira] [Commented] (FLINK-3579) Improve String concatenation

2016-03-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186929#comment-15186929 ] ramkrishna.s.vasudevan commented on FLINK-3579: --- [~twalthr] Once I analyse t

[jira] [Commented] (FLINK-3574) Implement math functions for Table API

2016-03-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186912#comment-15186912 ] ASF GitHub Bot commented on FLINK-3574: --- Github user zentol commented on a diff in t

[GitHub] flink pull request: [FLINK-3574] Implement math functions for Tabl...

2016-03-09 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/1775#discussion_r55497175 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/expressions/call.scala --- @@ -61,3 +70,11 @@ object BuiltInFunctionConstants