[jira] [Created] (FLINK-7686) Add Flink Forward Berlin 2017 conference slides to the flink website

[Hai Zhou_UTC+8 (JIRA)]

Hai Zhou_UTC+8 created FLINK-7686:
-

 Summary: Add Flink Forward Berlin 2017 conference slides to the 
flink website
 Key: FLINK-7686
 URL: https://issues.apache.org/jira/browse/FLINK-7686
 Project: Flink
  Issue Type: Wish
Reporter: Hai Zhou_UTC+8
Priority: Trivial


I recently watched [Flink Forward Berlin 
2017|https://berlin.flink-forward.org/sessions/] conference slides, the content 
is very good.  
I think we should add them to the [flink 
website|http://flink.apache.org/community.html] for more people to know.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Comment Edited] (FLINK-3827) Flink modules include unused dependencies

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-3827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178648#comment-16178648
 ] 

Hai Zhou_UTC+8 edited comment on FLINK-3827 at 9/25/17 7:15 AM:


Hey [~till.rohrmann],  I found only verified by _mvn dependency: analyze_ and 
unit tests is unreliable.

For some of my submitted PR, I will rebuild flink and run test job to see if 
there are any exceptions.

If I feel no problem after check, I will tell you and please you to review. :)


was (Author: yew1eb):
Hey [~till.rohrmann],  I found only verified by _mvn dependency: analyze_ and 
unit tests is unreliable.

For some of my submitted PR, I will rebuild flink and run test job to see if 
there are any exceptions.

If I feel no problem after check, I will tell you and please you to review the 
PR. :)

> Flink modules include unused dependencies
> -
>
> Key: FLINK-3827
> URL: https://issues.apache.org/jira/browse/FLINK-3827
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Affects Versions: 1.1.0
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>
> A quick look via {{mvn dependency:analyze}} revealed that many Flink modules 
> include dependencies which they don't really need. We should fix this for the 
> next {{1.1}} release.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Comment Edited] (FLINK-3827) Flink modules include unused dependencies

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-3827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178648#comment-16178648
 ] 

Hai Zhou_UTC+8 edited comment on FLINK-3827 at 9/25/17 7:14 AM:


Hey [~till.rohrmann],  I found only verified by _mvn dependency: analyze_ and 
unit tests is unreliable.

For some of my submitted PR, I will rebuild flink and run test job to see if 
there are any exceptions.

If I feel no problem after check, I will tell you and please you to review the 
PR. :)


was (Author: yew1eb):
Hey [~till.rohrmann],  I found that only via _mvn dependency:analyze_ detection 
unreliable.
For some of my submitted PR, I will rebuild flink and run test job to see if 
there are any exceptions.

If I feel no problem after check, I will tell you and please you to review the 
PR. :)

> Flink modules include unused dependencies
> -
>
> Key: FLINK-3827
> URL: https://issues.apache.org/jira/browse/FLINK-3827
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Affects Versions: 1.1.0
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>
> A quick look via {{mvn dependency:analyze}} revealed that many Flink modules 
> include dependencies which they don't really need. We should fix this for the 
> next {{1.1}} release.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-3827) Flink modules include unused dependencies

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-3827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178648#comment-16178648
 ] 

Hai Zhou_UTC+8 commented on FLINK-3827:
---

Hey [~till.rohrmann],  I found that only via _mvn dependency:analyze_ detection 
unreliable.
For some of my submitted PR, I will rebuild flink and run test job to see if 
there are any exceptions.

If I feel no problem after check, I will tell you and please you to review the 
PR. :)

> Flink modules include unused dependencies
> -
>
> Key: FLINK-3827
> URL: https://issues.apache.org/jira/browse/FLINK-3827
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Affects Versions: 1.1.0
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>
> A quick look via {{mvn dependency:analyze}} revealed that many Flink modules 
> include dependencies which they don't really need. We should fix this for the 
> next {{1.1}} release.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-3829) flink-java

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178487#comment-16178487
 ] 

Hai Zhou_UTC+8 commented on FLINK-3829:
---

Ha ha, [~mingleizhang] you are interesting, I am very happy to work with you.

Peace,
Rice

> flink-java
> --
>
> Key: FLINK-3829
> URL: https://issues.apache.org/jira/browse/FLINK-3829
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>
> {noformat}
> [WARNING] Used undeclared dependencies found:
> [WARNING]com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
> [WARNING]commons-cli:commons-cli:jar:1.3.1:compile
> [WARNING]org.apache.flink:flink-metrics-core:jar:1.4-SNAPSHOT:compile
> [WARNING]org.hamcrest:hamcrest-core:jar:1.3:test
> [WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
> [WARNING] Unused declared dependencies found:
> [WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
> [WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
> [WARNING]com.google.code.findbugs:jsr305:jar:1.3.9:compile
> [WARNING]log4j:log4j:jar:1.2.17:test
> [WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
> [WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
> [WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-3829) flink-java

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178480#comment-16178480
 ] 

Hai Zhou_UTC+8 commented on FLINK-3829:
---

[~mingleizhang], Thank you very much, can you tell me why you are so angry.;)

from now on, I will correct my bad behavior.

BTW, in issue [FLINK-6444], We should discuss first, instead of directly modify 
the issue assigned to their own.  you are familiar with the apache way, maybe 
you should be friendly to newbie.:D

Best,
Hai Zhou

> flink-java
> --
>
> Key: FLINK-3829
> URL: https://issues.apache.org/jira/browse/FLINK-3829
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>
> {noformat}
> [WARNING] Used undeclared dependencies found:
> [WARNING]com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
> [WARNING]commons-cli:commons-cli:jar:1.3.1:compile
> [WARNING]org.apache.flink:flink-metrics-core:jar:1.4-SNAPSHOT:compile
> [WARNING]org.hamcrest:hamcrest-core:jar:1.3:test
> [WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
> [WARNING] Unused declared dependencies found:
> [WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
> [WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
> [WARNING]com.google.code.findbugs:jsr305:jar:1.3.9:compile
> [WARNING]log4j:log4j:jar:1.2.17:test
> [WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
> [WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
> [WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-3829) flink-java

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178454#comment-16178454
 ] 

Hai Zhou_UTC+8 commented on FLINK-3829:
---

[~mingleizhang], I do not know what to say:P

Long ago, this issue's parent issue[FLINK-3827] assigned to me. If you love 
this issue, Maybe we'll talk first.;)

or you can create and fix other modules eg. flink-yarn, flink-yarn-tests, 
flink-metrics...

Best, 
Hai Zhou


> flink-java
> --
>
> Key: FLINK-3829
> URL: https://issues.apache.org/jira/browse/FLINK-3829
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>
> {noformat}
> [WARNING] Used undeclared dependencies found:
> [WARNING]com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
> [WARNING]commons-cli:commons-cli:jar:1.3.1:compile
> [WARNING]org.apache.flink:flink-metrics-core:jar:1.4-SNAPSHOT:compile
> [WARNING]org.hamcrest:hamcrest-core:jar:1.3:test
> [WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
> [WARNING] Unused declared dependencies found:
> [WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
> [WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
> [WARNING]com.google.code.findbugs:jsr305:jar:1.3.9:compile
> [WARNING]log4j:log4j:jar:1.2.17:test
> [WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
> [WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
> [WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (FLINK-3832) flink-streaming-scala

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 updated FLINK-3832:
--
Description: 
[INFO] --- maven-dependency-plugin:2.10:analyze (default-cli) @ 
flink-streaming-scala_2.11 ---
[WARNING] Used undeclared dependencies found:
[WARNING]org.apache.flink:flink-core:jar:1.4-SNAPSHOT:compile
[WARNING]com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
[WARNING]org.apache.flink:flink-test-utils-junit:jar:1.4-SNAPSHOT:test
[WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
[WARNING]org.apache.flink:flink-runtime_2.11:jar:1.4-SNAPSHOT:compile
[WARNING]org.apache.flink:flink-java:jar:1.4-SNAPSHOT:compile
[WARNING] Unused declared dependencies found:
[WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
[WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
[WARNING]com.google.code.findbugs:jsr305:jar:1.3.9:compile
[WARNING]log4j:log4j:jar:1.2.17:test
[WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
[WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test
[WARNING]org.scala-lang:scala-compiler:jar:2.11.11:compile
[WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
[WARNING]org.mockito:mockito-all:jar:1.10.19:test
[WARNING]org.scala-lang:scala-reflect:jar:2.11.11:compile
[WARNING]org.slf4j:slf4j-api:jar:1.7.7:compile
[WARNING]
org.apache.flink:flink-runtime_2.11:test-jar:tests:1.4-SNAPSHOT:test


> flink-streaming-scala
> -
>
> Key: FLINK-3832
> URL: https://issues.apache.org/jira/browse/FLINK-3832
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>
> [INFO] --- maven-dependency-plugin:2.10:analyze (default-cli) @ 
> flink-streaming-scala_2.11 ---
> [WARNING] Used undeclared dependencies found:
> [WARNING]org.apache.flink:flink-core:jar:1.4-SNAPSHOT:compile
> [WARNING]com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
> [WARNING]org.apache.flink:flink-test-utils-junit:jar:1.4-SNAPSHOT:test
> [WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
> [WARNING]org.apache.flink:flink-runtime_2.11:jar:1.4-SNAPSHOT:compile
> [WARNING]org.apache.flink:flink-java:jar:1.4-SNAPSHOT:compile
> [WARNING] Unused declared dependencies found:
> [WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
> [WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
> [WARNING]com.google.code.findbugs:jsr305:jar:1.3.9:compile
> [WARNING]log4j:log4j:jar:1.2.17:test
> [WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
> [WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test
> [WARNING]org.scala-lang:scala-compiler:jar:2.11.11:compile
> [WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
> [WARNING]org.mockito:mockito-all:jar:1.10.19:test
> [WARNING]org.scala-lang:scala-reflect:jar:2.11.11:compile
> [WARNING]org.slf4j:slf4j-api:jar:1.7.7:compile
> [WARNING]
> org.apache.flink:flink-runtime_2.11:test-jar:tests:1.4-SNAPSHOT:test



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (FLINK-3833) flink-test-utils

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 updated FLINK-3833:
--
Description: 
[INFO] --- maven-dependency-plugin:2.10:analyze (default-cli) @ 
flink-test-utils_2.11 ---
[WARNING] Used undeclared dependencies found:
[WARNING]org.apache.flink:flink-core:jar:1.4-SNAPSHOT:compile
[WARNING]org.apache.flink:flink-shaded-hadoop2:jar:1.4-SNAPSHOT:compile
[WARNING]io.netty:netty:jar:3.8.0.Final:compile
[WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
[WARNING]org.scala-lang:scala-library:jar:2.11.11:compile
[WARNING]commons-io:commons-io:jar:2.4:compile
[WARNING]com.data-artisans:flakka-actor_2.11:jar:2.3-custom:compile
[WARNING]org.apache.flink:flink-shaded-netty:jar:4.0.27.Final-1.0:compile
[WARNING]org.apache.flink:flink-optimizer_2.11:jar:1.4-SNAPSHOT:compile
[WARNING]org.apache.flink:flink-java:jar:1.4-SNAPSHOT:compile
[WARNING] Unused declared dependencies found:
[WARNING]org.apache.flink:flink-clients_2.11:jar:1.4-SNAPSHOT:compile
[WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
[WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
[WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
[WARNING]log4j:log4j:jar:1.2.17:test
[WARNING]org.mockito:mockito-all:jar:1.10.19:test
[WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
[WARNING]org.apache.curator:curator-test:jar:2.12.0:compile
[WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test


> flink-test-utils
> 
>
> Key: FLINK-3833
> URL: https://issues.apache.org/jira/browse/FLINK-3833
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>
> [INFO] --- maven-dependency-plugin:2.10:analyze (default-cli) @ 
> flink-test-utils_2.11 ---
> [WARNING] Used undeclared dependencies found:
> [WARNING]org.apache.flink:flink-core:jar:1.4-SNAPSHOT:compile
> [WARNING]org.apache.flink:flink-shaded-hadoop2:jar:1.4-SNAPSHOT:compile
> [WARNING]io.netty:netty:jar:3.8.0.Final:compile
> [WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
> [WARNING]org.scala-lang:scala-library:jar:2.11.11:compile
> [WARNING]commons-io:commons-io:jar:2.4:compile
> [WARNING]com.data-artisans:flakka-actor_2.11:jar:2.3-custom:compile
> [WARNING]org.apache.flink:flink-shaded-netty:jar:4.0.27.Final-1.0:compile
> [WARNING]org.apache.flink:flink-optimizer_2.11:jar:1.4-SNAPSHOT:compile
> [WARNING]org.apache.flink:flink-java:jar:1.4-SNAPSHOT:compile
> [WARNING] Unused declared dependencies found:
> [WARNING]org.apache.flink:flink-clients_2.11:jar:1.4-SNAPSHOT:compile
> [WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
> [WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
> [WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
> [WARNING]log4j:log4j:jar:1.2.17:test
> [WARNING]org.mockito:mockito-all:jar:1.10.19:test
> [WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
> [WARNING]org.apache.curator:curator-test:jar:2.12.0:compile
> [WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (FLINK-3830) flink-scala

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 updated FLINK-3830:
--
Description: 
[INFO] --- maven-dependency-plugin:2.10:analyze (default-cli) @ 
flink-scala_2.11 ---
[WARNING] Used undeclared dependencies found:
[WARNING]org.apache.flink:flink-metrics-core:jar:1.4-SNAPSHOT:compile
[WARNING]org.apache.flink:flink-shaded-hadoop2:jar:1.4-SNAPSHOT:compile
[WARNING]org.apache.flink:flink-test-utils-junit:jar:1.4-SNAPSHOT:test
[WARNING]com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
[WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
[WARNING]org.apache.commons:commons-lang3:jar:3.3.2:compile
[WARNING] Unused declared dependencies found:
[WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
[WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
[WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
[WARNING]com.google.code.findbugs:jsr305:jar:1.3.9:compile
[WARNING]log4j:log4j:jar:1.2.17:test
[WARNING]org.mockito:mockito-all:jar:1.10.19:test
[WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
[WARNING]
org.apache.flink:flink-test-utils_2.11:test-jar:tests:1.4-SNAPSHOT:test
[WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test


> flink-scala
> ---
>
> Key: FLINK-3830
> URL: https://issues.apache.org/jira/browse/FLINK-3830
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>
> [INFO] --- maven-dependency-plugin:2.10:analyze (default-cli) @ 
> flink-scala_2.11 ---
> [WARNING] Used undeclared dependencies found:
> [WARNING]org.apache.flink:flink-metrics-core:jar:1.4-SNAPSHOT:compile
> [WARNING]org.apache.flink:flink-shaded-hadoop2:jar:1.4-SNAPSHOT:compile
> [WARNING]org.apache.flink:flink-test-utils-junit:jar:1.4-SNAPSHOT:test
> [WARNING]com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
> [WARNING]org.apache.flink:flink-annotations:jar:1.4-SNAPSHOT:compile
> [WARNING]org.apache.commons:commons-lang3:jar:3.3.2:compile
> [WARNING] Unused declared dependencies found:
> [WARNING]org.hamcrest:hamcrest-all:jar:1.3:test
> [WARNING]org.apache.flink:force-shading:jar:1.4-SNAPSHOT:compile
> [WARNING]org.powermock:powermock-module-junit4:jar:1.6.5:test
> [WARNING]com.google.code.findbugs:jsr305:jar:1.3.9:compile
> [WARNING]log4j:log4j:jar:1.2.17:test
> [WARNING]org.mockito:mockito-all:jar:1.10.19:test
> [WARNING]org.powermock:powermock-api-mockito:jar:1.6.5:test
> [WARNING]
> org.apache.flink:flink-test-utils_2.11:test-jar:tests:1.4-SNAPSHOT:test
> [WARNING]org.slf4j:slf4j-log4j12:jar:1.7.7:test



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-3834) flink-statebackend-rocksdb

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-3834:
-

Assignee: Chesnay Schepler  (was: Hai Zhou_UTC+8)

> flink-statebackend-rocksdb
> --
>
> Key: FLINK-3834
> URL: https://issues.apache.org/jira/browse/FLINK-3834
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Chesnay Schepler
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (FLINK-3834) flink-statebackend-rocksdb

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 closed FLINK-3834.
-
Resolution: Fixed

> flink-statebackend-rocksdb
> --
>
> Key: FLINK-3834
> URL: https://issues.apache.org/jira/browse/FLINK-3834
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Chesnay Schepler
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Comment Edited] (FLINK-6444) Add a check that '@VisibleForTesting' methods are only used in tests

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178254#comment-16178254
 ] 

Hai Zhou_UTC+8 edited comment on FLINK-6444 at 9/24/17 3:43 PM:


[~StephanEwen]  I implemented a maven module "flink-spotbugs-plugin" that 
contains a *VisibleForTestingDetector* class used to detect whether 
'@VisibleForTesting' methods was used illegally.

commit: 
https://github.com/yew1eb/flink/commit/d8edc6625ad98302cca54d80c5321d7fe3948b82


But,I am troubled. this module needs to be deployed to a remote maven 
repository, and It dep the “flink-annotation” module, the version of 
flink-annotation is not certain. 
Can you give me some suggestions? 
Or have no choice but to use the second plan like 
*CheckForbiddenMethodsUsage.java*.

BTW, via VisibleForTestingDetector detector, I did find that many 
'@VisibleForTesting' methods are called not in the test code.


was (Author: yew1eb):
[~StephanEwen]  I implemented a maven module "flink-spotbugs-plugin" that 
contains a *VisibleForTestingDetector* class used to detect whether 
'@VisibleForTesting' methods was used illegally.
commit: 
https://github.com/yew1eb/flink/commit/d8edc6625ad98302cca54d80c5321d7fe3948b82

But,I am troubled. this module needs to be deployed to a remote maven 
repository, and It dep the “flink-annotation” module, the version of 
flink-annotation is not certain. 
Can you give me some suggestions? 
Or have no choice but to use the second plan like 
*CheckForbiddenMethodsUsage.java*.

BTW, via VisibleForTestingDetector detector, I did find that many 
'@VisibleForTesting' methods are called not in the test code.

> Add a check that '@VisibleForTesting' methods are only used in tests
> 
>
> Key: FLINK-6444
> URL: https://issues.apache.org/jira/browse/FLINK-6444
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Reporter: Stephan Ewen
>Assignee: mingleizhang
>
> Some methods are annotated with {{@VisibleForTesting}}. These methods should 
> only be called from tests.
> This is currently not enforced / checked during the build. We should add such 
> a check.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Comment Edited] (FLINK-6444) Add a check that '@VisibleForTesting' methods are only used in tests

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178254#comment-16178254
 ] 

Hai Zhou_UTC+8 edited comment on FLINK-6444 at 9/24/17 3:42 PM:


[~StephanEwen]  I implemented a maven module "flink-spotbugs-plugin" that 
contains a *VisibleForTestingDetector* class used to detect whether 
'@VisibleForTesting' methods was used illegally.
commit: 
https://github.com/yew1eb/flink/commit/d8edc6625ad98302cca54d80c5321d7fe3948b82

But,I am troubled. this module needs to be deployed to a remote maven 
repository, and It dep the “flink-annotation” module, the version of 
flink-annotation is not certain. 
Can you give me some suggestions? 
Or have no choice but to use the second plan like 
*CheckForbiddenMethodsUsage.java*.

BTW, via VisibleForTestingDetector detector, I did find that many 
'@VisibleForTesting' methods are called not in the test code.


was (Author: yew1eb):
[~StephanEwen]  I implemented a maven module "flink-spotbugs-plugin" that 
contains a *VisibleForTestingDetector* class used to detect whether 
'@VisibleForTesting' methods was used illegally.

But,I am troubled. this module needs to be deployed to a remote maven 
repository, and It dep the “flink-annotation” module, the version of 
flink-annotation is not certain. 
Can you give me some suggestions? 
Or have no choice but to use the second plan like 
*CheckForbiddenMethodsUsage.java*.

BTW, via VisibleForTestingDetector detector, I did find that many 
'@VisibleForTesting' methods are called not in the test code.

> Add a check that '@VisibleForTesting' methods are only used in tests
> 
>
> Key: FLINK-6444
> URL: https://issues.apache.org/jira/browse/FLINK-6444
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Reporter: Stephan Ewen
>Assignee: mingleizhang
>
> Some methods are annotated with {{@VisibleForTesting}}. These methods should 
> only be called from tests.
> This is currently not enforced / checked during the build. We should add such 
> a check.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-6444) Add a check that '@VisibleForTesting' methods are only used in tests

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178254#comment-16178254
 ] 

Hai Zhou_UTC+8 commented on FLINK-6444:
---

[~StephanEwen]  I implemented a maven module "flink-spotbugs-plugin" that 
contains a *VisibleForTestingDetector* class used to detect whether 
'@VisibleForTesting' methods was used illegally.

But,I am troubled. this module needs to be deployed to a remote maven 
repository, and It dep the “flink-annotation” module, the version of 
flink-annotation is not certain. 
Can you give me some suggestions? 
Or have no choice but to use the second plan like 
*CheckForbiddenMethodsUsage.java*.

BTW, via VisibleForTestingDetector detector, I did find that many 
'@VisibleForTesting' methods are called not in the test code.

> Add a check that '@VisibleForTesting' methods are only used in tests
> 
>
> Key: FLINK-6444
> URL: https://issues.apache.org/jira/browse/FLINK-6444
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Reporter: Stephan Ewen
>Assignee: mingleizhang
>
> Some methods are annotated with {{@VisibleForTesting}}. These methods should 
> only be called from tests.
> This is currently not enforced / checked during the build. We should add such 
> a check.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-3834) flink-statebackend-rocksdb

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-3834:
-

Assignee: Hai Zhou_UTC+8

> flink-statebackend-rocksdb
> --
>
> Key: FLINK-3834
> URL: https://issues.apache.org/jira/browse/FLINK-3834
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-3833) flink-test-utils

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-3833:
-

Assignee: Hai Zhou_UTC+8

> flink-test-utils
> 
>
> Key: FLINK-3833
> URL: https://issues.apache.org/jira/browse/FLINK-3833
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-3830) flink-scala

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-3830:
-

Assignee: Hai Zhou_UTC+8

> flink-scala
> ---
>
> Key: FLINK-3830
> URL: https://issues.apache.org/jira/browse/FLINK-3830
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-3832) flink-streaming-scala

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-3832:
-

Assignee: Hai Zhou_UTC+8

> flink-streaming-scala
> -
>
> Key: FLINK-3832
> URL: https://issues.apache.org/jira/browse/FLINK-3832
> Project: Flink
>  Issue Type: Sub-task
>  Components: Build System
>Reporter: Till Rohrmann
>Assignee: Hai Zhou_UTC+8
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-6444) Add a check that '@VisibleForTesting' methods are only used in tests

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176416#comment-16176416
 ] 

Hai Zhou_UTC+8 commented on FLINK-6444:
---

I am trying the first.
Implement a "Spotbugs" Detector, and configure a "Spotbugs" rule.

> Add a check that '@VisibleForTesting' methods are only used in tests
> 
>
> Key: FLINK-6444
> URL: https://issues.apache.org/jira/browse/FLINK-6444
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Reporter: Stephan Ewen
>Assignee: Hai Zhou_UTC+8
>
> Some methods are annotated with {{@VisibleForTesting}}. These methods should 
> only be called from tests.
> This is currently not enforced / checked during the build. We should add such 
> a check.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (FLINK-7537) Add InfluxDB Sink for Flink Streaming

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 closed FLINK-7537.
-
Resolution: Fixed

> Add InfluxDB Sink for Flink Streaming
> -
>
> Key: FLINK-7537
> URL: https://issues.apache.org/jira/browse/FLINK-7537
> Project: Flink
>  Issue Type: Wish
>  Components: Streaming Connectors
>Affects Versions: 1.3.0
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
> Fix For: 1.3.0
>
>
> InfluxDBSink via implementation RichSinkFunction.
> [BAHIR-134|https://issues.apache.org/jira/browse/BAHIR-134]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-7608) LatencyGauge change to histogram metric

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173185#comment-16173185
 ] 

Hai Zhou_UTC+8 commented on FLINK-7608:
---

[~rmetzger]   I do not know jmx, do not know why it is a HashMap, so I do not 
know how to do it.

I will go to explore it if i have free.

> LatencyGauge change to  histogram metric
> 
>
> Key: FLINK-7608
> URL: https://issues.apache.org/jira/browse/FLINK-7608
> Project: Flink
>  Issue Type: Bug
>  Components: Metrics
>Reporter: Hai Zhou_UTC+8
>Priority: Blocker
> Fix For: 1.4.0, 1.3.3
>
>
> I used slf4jReporter[https://issues.apache.org/jira/browse/FLINK-4831]  to 
> export metrics the log file.
> I found:
> {noformat}
> -- Gauges 
> -
> ..
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Map.0.latency:
>  value={LatencySourceDescriptor{vertexID=1, subtaskIndex=-1}={p99=116.0, 
> p50=59.5, min=11.0, max=116.0, p95=116.0, mean=61.836}}
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Sink- Unnamed.0.latency: 
> value={LatencySourceDescriptor{vertexID=1, subtaskIndex=0}={p99=195.0, 
> p50=163.5, min=115.0, max=195.0, p95=195.0, mean=161.0}}
> ..
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-7608) LatencyGauge change to histogram metric

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-7608:
-

Assignee: (was: Hai Zhou_UTC+8)

> LatencyGauge change to  histogram metric
> 
>
> Key: FLINK-7608
> URL: https://issues.apache.org/jira/browse/FLINK-7608
> Project: Flink
>  Issue Type: Bug
>  Components: Metrics
>Reporter: Hai Zhou_UTC+8
>Priority: Blocker
> Fix For: 1.4.0, 1.3.3
>
>
> I used slf4jReporter[https://issues.apache.org/jira/browse/FLINK-4831]  to 
> export metrics the log file.
> I found:
> {noformat}
> -- Gauges 
> -
> ..
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Map.0.latency:
>  value={LatencySourceDescriptor{vertexID=1, subtaskIndex=-1}={p99=116.0, 
> p50=59.5, min=11.0, max=116.0, p95=116.0, mean=61.836}}
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Sink- Unnamed.0.latency: 
> value={LatencySourceDescriptor{vertexID=1, subtaskIndex=0}={p99=195.0, 
> p50=163.5, min=115.0, max=195.0, p95=195.0, mean=161.0}}
> ..
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-7608) LatencyGauge change to histogram metric

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173155#comment-16173155
 ] 

Hai Zhou_UTC+8 commented on FLINK-7608:
---

BTW, we collect all the job metrics in production is such as: **implement a 
kafkareporter  -->  kafka2opentsdb (a flink job)  -->  Grafana**.

custom the scope task format like:
{noformat}
metrics.scope.task:  TASK
{noformat}

parse the metric into the opentsdb data format like:
{noformat}
{
"metric":"numBytesInLocalPerSecond",
"tags":{
"subtask_index":"0",
"host":"xxx-xxx-xx1588",
"job_name":"__",
"task_name":"Source--"
},
"timestamp":1505390758,
"value":2342
}
{noformat}


> LatencyGauge change to  histogram metric
> 
>
> Key: FLINK-7608
> URL: https://issues.apache.org/jira/browse/FLINK-7608
> Project: Flink
>  Issue Type: Bug
>  Components: Metrics
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
>Priority: Blocker
> Fix For: 1.4.0, 1.3.3
>
>
> I used slf4jReporter[https://issues.apache.org/jira/browse/FLINK-4831]  to 
> export metrics the log file.
> I found:
> {noformat}
> -- Gauges 
> -
> ..
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Map.0.latency:
>  value={LatencySourceDescriptor{vertexID=1, subtaskIndex=-1}={p99=116.0, 
> p50=59.5, min=11.0, max=116.0, p95=116.0, mean=61.836}}
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Sink- Unnamed.0.latency: 
> value={LatencySourceDescriptor{vertexID=1, subtaskIndex=0}={p99=195.0, 
> p50=163.5, min=115.0, max=195.0, p95=195.0, mean=161.0}}
> ..
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-7608) LatencyGauge change to histogram metric

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173125#comment-16173125
 ] 

Hai Zhou_UTC+8 commented on FLINK-7608:
---

Export to influxdb or opentsdb, I will split as follows:

metricName+ "max", histogram.getStatistics().getMax()
metricName+ "min", histogram.getStatistics().getMin()
...
metricName+ "p75",histogram.getStatistics().getQuantile(0.75)
...

But, if export to log4j, I will not split it, instead of using the toString 
method to print its value.

> LatencyGauge change to  histogram metric
> 
>
> Key: FLINK-7608
> URL: https://issues.apache.org/jira/browse/FLINK-7608
> Project: Flink
>  Issue Type: Bug
>  Components: Metrics
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
>Priority: Blocker
> Fix For: 1.4.0, 1.3.3
>
>
> I used slf4jReporter[https://issues.apache.org/jira/browse/FLINK-4831]  to 
> export metrics the log file.
> I found:
> {noformat}
> -- Gauges 
> -
> ..
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Map.0.latency:
>  value={LatencySourceDescriptor{vertexID=1, subtaskIndex=-1}={p99=116.0, 
> p50=59.5, min=11.0, max=116.0, p95=116.0, mean=61.836}}
> zhouhai-mbp.taskmanager.f3fd3a269c8c3da4e8319c8f6a201a57.Flink Streaming 
> Job.Sink- Unnamed.0.latency: 
> value={LatencySourceDescriptor{vertexID=1, subtaskIndex=0}={p99=195.0, 
> p50=163.5, min=115.0, max=195.0, p95=195.0, mean=161.0}}
> ..
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (FLINK-7654) Update RabbitMQ Java client to 4.x

[Hai Zhou_UTC+8 (JIRA)]

Hai Zhou_UTC+8 created FLINK-7654:
-

 Summary: Update RabbitMQ Java client to  4.x
 Key: FLINK-7654
 URL: https://issues.apache.org/jira/browse/FLINK-7654
 Project: Flink
  Issue Type: Improvement
  Components: RabbitMQ Connector, Streaming Connectors
Reporter: Hai Zhou_UTC+8
Assignee: Hai Zhou_UTC+8
 Fix For: 1.4.0


*RabbitMQ Java Client*

Starting with 4.0, this client releases are independent from RabbitMQ server 
releases.
These versions can still be used with RabbitMQ server 3.x.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (FLINK-7645) Modify system-metrics part show in the document

[Hai Zhou_UTC+8 (JIRA)]

Hai Zhou_UTC+8 created FLINK-7645:
-

 Summary: Modify system-metrics part show in the document
 Key: FLINK-7645
 URL: https://issues.apache.org/jira/browse/FLINK-7645
 Project: Flink
  Issue Type: Improvement
  Components: Documentation, Metrics
Reporter: Hai Zhou_UTC+8
 Fix For: 1.4.0


the system-metrics contents structure:
Currently,

{noformat}
├── System metrics
├── Latency tracking
├── Dashboard integration

{noformat}

I think the following is more reasonable,


{noformat}
├── System metrics
   ├── CPU
   ├── Memory
   ├── Threads
   ├── GarbageCollection
   ├── ClassLoader
   ├── Network
   ├── Cluster
   ├── Availability
   ├── Checkpointing
   ├── IO
   └── Connectors
  └──  Kafka Connectors
├── Latency tracking
├── Dashboard integration
{noformat}




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (FLINK-7644) Line the extra semicolon in the source code

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 updated FLINK-7644:
--
Description: 
eg. 
final TestDuplicateSerializer keySerializer = new TestDuplicateSerializer()*;;*

Unnecessary semicolon in the end of line.

  was:
eg. 
final TestDuplicateSerializer keySerializer = new TestDuplicateSerializer();;

Unnecessary semicolon in the end of line.


> Line the extra semicolon in the source code
> ---
>
> Key: FLINK-7644
> URL: https://issues.apache.org/jira/browse/FLINK-7644
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
>Priority: Minor
> Fix For: 1.4.0, 1.3.3
>
>
> eg.   
> final TestDuplicateSerializer keySerializer = new 
> TestDuplicateSerializer()*;;*
> Unnecessary semicolon in the end of line.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (FLINK-7644) Line the extra semicolon in the source code

[Hai Zhou_UTC+8 (JIRA)]

Hai Zhou_UTC+8 created FLINK-7644:
-

 Summary: Line the extra semicolon in the source code
 Key: FLINK-7644
 URL: https://issues.apache.org/jira/browse/FLINK-7644
 Project: Flink
  Issue Type: Improvement
  Components: Build System
Reporter: Hai Zhou_UTC+8
Assignee: Hai Zhou_UTC+8
Priority: Minor
 Fix For: 1.4.0, 1.3.3


eg. 
final TestDuplicateSerializer keySerializer = new TestDuplicateSerializer();;

Unnecessary semicolon in the end of line.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-6444) Add a check that '@VisibleForTesting' methods are only used in tests

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-6444:
-

Assignee: Hai Zhou_UTC+8

> Add a check that '@VisibleForTesting' methods are only used in tests
> 
>
> Key: FLINK-6444
> URL: https://issues.apache.org/jira/browse/FLINK-6444
> Project: Flink
>  Issue Type: Improvement
>  Components: Build System
>Reporter: Stephan Ewen
>Assignee: Hai Zhou_UTC+8
>
> Some methods are annotated with {{@VisibleForTesting}}. These methods should 
> only be called from tests.
> This is currently not enforced / checked during the build. We should add such 
> a check.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (FLINK-7626) Add some metric description about checkpoints

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 closed FLINK-7626.
-
Resolution: Fixed

> Add some metric description about checkpoints
> -
>
> Key: FLINK-7626
> URL: https://issues.apache.org/jira/browse/FLINK-7626
> Project: Flink
>  Issue Type: Bug
>  Components: Documentation, Metrics
>Affects Versions: 1.3.2
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
> Fix For: 1.4.0, 1.3.3
>
>
> I export the metrics to the logfile via 
> Slf4jReporter(https://issues.apache.org/jira/browse/FLINK-4831), and found 
> that there are some checkpoint metrics that are not described in the 
> document, so I added.
> {noformat}
> //Number of total checkpoints (in progress, completed, failed)
> totalNumberOfCheckpoints
>  //Number of in progress checkpoints.
> numberOfInProgressCheckpoints
> //Number of successfully completed checkpoints
> numberOfCompletedCheckpoints
> //Number of failed checkpoints.
> numberOfFailedCheckpoints
> //Timestamp when the checkpoint was restored at the coordinator.
> lastCheckpointRestoreTimestamp
> //Buffered bytes during alignment over all subtasks.
> lastCheckpointAlignmentBuffered
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-7634) Add option to create a savepoint while canceling a job in the dashboard

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-7634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172561#comment-16172561
 ] 

Hai Zhou_UTC+8 commented on FLINK-7634:
---

+1

> Add option to create a savepoint while canceling a job in the dashboard 
> 
>
> Key: FLINK-7634
> URL: https://issues.apache.org/jira/browse/FLINK-7634
> Project: Flink
>  Issue Type: Improvement
>  Components: JobManager
>Affects Versions: 1.3.2
>Reporter: Elias Levy
>Priority: Minor
>
> Currently there appears to be no way to trigger a savepoint in the dashboard, 
> to cancel a job while taking a savepoint, to list savepoints, or to list 
> external checkpoints.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (FLINK-7626) Add some metric description about checkpoints

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 updated FLINK-7626:
--
Description: 
I export the metrics to the logfile via 
Slf4jReporter(https://issues.apache.org/jira/browse/FLINK-4831), and found that 
there are some checkpoint metrics that are not described in the document, so I 
added.

{noformat}

//Number of total checkpoints (in progress, completed, failed)
totalNumberOfCheckpoints

 //Number of in progress checkpoints.
numberOfInProgressCheckpoints

//Number of successfully completed checkpoints
numberOfCompletedCheckpoints

//Number of failed checkpoints.
numberOfFailedCheckpoints

//Timestamp when the checkpoint was restored at the coordinator.
lastCheckpointRestoreTimestamp

//Buffered bytes during alignment over all subtasks.
lastCheckpointAlignmentBuffered
{noformat}


  was:
Add some metric description in"Debugging & Monitoring / Metrics"  part of  docs:

{noformat}

//Number of total checkpoints (in progress, completed, failed)
totalNumberOfCheckpoints

 //Number of in progress checkpoints.
numberOfInProgressCheckpoints

//Number of successfully completed checkpoints
numberOfCompletedCheckpoints

//Number of failed checkpoints.
numberOfFailedCheckpoints

//Timestamp when the checkpoint was restored at the coordinator.
lastCheckpointRestoreTimestamp

//Buffered bytes during alignment over all subtasks.
lastCheckpointAlignmentBuffered
{noformat}



> Add some metric description about checkpoints
> -
>
> Key: FLINK-7626
> URL: https://issues.apache.org/jira/browse/FLINK-7626
> Project: Flink
>  Issue Type: Bug
>  Components: Documentation, Metrics
>Affects Versions: 1.3.2
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
> Fix For: 1.4.0, 1.3.3
>
>
> I export the metrics to the logfile via 
> Slf4jReporter(https://issues.apache.org/jira/browse/FLINK-4831), and found 
> that there are some checkpoint metrics that are not described in the 
> document, so I added.
> {noformat}
> //Number of total checkpoints (in progress, completed, failed)
> totalNumberOfCheckpoints
>  //Number of in progress checkpoints.
> numberOfInProgressCheckpoints
> //Number of successfully completed checkpoints
> numberOfCompletedCheckpoints
> //Number of failed checkpoints.
> numberOfFailedCheckpoints
> //Timestamp when the checkpoint was restored at the coordinator.
> lastCheckpointRestoreTimestamp
> //Buffered bytes during alignment over all subtasks.
> lastCheckpointAlignmentBuffered
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (FLINK-7466) Add a flink connector for Apache RocketMQ

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 closed FLINK-7466.
-
Resolution: Duplicate

> Add a flink connector for Apache RocketMQ
> -
>
> Key: FLINK-7466
> URL: https://issues.apache.org/jira/browse/FLINK-7466
> Project: Flink
>  Issue Type: New Feature
>  Components: Streaming Connectors
>Reporter: yukon
>
> Hi Flink community:
> Flink is really a great stream processing framework, I would like to 
> contribute a flink-rocketmq-connector, if you think it's acceptable, I will 
> submit a pull request soon.
> Apache RocketMQ is a distributed messaging and streaming platform with low 
> latency, high performance and reliability, trillion-level capacity and 
> flexible scalability. More info please refer to http://rocketmq.apache.org/



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (FLINK-6573) Flink MongoDB Connector

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 reassigned FLINK-6573:
-

Assignee: Hai Zhou_UTC+8

> Flink MongoDB Connector
> ---
>
> Key: FLINK-6573
> URL: https://issues.apache.org/jira/browse/FLINK-6573
> Project: Flink
>  Issue Type: New Feature
>  Components: Batch Connectors and Input/Output Formats
>Affects Versions: 1.2.0
> Environment: Linux Operating System, Mongo DB
>Reporter: Nagamallikarjuna
>Assignee: Hai Zhou_UTC+8
>Priority: Minor
> Fix For: 2.0.0
>
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> Hi Community,
> Currently we are using Flink in the current Project. We have huge amount of 
> data to process using Flink which resides in Mongo DB. We have a requirement 
> of parallel data connectivity in between Flink and Mongo DB for both 
> reads/writes. Currently we are planning to create this connector and 
> contribute to the Community.
> I will update the further details once I receive your feedback 
> Please let us know if you have any concerns.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (FLINK-7536) Add MongoDB Source/Sink for Flink Streaming

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 closed FLINK-7536.
-
Resolution: Duplicate

> Add MongoDB Source/Sink for Flink Streaming
> ---
>
> Key: FLINK-7536
> URL: https://issues.apache.org/jira/browse/FLINK-7536
> Project: Flink
>  Issue Type: Wish
>  Components: Streaming Connectors
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
>
> MongoSource / MongoSink via implementation RichSourceFunction / 
> RichSinkFunction.
> [BAHIR-133|https://issues.apache.org/jira/browse/BAHIR-133]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (FLINK-7510) Move some connectors to Apache Bahir

[Hai Zhou_UTC+8 (JIRA)]

[ 
https://issues.apache.org/jira/browse/FLINK-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168982#comment-16168982
 ] 

Hai Zhou_UTC+8 commented on FLINK-7510:
---

Okay, I know maybe we need to vote for it.
but now, we are not anxious to do this issue.

> Move some connectors to Apache Bahir
> 
>
> Key: FLINK-7510
> URL: https://issues.apache.org/jira/browse/FLINK-7510
> Project: Flink
>  Issue Type: Wish
>  Components: Streaming Connectors
>Reporter: Hai Zhou_UTC+8
>Assignee: Hai Zhou_UTC+8
>
> Hi Flink community:
> Flink is really a great stream processing framework, provides a number of 
> connectors that support multiple data sources and sinks.
> but,
> I suggested that moving the unpopular connector to Bahir (and popular 
> connector to keep in the main Flink codebase).
> E.g
> flink-connectors/flink-connector-twitter
> flink-contrib/flink-connector-wikiedits
> 
> I am willing to do the work, if you think it's acceptable, I will create new 
> sub-task issue and  submit a PR soon.
> Regards,
> Hai Zhou
> the corresponding bahir issue: 
> [https://issues.apache.org/jira/browse/BAHIR-131]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (FLINK-7447) Hope add more committer information to "Community & Project Info" page.

[Hai Zhou_UTC+8 (JIRA)]

 [ 
https://issues.apache.org/jira/browse/FLINK-7447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hai Zhou_UTC+8 closed FLINK-7447.
-
Resolution: Won't Fix

> Hope add more committer information to "Community & Project Info" page.
> ---
>
> Key: FLINK-7447
> URL: https://issues.apache.org/jira/browse/FLINK-7447
> Project: Flink
>  Issue Type: Wish
>  Components: Project Website
>Reporter: Hai Zhou_UTC+8
>
> I wish add the "organization" and "time zone" information to committer 
> introduction, while using the mail instead of Apache ID.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)