[GitHub] flink issue #6373: [FLINK-9838][logging] Don't log slot request failures on ...

2018-07-23 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6373 Ran into this bug too. +1 for the fix ---

[GitHub] flink pull request #6300: [FLINK-9692][Kinesis Connector] Adaptive reads fro...

2018-07-12 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6300#discussion_r202199865 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/config/ConsumerConfigConstants.java

[GitHub] flink pull request #6300: [FLINK-9692][Kinesis Connector] Adaptive reads fro...

2018-07-12 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6300#discussion_r202201507 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumer.java --- @@ -330,4

[GitHub] flink pull request #6319: [FLINK-9822] Add Dockerfile for StandaloneJobClust...

2018-07-12 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6319#discussion_r202198679 --- Diff: flink-container/docker/README.md --- @@ -0,0 +1,44 @@ +# Apache Flink cluster deployment on docker using docker-compose --- End diff

[GitHub] flink pull request #6319: [FLINK-9822] Add Dockerfile for StandaloneJobClust...

2018-07-12 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6319#discussion_r202197686 --- Diff: flink-container/docker/README.md --- @@ -0,0 +1,44 @@ +# Apache Flink cluster deployment on docker using docker-compose

[GitHub] flink issue #6109: [FLINK-9483] 'Building Flink' doc doesn't highlight quick...

2018-07-10 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6109 cc @zentol ---

[GitHub] flink pull request #6277: [FLINK-9511] Implement TTL config

2018-07-09 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6277#discussion_r201216406 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/state/StateTtlConfiguration.java --- @@ -93,4 +97,82 @@ public Time getTtl

[GitHub] flink issue #6290: [Flink-9691] [Kinesis Connector] Attempt to call getRecor...

2018-07-09 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6290 +1, LGTM ---

[GitHub] flink issue #6195: [FLINK-9543][METRICS] Expose JobMaster ID to metric syste...

2018-07-04 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6195 Can you also add documentation to the Metrics page? ---

[GitHub] flink pull request #6130: [FLINK-9545] Support read a file multiple times in...

2018-06-15 Thread bowenli86
Github user bowenli86 closed the pull request at: https://github.com/apache/flink/pull/6130 ---

[GitHub] flink issue #6156: [FLINK-9572] Extend InternalAppendingState with internal ...

2018-06-13 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6156 +1 LGTM ---

[GitHub] flink issue #6130: [FLINK-9545] Support read a file multiple times in Flink ...

2018-06-13 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6130 Not really. It's not about having n copies of data. One use case is File-fed stream pipeline usually runs very fast with inadequate metrics, users need to run it end-to-end for a longer time

[GitHub] flink issue #6130: [FLINK-9545] Support read a file multiple times in Flink ...

2018-06-07 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6130 @aljoscha Motivation: We have the requirements to read a bunch files, each file to read multiple times, to feed our streams Specifically we need

[GitHub] flink pull request #6130: [FLINK-9545] Support read a file multiple times in...

2018-06-06 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/6130 [FLINK-9545] Support read a file multiple times in Flink DataStream ## What is the purpose of the change we need `StreamExecutionEnvironment.readFile/readTextFile` to read each file

[GitHub] flink pull request #6021: [FLINK-9374] [kinesis] Enable FlinkKinesisProducer...

2018-06-04 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6021#discussion_r192834879 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/util/TimeoutLatch.java --- @@ -0,0 +1,41

[GitHub] flink pull request #6021: [FLINK-9374] [kinesis] Enable FlinkKinesisProducer...

2018-06-04 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6021#discussion_r192837000 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/FlinkKinesisProducer.java --- @@ -180,9

[GitHub] flink issue #6116: [FLINK-9498][build] Disable dependency convergence for fl...

2018-06-04 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6116 Will it lower the possibility of detecting lib version conflicts of Flink's dependencies? ---

[GitHub] flink pull request #6109: [FLINK-9483] 'Building Flink' doc doesn't highligh...

2018-06-03 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6109#discussion_r192628940 --- Diff: docs/start/building.md --- @@ -50,7 +50,11 @@ mvn clean install -DskipTests This instructs [Maven](http://maven.apache.org) (`mvn

[GitHub] flink pull request #6109: [FLINK-9483] 'Building Flink' doc doesn't highligh...

2018-06-01 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6109#discussion_r192535262 --- Diff: docs/start/building.md --- @@ -50,7 +50,11 @@ mvn clean install -DskipTests This instructs [Maven](http://maven.apache.org) (`mvn

[GitHub] flink pull request #6109: [FLINK-9483] 'Building Flink' doc doesn't highligh...

2018-05-31 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/6109 [FLINK-9483] 'Building Flink' doc doesn't highlight quick build command ## What is the purpose of the change The blue part isn't corrected highlighted as the red ones ![screen

[GitHub] flink pull request #5649: [FLINK-8873] [DataStream API] [Tests] move unit te...

2018-05-31 Thread bowenli86
Github user bowenli86 closed the pull request at: https://github.com/apache/flink/pull/5649 ---

[GitHub] flink pull request #6104: [FLINK-9476]Emit late elements in CEP as sideOutPu...

2018-05-30 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6104#discussion_r191858415 --- Diff: docs/dev/libs/cep.md --- @@ -1524,7 +1524,52 @@ In `CEP` the order in which elements are processed matters. To guarantee that el

[GitHub] flink pull request #6104: [FLINK-9476]Emit late elements in CEP as sideOutPu...

2018-05-30 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6104#discussion_r191857843 --- Diff: docs/dev/libs/cep.md --- @@ -1524,7 +1524,52 @@ In `CEP` the order in which elements are processed matters. To guarantee that el

[GitHub] flink issue #5649: [FLINK-8873] [DataStream API] [Tests] move unit tests of ...

2018-05-30 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5649 When I was developing KeyedProcessFunction, I initially wondered why there's no tests for KeyedStream, and researched and realized that they were actually mixed with DataStream tests. I

[GitHub] flink issue #6097: [FLINK-9470] Allow querying the key in KeyedProcessFuncti...

2018-05-29 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6097 +1. I might forget to add the interfaces back then, would be good to have them ---

[GitHub] flink pull request #6066: [FLINK-9428] [checkpointing] Allow operators to fl...

2018-05-23 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6066#discussion_r190342404 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/StreamOperator.java --- @@ -93,6 +93,20 @@ // state

[GitHub] flink issue #5978: [FLINK-8554] Upgrade AWS SDK

2018-05-18 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5978 Are there anything in `1.11.325` we desperately need? If not, I would oppose upgrading AWS SDK too frequently. Highly likely that we don't need any of the new changes in `1.11.325`. As you

[GitHub] flink issue #6021: [FLINK-9374] [kinesis] Enable FlinkKinesisProducer Backpr...

2018-05-18 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6021 @tzulitai adding docs to educate users on tuning KPL performance would be good. I has quite some experience on it (as you may have know :) Ping me if you start working on it before I do, and I'll

[GitHub] flink pull request #6021: [FLINK-9374] [kinesis] Enable FlinkKinesisProducer...

2018-05-18 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6021#discussion_r189174902 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/FlinkKinesisProducer.java --- @@ -326,6

[GitHub] flink pull request #6021: [FLINK-9374] [kinesis] Enable FlinkKinesisProducer...

2018-05-18 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6021#discussion_r189175770 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/FlinkKinesisProducer.java --- @@ -326,6

[GitHub] flink pull request #6021: [FLINK-9374] [kinesis] Enable FlinkKinesisProducer...

2018-05-18 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6021#discussion_r189176708 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/FlinkKinesisProducer.java --- @@ -326,6

[GitHub] flink pull request #6021: [FLINK-9374] [kinesis] Enable FlinkKinesisProducer...

2018-05-18 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/6021#discussion_r189176320 --- Diff: flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/FlinkKinesisProducer.java --- @@ -326,6

[GitHub] flink issue #5649: [FLINK-8873] [DataStream API] [Tests] move unit tests of ...

2018-05-17 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5649 Hi @kl0u , can you pls take a look at this PR? ---

[GitHub] flink issue #5979: [FLINK-9070][state]improve the performance of RocksDBMapS...

2018-05-10 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5979 LGTM +1 ---

[GitHub] flink pull request #5979: [FLINK-9070][state]improve the performance of Rock...

2018-05-10 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5979#discussion_r187255609 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java --- @@ -356,6

[GitHub] flink pull request #5949: [FLINK-9288][docs] clarify the event time / waterm...

2018-05-02 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5949#discussion_r185588020 --- Diff: docs/dev/event_time.md --- @@ -35,30 +35,32 @@ Flink supports different notions of *time* in streaming programs. respective operation

[GitHub] flink pull request #5937: [FLINK-9270] Upgrade RocksDB to 5.11.3, and resolv...

2018-04-28 Thread bowenli86
Github user bowenli86 closed the pull request at: https://github.com/apache/flink/pull/5937 ---

[GitHub] flink pull request #5937: [FLINK-9270] Upgrade RocksDB to 5.11.3, and resolv...

2018-04-28 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5937 [FLINK-9270] Upgrade RocksDB to 5.11.3, and resolve concurrent test invocation problem of @RetryOnFailure ## What is the purpose of the change - Upgrade RocksDB to 5.11.3 to take latest

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184831365 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,539 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100

[GitHub] flink pull request #5885: [FLINK-8715] Remove usage of StateDescriptor in st...

2018-04-27 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5885#discussion_r184830451 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/AbstractKeyedStateBackend.java --- @@ -455,4 +455,5 @@ public

[GitHub] flink pull request #5885: [FLINK-8715] Remove usage of StateDescriptor in st...

2018-04-27 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5885#discussion_r184831125 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/AbstractRocksDBState.java --- @@ -190,4

[GitHub] flink issue #5887: [FLINK-6719] [docs] Add details about fault-tolerance of ...

2018-04-27 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5887 @fhueske updated! let me know how it looks now ---

[GitHub] flink issue #5932: [FLINK-9266][flink-connector-kinesis]Updates Kinesis conn...

2018-04-27 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5932 +1 ---

[GitHub] flink issue #5910: [FLINK-8841] [state] Remove HashMapSerializer and use Map...

2018-04-25 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5910 +1 ---

[GitHub] flink issue #5904: [FLINK-9249][build] Add convenience profile for skipping ...

2018-04-25 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5904 +1 ---

[GitHub] flink pull request #5887: [FLINK-6719] Add details about fault-tolerance of ...

2018-04-21 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5887 [FLINK-6719] Add details about fault-tolerance of timers to ProcessFunction docs ## What is the purpose of the change The fault-tolerance of timers is a frequently asked questions

[GitHub] flink issue #5864: [FLINK-8661] Replace Collections.EMPTY_MAP with Collectio...

2018-04-18 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5864 +1 ---

[GitHub] flink issue #5864: [FLINK-8661] Replace Collections.EMPTY_MAP with Collectio...

2018-04-18 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5864 does using Collections.EMPTY_MAP/EMPTY_SET lead to some warnings logging? ---

[GitHub] flink issue #5820: [hotfix] [DataStream API] [Scala] removed unused scala im...

2018-04-12 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5820 @zentol which scala checkstyle mvn plugin are you looking at? I didn't find any available ones, and I'm afraid there might will not be one. scalastyle explicitly said

[GitHub] flink pull request #5820: [hotfix] removed unused scala imports

2018-04-05 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5820 [hotfix] removed unused scala imports ## What is the purpose of the change removed unused scala imports ## Brief change log removed unused scala imports

[GitHub] flink pull request #5819: [FLINK-9140] [Build System] [scalastyle] simplify ...

2018-04-05 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5819 [FLINK-9140] [Build System] [scalastyle] simplify scalastyle configurations ## What is the purpose of the change Simplifying `` to `` ## Brief change log Simplifying

[GitHub] flink issue #5810: [FLINK-9127] [Core] Filesystem State Backend logged incor...

2018-04-05 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5810 The original logging is correct - filesystem state backend is actually memory state backend + filesystem checkpointing. No need to change the logging. ---

[GitHub] flink pull request #5809: [FLINK-8697] [Kinesis Connector] Rename DummyFlink...

2018-04-03 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5809 [FLINK-8697] [Kinesis Connector] Rename DummyFlinkKafkaConsumer in KinesisDataFetcherTest ## What is the purpose of the change `DummyFlinkKafkaConsumer` in `KinesisDataFetcherTest

[GitHub] flink issue #5800: [FLINK-8837] add @Experimental annotation and properly an...

2018-04-02 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5800 cc @StephanEwen @tillrohrmann @zentol ---

[GitHub] flink issue #5760: [hotfix] [doc] update maven versions in building flink pa...

2018-04-02 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5760 cc @zentol ---

[GitHub] flink pull request #5800: [FLINK-8837] add @Experimental annotation and prop...

2018-04-02 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5800 [FLINK-8837] add @Experimental annotation and properly annotate some classes ## What is the purpose of the change - add @Experimental annotation - properly annotate some classes

[GitHub] flink pull request #5760: [hotfix] [doc] fix maven version in building flink

2018-03-24 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5760 [hotfix] [doc] fix maven version in building flink ## What is the purpose of the change The maven version in `start/building` is inconsistent. Make it consistent by changing the maven

[GitHub] flink issue #5702: [FLINK-8771] [Build System] [Checkstyle/Scalastyle] Upgra...

2018-03-23 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5702 Hi @zentol , can you take a look at this PR? ---

[GitHub] flink issue #5702: [FLINK-8771] [Build System] [Checkstyle/Scalastyle] Upgra...

2018-03-21 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5702 cc @zentol ---

[GitHub] flink pull request #5702: [FLINK-8771] Upgrade scalastyle to 1.0.0

2018-03-15 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5702 [FLINK-8771] Upgrade scalastyle to 1.0.0 ## What is the purpose of the change Upgrade scalastyle from 0.8.0 to 1.0.0 ## Brief change log - Upgrade scalastyle from 0.8.0

[GitHub] flink pull request #5356: [FLINK-8364][state backend] Add iterator() to List...

2018-03-14 Thread bowenli86
Github user bowenli86 closed the pull request at: https://github.com/apache/flink/pull/5356 ---

[GitHub] flink issue #5649: [FLINK-8873] [DataStream API] [Tests] move unit tests of ...

2018-03-14 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5649 cc @kl0u ---

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-13 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r174231064 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/test/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapperTest.java

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-13 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r174230739 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/test/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapperTest.java

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-13 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r174231142 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/test/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapperTest.java

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-13 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r174231173 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/test/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapperTest.java

[GitHub] flink issue #5680: [FLINK-8919] Add KeyedProcessFunctionWithCleanupState.

2018-03-12 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5680 shall we add a unit test? ---

[GitHub] flink pull request #5677: [hotfix] update doc of InternalTimerService.regist...

2018-03-09 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5677 [hotfix] update doc of InternalTimerService.registerEventTimeTimer() ## What is the purpose of the change update doc of InternalTimerService.registerEventTimeTimer() ## Brief

[GitHub] flink issue #5663: [FLINK-8888] [Kinesis Connectors] Update the AWS SDK for ...

2018-03-09 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5663 Is your testing Flink job both reading from and writing to Kinesis, aka both KCL and KPL are tested? If so, +1 ---

[GitHub] flink issue #5356: [FLINK-8364][state backend] Add iterator() to ListState w...

2018-03-09 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5356 hmmm I think you are right, this actually might be a non-issue in the first place ---

[GitHub] flink pull request #5365: [FLINK-8515] update RocksDBMapState to replace dep...

2018-03-09 Thread bowenli86
Github user bowenli86 closed the pull request at: https://github.com/apache/flink/pull/5365 ---

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r172935414 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r172935214 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r172934683 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java

[GitHub] flink pull request #5649: [FLINK-8873] [DataStream API] [Tests] move unit te...

2018-03-06 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5649 [FLINK-8873] [DataStream API] [Tests] move unit tests of KeyedStream from DataStreamTest to KeyedStreamTest ## What is the purpose of the change move unit tests of `KeyedStream` from

[GitHub] flink issue #5501: [FLINK-6053][metrics] Add new Number-/StringGauge metric ...

2018-03-06 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5501 LGTM, +1 on merging to 1.6.0 ---

[GitHub] flink issue #5481: [FLINK-8560] Access to the current key in ProcessFunction...

2018-03-05 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5481 @kl0u @aljoscha I added the scala example, and I believe the only build failure in Travis is irrelevant ---

[GitHub] flink pull request #5482: [FLINK-8480][DataStream] Add Java API for timeboun...

2018-03-05 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5482#discussion_r172306197 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/TimeBoundedStreamJoinOperator.java --- @@ -0,0 +1,480

[GitHub] flink pull request #5482: [FLINK-8480][DataStream] Add Java API for timeboun...

2018-03-05 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5482#discussion_r172303424 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/JoinedStreams.java --- @@ -137,6 +158,151 @@ public EqualTo

[GitHub] flink pull request #5482: [FLINK-8480][DataStream] Add Java API for timeboun...

2018-03-05 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5482#discussion_r172302147 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/JoinedStreams.java --- @@ -137,6 +158,151 @@ public EqualTo

[GitHub] flink pull request #5482: [FLINK-8480][DataStream] Add Java API for timeboun...

2018-03-05 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5482#discussion_r172302583 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/JoinedStreams.java --- @@ -137,6 +158,151 @@ public EqualTo

[GitHub] flink pull request #5482: [FLINK-8480][DataStream] Add Java API for timeboun...

2018-03-05 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5482#discussion_r172303671 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/TimeBoundedStreamJoinOperator.java --- @@ -0,0 +1,480

[GitHub] flink issue #5616: [FLINK-8828] [stream, dataset, scala] Introduce collect m...

2018-03-02 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5616 need to add to java API as well ---

[GitHub] flink issue #5481: [FLINK-8560] Access to the current key in ProcessFunction...

2018-03-01 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5481 @kl0u I added the comments for `@deprecated` in the javadoc. Let me know if you can merge the two related PRs. Thanks ---

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-28 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 @kl0u @aljoscha I've updated this PR, and its build is green ---

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-27 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 @tillrohrmann @kl0u Thanks for reviewing, guys As @pnowojski mentioned, we three decided to expose timer keys in `ProcessFunction` in [FLINK-8560](https://github.com/apache/flink/pull

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-22 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 Hi @aljoscha , can you take a look? ---

[GitHub] flink issue #5481: [FLINK-8560] Access to the current key in ProcessFunction...

2018-02-21 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5481 Thanks for the review and suggestions. And your comment on `DataStream#process(KeyedProcessFunction)` makes sense, I've removed it. (btw, I feel https://github.com/apache/flink/pull/5500

[GitHub] flink issue #5481: [FLINK-8560] Access to the current key in ProcessFunction...

2018-02-20 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5481 cc @pnowojski @aljoscha ---

[GitHub] flink issue #5522: [FLINK-8710] [YARN] AbstractYarnClusterDescriptor doesn't...

2018-02-20 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5522 cc @tillrohrmann ---

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-20 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 cc @pnowojski @aljoscha ---

[GitHub] flink pull request #5537: [FLINK-8719] add module description for flink-cont...

2018-02-20 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5537 [FLINK-8719] add module description for flink-contrib to clarify its purpose ## What is the purpose of the change flink-contrib currently doesn't have any clarification or description

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-19 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 a irrelavent flaky unit test caused the error in travis build, and I've filed [FLINK-8709](https://issues.apache.org/jira/browse/FLINK-8709) for it ---

[GitHub] flink issue #5522: [hotfix] hotfix for AbstractYarnClusterDescriptor

2018-02-19 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5522 the failure in travis build is irrelevant ---

[GitHub] flink pull request #5522: [hotfix] [javadoc] fix wrong javadoc in AbstractYa...

2018-02-19 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5522 [hotfix] [javadoc] fix wrong javadoc in AbstractYarnClusterDescriptor ## What is the purpose of the change hotfix of javadoc in AbstractYarnClusterDescriptor ## Brief change log

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-17 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 @pnowojski @aljoscha I updated the code. Hopefully we can make this into 1.5.0! Thanks! ---

[GitHub] flink issue #5501: [FLINK-6053][metrics] Add new Number-/StringGauge metric ...

2018-02-16 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5501 LGTM generally. I still feel having all the `instanceof` in `notifyOfAddedMetric` and `notifyOfRemovedMetric` is a bit inelegant. I'm fine with it since there'll (hopefully) be only

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-16 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168891314 --- Diff: docs/ops/state/large_state_tuning.md --- @@ -234,4 +234,97 @@ Compression can be activated through the `ExecutionConfig`: **Notice

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-16 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r168855562 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/co/CoBroadcastWithKeyedOperator.java --- @@ -324,6 +324,11

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-15 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 cc @aljoscha @pnowojski ---

  1   2   3   4   5   >