Github user chiwanpark commented on the pull request:
https://github.com/apache/incubator-flink/pull/226#issuecomment-66663423
I implement this feature. As I said, There are two functions for this
feature. One is `FileMonitoringFunction` and another is `FileReadFunction` (I
renamed `FileMapFunction` to `FileReadFunction`).
if a user call `readFileStream` in `StreamExecutionEnvironment`, the system
creates a `FileMonitoringFunction` as a primary source and set degree of
parallelism to 1 (because of ignoring `NonParallelInput` interface) and connect
to `FileMapFunction` with `flatMap` method.
I tested in local mini cluster and HDFS environment with set degree of
parallelism to 5.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
