Hi,
Maybe this is an access rights issue? Could you try to create and write to same
file (same directory) in some other way (manually?), using the same user and
the same machine as would Flink job do?
Maybe there will be some hint in hdfs logs?
Piotrek
> On 12 Oct 2017, at 00:19, Isuru Suriarachchi <isur...@gmail.com> wrote:
>
> Hi all,
>
> I'm just trying to use an HDFS file as the sink for my flink stream job. I
> use the following line to do so.
>
> stream.writeAsText("hdfs://hadoop-master:9000/user/isuru/foo");
>
> I have not set "fs.hdfs.hadoopconf" in my flink configuration as it should
> work with the full hdfs file name according to [1].
>
> However, it doesn't work as expected. File foo is created on hdfs. But that
> file is empty. But I don't see any error logs too on Flink side. When I used
> a normal file sink using a "file:///.." url, it works fine and data is there
> in the file.
>
> Do I need any other configuration to get his working?
>
> Thanks,
> Isuru
>
> [1]
> https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/config.html#hdfs
>
> <https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/config.html#hdfs>
