Hi All depends of the filesystem you are using. If you want all nodes share the same files then you need a shared filesystem or distributed filesystem like hdfs (not yet supported by textio) or gs (supported by textio). If you use file (local filesystem) then the files will be local to each node.
Regards JB On Oct 5, 2016, 02:12, at 02:12, amir bahmanyari <[email protected]> wrote: >Hi Colleagues,When you are using TextIO() in a Beam (java) app >executing in a Flink Cluster, do you have to have a copy of the file in >every Flink cluster node?Also, if you want to read the file from one >node (probably remote node) only, how would the >TextIO.Read.from("....") look like?What are the best TextIO() practices >in situations like this?Thanks+regards,Amir
