There was some time ago a PR that added support to VFS with this at
least theorically we could support FTP and even HTTP listings.
However this needs some love to rebase and update it, but if you are
interested on hacking on this don't hesitate to cohtact me and I can
mentor you to do so or
For the calling external service, it's described in [1] as a pattern which
has a small sample of code instruction.
However, why not write a script to prepare the data first and then write a
pipeline to process it?
1.
Hi Folks ,
I'm newbie in Beam, but I looking for some way to read an File stored at
FTP
First of all, I could create ParDo, using FTPClient (Commons-net) and
access returning an Byte[] of File *.csv.
second ParDO create the csv
third PardDo using the TextIO to read lines
Somebody could