A filesystem is a lower level abstraction that a PTransform can use thus
there is no need to consider SDF when creating the S3 filesytem.
If we were redesigning the interface to all filesystems, then SDF should be
considered.
On Mon, Apr 8, 2019 at 10:54 AM Lara Schmidt wrote:
> I'd push
Currently, Pasan is working on a design for adding a couple implementations
to the Filesystem interface in Python, and it's not necessary to consider
SDF here. IMHO.
On the other hand, Python's fileio[1] could probably use SDF-based
improvements to split when many files are being matched.
Best
+dev +Pablo Estrada +Chamikara
Jayalath +Udi Meiri
Thank you Pasan. I quickly looked at the proposal and it looks good. Added
a few folks who could offer additional feedback.
On Mon, Apr 8, 2019 at 12:13 AM Pasan Kamburugamuwa <
pasankamburugamu...@gmail.com> wrote:
> Hi,
>
> I have updated
Hi,
I have updated the project proposal according to the given feedback. So can
you guys check my proposal again and give me your feedback about
corrections I have done.
Here is the link to the updated project proposal