Re: [SQL] s.s.a.coalescePartitions.parallelismFirst true but recommends false

2021-09-07 Thread Jacek Laskowski
Thanks Wenchen. If it's ever asked on SO I'm simply gonna quote you :) Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski "The Internals Of" Online Books Follow me on https://twitter.com/jaceklaskowski On Tue, Sep 7,

Re: Observer Namenode and Committer Algorithm V1

2021-09-07 Thread Steve Loughran
FileContext came in Hadoop 2.x with a cleaner split of client API and driver implementation, and stricter definition of some things considered broken in FileSystem (rename() corner cases, notion of a current directory, ...) But as it came out after the platform was broadly adopted & never