Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming

+1 On Sat, Nov 4, 2017 at 11:02 AM, Xiao Li wrote: > +1 > > 2017-11-04 11:00 GMT-07:00 Burak Yavuz : > >> +1 >> >> On Fri, Nov 3, 2017 at 10:02 PM, vaquar khan >> wrote: >> >>> +1 >>> >>> On Fri, Nov 3, 2017 at 8:14 PM, Weichen Xu

Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming

Thanks Tom. I'd imagine more details belong either in a full design doc, or a PR description. Might make sense to do an additional design doc, if there is enough delta from the current sketch doc. On Mon, Nov 6, 2017 at 7:29 AM, Tom Graves wrote: > +1 for the idea and

Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming

+1 for the idea and feature, but I think the design is definitely lacking detail on the internal changes needed and how the execution pieces work and the communication.  Are you planning on posting more of those details or were you just planning on discussing in PR? Tom On Wednesday,

[ML] Migrating transformers from mllib to ml

Hello, I saw that there are several TODOs to migrate some transformers (like HashingTF and IDF) to use only ml.Vector in order to avoid the overhead of converting them to the mllib ones and back. Is there any reason why this has not been done so far? Is it to avoid code duplication? If so, is it