Re: Implementation for approx_count_distinct_sketch and associated functions

2023-01-20 Thread Ryan Berti
Hello, Wanted to follow up and link out the Spark PR associated with these changes ; I'm excited to open up the implementation for community review! For reference, I worked with @Daniel Tenedorio and the Databricks team on a pre-review

Re: [DISCUSS] Deprecate DStream in 3.4

2023-01-20 Thread Jungtaek Lim
Heads-up: It's addressed via https://issues.apache.org/jira/browse/SPARK-42075. We just marked deprecation in the entry point of DStream, StreamContext. Marking all classes in the DStream module is not pragmatic and users would see the warning message anyway. On Mon, Jan 16, 2023 at 8:26 AM