The vote passes with 7 +1s (4 binding +1s).
Thanks to all who helped with the release!
(* = binding)
+1:
- Yuming Wang *
- Jie Yang
- Dongjoon Hyun *
- Liang-Chi Hsieh *
- Cheng Pan
- Mridul Muralidharan *
- Jia Fan
+0: None
-1: None
Thank you for your comments.
My vision of integrating machine learning (ML) into Spark Structured
Streaming (SSS) for capacity planning and performance optimization seems to
be promising. By leveraging ML techniques, I believe that we can
potentially create predictive models that enhance the
IMO, using any kind of machine learning or AI for DRA is overkill. The effort
involved would be considerable and likely counterproductive, compared to a more
conventional approach of comparing the rate of incoming stream data with the
effort of handling previous data rates.
> Forward to dev
Yes, the databricks runtime 13.0 and 13.1 and 13.2 are all ok and have the
same behavior with open source Apache Spark 3.4.x.
But I think the docs of databricks need to be updated[1]. It's confusing.
[1]
