??Spark ML??How to get access of the MLlib's LogisticRegressionWithSGD after 3.0.0?

Hi, I have updated my Spark to the version of 3.0.0, and it seems that the LogisticRegressionWithSGD's constructor is private within the mllib package, So i can't initialize an instance of this class. How can i still use this class rather than switch to the LogisticRegressionWithLBFGS ?

Re: [pyspark 2.4] broadcasting DataFrame throws error

Thanks Amit, I was referring to dynamic partition pruning ( https://issues.apache.org/jira/browse/SPARK-11150) & adaptive query execution (https://issues.apache.org/jira/browse/SPARK-31412) in Sparkk 3 - where it would figure out right partitions & pushes the filters to input before applying the

Exporting spark custom metrics via prometheus jmx exporter

I'm new to spark. Trying to export spark (2.4.0) custom metrics in prometheus format. I found this guide https://argus-sec.com/monitoring-spark-prometheus/ Running on my local pc (windows) I am able to see my metrics in visualVM and in spark's json http://localhost:4040/metrics/json/ My issue