Hello,
Is it possible to run SparkML using Spark Connect 3.5.0? So far I've had no
success setting up a connect client that uses ML package
The ML package uses spark core/sql afaik which seems to be shadowing the
Spark connect client classes
Do I have to exclude any dependencies from the mllib
Hi, All.
As a part of Apache Spark 4.0.0 (SPARK-44111), the Apache Spark community
starts to have test coverage for all supported Python versions from Today.
- https://github.com/apache/spark/actions/runs/7061665420
Here is a summary.
1. Main CI: All PRs and commits on `master` branch are
Ok pause/continue to throw some challenges.
The implication is to pause gracefully and resume the same' First have a
look at this SPIP of mine
[SPARK-42485] SPIP: Shutting down spark structured streaming when the
streaming process completed current process - ASF JIRA (apache.org)
Hi Spark Team,
I am using Spark 3.4.0 version in my application which is use to consume
messages from Kafka topics.
I have below queries:
1. Does DStream support pause/resume streaming message consumption at runtime
on particular condition? If yes, please provide details.
2. I tried to revoke
