unsubscribe

2023-12-11 Thread Stevens, Clay
unsubscribe

RE: The job failed when we upgraded from spark 3.3.1 to spark3.4.1

2023-11-16 Thread Stevens, Clay
Perhaps you also need to upgrade Scala? Clay Stevens From: Hanyu Huang Sent: Wednesday, 15 November, 2023 1:15 AM To: user@spark.apache.org Subject: The job failed when we upgraded from spark 3.3.1 to spark3.4.1 Caution, this email may be from a sender outside Wolters Kluwer. Verify the

Efficient cosine similarity computation

2019-09-23 Thread Stevens, Clay
There are several ways I can compute the cosine similarities between a Spark ML vector to each ML vector in a Spark DataFrame column then sorting for the highest results. However, I can't come up with a method that is faster than replacing the `/data/` in a Spark ML Word2Vec model, then using