Re: [Spark ML] existence of Matrix Factorization ALS algorithm's log version

Thanks for your quick reply. I'll hack it if needed :) James -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: [Spark ML] existence of Matrix Factorization ALS algorithm's log version

No there isn't a log version. You could probably copy and hack the implementation easily if necessary. On Wed, Jul 29, 2020 at 11:05 AM jyuan1986 wrote: > > Hi Team, > > I'm looking for information regarding MF_ALS algorithm's log version if > implemented. In original Hu et al.'s paper

[Spark ML] existence of Matrix Factorization ALS algorithm's log version

Hi Team, I'm looking for information regarding MF_ALS algorithm's log version if implemented. In original Hu et al.'s paper "Collaborative filtering for implicit feedback datasets", there're two different ways to construct confidence level c(ui) from raw info r(ui): the vanilla version is

Write to same hdfs dir from multiple spark jobs

Hi Is there any design pattern around writing to the same hdfs directory from multiple spark jobs? -- Thanks Deepak www.bigdatabig.com