Confidence in implicit factorization

2015-07-25 Thread Debasish Das
Hi, Implicit factorization is important for us since it drives recommendation when modeling user click/no-click and also topic modeling to handle 0 counts in document x word matrices through NMF and Sparse Coding. I am a bit confused on this code: val c1 = alpha * math.abs(rating) if (rating

Parallelism of Custom receiver in spark

2015-07-25 Thread anshu shukla
1 - How to increase the level of *parallelism in spark streaming custom RECEIVER* . 2 - Will ssc.receiverstream(/**anything //) will *delete the data stored in spark memory using store(s) * logic . -- Thanks Regards, Anshu Shukla

Re: non-deprecation compiler warnings are upgraded to build errors now

2015-07-25 Thread Iulian DragoČ™
On Fri, Jul 24, 2015 at 8:19 PM, Reynold Xin r...@databricks.com wrote: Jenkins only run Scala 2.10. I'm actually not sure what the behavior is with 2.11 for that patch. iulian - can you take a look into it and see if it is working as expected? It is, in the sense that warnings fail the

Protocol for build breaks

2015-07-25 Thread Patrick Wendell
Hi All, If there is a build break (i.e. a compile issue or consistently failing test) that somehow makes it into master, the best protocol is: 1. Revert the offending patch. 2. File a JIRA and assign it to the committer of the offending patch. The JIRA should contain links to broken builds.