Look into Powered by Spark page...I found a project there which used
autoencoder functions...It's not updated for a long time now !
On Thu, Jun 26, 2014 at 10:51 PM, Ulanov, Alexander alexander.ula...@hp.com
wrote:
Hi Bert,
It would be extremely interesting. Do you plan to implement
Hi all,
Just found this thread -- is there an update on including DSGD in Spark? We
have a project that entails topic modeling on a document-term matrix using
matrix factorization, and were wondering if we should use ALS or attempt
writing our own matrix factorization implementation on top of
Hi,
In my experiments with Jellyfish I did not see any substantial RMSE loss
over DSGD for Netflix dataset...
So we decided to stick with ALS and implemented a family of Quadratic
Minimization solvers that stays in the ALS realm but can solve interesting
constraints(positivity, bounds, L1,
Thanks Reynold for advice.
Ron
-Original Message-
From: Reynold Xin [mailto:r...@databricks.com]
Sent: Thursday, June 26, 2014 8:57 PM
To: dev@spark.apache.org
Subject: Re: IntelliJ IDEA cannot compile TreeNode.scala
IntelliJ parser/analyzer/compiler behaves differently from Scala
+1
Tested it out on Mac OS X and Windows, looked through docs.
Matei
On Jun 26, 2014, at 7:06 PM, Patrick Wendell pwend...@gmail.com wrote:
Please vote on releasing the following candidate as Apache Spark version
1.0.1!
The tag to be voted on is v1.0.1-rc1 (commit 7feeda3):
Hi,
I am looking for an efficient linear CG to be put inside the Quadratic
Minimization algorithms we added for Spark mllib.
With a good linear CG, we should be able to solve kernel SVMs with this
solver in mllib...
I use direct solves right now using cholesky decomposition which has higher
I have no ideas on benchmarks, but breeze has a CG solver:
https://github.com/scalanlp/breeze/tree/master/math/src/main/scala/breeze/optimize/linear/ConjugateGradient.scala
There is an issue with the SparkUI: the storage page continues to display
RDDs that are dropped from memory. This is fixed in
https://github.com/apache/spark/commit/21e0f77b6321590ed86223a60cdb8ae08ea4057f
but is not part of this RC.
2014-06-27 11:18 GMT-07:00 Matei Zaharia
Thanks David...Let me try it...I am keen to see the results first and later
will look into runtime optimizations...
Deb
On Fri, Jun 27, 2014 at 3:12 PM, David Hall d...@cs.berkeley.edu wrote:
I have no ideas on benchmarks, but breeze has a CG solver:
One question, then, is what to use to debug Spark if Intellij can only be used
for code browsing for the sake of unresolved symbols as mentioned by Ron?
More specifically, if one builds from command line, but would like to debug a
running Spark from a IDE, Intellij, e.g., what could he do?
(Forgot to mention, that UI bug is not in Spark 1.0.0, so it is technically
a regression)
2014-06-27 15:42 GMT-07:00 Andrew Or and...@databricks.com:
There is an issue with the SparkUI: the storage page continues to display
RDDs that are dropped from memory. This is fixed in
Hi Xiaokai,
My bad. I didn't notice this before I created another PR for Poisson
regression. The mails were buried in junk by the corp mail master. Also, thanks
for considering my comments and advice in your PR.
Adding my two cents here:
* PoissonRegressionModel and GammaRegressionModel have
+1
Compiled for CentOS 6.5, deployed in our 4 node cluster (Hadoop 2.2, YARN)
Smoke Tests (sparkPi,spark-shell, web UI) successful
Cheers
k/
On Thu, Jun 26, 2014 at 7:06 PM, Patrick Wendell pwend...@gmail.com wrote:
Please vote on releasing the following candidate as Apache Spark version
13 matches
Mail list logo
