Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/3221
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-168112375
I'm going to close this pull request. If this is still relevant and you are
interested in pushing it forward, please open a new pull request. Thanks!
---
If your project i
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-164884922
@mengxr @jkbradley is this still relevant given the recent changes in ALS?
---
If your project is set up for it, you can reply to this email and have your
reply appea
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-91869124
ohh sorry I don't know about requester pays...let me look into it
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHu
Github user jkbradley commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-91859312
@debasish83 Just to make sure, you're specifying it as a requestor-pays
bucket, right?
[http://docs.aws.amazon.com/AmazonS3/latest/dev/RequesterPaysBuckets.html]
---
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-91710827
@jkbradley let me know if you need vzcloud access and I can create few
nodes for you...ec2 might be easier for other's to access it as well...
---
If your project is
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-91710700
@jkbradley we still could not access the wikipedia dataset on ec2...will it
be possible for you to upload the 1 Billion token dataset on EC2 ? I wanted to
do a sparse
Github user jkbradley commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-91069400
@debasish83 Including sparsity for both recommendation and for topic
modeling will be useful, to be sure. We don't have perplexity (or even
prediction) implemented ye
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-90753041
@mengxr @josephk In my internal testing, I am finding the sparse
formulations useful for extracting genre/topic information out of
netflix/movielens dataset...The form
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87342283
What are MiMa tests ? I am bit confused on it...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If you
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87283216
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87283204
[Test build #29353 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29353/consoleFull)
for PR 3221 at commit
[`33b5a97`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87281642
[Test build #29353 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29353/consoleFull)
for PR 3221 at commit
[`33b5a97`](https://githu
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87168374
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87168365
[Test build #29340 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29340/consoleFull)
for PR 3221 at commit
[`1848181`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87165857
[Test build #29340 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29340/consoleFull)
for PR 3221 at commit
[`1848181`](https://githu
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-87165211
I integrated with Breeze 0.11.2. Only visible difference is first iteration
Breeze QuadraticMinimizer:
TUSCA09LMLVT00C:spark-qp-als v606014$ grep solve
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-86950106
@mengxr any updates on it ? breeze 0.11.2 is now integrated with Spark...I
can clean up the PR for reviews
---
If your project is set up for it, you can reply to this
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-85814758
@mengxr I discussed with David and the only reason I can think of is that
inside the solvers I am using DenseMatrix and DenseVector in-place of primitive
arrays for wo
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-85351062
All the runtime enhancements are being added to Breeze in this PR:
https://github.com/scalanlp/breeze/pull/386
Please let me know if there are additional feedbacks.
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-85161041
@mengxr I added the optimization for lower triangular matrix and now they
are very close...Let me know what do you think and if there are any other
tricks you would li
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-85158512
[Test build #29023 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29023/consoleFull)
for PR 3221 at commit
[`196d8c8`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-85158520
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-85158479
[Test build #29023 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29023/consoleFull)
for PR 3221 at commit
[`196d8c8`](https://githu
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84827225
I looked more into it and I will open up an API in Breeze
QuadraticMinimizer where in-place of DenseMatrix gram, upper triangular gram
can be sent but the inner worksp
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84766322
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84766375
Also for the ml.QuadraticSolver vs ml.CholeskySolver first iteration
runtime difference I am considering opening up an API in Breeze
QuadraticMinimizer which only uses
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84766316
[Test build #28972 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28972/consoleFull)
for PR 3221 at commit
[`a386c3e`](https://gith
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84765791
[Test build #28972 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28972/consoleFull)
for PR 3221 at commit
[`a386c3e`](https://githu
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84765491
I added all the testcases for ml.QuadraticSolver...the driver is through
MovieLensALS right now where --userConstraint and --productConstraint can be
specified...For s
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84643641
I am adding ml.QuadraticSolver tests that builds upon normal equation
(similar to CholeskySolver tests) for 1 - 5 basically...will update in a bit...
---
If your proj
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84524050
tests are failing due to scalastyle...once I clean up the breeze files, I
will fix the scalastyle issues...Later tomorrow hopefully...
---
If your project is set up f
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84522361
@mengxr @dlwh @tmyklebu I integrated Breeze QuadraticMinimizer in ml.ALS
redesign and first I am comparing the performance of ml.CholeskySolver with
Breeze QuadraticMi
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84521458
[Test build #28955 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28955/consoleFull)
for PR 3221 at commit
[`1cbe0cc`](https://gith
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84521460
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3221#issuecomment-84521399
[Test build #28955 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28955/consoleFull)
for PR 3221 at commit
[`1cbe0cc`](https://githu
36 matches
Mail list logo
