Github user tsailiming commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-114937463
@mengxr
I was looking into using openBLAS and found that the doc has been changed,
especially on the sentence for
> BLAS/LAPACK libraries on worker
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-115015539
It's not needed because it's all covered in the linked netlib-java
instructions. I recommend you click through.
---
If your project is set up for it, you can reply to th
Github user tsailiming commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-115091978
I couldn't find any specific information with regards to this change on
netlib-java instructions.
I thought there was a specific reason that we need to to bui
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-115157561
This is an OpenBLAS problem, it's not specific to Spark.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. I
Github user sujkh85 commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-115157681
NAVER - http://www.naver.com/
su...@naver.com ëê» ë³´ë´ì ë©ì¼ ì´ ë¤ìê³¼ ê°ì ì´ì ë¡ ì ì¡
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73376833
@mengxr I'm pretty sure that talk link is supposed to be permanent. If it
isn't, I'll be having words with skillsmatters! :smile: I don't have a youtube
link or anything f
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73376879
@mengxr sorry, forgot to answer re: gfortran. That's needed only for
natives. All is documented on the netlib-java webpage. If I get a lot of Spark
traffic, I'll create a
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73376909
@mengxr "warn people about LGPL"! Ha! That old Apache FUD.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73380448
@srowen I've had a big discussion with Apache about this and it went
nowhere, even though IP laywers stepped up to back up my stance. I firmly
believe the Apache stance on
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73370254
@fommil big talk, I like it! I don't think pay is on offer, but glory is.
Why not try a small improvement to demonstrate?
---
If your project is set up for it, you can re
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73380542
@mengxr btw, the talk page **definitely** contains more information than is
in the slides. There are no voice overlays on the high resolution slides. If I
had to pick one
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73370324
@srowen updated title. Re: natives, absolutely not! The whole point of
netlib-java is that it is a common API that is swapped at runtime for Java
(never leave the JVM), Na
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73370414
My primary FOSS focus right now is getting
[ENSIME](https://github.com/ensime/ensime-server/) to 1.0 and after that I have
a few private projects demanding my time.
---
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73370482
It's not part of the API. I can't evaluate your claims but you seem pretty
sure about them, but am not aware of the history why netlib-java wasn't used. I
suppose these th
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73380794
@srowen btw, have you looked inside the JBLAS jars? You know there are LGPL
binaries in there, right? Look for the 32 and 64 bit versions of
`libgfortran-3.dll` in this fi
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73370539
Glory, heh, yeah right. I think it'd just get me in more trouble with my
wife: I already spend too much of my personal time writing FOSS.
In light of https://githu
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73377917
@fommil I think you're misrepresenting the nature of the LGPL issue. It is
materially different from the Apache License 2, and so bundling LGPL with
Apache Licensed code m
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73370865
@srowen I can guess at the history. `netlib-java` used to require that
users compile their own natives but, inspired by JBLAS, about 2 years ago I did
a big spike and beat
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73381257
@fommil I don't agree with how you think about licenses, but it's off topic
for purposes here. But it's important if you're saying the JBLAS distro
contains LGPL code. Are
Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73378049
@fommil I didn't mean that you were advertising netlib-java. I'm only
worried about the link being "permanent" or not. We put two contracts here: 1)
skillsmatters won't ch
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73381618
@srowen nope, it's the full LGPL thing. Those aren't the only LGPL DLLs
either, there are a few others from GCC.
If you remove the JBLAS dependency, this "problem"
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73381756
I agree, looks like these are just for Windows, but they are separate from
the jblas shims. They need to be removed since they can't be redistributed. I
will make a JIRA f
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73381911
It's trivial work, just needs time. I'd actually really like to do it and
get more involved in optimising spark, but I really can't justify it on top of
other FOSS/private
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73381972
@fommil Yes. I mean that it can't be distributed at all in the Spark
assembly. Spark does not literally redistribute the jblas artifacts.
---
If your project is set up fo
Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73375745
@fommil Thanks for the update! As @srowen pointed out, MLlib still has some
JBLAS code in the NNLS solver and data generators. We should be able to remove
it in the next r
Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73442823
The current version looks good to me. I'm going to merge it into master and
branch-1.3. Thanks for the discussion about JBLAS' license. I think we should
remove JBLAS from
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/4448
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user debasish83 commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73567903
@mengxr NNLS is added to Breeze in this PR
https://github.com/scalanlp/breeze/pull/321 once David merges it, I believe you
can clean up jblas dependencies completely..
Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73602921
@debasish83 Thanks for the update! Please ping me when it gets merged.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitH
Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73606635
Sweet! :smile:
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
30 matches
Mail list logo
