[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14330377#comment-14330377
]
Apache Spark commented on SPARK-5669:
-
User 'srowen' has created a pull request for this issue:
https://github.com/apache/spark/pull/4715
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328364#comment-14328364
]
Sean Owen commented on SPARK-5669:
--
It *should* be fine on the grounds that the native libs are on the classpath
and there is no conflict. That said I have not tried it. Are you proposing the
new PR for 1.3.0? That would also solve the issue. If not, I would support it
if you felt more comfortable restoring the native libs for 1.3.0 instead.
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328358#comment-14328358
]
Xiangrui Meng commented on SPARK-5669:
--
Agree that users should maintain their dependencies. In 1.3, if users want to
use JBLAS to call native routines, there will be two JBLAS jars on the
classpath, one with native libraries from user and one without from Spark. I
don't know what would happen in this case. If we remove JBLAS in 1.4, there
will be only one BLAS jar. Btw, I sent out a PR for SPARK-5814. Maybe it is too
late to merge it into branch-1.3 now, but it should be a good change. Let's ask
[~pwendell].
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328092#comment-14328092
]
Sean Owen commented on SPARK-5669:
--
I do find it confusing. I can see an argument that this is allowed on the
grounds that it *does* meet the exception because the target work is created
*without* GCC, and on the grounds that it is *not* a Category X license case as
described in http://www.apache.org/legal/resolved.html#category-x , even though
the list calls out "special exception to the GPL" licenses, since the problem
it identifies regarding derived works is *not* part of the exception terms.
If that's true, I don't even see that a notice is required.
On that grounds, you could put back the binaries into 1.3. (Yes, it's a moot
point in 1.4). Your reasoning is that it would prevent users from having to
bring their own JBLAS if they already use JBLAS. But they'll have to in 1.4
anyway, and we've always required programs to bring their own dependencies even
if they're also used by Spark. I suppose I'd favor taking that hit earlier than
later, since it happens anyway, and if it lets us be a tiny bit more
conservative about the licensing issue.
But I do not feel strongly about it. Having said all that, would you rather
proceed with just putting back the libs in 1.3?
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328010#comment-14328010
]
Xiangrui Meng commented on SPARK-5669:
--
Yes, we are going to remove JBLAS anyway in 1.4. Having a simple dependency
tree is always a good thing. The problem is how we should proceed for
branch-1.0/1.1/1.2. If we are covered by this exemption. Maybe the only thing
we need to do is to put a notice. This also applies to branch-1.3. We don't
call native routines in Spark but it doesn't mean that users don't. With the
current solution, users need to supply the origin JBLAS jar at runtime to use
native routines, and I haven't tested whether it works or not. So if we are
covered by this exemption, the best thing to do might be to revert the patch
and put a notice.
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327997#comment-14327997
]
Sean Owen commented on SPARK-5669:
--
Aha, that's a good point. I'm still not clear if this exception covers the
usage in Spark, given the definition of "Eligible Compilation Process":
{code}
A Compilation Process is "Eligible" if it is done using GCC, alone or with
other GPL-compatible software, or if it is done without using any work based on
GCC. ...
{code}
Here the Target Work is just put together with bundling. It doesn't seem quite
in the spirit of this exemption as I understand it, but it's done without using
any work based on GCC," at least I think.
Well, regardless, my thinking was that there was already momentum to
standardize on one library, so erring on the side of caution regarding
licenses, and excising JBLAS also solves that problem. Also, since 1.3 we don't
even use the native libraries anyway. Do you think it's best to continue down
this road anyway, removing the native libs at least and likely JBLAS?
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327953#comment-14327953
]
Xiangrui Meng commented on SPARK-5669:
--
GFortran is part of GCC (https://gcc.gnu.org/wiki/GFortran) and hence the
`libgfortran` library. In Apple's libgfortran header file
(http://www.opensource.apple.com/source/gcc/gcc-5484/libgfortran/libgfortran.h),
I found the following:
{code}
As a special exception, if you link this library with other files,
some of which are compiled with GCC, to produce an executable,
this library does not by itself cause the resulting executable
to be covered by the GNU General Public License.
This exception does not however invalidate any other reasons why
the executable file might be covered by the GNU General Public License.
{code}
The official one linked to the special exception page:
https://github.com/gcc-mirror/gcc/blob/master/libgfortran/libgfortran.h#L18
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327133#comment-14327133
]
Sean Owen commented on SPARK-5669:
--
[~mengxr] That just applies to GCC, right? it still wouldn't change the LGPL
license for libgfortran. I also don't know if Spark qualifies given the
definition of "Eligible Compilation Process". My understanding is that without
this exception, anything compiled by GCC would be copyleft, and this prevents
that. I don't know if it generally allows redistribution of libgcc.
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326940#comment-14326940
]
Xiangrui Meng commented on SPARK-5669:
--
[~srowen] I came across this "GCC Runtime Library Exception" today:
https://www.gnu.org/licenses/gcc-exception but I haven't read it closely. It
seems that we can include GCC binaries with a NOTICE file. If this is true, the
issue becomes less critical.
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326706#comment-14326706
]
Xiangrui Meng commented on SPARK-5669:
--
[~srowen] We will remove JBLAS from runtime in 1.4. But for branch-1.1 and
branch-1.2, we should use your solution.
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325759#comment-14325759
]
Apache Spark commented on SPARK-5669:
-
User 'srowen' has created a pull request for this issue:
https://github.com/apache/spark/pull/4673
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322084#comment-14322084
]
Sean Owen commented on SPARK-5669:
--
Since the follow-up change is to remove JBLAS, and that's covered in
SPARK-5814, shall we track the remaining work there?
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322082#comment-14322082
]
Xiangrui Meng commented on SPARK-5669:
--
PR #4453 resolves this issue for master and branch-1.3.
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Assignee: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
[
https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310931#comment-14310931
]
Apache Spark commented on SPARK-5669:
-
User 'srowen' has created a pull request for this issue:
https://github.com/apache/spark/pull/4453
> Spark assembly includes incompatibly licensed libgfortran, libgcc code via
> JBLAS
>
>
> Key: SPARK-5669
> URL: https://issues.apache.org/jira/browse/SPARK-5669
> Project: Spark
> Issue Type: Bug
> Components: Build
>Reporter: Sean Owen
>Priority: Blocker
> Fix For: 1.3.0
>
>
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes
> the following, from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/libjblas.so
> lib/static/Linux/i386/libjblas_arch_flavor.so
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/libjblas.so
> lib/static/Linux/amd64/libjblas_arch_flavor.so
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are
> not licensed in a way that's compatible with Spark and the AL2 -- LGPL at
> least.
> It's easy to exclude them. I'm not clear what it does to running on Windows;
> I assume it can still work but the libs would have to be made available
> locally and put on the shared library path manually. I don't think there's a
> package manager as in Linux that would make it easily available. I'm not able
> to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to
> be removed on the double, or treated as a known issue for 1.3.0.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
