I notice that some people send messages directly to user@spark.apache.org
and some via nabble, either using email or the web client.
There are two index sites, one directly at apache.org and one at nabble.
But messages sent directly to user@spark.apache.org only show up in the
apache list.
yuzhih...@gmail.com wrote:
Jim:
I can find the example message here:
http://search-hadoop.com/m/JW1q5zP54J1
On Fri, Mar 20, 2015 at 12:29 PM, Jim Kleckner j...@cloudphysics.com
wrote:
I notice that some people send messages directly to user@spark.apache.org
and some via nabble, either
Do people have a reliable/repeatable method for solving dependency issues
or tips?
The current world of spark-hadoop-hbase-parquet-... is very challenging
given the huge footprint of dependent packages and we may be pushing
against the limits of how many packages can be combined into one
.
On Thu, Feb 26, 2015 at 9:54 AM, Marcelo Vanzin van...@cloudera.com wrote:
On Wed, Feb 25, 2015 at 8:42 PM, Jim Kleckner j...@cloudphysics.com
wrote:
So, should the userClassPathFirst flag work and there is a bug?
Sorry for jumping in the middle of conversation (and probably missing
some
Forwarding conversation below that didn't make it to the list.
-- Forwarded message --
From: Jim Kleckner j...@cloudphysics.com
Date: Wed, Feb 25, 2015 at 8:42 PM
Subject: Re: Spark excludes fastutil dependencies we need
To: Ted Yu yuzhih...@gmail.com
Cc: Sean Owen so
I created an issue and pull request.
Discussion can continue there:
https://issues.apache.org/jira/browse/SPARK-6029
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Fwd-Spark-excludes-fastutil-dependencies-we-need-tp21812p21814.html
Sent from the Apache
, 2015 at 5:34 AM, Ted Yu yuzhih...@gmail.com wrote:
bq. depend on missing fastutil classes like Long2LongOpenHashMap
Looks like Long2LongOpenHashMap should be added to the shaded jar.
Cheers
On Tue, Feb 24, 2015 at 7:36 PM, Jim Kleckner j...@cloudphysics.com
wrote:
Spark includes
Spark includes the clearspring analytics package but intentionally excludes
the dependencies of the fastutil package (see below).
Spark includes parquet-column which includes fastutil and relocates it under
parquet/
but creates a shaded jar file which is incomplete because it shades out some
of
