ilding
Spark, not during build.
On Sun, Jan 26, 2014 at 11:48 PM, Taka Shinagawa wrote:
> I'm always running sbt clean before building Spark. And I'm seeing the
> errors when I build Spark first time after downloading and extracting
> spark-0.9.0-incubating.tgz<http://people.apac
esses using the assembly
> > jar. If that's indeed the problem, removing the extra assembly jars
> should
> > fix them.
> >
> >
> > On Sun, Jan 26, 2014 at 10:49 PM, Taka Shinagawa >wrote:
> >
> >> If I build Spark for Hadoop 1.0.4 (either "SPA
If I build Spark for Hadoop 1.0.4 (either "SPARK_HADOOP_VERSION=1.0.4
sbt/sbt assembly" or "sbt/sbt assembly") or use the binary distribution,
'sbt/sbt test' runs successfully.
However, if I build Spark targeting any other Hadoop versions (e.g.
"SPARK_HADOOP_VERSION=1.2.1 sbt/sbt assembly", "SPAR
+1 for graduation. +1 for Matei as VP (The father of Spark should be the VP)
On Thu, Jan 23, 2014 at 4:40 PM, Mark Hamstra wrote:
> Is there any other choice that makes any kind of sense? Matei for VP: +1.
>
>
> On Thu, Jan 23, 2014 at 4:32 PM, Andy Konwinski >wrote:
>
> > +2 (1 for graduating
I've found a problem with the cartesian method on Pyspark and filed
as SPARK-1034
https://spark-project.atlassian.net/browse/SPARK-1034
0.8.1 doesn't have this problem. On Scala, cartesian method works fine.
It's also nice if SPARK-978 can be fixed, too.
https://spark-project.atlassian.net/browse
On my Core 2 Duo (slower) Mac, I'm having the same problem with building
v0.8.0-incubating as well.
I'm suspecting the slow build problem is caused by sbt-assembly as reported
here.
https://github.com/sbt/sbt-assembly/issues/68
I tried to upgrade sbt-assembly to version 0.10.1 (and sbt to 0.13.0)
That's a good point. Although it's definitely not a blocker for this
release, it would be more user friendly to mention sbt/sbt
assembly/assembly as well as Maven build instructions in the README and
quick-start files (at least until the time-consuming sbt assembly process
on a regular hardware get
As I reported in the Spark 0.8-1 RC2 thread, the 'sbt/sbt assembly' hangs
at the last step. It happens on a Macbook with Hadoop 2.2.0 (& Java
1.7.0_45) installed. The build was successful on another system with Hadoop
1.1.1 installed.
Here's the build command and the entire log. Thanks for the hel
? In that
> thread, could you paste the exact build command and entire output? The log
> you posted here suggests the first build detected hadoop 1.0.4 not 2.2.0
> based on the assembly file name it is logging.
>
> ---
> sent from my phone
> On Dec 8, 2013 4:13 PM, "Taka S
With Hadoop 2.2.0 (& Java 1.7.0_45) installed, I'm having trouble
completing the build process (sbt/sbt assembly) on Macbook. The sbt command
hangs at the last step.
...
...
[info] SHA-1: ce8275f5841002164c4305c912a2892ec7c1d395
[info] Packaging
/Users/taka/Documents/Spark/Releases/spark-0.8.1-inc
10 matches
Mail list logo
