+1 (non-binding)
built from source
fired up a spark-shell against YARN cluster
ran some jobs using parallelize
ran some jobs that read files
clicked around the web UI
On Sun, Nov 30, 2014 at 1:10 AM, GuoQiang Li wi...@qq.com wrote:
+1 (non-binding)
-- Original
Hi Michael,
About this new data source API, what type of data sources would it support?
Does it have to be RDBMS necessarily?
Cheers
On Sat, Nov 29, 2014 at 12:57 AM, Michael Armbrust mich...@databricks.com
wrote:
You probably don't need to create a new kind of SchemaRDD. Instead I'd
The inaugural Spark Summit East (spark-summit.org/east), an event to bring
the Apache Spark community together, will be in New York City on March 18,
2015. The call for submissions is currently open, but will close this
Friday December 5, at 11:59pm PST. The summit is looking for talks that
will
Hi everyone,
There’s an open bug report related to Spark standalone which could be a
potential release-blocker (pending investigation / a bug fix):
https://issues.apache.org/jira/browse/SPARK-4498. This issue seems
non-deterministc and only affects long-running Spark standalone deployments,
No, it should support any data source that has a schema and can produce
rows.
On Mon, Dec 1, 2014 at 1:34 AM, Niranda Perera nira...@wso2.com wrote:
Hi Michael,
About this new data source API, what type of data sources would it
support? Does it have to be RDBMS necessarily?
Cheers
On
+0.9 from me. Tested it on Mac and Windows (someone has to do it) and while
things work, I noticed a few recent scripts don't have Windows equivalents,
namely https://issues.apache.org/jira/browse/SPARK-4683 and
https://issues.apache.org/jira/browse/SPARK-4684. The first one at least would
be
i'll send out a reminder next week, but i wanted to give a heads up: i'll
be bringing down the entire jenkins infrastructure for reboots and system
updates.
please let me know if there are any conflicts with this, thanks!
shane
It seems there were some additional settings required to build spark now .
This should be a snap for most of you ot there about what I am missing.
Here is the command line I have traditionally used:
mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
That command line is
Already tried the solutions they provided.. Did not workout..
On 12/2/14 8:17 AM, Dinesh J. Weerakkody wrote:
Hi Lochana,
can you please go through this mail thread [1]. I haven't tried but
can be useful.
[1]
I tried the same command on MacBook and didn't experience the same error.
Which OS are you using ?
Cheers
On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch java...@gmail.com wrote:
It seems there were some additional settings required to build spark now .
This should be a snap for most of you
Mac as well. Just found the problem: I had created an alias to zinc a
couple of months back. Apparently that is not happy with the build anymore.
No problem now that the issue has been isolated - just need to fix my zinc
alias.
2014-12-01 18:55 GMT-08:00 Ted Yu yuzhih...@gmail.com:
I tried
The zinc src zip for 0.3.5.3 was downloaded and exploded. Then I ran
sbt dist/create . zinc is being launched from
dist/target/zinc-0.3.5.3/bin/zinc
2014-12-01 20:12 GMT-08:00 Ted Yu yuzhih...@gmail.com:
I use zinc 0.2.0 and started zinc with the same command shown below.
I don't observe
I used the following for brew:
http://repo.typesafe.com/typesafe/zinc/com/typesafe/zinc/dist/0.3.0/zinc-0.3.0.tgz
After starting zinc, I issued the same mvn command but didn't encounter the
error you saw.
FYI
On Mon, Dec 1, 2014 at 8:18 PM, Stephen Boesch java...@gmail.com wrote:
The zinc src
hello,
im running spark on a cluster and i want to monitor how many nodes/ cores
are active in different (specific) points of the program.
is there any way to do this?
thanks,
Isca
Hi,
Can the Scala classes in the spark source code, be inherited (and other OOP
concepts) in Java classes?
I want to customize some part of the code, but I would like to do it in a
Java environment.
Rgds
--
*Niranda Perera*
Software Engineer, WSO2 Inc.
Mobile: +94-71-554-8430
Twitter: @n1r44
I'm having no problems with the build or zinc on my Mac. I use zinc
from brew install zinc.
On Tue, Dec 2, 2014 at 3:02 AM, Stephen Boesch java...@gmail.com wrote:
Mac as well. Just found the problem: I had created an alias to zinc a
couple of months back. Apparently that is not happy with
Yes, they are compiled to classes in JVM bytecode just the same. You
may find the generated code from Scala looks a bit strange and uses
Scala-specific classes, but it's certainly possible to treat them like
other Java classes.
On Tue, Dec 2, 2014 at 5:22 AM, Niranda Perera nira...@wso2.com
Oops my previous response wasn't sent properly to the dev list. Here you go
for archiving.
Yes you can. Scala classes are compiled down to classes in bytecode. Take a
look at this: https://twitter.github.io/scala_school/java.html
Note that questions like this are not exactly what this dev list
Hey All,
Just an update. Josh, Andrew, and others are working to reproduce
SPARK-4498 and fix it. Other than that issue no serious regressions
have been reported so far. If we are able to get a fix in for that
soon, we'll likely cut another RC with the patch.
Continued testing of RC1 is
19 matches
Mail list logo
