Hi
My environment:
Windows 10,
Spark 1.6.1 built for Hadoop 2.6.0 Build
Python 2.7
Java 1.8
Issue:
Go to C:\Spark
The command:
bin\spark-submit --master local C:\Spark\examples\src\main\python\pi.py 10
gives:
File "", line 1
bin\spark-submit --master local C:\Spark\examples\src\main\python\p
Got it to work...thanks a lot for the help! I started a new cluster where
Spark has Yarn as a dependency. I ran it with the script with local[2] and
it worked (this same script did not work with Spark in standalone mode).
A follow up question...I have seen this question posted around the internet
I thought I was running it in local mode as
http://spark.apache.org/docs/1.1.1/submitting-applications.html says that
if I don't include "--deploy-mode cluster" then it will run as local mode?
I tried both of the scripts above and they gave the same result as the
script I was running before.
Also
ge my submit script or how I could do so?
Thanks a lot for the help!
Suhas Shekar
University of California, Los Angeles
B.A. Economics, Specialization in Computing 2014
On Mon, Dec 29, 2014 at 12:55 AM, Akhil Das
wrote:
> How many cores are you allocated/seeing in the webui? (that usually run
:
[ConsumerFetcherManager-1419860798873] Added fetcher for partitions
ArrayBuffer([[test,0], initOffset 221 to broker
id:0,host:ip-10-0-1-232.us-west-1.compute.internal,port:9092] )
Suhas Shekar
University of California, Los Angeles
B.A. Economics, Specialization in Computing 2014
On Mon, Dec 29
in my kafka producer, the
console reacts as I showed above...do I have to place the awaitTermination
somewhere else? Or Is the warning saying there is an underlying problem?
Thank you for the help...hopefully I am as close as I think I am!
Suhas Shekar
University of California, Los Angeles
B.A
ms to keep trying every 2 seconds (as I've included 2000 in my
duration in my java app). How can I stop the Receiver from consuming
messages after 10 seconds and output the word count to the console?
Thanks a lot for all the help! I'm excited to see this word count :)
Suhas Shekar
at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
... 18 more
Suhas Shekar
University of California, Los Angeles
B.A. Economics, Specialization in Computing 2014
On Sun, Dec 28, 2014 at 11:52 PM, Suhas She
x27;t think
that will solve the error as I dont think the application had got to level
yet.
Please let me know of any possible next steps.
Thank you again for the time and the help!
Suhas Shekar
University of California, Los Angeles
B.A. Economics, Specialization in Computing 2014
On Sun, D
with a local file)
Thank you for the help!
Suhas Shekar
University of California, Los Angeles
B.A. Economics, Specialization in Computing 2014
On Sun, Dec 28, 2014 at 11:04 PM, Akhil Das
wrote:
> Make sure you verify the following:
>
> - Scala version : I think the correct version
10 matches
Mail list logo
