This should help you understand the cost of running a Spark cluster for a short period of time:
http://www.ec2instances.info/ If you run an instance for even 1 second of a single hour you are charged for that complete hour. So before you shut down your miniature cluster make sure you really are done with what you want to do, as firing up the cluster again will be like using an extra hour's worth of time. The purpose of EC2's free tier is to get you to purchase into AWS services. At the free level its not terribly useful except for the most simplest of web applications (which you could host on Heroku - also uses AWS - for free) or simple long running but largely dormant shell processes. On Tue Feb 24 2015 at 10:16:56 AM Deep Pradhan <pradhandeep1...@gmail.com> wrote: > Thank You Sean. > I was just trying to experiment with the performance of Spark Applications > with various worker instances (I hope you remember that we discussed about > the worker instances). > I thought it would be a good one to try in EC2. So, it doesn't work out, > does it? > > Thank You > > On Tue, Feb 24, 2015 at 8:40 PM, Sean Owen <so...@cloudera.com> wrote: > >> The free tier includes 750 hours of t2.micro instance time per month. >> http://aws.amazon.com/free/ >> >> That's basically a month of hours, so it's all free if you run one >> instance only at a time. If you run 4, you'll be able to run your >> cluster of 4 for about a week free. >> >> A t2.micro has 1GB of memory, which is small but something you could >> possible get work done with. >> >> However it provides only burst CPU. You can only use about 10% of 1 >> vCPU continuously due to capping. Imagine this as about 1/10th of 1 >> core on your laptop. It would be incredibly slow. >> >> This is not to mention the network and I/O bottleneck you're likely to >> run into as you don't get much provisioning with these free instances. >> >> So, no you really can't use this for anything that is at all CPU >> intensive. It's for, say, running a low-traffic web service. >> >> On Tue, Feb 24, 2015 at 2:55 PM, Deep Pradhan <pradhandeep1...@gmail.com> >> wrote: >> > Hi, >> > I have just signed up for Amazon AWS because I learnt that it provides >> > service for free for the first 12 months. >> > I want to run Spark on EC2 cluster. Will they charge me for this? >> > >> > Thank You >> > >
