Are intermediate results stored in S3 as well?
Also, any plans to support HTable?
Chris K Wensel-2 wrote:
FYI
Amazons new Hadoop offering:
http://aws.amazon.com/elasticmapreduce/
And Cascading 1.0 supports it:
http://www.cascading.org/2009/04/amazon-elastic-mapreduce.html
Intermediate results can be stored in hdfs on the EC2 machines, or in S3
using s3n... performance is better if you store on hdfs:
-input,
s3n://elasticmapreduce/samples/similarity/lastfm/input/,
-output,hdfs:///home/hadoop/output2/,
On Mon, Apr 6, 2009 at
Brian Bockelman wrote:
On Apr 2, 2009, at 3:13 AM, zhang jianfeng wrote:
seems like I should pay for additional money, so why not configure a
hadoop
cluster in EC2 by myself. This already have been automatic using script.
Not everyone has a support team or an operations team or enough
On Fri, 2009-04-03 at 11:19 +0100, Steve Loughran wrote:
True, but this way nobody gets the opportunity to learn how to do it
themselves, which can be a tactical error one comes to regret further
down the line. By learning the pain of cluster management today, you get
to keep it under
On Thu, Apr 2, 2009 at 4:13 AM, zhang jianfeng zjf...@gmail.com wrote:
seems like I should pay for additional money, so why not configure a hadoop
cluster in EC2 by myself. This already have been automatic using script.
Personally, I'm excited about this. They're charging a tiny fraction
above
I may be wrong but I would welcome this. As far as I understand the hot
topic in cloud computing these days is standardization ... and I would be
happy if Hadoop could be considered as a standard for cloud computing
architecture. So the more Amazon pushes Hadoop the more it could be accepted
by
them to learn all the admin aspects of Hadoop, which
becomes a hurdle for them to move fast.
Rgds,
Ricky
-Original Message-
From: Steve Loughran [mailto:ste...@apache.org]
Sent: Friday, April 03, 2009 2:19 AM
To: core-user@hadoop.apache.org
Subject: Re: Amazon Elastic MapReduce
Brian
Does it support pig ?
On Thu, Apr 2, 2009 at 3:47 PM, Chris K Wensel ch...@wensel.net wrote:
FYI
Amazons new Hadoop offering:
http://aws.amazon.com/elasticmapreduce/
And Cascading 1.0 supports it:
http://www.cascading.org/2009/04/amazon-elastic-mapreduce.html
cheers,
ckw
--
Chris
... and only in the US
Miles
2009/4/2 zhang jianfeng zjf...@gmail.com:
Does it support pig ?
On Thu, Apr 2, 2009 at 3:47 PM, Chris K Wensel ch...@wensel.net wrote:
FYI
Amazons new Hadoop offering:
http://aws.amazon.com/elasticmapreduce/
And Cascading 1.0 supports it:
seems like I should pay for additional money, so why not configure a hadoop
cluster in EC2 by myself. This already have been automatic using script.
On Thu, Apr 2, 2009 at 4:09 PM, Miles Osborne mi...@inf.ed.ac.uk wrote:
... and only in the US
Miles
2009/4/2 zhang jianfeng
On Apr 2, 2009, at 3:13 AM, zhang jianfeng wrote:
seems like I should pay for additional money, so why not configure a
hadoop
cluster in EC2 by myself. This already have been automatic using
script.
Not everyone has a support team or an operations team or enough time
to learn how to
You should check out the new pricing.
On Apr 2, 2009, at 1:13 AM, zhang jianfeng wrote:
seems like I should pay for additional money, so why not configure a
hadoop
cluster in EC2 by myself. This already have been automatic using
script.
On Thu, Apr 2, 2009 at 4:09 PM, Miles Osborne
So if I understand correctly, this is an automated system to bring up a
hadoop cluster on EC2, import some data from S3, run a job flow, write the
data back to S3, and bring down the cluster?
This seems like a pretty good deal. At the pricing they are offering, unless
I'm able to keep a cluster
Kevin,
The API accepts any arguments you can pass in the standard jobconf for
Hadoop 18.3, it is pretty easy to convert over an existing jobflow to a JSON
job description that will run on the service.
-Pete
On Thu, Apr 2, 2009 at 2:44 PM, Kevin Peterson kpeter...@biz360.com wrote:
So if I
14 matches
Mail list logo
