Owen so...@cloudera.com
Cc: dev dev@spark.apache.org, jay vyas jayunit100.apa...@gmail.com,
Paolo Platter
paolo.plat...@agilelab.it, Nicholas Chammas
nicholas.cham...@gmail.com, Will Benton wi...@redhat.com
Sent: Wednesday, January 21, 2015 2:09:35 AM
Subject: Re: Standardized Spark dev
If the goal is a reproducible test environment then I think that is what
Jenkins is. Granted you can only ask it for a test. But presumably you get
the same result if you start from the same VM image as Jenkins and run the
same steps.
But the issue is when users can't reproduce Jenkins
What do y'all think of creating a standardized Spark development
environment, perhaps encoded as a Vagrantfile, and publishing it under
`dev/`?
The goal would be to make it easier for new developers to get started with
all the right configs and tools pre-installed.
If we use something like
Great suggestion.
On Jan 20, 2015 7:14 PM, Nicholas Chammas nicholas.cham...@gmail.com
wrote:
What do y'all think of creating a standardized Spark development
environment, perhaps encoded as a Vagrantfile, and publishing it under
`dev/`?
The goal would be to make it easier for new developers
How many profiles (hadoop / hive /scala) would this development environment
support ?
Cheers
On Tue, Jan 20, 2015 at 4:13 PM, Nicholas Chammas
nicholas.cham...@gmail.com wrote:
What do y'all think of creating a standardized Spark development
environment, perhaps encoded as a Vagrantfile, and
Message -
From: Nicholas Chammas nicholas.cham...@gmail.com
To: Spark dev list dev@spark.apache.org
Sent: Tuesday, January 20, 2015 6:13:31 PM
Subject: Standardized Spark dev environment
What do y'all think of creating a standardized Spark development
environment, perhaps encoded
Chammas nicholas.cham...@gmail.com
To: Spark dev list dev@spark.apache.org
Sent: Tuesday, January 20, 2015 6:13:31 PM
Subject: Standardized Spark dev environment
What do y'all think of creating a standardized Spark development
environment, perhaps encoded as a Vagrantfile
if any folks are interested.
Nate
-Original Message-
From: Sean Owen [mailto:so...@cloudera.com]
Sent: Tuesday, January 20, 2015 5:09 PM
To: Nicholas Chammas
Cc: dev
Subject: Re: Standardized Spark dev environment
My concern would mostly be maintenance. It adds to an already very complex
: Nicholas Chammas nicholas.cham...@gmail.com
To: Spark dev list dev@spark.apache.org
Sent: Tuesday, January 20, 2015 6:13:31 PM
Subject: Standardized Spark dev environment
What do y'all think of creating a standardized Spark development
environment, perhaps encoded as a Vagrantfile
: Will Bentonmailto:wi...@redhat.com; Spark dev
listmailto:dev@spark.apache.org
Oggetto: Re: Standardized Spark dev environment
I can comment on both... hi will and nate :)
1) Will's Dockerfile solution is the most simple direct solution to the
dev environment question : its a efficient way
Chammasmailto:nicholas.cham...@gmail.com
Cc: Will Bentonmailto:wi...@redhat.com; Spark dev
listmailto:dev@spark.apache.org
Oggetto: Re: Standardized Spark dev environment
I can comment on both... hi will and nate :)
1) Will's Dockerfile solution is the most simple direct solution to the
dev
11 matches
Mail list logo
