Yes, very well could be. A lot of big changes with version 4. I'll see if I
can figure out where that library may have gone. They have added Zookeeper
as a supported application that EMR can install at startup, so at least we
should be able to eliminate the Zookeeper install from the bootstrap scri
Could be a EMR 3 vs 4 difference.
> On Jul 2, 2016, at 8:51 AM, David Kincaid wrote:
>
> I tried to run it from the shell (ssh'd in) on the master node of a newly
> spun up EMR cluster which used the AWS EMR 4.x.
>
> On Fri, Jul 1, 2016 at 10:33 PM, Paul Mogren
> wrote:
>
>> Did you by chanc
I tried to run it from the shell (ssh'd in) on the master node of a newly
spun up EMR cluster which used the AWS EMR 4.x.
On Fri, Jul 1, 2016 at 10:33 PM, Paul Mogren
wrote:
> Did you by chance attempt to run it outside of EMR? AWS is known to
> provide a local install of EMR integration librar
Did you by chance attempt to run it outside of EMR? AWS is known to provide a
local install of EMR integration libraries on the nodes, but not publish them
to OSS repositories.
This was derived from the old
https://github.com/awslabs/emr-bootstrap-actions/tree/master/drill and worked
for us f
Thanks, Paul. This does look like a good place to start. Unfortunately, it
fails right off the bat due to the emr/common library not being available.
Not being a Ruby guy, I'm not sure where to go from here. Is there some
package that I can easily install to get that library?
- Dave
Here's the er
Dave,
This is a little bit old/outdated but may be better than others you found:
https://github.com/commercehub-oss/watershed/blob/master/watershed/resources/s3/emr/exec/setup_drill
We haven’t gotten around to updating the overall Watershed project for EMR 4,
which is managed differently, nor mo
I was wondering if anyone had an up to date bootstrap script that installs
and configures Drill on an AWS EMR cluster. I'm looking for one that will
work with the stock Amazon EMR version and not a MapR EMR cluster. I've had
too much trouble in the past with the MapR EMR bootstrap scripts themselve