Re: fs.s3a.endpoint not working

2016-01-14 Thread Phillips, Caleb
Hi Jonathan, >Im not totally following this thread from the beginning but I might be >able to help as I have some experience with Amazon EMR (elastic map >reduce) when working with custom jar files and s3 >Are you using EMR or something internal and offloading strage to s3? We have an

Re: fs.s3a.endpoint not working

2016-01-14 Thread Jonathan Aquilina
Im not totally following this thread from the beginning but I might be able to help as I have some experience with Amazon EMR (elastic map reduce) when working with custom jar files and s3 Are you using EMR or something internal and offloading strage to s3? --- Regards, Jonathan Aquilina

Re: Help for a hadoop build error: "Failed to parse plugin descriptor for org.apache.hadoop:hadoop-maven-plugins:2.7.1"

2016-01-14 Thread Boric Tan
It works! Thanks a lot, Chris. Boric On Thu, Jan 14, 2016 at 1:34 PM, Chris Nauroth wrote: > There is a Maven limitation that prevents "mvn compile" from building and > using the hadoop-maven-plugins module in the reactor for use by subsequent > modules. This does

Help for a hadoop build error: "Failed to parse plugin descriptor for org.apache.hadoop:hadoop-maven-plugins:2.7.1"

2016-01-14 Thread Boric Tan
Hi there, I was trying to build Hadoop 2.7.1 source from scratch on a Ubuntun 14.04 machine. I was following the instructions from BUILDING.txt. After installed all required packages, I used the following command under /hadoop-2.7.1-src. $mvn compile -e And it returned an error message shown

Re: Help for a hadoop build error: "Failed to parse plugin descriptor for org.apache.hadoop:hadoop-maven-plugins:2.7.1"

2016-01-14 Thread Chris Nauroth
There is a Maven limitation that prevents "mvn compile" from building and using the hadoop-maven-plugins module in the reactor for use by subsequent modules. This does not impact other targets like "mvn test" or "mvn install", and a standard work-around is to run an initial "mvn install" from

Re: fs.s3a.endpoint not working

2016-01-14 Thread Alexander Pivovarov
http://www.jets3t.org/toolkit/configuration.html On Jan 14, 2016 10:56 AM, "Alexander Pivovarov" wrote: > Add jets3t.properties file with s3service.s3-endpoint= to > /etc/hadoop/conf folder > > The folder with the file should be in HADOOP_CLASSPATH > > JetS3t library which

Re: fs.s3a.endpoint not working

2016-01-14 Thread Alexander Pivovarov
Add jets3t.properties file with s3service.s3-endpoint= to /etc/hadoop/conf folder The folder with the file should be in HADOOP_CLASSPATH JetS3t library which is used by hadoop is looking for this file. On Dec 22, 2015 12:39 PM, "Phillips, Caleb" wrote: > Hi All, > >