Re: Cluster mode deployment from jar in S3

2016-07-11 Thread Steve Loughran
our s3 bucket without any access restrictions? Best regards / Mit freundlichen Grüßen / Sincères salutations M. Lohith Samaga From: Ashic Mahtab [mailto:as...@live.com] Sent: Monday, July 04, 2016 15.06 To: Apache Spark Subject: RE: Cluster mode deployment from jar in S3 Sorry to do this...

RE: Cluster mode deployment from jar in S3

2016-07-04 Thread Ashic Mahtab
lohith.sam...@mphasis.com; user@spark.apache.org Subject: RE: Cluster mode deployment from jar in S3 Date: Mon, 4 Jul 2016 11:30:31 +0100 Hi Lohith,Thanks for the response. The S3 bucket does have access restrictions, but the instances in which the Spark master and workers run have an IAM role policy t

RE: Cluster mode deployment from jar in S3

2016-07-04 Thread Ashic Mahtab
n't put it in application code, as the issue is in downloading the jar from S3. -Ashic. From: lohith.sam...@mphasis.com To: as...@live.com; user@spark.apache.org Subject: RE: Cluster mode deployment from jar in S3 Date: Mon, 4 Jul 2016 09:50:50 + Hi, The aws CLI a

RE: Cluster mode deployment from jar in S3

2016-07-04 Thread Lohith Samaga M
[mailto:as...@live.com] Sent: Monday, July 04, 2016 15.06 To: Apache Spark Subject: RE: Cluster mode deployment from jar in S3 Sorry to do this...but... *bump* From: as...@live.com<mailto:as...@live.com> To: user@spark.apache.org<mailto:user@spark.apache.org

RE: Cluster mode deployment from jar in S3

2016-07-04 Thread Ashic Mahtab
Sorry to do this...but... *bump* From: as...@live.com To: user@spark.apache.org Subject: Cluster mode deployment from jar in S3 Date: Fri, 1 Jul 2016 17:45:12 +0100 Hello,I've got a Spark stand-alone cluster using EC2 instances. I can submit jobs using "--deploy-mode client", however using "--