Ey-chih,
>>>>>
>>>>> That makes more sense. This is a known issue that will be fixed as
>>>>> part of SPARK-5242 <https://issues.apache.org/jira/browse/SPARK-5242>.
>>>>>
>>>>> Charles,
>>>>&g
>>>>>
>>>>> (I've stood up 4 integration clusters and 2 production clusters on EC2
>>>>> since with no problems.)
>>>>>
>>>>> On Wed Jan 28 2015 at 12:05:43 PM Nicholas Chammas <
>>>>> nicholas.ch
known issue that will be fixed as part
>>>> of SPARK-5242 <https://issues.apache.org/jira/browse/SPARK-5242>.
>>>>
>>>> Charles,
>>>>
>>>> Thanks for the info. In your case, when does spark-ec2 hang? Only when
>>>> th
path to the identity file doesn't exist? Or also when you
>>> specify the path as a relative path or with ~?
>>>
>>> Nick
>>>
>>>
>>> On Wed Jan 28 2015 at 9:29:34 AM ey-chih chow
>>> wrote:
>>>
>>>> We found the prob
ve path or with ~?
>>
>> Nick
>>
>>
>> On Wed Jan 28 2015 at 9:29:34 AM ey-chih chow wrote:
>>
>>> We found the problem and already fixed it. Basically, spark-ec2
>>> requires ec2 instances to have external ip addresses. You need to specify
&g
d to specify this in
>> the ASW console.
>> --
>> From: nicholas.cham...@gmail.com
>> Date: Tue, 27 Jan 2015 17:19:21 +
>> Subject: Re: spark 1.2 ec2 launch script hang
>> To: charles.fed...@gmail.com; pzybr...@gmail.com; eyc...@
> the ASW console.
> --
> From: nicholas.cham...@gmail.com
> Date: Tue, 27 Jan 2015 17:19:21 +0000
> Subject: Re: spark 1.2 ec2 launch script hang
> To: charles.fed...@gmail.com; pzybr...@gmail.com; eyc...@hotmail.com
> CC: user@spark.apache.org
>
>
> For thos
We found the problem and already fixed it. Basically, spark-ec2 requires ec2
instances to have external ip addresses. You need to specify this in the ASW
console.
From: nicholas.cham...@gmail.com
Date: Tue, 27 Jan 2015 17:19:21 +
Subject: Re: spark 1.2 ec2 launch script hang
To
For those who found that absolute vs. relative path for the pem file
mattered, what OS and shell are you using? What version of Spark are you
using?
~/ vs. absolute path shouldn’t matter. Your shell will expand the ~/ to the
absolute path before sending it to spark-ec2. (i.e. tilde expansion.)
Ab
Absolute path means no ~ and also verify that you have the path to the file
correct. For some reason the Python code does not validate that the file
exists and will hang (this is the same reason why ~ hangs).
On Mon, Jan 26, 2015 at 10:08 PM Pete Zybrick wrote:
> Try using an absolute path to the
Try using an absolute path to the pem file
> On Jan 26, 2015, at 8:57 PM, ey-chih chow wrote:
>
> Hi,
>
> I used the spark-ec2 script of spark 1.2 to launch a cluster. I have
> modified the script according to
>
> https://github.com/grzegorz-dubicki/spark/commit/5dd8458d2ab9753aae939b3bb33
Hi,
I used the spark-ec2 script of spark 1.2 to launch a cluster. I have
modified the script according to
https://github.com/grzegorz-dubicki/spark/commit/5dd8458d2ab9753aae939b3bb33be953e2c13a70
But the script was still hung at the following message:
Waiting for cluster to enter 'ssh-ready'
12 matches
Mail list logo
