pyspark installation using pip3

2017-08-25 Thread Wei-Shun Lo
Hi Spark dev team, I found that the pyspark installation may always download the full package again and it is not quite reasonable move. Please see the screen shot for information. A version-check before reinstall will be better. Please advise, and thanks. ! Best , Ralic ********

Re: Unable to access Resource Manager /Name Node on port 9026 / 9101 on a Spark EMR Cluster

2016-04-15 Thread Wei-Shun Lo
Hi Chanda, You may want to check by using nmap to check whether the port and service is correctly started locally. ex. nmap localhost If the port is already successfully internally, it might be related to the outbound/inbound traffic control in your security group setting. Just fyi. On Fri, Ap