[
https://issues.apache.org/jira/browse/HAWQ-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Radar Lei resolved HAWQ-385.
----------------------------
Resolution: Fixed
> hawq failed to initialize due to too many concurrent ssh connection to master
> or standby
> ----------------------------------------------------------------------------------------
>
> Key: HAWQ-385
> URL: https://issues.apache.org/jira/browse/HAWQ-385
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Command Line Tools
> Reporter: Zhanwei Wang
> Assignee: Radar Lei
>
> {code}
> 20160202:00:58:48:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Init segments in
> list: ['gva-w1', 'gva-w2', 'gva-w3', 'gva-w4', 'gva-w5', 'gva-w6', 'gva-w7',
> 'gva-w8', 'gva-w9', 'gva-w10', 'gva-w11', 'gva-w12', 'gva-w13', 'gva-w14',
> 'gva-w15', 'gva-w16']
> .20160202:00:58:52:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get
> standby ip addresses
> 20160202:00:58:52:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> ssh_exchange_identification: Connection closed by remote host
> 20160202:00:58:52:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed
> on gva-w5
> ............20160202:00:59:03:184610
> hawq_init:gva-mst1:gpadmin-[INFO]:-Warning: Permanently added
> 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get
> master ip addresses
> 20160202:00:59:03:184610
> hawq_init:gva-mst1:gpadmin-[INFO]:-ssh_exchange_identification: Connection
> closed by remote host
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed
> on gva-w8
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get
> master ip addresses
> 20160202:00:59:03:184610
> hawq_init:gva-mst1:gpadmin-[INFO]:-ssh_exchange_identification: Connection
> closed by remote host
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed
> on gva-w15
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Failed to get
> standby ip addresses
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> ssh_exchange_identification: Connection closed by remote host
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[ERROR]:-HAWQ init failed
> on gva-w12
> 20160202:00:59:03:184610 hawq_init:gva-mst1:gpadmin-[INFO]:-Warning:
> Permanently added 'gva-mst1,172.28.8.250' (RSA) to the list of known hosts.
> Warning: Permanently added 'gva-mst2,172.28.8.251' (RSA) to the list of known
> hosts.
> Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
> {code}
> {code}
> ssh_exchange_identification: Connection closed by remote host
> {code}
> sshd has a default max startup connection.
> {code}
> vi /etc/ssh/sshd_config
> #MaxStartups 10
> {code}
> Current logic of {{hawq init cluster}} seems unclear. Master ssh to segment
> to executor init command, bug segments will ssh back to master to get
> Master/Standby ip address.
> IP address information should be collected on master and send to segments
> directly.
> {code}
> get_all_ip_address() {
> if [ "${distro_based_on}" = "RedHat" ] && [ "${distro_major_version}" -ge
> 7 ]; then
> cmd_str="${IFCONFIG} |${GREP} -v '127.0.0' | ${GREP} 'inet '|${AWK}
> '{print \$2}'"
> elif [ "${distro_based_on}" = "Mac" ]; then
> cmd_str="${IFCONFIG} |${GREP} -v '127.0.0' | ${GREP} 'inet '|${AWK}
> '{print \$2}'"
> else
> cmd_str="${IFCONFIG} |${GREP} -v '127.0.0' |${AWK} '/inet addr/{print
> substr(\$2,6)}'"
> fi
> master_ip_address_all=`${SSH} -o 'StrictHostKeyChecking no'
> ${hawqUser}@${master_host_name} "${cmd_str}"`
> if [ -z "${master_ip_address_all}" ];then
> ${ECHO} "Failed to get master ip addresses"
> exit 1
> fi
> if [ "${standby_host_lowercase}" != "none" ] && [ -n
> "${standby_host_lowercase}" ];then
> standby_ip_address_all=`${SSH} -o 'StrictHostKeyChecking no'
> ${hawqUser}@${standby_host_name} "${cmd_str}"`
> if [ -z "${standby_ip_address_all}" ];then
> ${ECHO} "Failed to get standby ip addresses"
> exit 1
> fi
> fi
> segment_ip_address_all=`${SSH} -o 'StrictHostKeyChecking no'
> ${hawqUser}@localhost "${cmd_str}"`
> if [ -z "${segment_ip_address_all}" ];then
> ${ECHO} "Failed to get segment ip addresses"
> exit 1
> fi
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
