[jira] [Updated] (AMBARI-25473) Upgrade Infra Solr Clients fails if it is installed on only one host

2020-02-07 Thread Szilard Antal (Jira)


 [ 
https://issues.apache.org/jira/browse/AMBARI-25473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Antal updated AMBARI-25473:
---
Status: Patch Available  (was: In Progress)

> Upgrade Infra Solr Clients fails if it is installed on only one host
> 
>
> Key: AMBARI-25473
> URL: https://issues.apache.org/jira/browse/AMBARI-25473
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-infra
>Affects Versions: 2.7.5
>Reporter: Szilard Antal
>Assignee: Szilard Antal
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 2.7.6
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Executed command:
> {code:java}
> [root@santal-atlas-dc-upgr ~]# 
> /usr/lib/ambari-infra-solr-client/ambariSolrMigration.sh --ini-file 
> $CONFIG_INI_LOCATION --mode backup | tee backup_output.txt Execute command: 
> /usr/bin/python /usr/lib/ambari-infra-solr-client/migrationHelper.py 
> --ini-file ambari_solr_migration.ini --action check-shards Dumping 
> collections data to 
> /usr/lib/ambari-infra-solr-client/migrate/data/check_collections.json ... 
> DONE Checking available shards for 'fulltext_index' collection... 
> -- Number of shards: 1 OK: Found active leader 
> replica for shard1 Index size per shard for fulltext_index: - shard1: 71 
> bytes Index size per host for fulltext_index (consider this for backup): - 
> 172.22.111.200: 71 bytes -- Checking available 
> shards for 'edge_index' collection... -- Number 
> of shards: 1 OK: Found active leader replica for shard1 Index size per shard 
> for edge_index: - shard1: 71 bytes Index size per host for edge_index 
> (consider this for backup): - 172.22.111.200: 71 bytes 
> -- Checking available shards for 'vertex_index' 
> collection... -- Number of shards: 1 OK: Found 
> active leader replica for shard1 Index size per shard for vertex_index: - 
> shard1: 16.8 KB Index size per host for vertex_index (consider this for 
> backup): - 172.22.111.200: 16.8 KB -- Full index 
> size per hosts: (consider this for backup) - 172.22.111.200: 16.94 KB All 
> warnings: 0 Check shards - PASSED -- Command 
> elapsed time: 00:00:03 -- Migration helper 
> command FINISHED Execute command: /usr/bin/python 
> /usr/lib/ambari-infra-solr-client/migrationHelper.py --ini-file 
> ambari_solr_migration.ini --action upgrade-solr-clients Sending upgrade 
> request: [Upgrade Solr Clients] Traceback (most recent call last): File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 2002, in 
>  upgrade_solr_clients(options, accessor, parser, config) File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 517, in 
> upgrade_solr_clients response = post_json(accessor, 
> CLUSTERS_URL.format(cluster) + REQUESTS_API_URL, cmd_request) File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 250, in 
> post_json response = accessor(url, 'POST', json.dumps(request_body)) File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 117, in 
> do_request raise Exception('Problem with accessing api. Reason: 
> {0}'.format(exc)) Exception: Problem with accessing api. Reason: HTTP Error 
> 500: Internal Server Error Total Runtime: 00:00:03 Upgrade Solr Clients 
> command FAILED. Stop migration commands ...
> {code}
> ambari-server.log:
>  
> {code:java}
> Caused by: org.apache.ambari.server.ServiceComponentHostNotFoundException: 
> ServiceComponentHost not found, clusterName=atlas_upgr_cl, 
> serviceName=AMBARI_INFRA_SOLR, serviceComponentName=INFRA_SOLR_CLIENT, 
> hostName=
> at 
> org.apache.ambari.server.state.ServiceComponentImpl.getServiceComponentHost(ServiceComponentImpl.java:346)
> at 
> org.apache.ambari.server.controller.MaintenanceStateHelper.isOperationAllowed(MaintenanceStateHelper.java:111)
> at 
> org.apache.ambari.server.controller.MaintenanceStateHelper.isOperationAllowed(MaintenanceStateHelper.java:87)
> at 
> org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper$1.shouldHostBeRemoved(AmbariCustomCommandExecutionHelper.java:287)
> at 
> org.apache.ambari.server.controller.MaintenanceStateHelper.filterHostsInMaintenanceState(MaintenanceStateHelper.java:423)
> at 
> org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper.addCustomCommandAction(AmbariCustomCommandExecutionHelper.java:278)
> at 
> org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper.addExecutionCommandsToStage(AmbariCustomCommandExecutionHelper.java:1187)
> at 
> 

[jira] [Updated] (AMBARI-25473) Upgrade Infra Solr Clients fails if it is installed on only one host

2020-02-07 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/AMBARI-25473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated AMBARI-25473:

Labels: pull-request-available  (was: )

> Upgrade Infra Solr Clients fails if it is installed on only one host
> 
>
> Key: AMBARI-25473
> URL: https://issues.apache.org/jira/browse/AMBARI-25473
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-infra
>Affects Versions: 2.7.5
>Reporter: Szilard Antal
>Assignee: Szilard Antal
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 2.7.6
>
>
> Executed command:
> {code:java}
> [root@santal-atlas-dc-upgr ~]# 
> /usr/lib/ambari-infra-solr-client/ambariSolrMigration.sh --ini-file 
> $CONFIG_INI_LOCATION --mode backup | tee backup_output.txt Execute command: 
> /usr/bin/python /usr/lib/ambari-infra-solr-client/migrationHelper.py 
> --ini-file ambari_solr_migration.ini --action check-shards Dumping 
> collections data to 
> /usr/lib/ambari-infra-solr-client/migrate/data/check_collections.json ... 
> DONE Checking available shards for 'fulltext_index' collection... 
> -- Number of shards: 1 OK: Found active leader 
> replica for shard1 Index size per shard for fulltext_index: - shard1: 71 
> bytes Index size per host for fulltext_index (consider this for backup): - 
> 172.22.111.200: 71 bytes -- Checking available 
> shards for 'edge_index' collection... -- Number 
> of shards: 1 OK: Found active leader replica for shard1 Index size per shard 
> for edge_index: - shard1: 71 bytes Index size per host for edge_index 
> (consider this for backup): - 172.22.111.200: 71 bytes 
> -- Checking available shards for 'vertex_index' 
> collection... -- Number of shards: 1 OK: Found 
> active leader replica for shard1 Index size per shard for vertex_index: - 
> shard1: 16.8 KB Index size per host for vertex_index (consider this for 
> backup): - 172.22.111.200: 16.8 KB -- Full index 
> size per hosts: (consider this for backup) - 172.22.111.200: 16.94 KB All 
> warnings: 0 Check shards - PASSED -- Command 
> elapsed time: 00:00:03 -- Migration helper 
> command FINISHED Execute command: /usr/bin/python 
> /usr/lib/ambari-infra-solr-client/migrationHelper.py --ini-file 
> ambari_solr_migration.ini --action upgrade-solr-clients Sending upgrade 
> request: [Upgrade Solr Clients] Traceback (most recent call last): File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 2002, in 
>  upgrade_solr_clients(options, accessor, parser, config) File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 517, in 
> upgrade_solr_clients response = post_json(accessor, 
> CLUSTERS_URL.format(cluster) + REQUESTS_API_URL, cmd_request) File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 250, in 
> post_json response = accessor(url, 'POST', json.dumps(request_body)) File 
> "/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 117, in 
> do_request raise Exception('Problem with accessing api. Reason: 
> {0}'.format(exc)) Exception: Problem with accessing api. Reason: HTTP Error 
> 500: Internal Server Error Total Runtime: 00:00:03 Upgrade Solr Clients 
> command FAILED. Stop migration commands ...
> {code}
> ambari-server.log:
>  
> {code:java}
> Caused by: org.apache.ambari.server.ServiceComponentHostNotFoundException: 
> ServiceComponentHost not found, clusterName=atlas_upgr_cl, 
> serviceName=AMBARI_INFRA_SOLR, serviceComponentName=INFRA_SOLR_CLIENT, 
> hostName=
> at 
> org.apache.ambari.server.state.ServiceComponentImpl.getServiceComponentHost(ServiceComponentImpl.java:346)
> at 
> org.apache.ambari.server.controller.MaintenanceStateHelper.isOperationAllowed(MaintenanceStateHelper.java:111)
> at 
> org.apache.ambari.server.controller.MaintenanceStateHelper.isOperationAllowed(MaintenanceStateHelper.java:87)
> at 
> org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper$1.shouldHostBeRemoved(AmbariCustomCommandExecutionHelper.java:287)
> at 
> org.apache.ambari.server.controller.MaintenanceStateHelper.filterHostsInMaintenanceState(MaintenanceStateHelper.java:423)
> at 
> org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper.addCustomCommandAction(AmbariCustomCommandExecutionHelper.java:278)
> at 
> org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper.addExecutionCommandsToStage(AmbariCustomCommandExecutionHelper.java:1187)
> at 
> 

[jira] [Updated] (AMBARI-25473) Upgrade Infra Solr Clients fails if it is installed on only one host

2020-02-07 Thread Szilard Antal (Jira)


 [ 
https://issues.apache.org/jira/browse/AMBARI-25473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Antal updated AMBARI-25473:
---
Description: 
Executed command:
{code:java}
[root@santal-atlas-dc-upgr ~]# 
/usr/lib/ambari-infra-solr-client/ambariSolrMigration.sh --ini-file 
$CONFIG_INI_LOCATION --mode backup | tee backup_output.txt Execute command: 
/usr/bin/python /usr/lib/ambari-infra-solr-client/migrationHelper.py --ini-file 
ambari_solr_migration.ini --action check-shards Dumping collections data to 
/usr/lib/ambari-infra-solr-client/migrate/data/check_collections.json ... DONE 
Checking available shards for 'fulltext_index' collection... 
-- Number of shards: 1 OK: Found active leader 
replica for shard1 Index size per shard for fulltext_index: - shard1: 71 bytes 
Index size per host for fulltext_index (consider this for backup): - 
172.22.111.200: 71 bytes -- Checking available 
shards for 'edge_index' collection... -- Number of 
shards: 1 OK: Found active leader replica for shard1 Index size per shard for 
edge_index: - shard1: 71 bytes Index size per host for edge_index (consider 
this for backup): - 172.22.111.200: 71 bytes -- 
Checking available shards for 'vertex_index' collection... 
-- Number of shards: 1 OK: Found active leader 
replica for shard1 Index size per shard for vertex_index: - shard1: 16.8 KB 
Index size per host for vertex_index (consider this for backup): - 
172.22.111.200: 16.8 KB -- Full index size per 
hosts: (consider this for backup) - 172.22.111.200: 16.94 KB All warnings: 0 
Check shards - PASSED -- Command elapsed time: 
00:00:03 -- Migration helper command FINISHED 
Execute command: /usr/bin/python 
/usr/lib/ambari-infra-solr-client/migrationHelper.py --ini-file 
ambari_solr_migration.ini --action upgrade-solr-clients Sending upgrade 
request: [Upgrade Solr Clients] Traceback (most recent call last): File 
"/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 2002, in  
upgrade_solr_clients(options, accessor, parser, config) File 
"/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 517, in 
upgrade_solr_clients response = post_json(accessor, 
CLUSTERS_URL.format(cluster) + REQUESTS_API_URL, cmd_request) File 
"/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 250, in post_json 
response = accessor(url, 'POST', json.dumps(request_body)) File 
"/usr/lib/ambari-infra-solr-client/migrationHelper.py", line 117, in do_request 
raise Exception('Problem with accessing api. Reason: {0}'.format(exc)) 
Exception: Problem with accessing api. Reason: HTTP Error 500: Internal Server 
Error Total Runtime: 00:00:03 Upgrade Solr Clients command FAILED. Stop 
migration commands ...

{code}
ambari-server.log:

 
{code:java}
Caused by: org.apache.ambari.server.ServiceComponentHostNotFoundException: 
ServiceComponentHost not found, clusterName=atlas_upgr_cl, 
serviceName=AMBARI_INFRA_SOLR, serviceComponentName=INFRA_SOLR_CLIENT, hostName=
at 
org.apache.ambari.server.state.ServiceComponentImpl.getServiceComponentHost(ServiceComponentImpl.java:346)
at 
org.apache.ambari.server.controller.MaintenanceStateHelper.isOperationAllowed(MaintenanceStateHelper.java:111)
at 
org.apache.ambari.server.controller.MaintenanceStateHelper.isOperationAllowed(MaintenanceStateHelper.java:87)
at 
org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper$1.shouldHostBeRemoved(AmbariCustomCommandExecutionHelper.java:287)
at 
org.apache.ambari.server.controller.MaintenanceStateHelper.filterHostsInMaintenanceState(MaintenanceStateHelper.java:423)
at 
org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper.addCustomCommandAction(AmbariCustomCommandExecutionHelper.java:278)
at 
org.apache.ambari.server.controller.AmbariCustomCommandExecutionHelper.addExecutionCommandsToStage(AmbariCustomCommandExecutionHelper.java:1187)
at 
org.apache.ambari.server.controller.AmbariManagementControllerImpl.createAction(AmbariManagementControllerImpl.java:4140)
at 
org.apache.ambari.server.controller.internal.RequestResourceProvider$1.invoke(RequestResourceProvider.java:283)
at 
org.apache.ambari.server.controller.internal.RequestResourceProvider$1.invoke(RequestResourceProvider.java:212)
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:465)
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.createResources(AbstractResourceProvider.java:288)
{code}

The solr client update request must be terminated if no other host can be 
upgraded.


  was:
Executed command:
{code:java}
[root@santal-atlas-dc-upgr