This is an automated email from the ASF dual-hosted git repository. oleewere pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/ambari-infra.git.
discard 4019c37 init new 5663f32 AMBARI-20566. Create ambari-infra module in Ambari (move solr modules from ambari-logsearch) (oleewere) new 5f40a0f AMBARI-20611. Add disable security option to infra-solr-client (oleewere) new e780fe8 AMBARI-20751. Fix misleading solr-client output messages (oleewere) new 66ebb96 AMBARI-20837. Fix AmbariSolrCloudCLI package name in solr-client script (oleewere) new 5a4c334 AMBARI-20720. Create skeleton for Ambari Infra Manager (oleewere) new 7b8b1ea AMBARI-20720. ADDENDUM Create skeleton for Ambari Infra Manager (oleewere) new ff0db07 AMBARI-20989. Ambari infra manager: add batch support (oleewere) new e479db6 AMBARI-21024. Support rpm/deb build for ambari-infra-manager (oleewere) new f5cd702 AMBARI-21031. Add docker support for infra manager (oleewere) new 2c2bb72 AMBARI-21071. Ambari Infra Manager: add jobs/steps REST API endpoints (oleewere) new 34c5683 AMBARI-21087. Infra manger: Add static data folder servlet endpoint (oleewere) new 940b81a AMBARI-21155. Design Ambari Infra Component & workflows (oleewere) new d15c42f AMBARI-21155. Update Infra Manager README.md (oleewere) new 3fc6222 AMBARI-21196. Fix ambari-solr-plugin folder structure (oleewere) new 10aacc0 AMBARI-20853. Service Advisor - Allow Service to define its Advisor Type as Python or Java (alejandro) new b15953c AMBARI-21247. Infra Manager: Use custom serializer for execution contexts of job & steps (oleewere) new 9482776 AMBARI-21257. Add ambari prefix for utility and serviceadvisor modules (oleewere) new bd44a8e AMBARI-21369. Use JDK 8 compiler maven plugin for Log Search and Infra projects (oleewere) new 4cf6cad AMBARI-21400. Upgrade Infra Solr version from 5.5.2 to 6.6.x (oleewere) new 91f9f71 AMBARI-21459. Add lucene index migration script to infra solr client package (oleewere) new 0f3d7a6 AMBARI-21810. Create Utility Script to support Solr Collection Data Retention/Purging/Archiving (mgergely) new 9ee2cb0 AMBARI-22045. Infra Solr client cleanup: make infra-solr-client script usable with symlinks (oleewere) new 30426d1 AMBARI-22046. Infra Manager: Integrate with Spring Boot (oleewere) new d2fe0cb AMBARI-22050. Infra Manager jobs should handle their own configuration (mgergely) new 2865328 AMBARI-22049. Solr Data Manager should use --line-delimited option by default (mgergely) new 1c94fe4 AMBARI-22056. Solr Data Manager script should use gzip compression type (mgergely) new 5875aff AMBARI-22061. Solr Data Manager script should provide non-destructive archive download option (mgergely) new d01288d AMBARI-22059. Use symlinks for Infra components (oleewere) new d1e4617 AMBARI-22064. Remove Database auto configuration from Infra Manager (oleewere) new 8603c9e AMBARI-22075. Use symlinks for Solr Data Manager (mgergely) new 3b85e64 AMBARI-22238 : Maven cleanup of ambari utility, logsearch and ambari metrics modules. (avijayan) new 47e061d AMBARI-22238 : Maven cleanup of ambari utility, logsearch and ambari metrics modules. (Commit 2) (avijayan) new f9da0f0 AMBARI-22305. Update Solr (Infra Solr + clients) version to 6.6.2 from 6.6.0 (oleewere) new c8b1efd AMBARI-22310. Get rid of deprecated Solr usages (infra + logsearch) (oleewere) new ce76c05 AMBARI-22514. Initial implementation of Schedulable document deletion & archiving for Infra Solr (Krisztian Kasa via oleewere) new 79f7f13 AMBARI-22514, AMBARI-22653. Ambari Infra Manager: solr data exporting jobs and integration test environment. (Krisztian Kasa via swagle) new a8530df AMBARI-22653. ADDENDUM Infra Manager: s3 upload support for archiving Infra Solr (Krisztian Kasa via oleewere) new 42cc9a9 AMBARI-22702. Infra Manager: scheduled deleting of Infra Solr documents (Krisztian Kasa via oleewere ) new fd78657 AMBARI-22731. Infra Manager - hdfs upload support for archiving Infra Solr new b1082a7 AMBARI-22760 Infra Manager: install packages new 4f9cdce AMBARI-22789. Fix Log Search / Log Feeder / Infra Manager start scripts new 8700af7 AMBARI-22787 - Add new Ambari Infra Manager component to Ambari infra stack new c45ff8c AMBARI-22799 - define scheduling of archiving Infra Solr Documents new 34d538f AMBARI-22860. Support external zookeeper for Infra Solr and Log Search new 6ea38bc [AMBARI-22886] Infra Manager: store s3 credentials in Hadoop credential store (#261) new bab13ad AMBARI-22924. Ambari Infra: make ambari-infra maven build independent from other modules. (#281) new 88ce547 AMBARI-22899. Upgrade Infra Solr version to 7.2.1 (#309) new e4d77c2 AMBARI-22958. Upgrade Apache Rat to 0.12 new 3d5a9d5 AMBARI-22959. ADDENDUM: Upgrade Log Search Solr client version to 7.2.1 new f28c68b AMBARI-22967. Update Solr version defaults in docker envs (infra-manager and logsearch) new 469da1a AMBARI-22993. Get rid of overriding solr start script during infra solr build (#364) new 00c05a7 AMBARI-20566. Create ambari-infra module in Ambari (move solr modules from ambari-logsearch) (oleewere) new cb51cc7 AMBARI-20611. Add disable security option to infra-solr-client (oleewere) new 5c8bb40 AMBARI-20751. Fix misleading solr-client output messages (oleewere) new 029ee39 Merge remote-tracking branch 'remotes/origin/trunk' into branch-3.0-perf new 301297c Merge remote-tracking branch 'remotes/origin/trunk' into branch-3.0-perf new 02ce341 Merge branch 'trunk' into branch-3.0-perf new c5894af Merge remote-tracking branch 'remotes/alt/trunk' into branch-3.0-perf-unchanged new 60add52 Merge branch 'branch-3.0-perf' into trunk new 94f0fa9 AMBARI-23010. Make solrIndexHelper.sh script to be able to run index migration against a snapshot (#381) new 068696e AMBARI-23019. Use lucene version 6.6.2 instead of 6.6.0 in index migration script (#402) new 76fc442 AMBARI-23027. Add backup/copy znode command for infra-solr-client. (#417) new d2ed610 AMBARI-23027. Rename copy-dist to copy-dest. new 5c0a20a AMBARI-23044. Version upgrades of 3rd party dependencies for Log Sear… (#452) new 14432d5 AMBARI-23118. Add apidoc for InfraRuleBasedAuthorizationPlugin. (#513) new af0bd42 AMBARI-23182. Infra Solr - add custom Ambari commands for backup/migrate/restore index. (#596) new cd5377b AMBARI-23200. Infra Solr - utility script to run infra-solr custom commands (migrate/backup/restore) (#649) new 13e0576 AMBARI-23200. Infra Solr - ADDENDUM - utility script to run infra-solr custom commands (migrate/backup/restore) new e53e13a AMBARI-23200. Fill properties for infra-solr utility script new 42e1daa AMBARI-23307. Rename AMBARI_INFRA to AMBARI_INFRA_SOLR in upgrade helper script. (#735) new 6cb10bb AMBARI-23275. Upgrade jdeb and rpm-maven-plugin (#698) new 1533af1 Revert "AMBARI-23275. Upgrade jdeb and rpm-maven-plugin (#698)" new 8ed15a1 AMBARI-22061. Solr Data Manager script should provide non-destructive archive download option. new 86ecedf AMBARI-23421. Add solr-to-solr archive operation for solrDataManager.py. (#849) new ce44a0a AMBARI-23142 - Add AMS Metrics publisher to Infra Solr (#556) new df82ec1 AMBARI-23421. ADDENDUM: fix spaces before content type header new 3e7570e AMBARI-23421. solrDataManager.py: Add _version_ to exclude list by default new ac751f0 AMBARI-23646. Include commons-logging library for Infra Solr debian build. (#1062) new 4b387e4 AMBARI-23649. Upgrade Solr version from 7.2.1 to 7.3.0 new f03c66c [AMBARI-23678] Fix CVE issues for ambari-infra-solr 2.7.0 (#1084) new aadd198 AMBARI-23677. ADDENDUM - Update Swagger UI versions. new ed858dc AMBARI-23677. Fix rat issues (missing license) new 5f79ac3 AMBARI-23761. Add organization / license data to ambari-infra and ambari-logsearch. (#1177) new c068fca AMBARI-23822. Infra Solr: Migration script does not backup/restore all of the cores. new 3d00315 AMBARI-23822. Infra Solr: Add restore support if index is on HDFS. new c754706 AMBARI-23822. Add README.md for Solr Migration new af1c49d AMBARI-23822. Add license header for README.md new 0c02656 AMBARI-23822. Document Log Search / Atlas Solr collection migration as well new 08b191b AMBARI-23822. Add anchor tags for migration documentation new 9b73653 AMBARI-23859. Fix Log Search / Ambari Infra CVE issues. (#1286) new 533b562 AMBARI-23822. Put write.lock back if it was deleted during Solr index migration. new e82f2bb AMBARI-23865. Upload Infra Solr to use Solr 7.3.1 (#1292) new a09a62f AMBARI-23822. Migration Helper: handle if action option is missing new 78ef172 AMBARI-23822. Add --skip-generate-restore-host-cores option to migrationHelper.py (only read the json file, do not generate it) new 73deb62 AMBARI-23945. Infra Solr: Generate .ini file for migration helper. (#1382) new 259845a AMBARI-23945. Migration Config generator: add backup base path options new 882927f AMBARI-23945. Migration Config generator: add zk details new de5b0ad AMBARI-23945. Add new --delete-znode command for solrCloudClient.sh new 48f7ff5 AMBARI-23945. Infra Solr: Add ranger managed-schema (new) for migration new e07b023 AMBARI-23945. Re-implement migration helper (use params from ini file) new b19bbf3 AMBARI-23945. Migration helper: add rolling-restart for Infra Solr instances new 75bae73 AMBARI-23945. Migration helper: add ability to include/exclude solr hosts for commands new ff804b3 AMBARI-23945. Migration helper: support shared drive & hdfs base path new eb4a2a3 AMBARI-23945. Update migration docs & refactor new 114997f AMBARI-23945. Add upgrade & restart/stop hidden service component commands. new b527d43 Fix internal links in Infra Solr client README.md new c7918de AMBARI-23945. Fix migration scripts if ambari-server uses HTTPS. new f580218 AMBARI-23945. Infra Solr Migration: Fix Atlas edge index location. new 37513c3 AMBARI-23945. Update Solr migration README.md (fix port flag) new 4f337ab AMBARI-24055 - INFRA_SOLR START failed (#1491) new 73d2854 AMBARI-23945. Infra Solr migration - restored data can be deleted on Solr startup (if data on hdfs) new eac1229 AMBARI-23945. Infra Solr migration - remove PYTHONHTTPSVERIFY=0 from migrationConfigGenerator.py new cc9c426 AMBARI-23945. Embed migration config generation steps to README.md new cc6e92a AMBARI-23945. Embed backup/migration/restore collection steps to README.md new b45a454 AMBARI-23945. Infra Solr migration: Add dump collections support & refactor. new 621065f AMBARI-23945. Infra Solr migration - Update asciinema links new cc6a4f7 AMBARI-23945. Infra Solr migration - Add disable-solr-authorization command new 45cf109 AMBARI-23945. Infra Solr migration - Add filter-cores support during restore new cdd8d03 AMBARI-23945. Infra Solr migration - Add shard replica check command new 9453e26 AMBARI-23945. Create dump collections file even if no available collections. new 3b577e0 AMBARI-23945. Infra Solr migration - Update docs new ab9e330 AMBARI-23945. Infra Solr migration - remove 'solr_skip_generate_restore_host_cores' usages. new 5f7ecff AMBARI-23945. Infra Solr migration - Add --skip-json-dump-files flag new 0559bf7 AMBARI-23945. Infra Solr migration - Add core filter & skip-json-dump-files to the doc new d482acc AMBARI-23945. Get Logfeeder hosts for migrationHelper.py to upgrade Logfeeders new 98fdcfd AMBARI-23945. Infra Solr Client - add number of docs to collection dump new ba61fda AMBARI-23945. Infra Solr Migration - check collections are empty or not new 76662f5 AMBARI-23945. Infra Solr Migration: add number of docs check. new 1ec44be AMBARI-24163. Infra Solr: solrDataManager.py should support transport data without timestamp field. (#1594) new 2fc591d AMBARI-23945. Add some new restart/rolling-restart commands for ATLAS/RANGER/INFRA_SOLR components. new 24d3e78 AMBARI-23945. Infra Solr migration - Update README.md new f8bb671 AMBARI-23945. Infra Solr migration: Add transfer data asciicinema links to README.md new 783cf7b AMBARI-23945. Fix typo in asciinema video new 24268f4 AMBARI-23945. Add script for migration happy path. new b8961c8 AMBARI-23945. Infra Solr Migration - update README.md + add check index size step new 5cd88a8 AMBARI-23945. Infra Solr Migration - helper command to enable/disable/fix solr kerberos config. new 558ce8c AMBARI-23945. Infra Solr Migration - do not use solr hosts which are not related with the right collection new 9ec08c0 AMBARI-23945. Infra Solr migration - fix batch interval argument usage. new 30afdcc AMBARI-23945. Infra Solr Migration - add --keep-backup to automation script + use elapsed time as well new 78d2eca AMBARI-23945. ADDENDUM: --keep-backup was not added to restore command new bd1efdd AMBARI-23945. Add warning for migration config generation (if wrong host is used) new 262501f AMBARI-23945. Simplify old Solr data transport new 9169a3e AMBARI-23945. Infra Solr migration - README fixes new 7d03c2f AMBARI-23945. Infra Solr migration - Update README.md new d602aa6 AMBARI-23945. Infra Solr migration: use async request for collection deletion new ba601dc AMBARI-23945. Infra Solr migration: REQUESTSTATUS response content type is xml instead of json (#1737) new c118b1f AMBARI-24281. Infra Solr migration: migrationConfigGenerator script failed with custom service user (#1749) new b4f8728 AMBARI-24431. Infra Manager / Log Search: Fix Jetty CVE-2018-12536. (#2002) new f9e22fb AMBARI-24480. Upgrade Infra Solr (from Solr 7.3.1 to Solr 7.4.0 (#2088) new 2afcbbe AMBARI-23903: Add jdeb support (#1642) new e553115 AMBARI-24511: Add rpm support infra and logsearch (#2125) new 5c0cd68 Cleanup for history migration This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (4019c37) \ N -- N -- N refs/heads/master (5c0cd68) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 152 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gitattributes | 1 + .gitignore | 16 + README.md | 1 - ambari-infra-assembly/pom.xml | 429 ++++ .../src/main/package/deb/manager/control | 22 + .../src/main/package/deb/manager/postinst | 27 + .../src/main/package/deb/manager/postrm | 23 + .../src/main/package/deb/manager/preinst | 15 + .../src/main/package/deb/manager/prerm | 15 + .../src/main/package/deb/solr-client/control | 22 + .../src/main/package/deb/solr-client/postinst | 28 + .../src/main/package/deb/solr-client/postrm | 15 + .../src/main/package/deb/solr-client/preinst | 15 + .../src/main/package/deb/solr-client/prerm | 15 + .../src/main/package/deb/solr/control | 22 + .../src/main/package/deb/solr/postinst | 15 + .../src/main/package/deb/solr/postrm | 15 + .../src/main/package/deb/solr/preinst | 15 + .../src/main/package/deb/solr/prerm | 15 + .../src/main/package/rpm/manager/postinstall.sh | 27 + .../src/main/package/rpm/manager/postremove.sh | 23 + .../main/package/rpm/solr-client/postinstall.sh | 28 + ambari-infra-manager-it/pom.xml | 224 +++ .../java/org/apache/ambari/infra/HttpResponse.java | 37 + .../java/org/apache/ambari/infra/InfraClient.java | 132 ++ .../apache/ambari/infra/InfraManagerStories.java | 108 + .../org/apache/ambari/infra/JobExecutionInfo.java | 45 + .../ambari/infra/OffsetDateTimeConverter.java | 39 + .../test/java/org/apache/ambari/infra/Solr.java | 107 + .../java/org/apache/ambari/infra/TestUtil.java | 82 + .../ambari/infra/solr/metrics/MetricsIT.java | 142 ++ .../infra/solr/metrics/MockMetricsServer.java | 75 + .../ambari/infra/steps/AbstractInfraSteps.java | 183 ++ .../apache/ambari/infra/steps/ExportJobsSteps.java | 228 +++ .../src/test/resources/log4j.properties | 16 + .../test/resources/stories/infra_api_tests.story | 67 + ambari-infra-manager/.gitignore | 5 + ambari-infra-manager/README.md | 117 ++ ambari-infra-manager/build.xml | 57 + ambari-infra-manager/docker/Dockerfile | 52 + ambari-infra-manager/docker/bin/start.sh | 21 + ambari-infra-manager/docker/docker-compose.yml | 103 + .../docker/infra-manager-docker-compose.sh | 124 ++ .../docker/infra-manager-docker.sh | 85 + ambari-infra-manager/docs/api/swagger.yaml | 784 ++++++++ ambari-infra-manager/docs/images/batch-1.png | Bin 0 -> 20521 bytes ambari-infra-manager/docs/images/batch-2.png | Bin 0 -> 29388 bytes ambari-infra-manager/docs/images/batch-3.png | Bin 0 -> 14105 bytes ambari-infra-manager/docs/images/batch-4.png | Bin 0 -> 23277 bytes ambari-infra-manager/pom.xml | 465 +++++ .../java/org/apache/ambari/infra/InfraManager.java | 53 + .../infra/conf/InfraManagerApiDocConfig.java | 75 + .../ambari/infra/conf/InfraManagerConfig.java | 36 + .../ambari/infra/conf/InfraManagerDataConfig.java | 37 + .../conf/InfraManagerJerseyResourceConfig.java | 37 + .../infra/conf/InfraManagerSchedulingConfig.java | 32 + .../infra/conf/InfraManagerServletConfig.java | 83 + .../infra/conf/StaticResourceConfiguration.java | 49 + .../infra/conf/batch/InfraManagerBatchConfig.java | 212 ++ .../conf/security/CompositePasswordStore.java | 39 + .../infra/conf/security/HadoopCredentialStore.java | 55 + .../conf/security/InfraManagerSecurityConfig.java | 38 + .../ambari/infra/conf/security/PasswordStore.java | 25 + .../infra/conf/security/SecurityEnvironment.java | 28 + .../infra/doc/InfraManagerApiDocStorage.java | 90 + .../infra/job/AbstractJobsConfiguration.java | 82 + .../apache/ambari/infra/job/CloseableIterator.java | 24 + .../infra/job/JobConfigurationException.java | 25 + .../ambari/infra/job/JobContextRepository.java | 26 + .../ambari/infra/job/JobContextRepositoryImpl.java | 52 + .../org/apache/ambari/infra/job/JobProperties.java | 82 + .../org/apache/ambari/infra/job/JobScheduler.java | 89 + .../apache/ambari/infra/job/JobsPropertyMap.java | 59 + .../org/apache/ambari/infra/job/ObjectSource.java | 23 + .../ambari/infra/job/SchedulingProperties.java | 49 + .../org/apache/ambari/infra/job/SolrDAOBase.java | 65 + .../infra/job/archive/AbstractFileAction.java | 38 + .../infra/job/archive/CompositeFileAction.java | 47 + .../apache/ambari/infra/job/archive/Document.java | 53 + .../archive/DocumentArchivingConfiguration.java | 169 ++ .../job/archive/DocumentArchivingProperties.java | 227 +++ .../job/archive/DocumentArchivingPropertyMap.java | 38 + .../infra/job/archive/DocumentDestination.java | 23 + .../ambari/infra/job/archive/DocumentExporter.java | 117 ++ .../infra/job/archive/DocumentItemReader.java | 137 ++ .../infra/job/archive/DocumentItemWriter.java | 25 + .../ambari/infra/job/archive/DocumentWiper.java | 23 + .../infra/job/archive/ExportDestination.java | 25 + .../ambari/infra/job/archive/FileAction.java | 25 + .../infra/job/archive/FileNameSuffixFormatter.java | 63 + .../ambari/infra/job/archive/HdfsUploader.java | 55 + .../infra/job/archive/ItemWriterListener.java | 23 + .../infra/job/archive/LocalDocumentItemWriter.java | 85 + .../infra/job/archive/LocalItemWriterListener.java | 36 + .../ambari/infra/job/archive/S3AccessCsv.java | 94 + .../job/archive/S3AccessCsvFormatException.java | 25 + .../ambari/infra/job/archive/S3AccessKeyNames.java | 40 + .../ambari/infra/job/archive/S3Properties.java | 66 + .../ambari/infra/job/archive/S3Uploader.java | 74 + .../apache/ambari/infra/job/archive/SolrDAO.java | 68 + .../infra/job/archive/SolrDocumentIterator.java | 92 + .../infra/job/archive/SolrDocumentSource.java | 39 + .../infra/job/archive/SolrParametrizedString.java | 77 + .../ambari/infra/job/archive/SolrProperties.java | 117 ++ .../ambari/infra/job/archive/SolrQueryBuilder.java | 100 + .../infra/job/archive/SolrQueryProperties.java | 97 + .../ambari/infra/job/archive/TarGzCompressor.java | 50 + .../infra/job/archive/WriteCompletedEvent.java | 45 + .../deleting/DocumentDeletingConfiguration.java | 78 + .../job/deleting/DocumentDeletingProperties.java | 77 + .../job/deleting/DocumentDeletingPropertyMap.java | 38 + .../infra/job/deleting/DocumentWiperTasklet.java | 49 + .../ambari/infra/job/dummy/DummyItemProcessor.java | 36 + .../ambari/infra/job/dummy/DummyItemWriter.java | 65 + .../infra/job/dummy/DummyJobConfiguration.java | 108 + .../ambari/infra/job/dummy/DummyJobListener.java | 46 + .../apache/ambari/infra/job/dummy/DummyObject.java | 40 + .../ambari/infra/job/dummy/DummyStepListener.java | 41 + .../apache/ambari/infra/manager/JobManager.java | 291 +++ .../java/org/apache/ambari/infra/manager/Jobs.java | 42 + .../infra/model/ExecutionContextResponse.java | 40 + .../ambari/infra/model/JobDetailsResponse.java | 53 + .../infra/model/JobExecutionDetailsResponse.java | 49 + .../infra/model/JobExecutionInfoResponse.java | 141 ++ .../ambari/infra/model/JobExecutionRequest.java | 46 + .../infra/model/JobExecutionRestartRequest.java | 62 + .../infra/model/JobExecutionStopRequest.java | 50 + .../infra/model/JobInstanceDetailsResponse.java | 54 + .../infra/model/JobInstanceStartRequest.java | 49 + .../ambari/infra/model/JobOperationParams.java | 31 + .../org/apache/ambari/infra/model/JobRequest.java | 37 + .../org/apache/ambari/infra/model/PageRequest.java | 49 + .../infra/model/StepExecutionContextResponse.java | 58 + .../infra/model/StepExecutionInfoResponse.java | 115 ++ .../infra/model/StepExecutionProgressResponse.java | 53 + .../ambari/infra/model/StepExecutionRequest.java | 49 + .../infra/model/wrapper/JobExecutionData.java | 118 ++ .../infra/model/wrapper/StepExecutionData.java | 133 ++ .../apache/ambari/infra/rest/ApiDocResource.java | 56 + .../ambari/infra/rest/JobExceptionMapper.java | 110 ++ .../org/apache/ambari/infra/rest/JobResource.java | 207 ++ .../src/main/resources/dummy/dummy.txt | 3 + .../src/main/resources/infra-manager-env.sh | 40 + .../src/main/resources/infra-manager.properties | 74 + .../src/main/resources/infraManager.sh | 272 +++ ambari-infra-manager/src/main/resources/log4j2.xml | 44 + .../src/main/resources/static/index.html | 24 + .../src/main/resources/swagger/swagger.html | 136 ++ .../conf/security/CompositePasswordStoreTest.java | 48 + .../apache/ambari/infra/job/JobPropertiesTest.java | 56 + .../apache/ambari/infra/job/JobSchedulerTest.java | 114 ++ .../infra/job/archive/DocumentExporterTest.java | 215 ++ .../infra/job/archive/DocumentItemReaderTest.java | 199 ++ .../job/archive/FileNameSuffixFormatterTest.java | 58 + .../job/archive/LocalDocumentItemWriterTest.java | 115 ++ .../ambari/infra/job/archive/S3AccessCsvTest.java | 70 + .../job/archive/SolrParametrizedStringTest.java | 57 + .../infra/job/archive/SolrPropertiesTest.java | 54 + .../infra/job/archive/SolrQueryBuilderTest.java | 106 + .../infra/job/archive/SolrQueryPropertiesTest.java | 54 + .../vagrant-infra-manager.properties.sample | 39 + ambari-infra-solr-client/README.md | 1060 ++++++++++ ambari-infra-solr-client/build.xml | 79 + ambari-infra-solr-client/pom.xml | 178 ++ .../ambari/infra/solr/AmbariSolrCloudCLI.java | 680 +++++++ .../ambari/infra/solr/AmbariSolrCloudClient.java | 405 ++++ .../infra/solr/AmbariSolrCloudClientBuilder.java | 246 +++ .../infra/solr/AmbariSolrCloudClientException.java | 28 + .../org/apache/ambari/infra/solr/S3Uploader.java | 64 + .../infra/solr/commands/AbstractRetryCommand.java | 58 + .../solr/commands/AbstractSolrRetryCommand.java | 53 + .../solr/commands/AbstractStateFileZkCommand.java | 42 + .../commands/AbstractZookeeperConfigCommand.java | 44 + .../commands/AbstractZookeeperRetryCommand.java | 40 + .../infra/solr/commands/CheckConfigZkCommand.java | 34 + .../infra/solr/commands/CheckZnodeZkCommand.java | 45 + .../solr/commands/CreateCollectionCommand.java | 54 + .../infra/solr/commands/CreateShardCommand.java | 48 + .../solr/commands/CreateSolrZnodeZkCommand.java | 42 + .../infra/solr/commands/DeleteZnodeZkCommand.java | 37 + .../solr/commands/DownloadConfigZkCommand.java | 47 + .../solr/commands/DumpCollectionsCommand.java | 157 ++ .../EnableKerberosPluginSolrZkCommand.java | 88 + .../infra/solr/commands/GetShardsCommand.java | 39 + .../infra/solr/commands/GetSolrHostsCommand.java | 53 + .../infra/solr/commands/GetStateFileZkCommand.java | 43 + .../infra/solr/commands/ListCollectionCommand.java | 49 + .../solr/commands/RemoveAdminHandlersCommand.java | 46 + .../solr/commands/SecureSolrZNodeZkCommand.java | 86 + .../infra/solr/commands/SecureZNodeZkCommand.java | 49 + .../solr/commands/SetClusterPropertyZkCommand.java | 40 + .../solr/commands/TransferZnodeZkCommand.java | 45 + .../solr/commands/UnsecureZNodeZkCommand.java | 44 + .../solr/commands/UpdateStateFileZkCommand.java | 84 + .../infra/solr/commands/UploadConfigZkCommand.java | 41 + .../ambari/infra/solr/domain/AmbariSolrState.java | 26 + .../infra/solr/domain/json/SolrCollection.java | 89 + .../infra/solr/domain/json/SolrCoreData.java | 57 + .../ambari/infra/solr/domain/json/SolrShard.java | 55 + .../apache/ambari/infra/solr/util/AclUtils.java | 85 + .../apache/ambari/infra/solr/util/ShardUtils.java | 71 + .../src/main/python/migrationConfigGenerator.py | 518 +++++ .../src/main/python/migrationHelper.py | 2079 ++++++++++++++++++++ .../src/main/python/solrDataManager.py | 823 ++++++++ .../src/main/resources/ambariSolrMigration.sh | 322 +++ .../resources/data/security-without-authr.json | 6 + .../src/main/resources/log4j.properties | 35 + .../src/main/resources/managed-schema | 93 + .../src/main/resources/solrCloudCli.sh | 26 + .../src/main/resources/solrIndexHelper.sh | 237 +++ .../infra/solr/AmbariSolrCloudClientTest.java | 134 ++ ambari-infra-solr-plugin/.gitignore | 3 + ambari-infra-solr-plugin/docker/Dockerfile | 46 + ambari-infra-solr-plugin/docker/docker-compose.yml | 54 + .../docker/infra-solr-docker-compose.sh | 122 ++ ambari-infra-solr-plugin/docker/infra-solr.sh | 69 + ambari-infra-solr-plugin/docker/solr.xml | 108 + ambari-infra-solr-plugin/pom.xml | 88 + .../solr/metrics/reporters/AMSCacheReporter.java | 51 + .../infra/solr/metrics/reporters/AMSProtocol.java | 24 + .../infra/solr/metrics/reporters/AMSReporter.java | 104 + .../solr/metrics/reporters/GaugeConverter.java | 29 + .../infra/solr/metrics/reporters/MetricsUtils.java | 79 + .../metrics/reporters/ScheduledAMSReporter.java | 117 ++ .../reporters/ScheduledAMSReporterBuilder.java | 101 + .../solr/metrics/reporters/SimpleAMSReporter.java | 38 + .../reporters/SolrMetricsSecurityConfig.java | 44 + .../solr/metrics/reporters/SolrMetricsSink.java | 103 + .../solr/security/InfraKerberosHostValidator.java | 54 + .../InfraRuleBasedAuthorizationPlugin.java | 303 +++ .../security/InfraUserRolesLookupStrategy.java | 49 + ...uster.security.InfraRuleBasedAuthorization.json | 129 ++ .../security/InfraKerberosHostValidatorTest.java | 114 ++ .../InfraRuleBasedAuthorizationPluginTest.java | 259 +++ .../security/InfraUserRolesLookupStrategyTest.java | 83 + pom.xml | 366 ++++ 236 files changed, 23349 insertions(+), 1 deletion(-) create mode 100644 .gitattributes create mode 100644 .gitignore delete mode 100644 README.md create mode 100644 ambari-infra-assembly/pom.xml create mode 100644 ambari-infra-assembly/src/main/package/deb/manager/control create mode 100644 ambari-infra-assembly/src/main/package/deb/manager/postinst create mode 100644 ambari-infra-assembly/src/main/package/deb/manager/postrm create mode 100644 ambari-infra-assembly/src/main/package/deb/manager/preinst create mode 100644 ambari-infra-assembly/src/main/package/deb/manager/prerm create mode 100644 ambari-infra-assembly/src/main/package/deb/solr-client/control create mode 100644 ambari-infra-assembly/src/main/package/deb/solr-client/postinst create mode 100644 ambari-infra-assembly/src/main/package/deb/solr-client/postrm create mode 100644 ambari-infra-assembly/src/main/package/deb/solr-client/preinst create mode 100644 ambari-infra-assembly/src/main/package/deb/solr-client/prerm create mode 100644 ambari-infra-assembly/src/main/package/deb/solr/control create mode 100644 ambari-infra-assembly/src/main/package/deb/solr/postinst create mode 100644 ambari-infra-assembly/src/main/package/deb/solr/postrm create mode 100644 ambari-infra-assembly/src/main/package/deb/solr/preinst create mode 100644 ambari-infra-assembly/src/main/package/deb/solr/prerm create mode 100644 ambari-infra-assembly/src/main/package/rpm/manager/postinstall.sh create mode 100644 ambari-infra-assembly/src/main/package/rpm/manager/postremove.sh create mode 100644 ambari-infra-assembly/src/main/package/rpm/solr-client/postinstall.sh create mode 100644 ambari-infra-manager-it/pom.xml create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/HttpResponse.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/InfraClient.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/InfraManagerStories.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/JobExecutionInfo.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/OffsetDateTimeConverter.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/Solr.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/TestUtil.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/solr/metrics/MetricsIT.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/solr/metrics/MockMetricsServer.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/steps/AbstractInfraSteps.java create mode 100644 ambari-infra-manager-it/src/test/java/org/apache/ambari/infra/steps/ExportJobsSteps.java create mode 100644 ambari-infra-manager-it/src/test/resources/log4j.properties create mode 100644 ambari-infra-manager-it/src/test/resources/stories/infra_api_tests.story create mode 100644 ambari-infra-manager/.gitignore create mode 100644 ambari-infra-manager/README.md create mode 100644 ambari-infra-manager/build.xml create mode 100644 ambari-infra-manager/docker/Dockerfile create mode 100755 ambari-infra-manager/docker/bin/start.sh create mode 100644 ambari-infra-manager/docker/docker-compose.yml create mode 100755 ambari-infra-manager/docker/infra-manager-docker-compose.sh create mode 100755 ambari-infra-manager/docker/infra-manager-docker.sh create mode 100644 ambari-infra-manager/docs/api/swagger.yaml create mode 100644 ambari-infra-manager/docs/images/batch-1.png create mode 100644 ambari-infra-manager/docs/images/batch-2.png create mode 100644 ambari-infra-manager/docs/images/batch-3.png create mode 100644 ambari-infra-manager/docs/images/batch-4.png create mode 100644 ambari-infra-manager/pom.xml create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/InfraManager.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/InfraManagerApiDocConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/InfraManagerConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/InfraManagerDataConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/InfraManagerJerseyResourceConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/InfraManagerSchedulingConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/InfraManagerServletConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/StaticResourceConfiguration.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/batch/InfraManagerBatchConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/security/CompositePasswordStore.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/security/HadoopCredentialStore.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/security/InfraManagerSecurityConfig.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/security/PasswordStore.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/conf/security/SecurityEnvironment.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/doc/InfraManagerApiDocStorage.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/AbstractJobsConfiguration.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/CloseableIterator.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/JobConfigurationException.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/JobContextRepository.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/JobContextRepositoryImpl.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/JobProperties.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/JobScheduler.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/JobsPropertyMap.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/ObjectSource.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/SchedulingProperties.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/SolrDAOBase.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/AbstractFileAction.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/CompositeFileAction.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/Document.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentArchivingConfiguration.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentArchivingProperties.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentArchivingPropertyMap.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentDestination.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentExporter.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentItemReader.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentItemWriter.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentWiper.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/ExportDestination.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/FileAction.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/FileNameSuffixFormatter.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/HdfsUploader.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/ItemWriterListener.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/LocalDocumentItemWriter.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/LocalItemWriterListener.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/S3AccessCsv.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/S3AccessCsvFormatException.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/S3AccessKeyNames.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/S3Properties.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/S3Uploader.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrDAO.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrDocumentIterator.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrDocumentSource.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrParametrizedString.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrProperties.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrQueryBuilder.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrQueryProperties.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/TarGzCompressor.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/WriteCompletedEvent.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/deleting/DocumentDeletingConfiguration.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/deleting/DocumentDeletingProperties.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/deleting/DocumentDeletingPropertyMap.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/deleting/DocumentWiperTasklet.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/dummy/DummyItemProcessor.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/dummy/DummyItemWriter.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/dummy/DummyJobConfiguration.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/dummy/DummyJobListener.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/dummy/DummyObject.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/dummy/DummyStepListener.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/manager/JobManager.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/manager/Jobs.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/ExecutionContextResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobDetailsResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobExecutionDetailsResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobExecutionInfoResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobExecutionRequest.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobExecutionRestartRequest.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobExecutionStopRequest.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobInstanceDetailsResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobInstanceStartRequest.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobOperationParams.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/JobRequest.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/PageRequest.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/StepExecutionContextResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/StepExecutionInfoResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/StepExecutionProgressResponse.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/StepExecutionRequest.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/wrapper/JobExecutionData.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/model/wrapper/StepExecutionData.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/rest/ApiDocResource.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/rest/JobExceptionMapper.java create mode 100644 ambari-infra-manager/src/main/java/org/apache/ambari/infra/rest/JobResource.java create mode 100644 ambari-infra-manager/src/main/resources/dummy/dummy.txt create mode 100644 ambari-infra-manager/src/main/resources/infra-manager-env.sh create mode 100644 ambari-infra-manager/src/main/resources/infra-manager.properties create mode 100644 ambari-infra-manager/src/main/resources/infraManager.sh create mode 100644 ambari-infra-manager/src/main/resources/log4j2.xml create mode 100644 ambari-infra-manager/src/main/resources/static/index.html create mode 100644 ambari-infra-manager/src/main/resources/swagger/swagger.html create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/conf/security/CompositePasswordStoreTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/JobPropertiesTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/JobSchedulerTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/DocumentExporterTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/DocumentItemReaderTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/FileNameSuffixFormatterTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/LocalDocumentItemWriterTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/S3AccessCsvTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/SolrParametrizedStringTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/SolrPropertiesTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/SolrQueryBuilderTest.java create mode 100644 ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/SolrQueryPropertiesTest.java create mode 100644 ambari-infra-manager/src/test/resoruces/vagrant-infra-manager.properties.sample create mode 100644 ambari-infra-solr-client/README.md create mode 100644 ambari-infra-solr-client/build.xml create mode 100644 ambari-infra-solr-client/pom.xml create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/AmbariSolrCloudCLI.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/AmbariSolrCloudClient.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/AmbariSolrCloudClientBuilder.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/AmbariSolrCloudClientException.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/S3Uploader.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/AbstractRetryCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/AbstractSolrRetryCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/AbstractStateFileZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/AbstractZookeeperConfigCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/AbstractZookeeperRetryCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/CheckConfigZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/CheckZnodeZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/CreateCollectionCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/CreateShardCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/CreateSolrZnodeZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/DeleteZnodeZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/DownloadConfigZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/DumpCollectionsCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/EnableKerberosPluginSolrZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/GetShardsCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/GetSolrHostsCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/GetStateFileZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/ListCollectionCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/RemoveAdminHandlersCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/SecureSolrZNodeZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/SecureZNodeZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/SetClusterPropertyZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/TransferZnodeZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/UnsecureZNodeZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/UpdateStateFileZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/commands/UploadConfigZkCommand.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/domain/AmbariSolrState.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/domain/json/SolrCollection.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/domain/json/SolrCoreData.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/domain/json/SolrShard.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/util/AclUtils.java create mode 100644 ambari-infra-solr-client/src/main/java/org/apache/ambari/infra/solr/util/ShardUtils.java create mode 100755 ambari-infra-solr-client/src/main/python/migrationConfigGenerator.py create mode 100755 ambari-infra-solr-client/src/main/python/migrationHelper.py create mode 100755 ambari-infra-solr-client/src/main/python/solrDataManager.py create mode 100755 ambari-infra-solr-client/src/main/resources/ambariSolrMigration.sh create mode 100644 ambari-infra-solr-client/src/main/resources/data/security-without-authr.json create mode 100644 ambari-infra-solr-client/src/main/resources/log4j.properties create mode 100644 ambari-infra-solr-client/src/main/resources/managed-schema create mode 100644 ambari-infra-solr-client/src/main/resources/solrCloudCli.sh create mode 100755 ambari-infra-solr-client/src/main/resources/solrIndexHelper.sh create mode 100644 ambari-infra-solr-client/src/test/java/org/apache/ambari/infra/solr/AmbariSolrCloudClientTest.java create mode 100644 ambari-infra-solr-plugin/.gitignore create mode 100644 ambari-infra-solr-plugin/docker/Dockerfile create mode 100644 ambari-infra-solr-plugin/docker/docker-compose.yml create mode 100755 ambari-infra-solr-plugin/docker/infra-solr-docker-compose.sh create mode 100755 ambari-infra-solr-plugin/docker/infra-solr.sh create mode 100644 ambari-infra-solr-plugin/docker/solr.xml create mode 100644 ambari-infra-solr-plugin/pom.xml create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/AMSCacheReporter.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/AMSProtocol.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/AMSReporter.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/GaugeConverter.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/MetricsUtils.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/ScheduledAMSReporter.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/ScheduledAMSReporterBuilder.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/SimpleAMSReporter.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/SolrMetricsSecurityConfig.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/ambari/infra/solr/metrics/reporters/SolrMetricsSink.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/solr/security/InfraKerberosHostValidator.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/solr/security/InfraRuleBasedAuthorizationPlugin.java create mode 100644 ambari-infra-solr-plugin/src/main/java/org/apache/solr/security/InfraUserRolesLookupStrategy.java create mode 100644 ambari-infra-solr-plugin/src/main/resources/apispec/cluster.security.InfraRuleBasedAuthorization.json create mode 100644 ambari-infra-solr-plugin/src/test/java/org/apache/solr/security/InfraKerberosHostValidatorTest.java create mode 100644 ambari-infra-solr-plugin/src/test/java/org/apache/solr/security/InfraRuleBasedAuthorizationPluginTest.java create mode 100644 ambari-infra-solr-plugin/src/test/java/org/apache/solr/security/InfraUserRolesLookupStrategyTest.java create mode 100644 pom.xml