[ https://issues.apache.org/jira/browse/SOLR-10272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068402#comment-16068402 ]
Steve Rowe commented on SOLR-10272: ----------------------------------- Policeman Jenkins failure [https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1408/] - doesn't reproduce for me on Linux, but I suspect the Solaris platform is relevant here, and that the failing directory comparison is depending on a sort that's not stable across platforms, since the directory contents are the same, just in a different order: {noformat} Checking out Revision c9c0121d9399ff0009c51d6a32632dd0962e8c8f (refs/remotes/origin/master) [...] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestConfigSetsAPI -Dtests.method=testUserAndTestDefaultConfigsetsAreSame -Dtests.seed=DBE6E9A12E3D770 -Dtests.slow=true -Dtests.locale=zh -Dtests.timezone=Africa/Sao_Tome -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] FAILURE 2.02s J1 | TestConfigSetsAPI.testUserAndTestDefaultConfigsetsAreSame <<< [junit4] > Throwable #1: org.junit.ComparisonFailure: Mismatch in files expected:<[[lang, elevate.xml, currency.xml, managed-schema, params.json, protwords.txt, stopwords.txt, synonyms.txt, solrconfig.xml]]> but was:<[[params.json, solrconfig.xml, lang, currency.xml, stopwords.txt, elevate.xml, protwords.txt, managed-schema, synonyms.txt]]> [junit4] > at __randomizedtesting.SeedInfo.seed([DBE6E9A12E3D770:72C37467A4C75D3]:0) [junit4] > at org.apache.solr.cloud.TestConfigSetsAPI$1.preVisitDirectory(TestConfigSetsAPI.java:747) [junit4] > at org.apache.solr.cloud.TestConfigSetsAPI$1.preVisitDirectory(TestConfigSetsAPI.java:741) [junit4] > at java.nio.file.Files.walkFileTree(Files.java:2677) [junit4] > at java.nio.file.Files.walkFileTree(Files.java:2742) [junit4] > at org.apache.solr.cloud.TestConfigSetsAPI.compareDirectories(TestConfigSetsAPI.java:741) [junit4] > at org.apache.solr.cloud.TestConfigSetsAPI.testUserAndTestDefaultConfigsetsAreSame(TestConfigSetsAPI.java:732) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestConfigSetsAPI_DBE6E9A12E3D770-001 [junit4] 2> Jun 29, 2017 11:31:15 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=zh, timezone=Africa/Sao_Tome [junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_131 (64-bit)/cpus=3,threads=1,free=176703120,total=518979584 [junit4] 2> NOTE: All tests run in this JVM: [TestQueryUtils, MoveReplicaTest, EchoParamsTest, SparseHLLTest, TestPayloadScoreQParserPlugin, TestLegacyFieldCache, SimpleMLTQParserTest, TestLockTree, V2StandaloneTest, TestPushWriter, TestDynamicFieldCollectionResource, BasicAuthStandaloneTest, TestPerFieldSimilarity, TestFieldCollectionResource, OverseerModifyCollectionTest, TestPostingsSolrHighlighter, TestMultiValuedNumericRangeQuery, TestUseDocValuesAsStored, TestStressLucene, TestInPlaceUpdatesStandalone, SolrGraphiteReporterTest, DistributedFacetPivotSmallTest, TestChildDocTransformer, TestFastWriter, TestSolrJ, TestDistributedGrouping, TestDynamicLoading, DistribDocExpirationUpdateProcessorTest, FieldMutatingUpdateProcessorTest, SolrPluginUtilsTest, TestFiltering, TestSizeLimitedDistributedMap, SolrCmdDistributorTest, TestSolrConfigHandlerCloud, DocumentAnalysisRequestHandlerTest, HdfsTlogReplayBufferedWhileIndexingTest, TestCryptoKeys, DirectSolrSpellCheckerTest, TestPolicyCloud, LukeRequestHandlerTest, TestReplicaProperties, BasicZkTest, SolrCoreCheckLockOnStartupTest, ParsingFieldUpdateProcessorsTest, DistributedQueryComponentCustomSortTest, SpellCheckCollatorTest, DistributedFacetPivotLongTailTest, SolrIndexConfigTest, TlogReplayBufferedWhileIndexingTest, TestRandomCollapseQParserPlugin, TestRequestStatusCollectionAPI, CurrencyFieldTypeTest, TestExclusionRuleCollectionAccess, HdfsSyncSliceTest, HdfsChaosMonkeySafeLeaderTest, ReplicationFactorTest, TestAnalyzedSuggestions, TermsComponentTest, TestWordDelimiterFilterFactory, ClassificationUpdateProcessorTest, TestManagedSynonymGraphFilterFactory, FileBasedSpellCheckerTest, TestSchemaNameResource, TestSlowCompositeReaderWrapper, SolrCloudExampleTest, TestInitQParser, CachingDirectoryFactoryTest, TestTolerantUpdateProcessorCloud, TestCloudRecovery, SolrShardReporterTest, TestRecovery, BlockCacheTest, TestInfoStreamLogging, TestConfigSetsAPIExclusivity, TestSolrFieldCacheBean, FullSolrCloudDistribCmdsTest, TestValueSourceCache, OpenExchangeRatesOrgProviderTest, DocExpirationUpdateProcessorFactoryTest, ConnectionManagerTest, TestBulkSchemaConcurrent, TestBadConfig, ShufflingReplicaListTransformerTest, TestReRankQParserPlugin, PolyFieldTest, TestRealTimeGet, TestElisionMultitermQuery, TestRandomRequestDistribution, StatsComponentTest, TestSegmentSorting, TestRuleBasedAuthorizationPlugin, AddBlockUpdateTest, CustomCollectionTest, InfixSuggestersTest, ExitableDirectoryReaderTest, TestOverriddenPrefixQueryForCustomFieldType, ActionThrottleTest, TestCloudPivotFacet, ChaosMonkeySafeLeaderTest, TestMultiWordSynonyms, TestLMJelinekMercerSimilarityFactory, SuggesterFSTTest, InfoHandlerTest, PropertiesRequestHandlerTest, TestRTGBase, TestSuggestSpellingConverter, TestFieldTypeCollectionResource, DocValuesMultiTest, TestSolrIndexConfig, TestJsonFacetRefinement, DocValuesNotIndexedTest, TestConfigSetProperties, TestConfigOverlay, SystemInfoHandlerTest, TestCoreDiscovery, IndexSchemaRuntimeFieldTest, TestAuthorizationFramework, TestLeaderElectionWithEmptyReplica, DeleteReplicaTest, TestPartialUpdateDeduplication, TestMacroExpander, TestCorePropertiesReload, LeaderElectionIntegrationTest, TestTestInjection, TestHdfsBackupRestoreCore, TestHdfsUpdateLog, PingRequestHandlerTest, CdcrUpdateLogTest, UUIDUpdateProcessorFallbackTest, TestXmlQParser, TestLegacyNumericUtils, TestNumericRangeQuery64, TestNRTOpen, SharedFSAutoReplicaFailoverTest, JSONWriterTest, ZkSolrClientTest, BaseCdcrDistributedZkTest, TestFieldCache, TestSerializedLuceneMatchVersion, CoreAdminRequestStatusTest, TestNamedUpdateProcessors, TestBinaryResponseWriter, TestSimpleTrackingShardHandler, TestPullReplicaErrorHandling, NodeMutatorTest, BlobRepositoryCloudTest, SaslZkACLProviderTest, TestFastOutputStream, CollectionStateFormat2Test, TestFreeTextSuggestions, SampleTest, TestConfigsApi, PreAnalyzedFieldTest, SuggesterTSTTest, BufferStoreTest, CollectionsAPIDistributedZkTest, RuleEngineTest, AnalyticsMergeStrategyTest, ManagedSchemaRoundRobinCloudTest, SpellPossibilityIteratorTest, ConvertedLegacyTest, TestPerFieldSimilarityWithDefaultOverride, TestJoin, TestSolrCloudWithHadoopAuthPlugin, TestSolrCloudSnapshots, TestDistributedMissingSort, TestManagedSchema, TestFieldSortValues, DistributedTermsComponentTest, TestRTimerTree, TestSQLHandler, TestLRUStatsCache, TestGraphMLResponseWriter, ZkStateWriterTest, TestStressLiveNodes, TestReqParamsAPI, BasicDistributedZk2Test, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, RecoveryZkTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, AutoCommitTest, TestFaceting, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestStressReorder, TestReload, TestStressVersions, TestRangeQuery, TestCoreContainer, TestSolr4Spatial, SpellCheckComponentTest, PeerSyncTest, BadIndexSchemaTest, TestSort, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, TestIndexSearcher, HighlighterTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SolrRequestParserTest, TestTrie, TestCSVLoader, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, TestRemoteStreaming, TestSolrDeletionPolicy1, SolrInfoBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, TestSolrQueryParser, LoggingHandlerTest, RegexBoostProcessorTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, QueryParsingTest, JsonLoaderTest, TestPHPSerializedResponseWriter, TestComponentsName, SearchHandlerTest, TestLFUCache, HighlighterConfigTest, SOLR749Test, UpdateParamsTest, AlternateDirectoryTest, CopyFieldTest, BadComponentTest, TestStressRecovery, TestMergePolicyConfig, TestDocSet, TestBinaryField, TestSearchPerf, NumericFieldsTest, TestConfig, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, TestCharFilters, SynonymTokenizerTest, TestXIncludeConfig, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestBM25SimilarityFactory, TimeZoneUtilsTest, ScriptEngineTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, SpellingQueryConverterTest, DOMUtilTest, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestHighlightDedupGrouping, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, AssignTest, AsyncCallRequestStatusResponseTest, CdcrBootstrapTest, CdcrReplicationDistributedZkTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CloudExitableDirectoryReaderTest, CollectionTooManyReplicasTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DeleteStatusTest, DistribCursorPagingTest, HttpPartitionTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MultiThreadedOCPTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, SolrCLIZkUtilsTest, TestAuthenticationFramework, TestConfigSetsAPI] {noformat} > Use a default configset and make the configName parameter optional. > ------------------------------------------------------------------- > > Key: SOLR-10272 > URL: https://issues.apache.org/jira/browse/SOLR-10272 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Reporter: Varun Thacker > Assignee: Ishan Chattopadhyaya > Priority: Blocker > Fix For: master (7.0) > > Attachments: SOLR-10272.patch, SOLR-10272.patch.gz, > SOLR-10272.patch.gz, SOLR-10272.patch.gz > > > This Jira's motivation is to improve the creating a collection experience > better for users. > To create a collection we need to specify a configName that needs to be > present in ZK. When a new user is starting Solr why should he worry about > having to know about configsets before he can can create a collection. > When you create a collection using "bin/solr create" the script uploads a > configset and references it. This is great. We should extend this idea to API > users as well. > So here is the rough outline of what I think we can do here: > 1. When you start solr , the bin script checks to see if > "/configs/_baseConfigSet" znode is present . If not it uploads the > "basic_configs". > We can discuss if its the "basic_configs" or something other default config > set. > Also we can discuss the name for "/_baseConfigSet". Moving on though > 2. When a user creates a collection from the API > {{admin/collections?action=CREATE&name=gettingstarted}} here is what we do : > Use https://cwiki.apache.org/confluence/display/solr/ConfigSets+API to copy > over the default config set to a configset with the name of the collection > specified. > collection.configName can truly be an optional parameter. If its specified we > don't need to do this step. > 3. Have the bin scripts use this and remove the logic built in there to do > the same thing. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org