Re: Failed to create collection SOLR 6.3 HDP 2.6.2

[Dan Caulfield]

Shawn Heisey-2 wrote
> On 10/26/2017 10:29 AM, Dan Caulfield wrote:
>> I'm creating a collection on a new cluster.  There are six new Solr nodes
>> using a HDP 2.6.2 cluster for storage.  Has anyone seen similar errors?
> 
>> ERROR: Failed to create collection 'maxis_clickstream' due to:
>> {10.126.191.24:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
>> from server at http://10.126.191.24:8983/solr: Error CREATEing SolrCore
>> 'maxis_clickstream_shard6_replica1': Unable to create core
>> [maxis_clickstream_shard6_replica1] Caused by: no segments* file found in
>> LockValidatingDirectoryWrapper(NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node4/data/index
> 
> This error looks like what happens when the index directory already
> exists but contains no files. This specific error log mentions the
> following location:
> 
> hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node4/data/index
> 
> If I'm right, then you'll need to rename or delete that index directory
> on your HDFS store in order for the core creation to work.  The log
> snippet you shared included this error on several index directories, so
> you will need to repeat the rename or delete on all of them that show
> the error.
> 
> If you can be absolutely certain that there is no data contained there
> that is actively being used, then I *think* you could take care of
> everything in one step by renaming the maxis_clickstream directory to
> something else so that Solr will recreate the entire directory
> structure.  I am not recommending *deleting* that directory, because I
> have no idea whether it might contain something you'll want to keep.
> 
> The underlying problem I'm describing happens at the Lucene layer, and
> Solr is unable to do anything about it.  In order for Lucene to create a
> new index, the index directory must not be there at all.  Deleting the
> contents of the index directory but leaving the directory will cause
> errors the next time Lucene tries to use that directory.
> 
> Thanks,
> Shawn

Thanks Shawn, 
I tried your recommended solution and delete the maxis_clickstream
directory.  I got the same error when trying to recreate the collection. 
Can you think of anything else to try?  




--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Failed to create collection SOLR 6.3 HDP 2.6.2

[Dan Caulfield]

I'm creating a collection on a new cluster.  There are six new Solr nodes using 
a HDP 2.6.2 cluster for storage.  Has anyone seen similar errors?


/usr/iopsolr/current/iop-solr/server/scripts/cloud-scripts/zkcli.sh -cmd 
upconfig -zkhost 
d2mitphmn1001.edc.nam.gm.com:2181,d2mitphmn1003.edc.nam.gm.com:2181,d2mitphmn1004.edc.nam.gm.com:2181/solr
 -confname maxis_clickstream -confdir 
/home/solr/solr_configs/maxis_clickstream/conf


/usr/iopsolr/current/iop-solr/bin/solr create -c maxis_clickstream -d 
/home/solr/solr_configs/maxis_clickstream/conf -n maxis_clickstream -s 6 -rf 1
Connecting to ZooKeeper at 
d2mitphmn1001.edc.nam.gm.com:2181,d2mitphmn1003.edc.nam.gm.com:2181,d2mitphmn1004.edc.nam.gm.com:2181,d2mitphmn1005.edc.nam.gm.com:2181,d2mitphmn1006.edc.nam.gm.com:2181/solr
 ...
Re-using existing configuration directory maxis_clickstream

Creating new collection 'maxis_clickstream' using command:
http://localhost:8983/solr/admin/collections?action=CREATE&name=maxis_clickstream&numShards=6&replicationFactor=1&maxShardsPerNode=1&collection.configName=maxis_clickstream


ERROR: Failed to create collection 'maxis_clickstream' due to: 
{10.126.191.24:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://10.126.191.24:8983/solr: Error CREATEing SolrCore 
'maxis_clickstream_shard6_replica1': Unable to create core 
[maxis_clickstream_shard6_replica1] Caused by: no segments* file found in 
LockValidatingDirectoryWrapper(NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node4/data/index
 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@6d8569e4); 
maxCacheMB=192.0 maxMergeSizeMB=16.0)): files: [write.lock], 
10.126.191.28:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://10.126.191.28:8983/solr: Error CREATEing SolrCore 
'maxis_clickstream_shard4_replica1': Unable to create core 
[maxis_clickstream_shard4_replica1] Caused by: no segments* file found in 
LockValidatingDirectoryWrapper(NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node1/data/index
 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@77f88c13); 
maxCacheMB=192.0 maxMergeSizeMB=16.0)): files: [write.lock], 
10.126.191.27:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://10.126.191.27:8983/solr: Error CREATEing SolrCore 
'maxis_clickstream_shard5_replica1': Unable to create core 
[maxis_clickstream_shard5_replica1] Caused by: no segments* file found in 
LockValidatingDirectoryWrapper(NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node6/data/index
 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@4f658374); 
maxCacheMB=192.0 maxMergeSizeMB=16.0)): files: [write.lock], 
10.126.191.26:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://10.126.191.26:8983/solr: Error CREATEing SolrCore 
'maxis_clickstream_shard2_replica1': Unable to create core 
[maxis_clickstream_shard2_replica1] Caused by: no segments* file found in 
LockValidatingDirectoryWrapper(NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node2/data/index
 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@24deb971); 
maxCacheMB=192.0 maxMergeSizeMB=16.0)): files: [write.lock], 
10.126.191.25:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://10.126.191.25:8983/solr: Error CREATEing SolrCore 
'maxis_clickstream_shard3_replica1': Unable to create core 
[maxis_clickstream_shard3_replica1] Caused by: no segments* file found in 
LockValidatingDirectoryWrapper(NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node3/data/index
 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@3be7e4ac); 
maxCacheMB=192.0 maxMergeSizeMB=16.0)): files: [write.lock], 
10.126.191.23:8983_solr=org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://10.126.191.23:8983/solr: Error CREATEing SolrCore 
'maxis_clickstream_shard1_replica1': Unable to create core 
[maxis_clickstream_shard1_replica1] Caused by: no segments* file found in 
LockValidatingDirectoryWrapper(NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://edwbitstmil/apps/solr/data/maxis_clickstream/core_node5/data/index
 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@24a98dd3); 
maxCacheMB=192.0 maxMergeSizeMB=16.0)): files: [write.lock]}







Nothing in this message is intended to constitute an electronic signature 
unless a specific statement to the contrary is included in this message.

Confidentiality Note: This message is intended only for the person or entity to 
which it is addressed. It may contain confidential and/or