Re: Backup and restore Solr 8.11.2 collections and configsets in Zookeeper version: 3.7.0
On Thu, Sep 22, 2022 at 4:06 PM Szalay-Bekő Máté wrote: > Hello Kaushal! > > One of my Solr colleagues just mentioned a possible solution. What about > using the solr admin script? With recursive option, like "solr zk -r" > > e.g. > > bin/solr zk cp -r file:/apache/confgs/whatever/conf zk:/configs/myconf -z > 111.222.333.444:2181 > > > https://solr.apache.org/guide/8_11/solr-control-script-reference.html#copy-between-local-files-and-zookeeper-znodes > > Isn't this what you are looking for? > > Best regards, > Máté > Thanks Mate and appreciate it. I will try it out and keep you posted. Thanks in advance. Best Regards, Kaushal
Re: Backup and restore Solr 8.11.2 collections and configsets in Zookeeper version: 3.7.0
Hello Kaushal! One of my Solr colleagues just mentioned a possible solution. What about using the solr admin script? With recursive option, like "solr zk -r" e.g. bin/solr zk cp -r file:/apache/confgs/whatever/conf zk:/configs/myconf -z 111.222.333.444:2181 https://solr.apache.org/guide/8_11/solr-control-script-reference.html#copy-between-local-files-and-zookeeper-znodes Isn't this what you are looking for? Best regards, Máté On Fri, Sep 16, 2022 at 8:23 PM Shawn Heisey wrote: > On 9/16/22 09:37, Szalay-Bekő Máté wrote: > > But actually much better would be to do the backup and restore on Solr > > level. > > Solr doesn't currently have this capability. We do have functionality > that can download index configs from ZK to the filesystem, but not all > the cluster contents in ZK. > > If the ZK is dedicated to Solr, I believe you can copy the entire > "version-2" directory from the ZK datadir and install it in new ZK nodes > while they are down, then start them up. > > Thanks, > Shawn > >
Re: Backup and restore Solr 8.11.2 collections and configsets in Zookeeper version: 3.7.0
On 9/16/22 09:37, Szalay-Bekő Máté wrote: But actually much better would be to do the backup and restore on Solr level. Solr doesn't currently have this capability. We do have functionality that can download index configs from ZK to the filesystem, but not all the cluster contents in ZK. If the ZK is dedicated to Solr, I believe you can copy the entire "version-2" directory from the ZK datadir and install it in new ZK nodes while they are down, then start them up. Thanks, Shawn
Re: Backup and restore Solr 8.11.2 collections and configsets in Zookeeper version: 3.7.0
Hello Kaushal! I think best would be to ask this in an Apache Solr mailing list. Here we mostly know about ZooKeeper :) I know that Solr is storing many configurations (including full config files) in ZooKeeper. To backup everything, you would need to export all the content from ZooKeeper under e.g. the "/solr" ZNode. We don't have such a recursive backup / restore solution in ZooKeeper. We mainly support the backup and restore of the whole ZooKeeper data tree. One can create some recursive script to achieve this (e.g. using the official ZooKeeper clients, or other clients listed here - https://cwiki.apache.org/confluence/display/zookeeper/zkclientbindings . I typically use kazoo for custom scripts like this). But actually much better would be to do the backup and restore on Solr level. I'm not exactly sure about the best practices, but here are some links to the official Solr documentation that might be helpful: - https://solr.apache.org/guide/8_11/using-zookeeper-to-manage-configuration-files.html - https://solr.apache.org/guide/8_11/collections-api.html - https://solr.apache.org/guide/8_11/collection-management.html#backup Best regards, Máté On Fri, Sep 16, 2022 at 5:21 PM Kaushal Shriyan wrote: > Hi, > > I am running Solr 8.11.2 (2 nodes) and Zookeeper version: 3.7.0 ( 3 nodes > -> 1 Leader and 2 Followers) on Linux release 7.9.2009 (Core). > > Is there a way to back up the collections and configsets in Zookeeper > version: 3.7.0 ( 3 nodes -> 1 Leader and 2 Followers) on Linux release > 7.9.2009 (Core) as per the details below? > > #./zkCli.sh > /bin/java > Connecting to localhost:2181 > Welcome to ZooKeeper! > JLine support is enabled > > WATCHER:: > > WatchedEvent state:SyncConnected type:None path:null > [zk: localhost:2181(CONNECTED) 0] ls / > solrzookeeper > [zk: localhost:2181(CONNECTED) 0] ls /solr/co > *collections* *configs* > [zk: localhost:2181(CONNECTED) 0] > > Thanks in advance. Please guide and I look forward to hearing from you. > > Best Regards, > > Kaushal >
Backup and restore Solr 8.11.2 collections and configsets in Zookeeper version: 3.7.0
Hi, I am running Solr 8.11.2 (2 nodes) and Zookeeper version: 3.7.0 ( 3 nodes -> 1 Leader and 2 Followers) on Linux release 7.9.2009 (Core). Is there a way to back up the collections and configsets in Zookeeper version: 3.7.0 ( 3 nodes -> 1 Leader and 2 Followers) on Linux release 7.9.2009 (Core) as per the details below? #./zkCli.sh /bin/java Connecting to localhost:2181 Welcome to ZooKeeper! JLine support is enabled WATCHER:: WatchedEvent state:SyncConnected type:None path:null [zk: localhost:2181(CONNECTED) 0] ls / solrzookeeper [zk: localhost:2181(CONNECTED) 0] ls /solr/co *collections* *configs* [zk: localhost:2181(CONNECTED) 0] Thanks in advance. Please guide and I look forward to hearing from you. Best Regards, Kaushal
