Re: Replication of Solr Model and feature store
Thank you, Krishan. It did turn out to be a mis-match between the model and feature store with a feature name. And thanks for the information that the API can struggle when there is a corrupt model or feature store file – we get the model and feature store from our data science team and have had issues a couple of times. Monica D Skidmore Lead Engineer, Core Search [CareerBuilder] CareerBuilder.com<https://www.careerbuilder.com/> | Blog<https://www.careerbuilder.com/advice> | Press Room<https://press.careerbuilder.com/> From: krishan goyal Date: Friday, August 7, 2020 at 10:28 AM To: "solr-user@lucene.apache.org" , Monica Skidmore Cc: Christine Poerschke Subject: Re: Replication of Solr Model and feature store Hi Monica, Replication is working fine for me. You just have to add the _schema_feature-store.json and _schema_model-store.json to confFiles under /replication in solrconfig.xml I think the issue you are seeing is where the model is referencing a feature which is not present in the feature store. Or the feature weights for the model are incorrect. The issue in solr is that it doesn't return you the right exception but throws a model not found exception Try these ways to fix it 1. verify feature weights are < 1. I am not sure why having weights > 1 is an issue but apparently it is in some random cases 2. verify all features used in the model file _schema_model-store.json are actually present in the feature file _schema_feature-store.json. Another issue with solr LTR is if you have a corrupt model/feature file, you can't update/delete it via the API in some cases. you would need to change the respective _schema_model-store.json and _schema_feature-store.json files and reload the cores for the changes to take effect. Please try these and let me know if the issue still exists On Thu, Aug 6, 2020 at 11:18 PM Monica Skidmore mailto:monica.skidm...@careerbuilder.com>> wrote: I would be interested in the answer here, as well. We're using LTR successfully on Solr 7.3 and Solr 8.3 in cloud mode, but we're struggling to load a simple, test model on 8.3 in master/slave mode. The FeatureStore appears to load, but we're not sure it's loading correctly, either. Here are some details from the engineer on our team who is leading that effort: "I'm getting a ClassCastException when uploading a Model. Using the debugger, was able to see the line throwing the exception is: org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:488) Apparently it cannot find: org.apache.solr.ltr.model.LinearModel, although the features appear to be created without issues with the following class: org.apache.solr.ltr.feature.FieldValueFeature Another thing we were able to see is that the List features has a list of null elements, so that made us think there may be some issues when creating the instances of Feature. We had begun to believe this might be related to the fact that we are running Solr in Master/Slave config. Was LTR ever tested on non-cloud deployments?? Any help is appreciated." Monica D Skidmore Lead Engineer, Core Search CareerBuilder.com <https://www.careerbuilder.com/<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.careerbuilder.com%2F=01%7C01%7CMonica.Skidmore%40careerbuilder.com%7C24c17c2feda848aa568f08d83ade2a1c%7C7cc1677566a34e8b80fd5b1f1db15061%7C0=YOVsrFay2%2F7DikgP4kabmRwBd6aOwXVtWXZvXOCdz3k%3D=0>> | Blog <https://www.careerbuilder.com/advice<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.careerbuilder.com%2Fadvice=01%7C01%7CMonica.Skidmore%40careerbuilder.com%7C24c17c2feda848aa568f08d83ade2a1c%7C7cc1677566a34e8b80fd5b1f1db15061%7C0=74IweSSuSygVP%2FyhO4mTW%2B3crHtSoo6aT4T1rPQ8ijg%3D=0>> | Press Room <https://press.careerbuilder.com/<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpress.careerbuilder.com%2F=01%7C01%7CMonica.Skidmore%40careerbuilder.com%7C24c17c2feda848aa568f08d83ade2a1c%7C7cc1677566a34e8b80fd5b1f1db15061%7C0=%2BnAZ1sigMex2ijQ4J5Aox%2FdfhVh5tJPz3FyGp5wiYZk%3D=0>> On 7/24/20, 7:58 AM, "Christine Poerschke (BLOOMBERG/ LONDON)" mailto:cpoersc...@bloomberg.net>> wrote: Hi Krishan, Could you share what version of Solr you are using? And I wonder if the observed behaviour could be reproduced e.g. with the techproducts example, changes not applying after reload [1] sounds like a bug if so. Hope that helps. Regards, Christine [1] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flucene.apache.org%2Fsolr%2Fguide%2F8_6%2Flearning-to-rank.html%23applying-changesdata=01%7C01%7CMonica.Skidmore%40careerbuilder.com%7C65581e5e79414c90832508d82fc8ce21%7C7cc1677566a34e8b80fd5b1f1db15061%7C0sdata=mMqgPhnkjb8h7ETQNaySOBJQ8x%2FP2dtzM%2FgSE1K1FZg%3Dreserved=0<https://nam04.safelinks.protection.outlook.com/?ur
Re: Replication of Solr Model and feature store
Hi Monica, Replication is working fine for me. You just have to add the _schema_feature-store.json and _schema_model-store.json to confFiles under /replication in solrconfig.xml I think the issue you are seeing is where the model is referencing a feature which is not present in the feature store. Or the feature weights for the model are incorrect. The issue in solr is that it doesn't return you the right exception but throws a model not found exception Try these ways to fix it 1. verify feature weights are < 1. I am not sure why having weights > 1 is an issue but apparently it is in some random cases 2. verify all features used in the model file _schema_model-store.json are actually present in the feature file _schema_feature-store.json. Another issue with solr LTR is if you have a corrupt model/feature file, you can't update/delete it via the API in some cases. you would need to change the respective _schema_model-store.json and _schema_feature-store.json files and reload the cores for the changes to take effect. Please try these and let me know if the issue still exists On Thu, Aug 6, 2020 at 11:18 PM Monica Skidmore < monica.skidm...@careerbuilder.com> wrote: > I would be interested in the answer here, as well. We're using LTR > successfully on Solr 7.3 and Solr 8.3 in cloud mode, but we're struggling > to load a simple, test model on 8.3 in master/slave mode. The > FeatureStore appears to load, but we're not sure it's loading correctly, > either. Here are some details from the engineer on our team who is leading > that effort: > > "I'm getting a ClassCastException when uploading a Model. Using the > debugger, was able to see the line throwing the exception is: > org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:488) > > Apparently it cannot find: org.apache.solr.ltr.model.LinearModel, although > the features appear to be created without issues with the following class: > org.apache.solr.ltr.feature.FieldValueFeature > > Another thing we were able to see is that the List features has a > list of null elements, so that made us think there may be some issues when > creating the instances of Feature. > > We had begun to believe this might be related to the fact that we are > running Solr in Master/Slave config. Was LTR ever tested on non-cloud > deployments?? > > Any help is appreciated." > > Monica D Skidmore > Lead Engineer, Core Search > > > > CareerBuilder.com <https://www.careerbuilder.com/> | Blog < > https://www.careerbuilder.com/advice> | Press Room < > https://press.careerbuilder.com/> > > > > > On 7/24/20, 7:58 AM, "Christine Poerschke (BLOOMBERG/ LONDON)" < > cpoersc...@bloomberg.net> wrote: > > Hi Krishan, > > Could you share what version of Solr you are using? > > And I wonder if the observed behaviour could be reproduced e.g. with > the techproducts example, changes not applying after reload [1] sounds like > a bug if so. > > Hope that helps. > > Regards, > > Christine > > [1] > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flucene.apache.org%2Fsolr%2Fguide%2F8_6%2Flearning-to-rank.html%23applying-changesdata=01%7C01%7CMonica.Skidmore%40careerbuilder.com%7C65581e5e79414c90832508d82fc8ce21%7C7cc1677566a34e8b80fd5b1f1db15061%7C0sdata=mMqgPhnkjb8h7ETQNaySOBJQ8x%2FP2dtzM%2FgSE1K1FZg%3Dreserved=0 > > From: solr-user@lucene.apache.org At: 07/22/20 14:00:59To: > solr-user@lucene.apache.org > Subject: Re: Replication of Solr Model and feature store > > Adding more details here > > I need some help on how to enable the solr LTR model and features on > all > nodes of a solr cluster. > > I am unable to replicate the model and the feature store though from > any > master to its slaves with the replication API ? And unable to find any > documentation for the same. Is replication possible? > > Without replication, would I have to individually update all nodes of a > cluster ? Or can the feature and model files be read as a resource > (like > config or schema) so that I can replicate the file or add the file to > my > deployments. > > > On Wed, Jul 22, 2020 at 5:53 PM krishan goyal > wrote: > > > Bump. Any one has an idea how to proceed here ? > > > > On Wed, Jul 8, 2020 at 5:41 PM krishan goyal > > wrote: > > > >> Hi, > >> > >> How do I enable replication of the model and feature store ? > >> > >> Thanks > >> Krishan > >> > > > > > >
Re: Replication of Solr Model and feature store
I would be interested in the answer here, as well. We're using LTR successfully on Solr 7.3 and Solr 8.3 in cloud mode, but we're struggling to load a simple, test model on 8.3 in master/slave mode. The FeatureStore appears to load, but we're not sure it's loading correctly, either. Here are some details from the engineer on our team who is leading that effort: "I'm getting a ClassCastException when uploading a Model. Using the debugger, was able to see the line throwing the exception is: org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:488) Apparently it cannot find: org.apache.solr.ltr.model.LinearModel, although the features appear to be created without issues with the following class: org.apache.solr.ltr.feature.FieldValueFeature Another thing we were able to see is that the List features has a list of null elements, so that made us think there may be some issues when creating the instances of Feature. We had begun to believe this might be related to the fact that we are running Solr in Master/Slave config. Was LTR ever tested on non-cloud deployments?? Any help is appreciated." Monica D Skidmore Lead Engineer, Core Search CareerBuilder.com <https://www.careerbuilder.com/> | Blog <https://www.careerbuilder.com/advice> | Press Room <https://press.careerbuilder.com/> On 7/24/20, 7:58 AM, "Christine Poerschke (BLOOMBERG/ LONDON)" wrote: Hi Krishan, Could you share what version of Solr you are using? And I wonder if the observed behaviour could be reproduced e.g. with the techproducts example, changes not applying after reload [1] sounds like a bug if so. Hope that helps. Regards, Christine [1] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flucene.apache.org%2Fsolr%2Fguide%2F8_6%2Flearning-to-rank.html%23applying-changesdata=01%7C01%7CMonica.Skidmore%40careerbuilder.com%7C65581e5e79414c90832508d82fc8ce21%7C7cc1677566a34e8b80fd5b1f1db15061%7C0sdata=mMqgPhnkjb8h7ETQNaySOBJQ8x%2FP2dtzM%2FgSE1K1FZg%3Dreserved=0 From: solr-user@lucene.apache.org At: 07/22/20 14:00:59To: solr-user@lucene.apache.org Subject: Re: Replication of Solr Model and feature store Adding more details here I need some help on how to enable the solr LTR model and features on all nodes of a solr cluster. I am unable to replicate the model and the feature store though from any master to its slaves with the replication API ? And unable to find any documentation for the same. Is replication possible? Without replication, would I have to individually update all nodes of a cluster ? Or can the feature and model files be read as a resource (like config or schema) so that I can replicate the file or add the file to my deployments. On Wed, Jul 22, 2020 at 5:53 PM krishan goyal wrote: > Bump. Any one has an idea how to proceed here ? > > On Wed, Jul 8, 2020 at 5:41 PM krishan goyal > wrote: > >> Hi, >> >> How do I enable replication of the model and feature store ? >> >> Thanks >> Krishan >> >
Re: Replication of Solr Model and feature store
Hi Christine, I am using Solr 7.7 I am able to get it replicated now. I didn't know that the feature and model store are saved as files in the config structure. And by providing these names in /replication handle, I can replicate them. I guess this is something that can be provided in the LTR documentation. Will try to raise a PR for this. On Fri, Jul 24, 2020 at 5:28 PM Christine Poerschke (BLOOMBERG/ LONDON) < cpoersc...@bloomberg.net> wrote: > Hi Krishan, > > Could you share what version of Solr you are using? > > And I wonder if the observed behaviour could be reproduced e.g. with the > techproducts example, changes not applying after reload [1] sounds like a > bug if so. > > Hope that helps. > > Regards, > > Christine > > [1] > https://lucene.apache.org/solr/guide/8_6/learning-to-rank.html#applying-changes > > From: solr-user@lucene.apache.org At: 07/22/20 14:00:59To: > solr-user@lucene.apache.org > Subject: Re: Replication of Solr Model and feature store > > Adding more details here > > I need some help on how to enable the solr LTR model and features on all > nodes of a solr cluster. > > I am unable to replicate the model and the feature store though from any > master to its slaves with the replication API ? And unable to find any > documentation for the same. Is replication possible? > > Without replication, would I have to individually update all nodes of a > cluster ? Or can the feature and model files be read as a resource (like > config or schema) so that I can replicate the file or add the file to my > deployments. > > > On Wed, Jul 22, 2020 at 5:53 PM krishan goyal > wrote: > > > Bump. Any one has an idea how to proceed here ? > > > > On Wed, Jul 8, 2020 at 5:41 PM krishan goyal > > wrote: > > > >> Hi, > >> > >> How do I enable replication of the model and feature store ? > >> > >> Thanks > >> Krishan > >> > > > > >
Re: Replication of Solr Model and feature store
Hi Krishan, Could you share what version of Solr you are using? And I wonder if the observed behaviour could be reproduced e.g. with the techproducts example, changes not applying after reload [1] sounds like a bug if so. Hope that helps. Regards, Christine [1] https://lucene.apache.org/solr/guide/8_6/learning-to-rank.html#applying-changes From: solr-user@lucene.apache.org At: 07/22/20 14:00:59To: solr-user@lucene.apache.org Subject: Re: Replication of Solr Model and feature store Adding more details here I need some help on how to enable the solr LTR model and features on all nodes of a solr cluster. I am unable to replicate the model and the feature store though from any master to its slaves with the replication API ? And unable to find any documentation for the same. Is replication possible? Without replication, would I have to individually update all nodes of a cluster ? Or can the feature and model files be read as a resource (like config or schema) so that I can replicate the file or add the file to my deployments. On Wed, Jul 22, 2020 at 5:53 PM krishan goyal wrote: > Bump. Any one has an idea how to proceed here ? > > On Wed, Jul 8, 2020 at 5:41 PM krishan goyal > wrote: > >> Hi, >> >> How do I enable replication of the model and feature store ? >> >> Thanks >> Krishan >> >
Re: Replication of Solr Model and feature store
Adding more details here I need some help on how to enable the solr LTR model and features on all nodes of a solr cluster. I am unable to replicate the model and the feature store though from any master to its slaves with the replication API ? And unable to find any documentation for the same. Is replication possible? Without replication, would I have to individually update all nodes of a cluster ? Or can the feature and model files be read as a resource (like config or schema) so that I can replicate the file or add the file to my deployments. On Wed, Jul 22, 2020 at 5:53 PM krishan goyal wrote: > Bump. Any one has an idea how to proceed here ? > > On Wed, Jul 8, 2020 at 5:41 PM krishan goyal > wrote: > >> Hi, >> >> How do I enable replication of the model and feature store ? >> >> Thanks >> Krishan >> >
Re: Replication of Solr Model and feature store
Bump. Any one has an idea how to proceed here ? On Wed, Jul 8, 2020 at 5:41 PM krishan goyal wrote: > Hi, > > How do I enable replication of the model and feature store ? > > Thanks > Krishan >
Replication of Solr Model and feature store
Hi, How do I enable replication of the model and feature store ? Thanks Krishan
