Re: How to integrate nlp in solr
Aman, I feel focusing on Question-Answering and Information Extraction components of NLP should help you achieve what you are looking for. Go through this book *Taming Text * (http://www.manning.com/ingersoll/ ) . Most of your queries should be answered including details on implementation and sample source codes. To state naively : NLP tools gives you the power to extract or interpret knowledge from text, which you basically store in the lucene index in form of fields or store along with the terms using payloads. During query processing time, you similarly gather additional knowledge from the query (using techniques like query expansion, relevance feedback, or ontologies ) and simply map those knowledge with the knowledge gained from the text. Its an effort to move to semantic retrieval rather than simple term matching. Thanks, Parnab On Wed, Jul 2, 2014 at 6:29 AM, Aman Tandon amantandon...@gmail.com wrote: Hi Alex, Thanks alex, one more thing i want to ask that so do we need to add the extra fields for those entities, e.g. Item (bags), color (blue), etc. If some how i managed to implement this nlp then i will definitely publish it on my blog :) With Regards Aman Tandon On Wed, Jul 2, 2014 at 10:34 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: Not from me, no. I don't have any real examples for this ready. I suspect the path beyond the basics is VERY dependent on your data and your business requirements. I would start from thinking how would YOU (as a human) do that match. Where does the 'blue' and 'color' and 'college' and 'bags' come from. Then, figuring out what is required for Solr to know to look there. NLP is not magic, just advanced technology. You need to know where you are going to get there. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon amantandon...@gmail.com wrote: Any help here With Regards Aman Tandon On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon amantandon...@gmail.com wrote: Hi Alex, I was try to get knowledge from these tutorials http://www.slideshare.net/teofili/natural-language-search-in-solr https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining but the real demo is not present. e.g. query: I want blue color college bags, then how using nlp it will work and how it will search, there is no such brief explanation out there, i will be thankful to you if you can help me in this. With Regards Aman Tandon On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon amantandon...@gmail.com wrote: the appropriate results What are those specifically? You need to be a bit more precise about what you are trying to achieve. Otherwise, there are too many NLP branches and too many approaches. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
Re: How to integrate nlp in solr
Thanks pranab, I am unfamiliar with payloads, can you provide some info about payload and how they are helpful in nlp On Jul 2, 2014 7:41 PM, parnab kumar parnab.2...@gmail.com wrote: Aman, I feel focusing on Question-Answering and Information Extraction components of NLP should help you achieve what you are looking for. Go through this book *Taming Text * (http://www.manning.com/ingersoll/ ) . Most of your queries should be answered including details on implementation and sample source codes. To state naively : NLP tools gives you the power to extract or interpret knowledge from text, which you basically store in the lucene index in form of fields or store along with the terms using payloads. During query processing time, you similarly gather additional knowledge from the query (using techniques like query expansion, relevance feedback, or ontologies ) and simply map those knowledge with the knowledge gained from the text. Its an effort to move to semantic retrieval rather than simple term matching. Thanks, Parnab On Wed, Jul 2, 2014 at 6:29 AM, Aman Tandon amantandon...@gmail.com wrote: Hi Alex, Thanks alex, one more thing i want to ask that so do we need to add the extra fields for those entities, e.g. Item (bags), color (blue), etc. If some how i managed to implement this nlp then i will definitely publish it on my blog :) With Regards Aman Tandon On Wed, Jul 2, 2014 at 10:34 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: Not from me, no. I don't have any real examples for this ready. I suspect the path beyond the basics is VERY dependent on your data and your business requirements. I would start from thinking how would YOU (as a human) do that match. Where does the 'blue' and 'color' and 'college' and 'bags' come from. Then, figuring out what is required for Solr to know to look there. NLP is not magic, just advanced technology. You need to know where you are going to get there. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon amantandon...@gmail.com wrote: Any help here With Regards Aman Tandon On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon amantandon...@gmail.com wrote: Hi Alex, I was try to get knowledge from these tutorials http://www.slideshare.net/teofili/natural-language-search-in-solr https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining but the real demo is not present. e.g. query: I want blue color college bags, then how using nlp it will work and how it will search, there is no such brief explanation out there, i will be thankful to you if you can help me in this. With Regards Aman Tandon On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon amantandon...@gmail.com wrote: the appropriate results What are those specifically? You need to be a bit more precise about what you are trying to achieve. Otherwise, there are too many NLP branches and too many approaches. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
Re: How to integrate nlp in solr
Any help here With Regards Aman Tandon On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon amantandon...@gmail.com wrote: Hi Alex, I was try to get knowledge from these tutorials http://www.slideshare.net/teofili/natural-language-search-in-solr https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining but the real demo is not present. e.g. query: I want blue color college bags, then how using nlp it will work and how it will search, there is no such brief explanation out there, i will be thankful to you if you can help me in this. With Regards Aman Tandon On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon amantandon...@gmail.com wrote: the appropriate results What are those specifically? You need to be a bit more precise about what you are trying to achieve. Otherwise, there are too many NLP branches and too many approaches. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
Re: How to integrate nlp in solr
Not from me, no. I don't have any real examples for this ready. I suspect the path beyond the basics is VERY dependent on your data and your business requirements. I would start from thinking how would YOU (as a human) do that match. Where does the 'blue' and 'color' and 'college' and 'bags' come from. Then, figuring out what is required for Solr to know to look there. NLP is not magic, just advanced technology. You need to know where you are going to get there. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon amantandon...@gmail.com wrote: Any help here With Regards Aman Tandon On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon amantandon...@gmail.com wrote: Hi Alex, I was try to get knowledge from these tutorials http://www.slideshare.net/teofili/natural-language-search-in-solr https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining but the real demo is not present. e.g. query: I want blue color college bags, then how using nlp it will work and how it will search, there is no such brief explanation out there, i will be thankful to you if you can help me in this. With Regards Aman Tandon On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon amantandon...@gmail.com wrote: the appropriate results What are those specifically? You need to be a bit more precise about what you are trying to achieve. Otherwise, there are too many NLP branches and too many approaches. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
Re: How to integrate nlp in solr
Hi Alex, Thanks alex, one more thing i want to ask that so do we need to add the extra fields for those entities, e.g. Item (bags), color (blue), etc. If some how i managed to implement this nlp then i will definitely publish it on my blog :) With Regards Aman Tandon On Wed, Jul 2, 2014 at 10:34 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: Not from me, no. I don't have any real examples for this ready. I suspect the path beyond the basics is VERY dependent on your data and your business requirements. I would start from thinking how would YOU (as a human) do that match. Where does the 'blue' and 'color' and 'college' and 'bags' come from. Then, figuring out what is required for Solr to know to look there. NLP is not magic, just advanced technology. You need to know where you are going to get there. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon amantandon...@gmail.com wrote: Any help here With Regards Aman Tandon On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon amantandon...@gmail.com wrote: Hi Alex, I was try to get knowledge from these tutorials http://www.slideshare.net/teofili/natural-language-search-in-solr https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining but the real demo is not present. e.g. query: I want blue color college bags, then how using nlp it will work and how it will search, there is no such brief explanation out there, i will be thankful to you if you can help me in this. With Regards Aman Tandon On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon amantandon...@gmail.com wrote: the appropriate results What are those specifically? You need to be a bit more precise about what you are trying to achieve. Otherwise, there are too many NLP branches and too many approaches. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
Re: How to integrate nlp in solr
Hi Alex, I was try to get knowledge from these tutorials http://www.slideshare.net/teofili/natural-language-search-in-solr https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining but the real demo is not present. e.g. query: I want blue color college bags, then how using nlp it will work and how it will search, there is no such brief explanation out there, i will be thankful to you if you can help me in this. With Regards Aman Tandon On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch arafa...@gmail.com wrote: On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon amantandon...@gmail.com wrote: the appropriate results What are those specifically? You need to be a bit more precise about what you are trying to achieve. Otherwise, there are too many NLP branches and too many approaches. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
How to integrate nlp in solr
Hi, I want to process the natural language and want to gave back the appropriate results back to client, how can i configure my solr to achieve this. I read so many blogs out there everybody is just discussing how better results they are providing now but nobody provide a good demo of this. If there is any NLP guy please help me out here. I will really be thankful to you for this. With Regards Aman Tandon
Re: How to integrate nlp in solr
On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon amantandon...@gmail.com wrote: the appropriate results What are those specifically? You need to be a bit more precise about what you are trying to achieve. Otherwise, there are too many NLP branches and too many approaches. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
