[jira] Created: (SOLR-1040) XPathEntityProcessor fails with an xpath like /feed/entry/li...@type='text/html']/@href
XPathEntityProcessor fails with an xpath like
/feed/entry/li...@type='text/html']/@href
---
Key: SOLR-1040
URL: https://issues.apache.org/jira/browse/SOLR-1040
Project: Solr
Issue Type: Bug
Components: contrib - DataImportHandler
Reporter: Noble Paul
Fix For: 1.4
If an XPath expression is
{code}
/feed/entry/li...@type='text/html']/@href
{code}
the xpath does not work
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (SOLR-1040) XPathEntityProcessor fails with an xpath like /feed/entry/li...@type='text/html']/@href
[
https://issues.apache.org/jira/browse/SOLR-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noble Paul updated SOLR-1040:
-
Attachment: SOLR-1040.patch
if there are single quotes they must be escaped
> XPathEntityProcessor fails with an xpath like
> /feed/entry/li...@type='text/html']/@href
> ---
>
> Key: SOLR-1040
> URL: https://issues.apache.org/jira/browse/SOLR-1040
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
>Reporter: Noble Paul
> Fix For: 1.4
>
> Attachments: SOLR-1040.patch
>
>
> If an XPath expression is
> {code}
> /feed/entry/li...@type='text/html']/@href
> {code}
> the xpath does not work
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Stax-API jar
Hi Folks, I think I've identified a bug in stax-api-1.0.jar. Specifically javax.xml.stream.XMLStreamReader::getTextStart(). I'm just wonder who owns/manages the source of the implementation that Solr uses? https://stax-utils.dev.java.net/ gives four implementations, I just need to know which one so that I can take up my issue in that space. Is there any easy way to tell? Tricia
Re: Stax-API jar
On Thu, Feb 26, 2009 at 5:24 PM, Tricia Williams wrote: > Hi Folks, > > I think I've identified a bug in stax-api-1.0.jar. Specifically > javax.xml.stream.XMLStreamReader::getTextStart(). I'm just wonder who > owns/manages the source of the implementation that Solr uses? > https://stax-utils.dev.java.net/ gives four implementations, I just need > to know which one so that I can take up my issue in that space. Is there > any easy way to tell? > Solr is using the woodstox implementation: 1. wstx-asl-3.2.7.jar 2. geronimo-stax-api_1.0_spec-1.0.1.jar -- Regards, Shalin Shekhar Mangar.
[jira] Assigned: (SOLR-1040) XPathEntityProcessor fails with an xpath like /feed/entry/li...@type='text/html']/@href
[
https://issues.apache.org/jira/browse/SOLR-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shalin Shekhar Mangar reassigned SOLR-1040:
---
Assignee: Shalin Shekhar Mangar
> XPathEntityProcessor fails with an xpath like
> /feed/entry/li...@type='text/html']/@href
> ---
>
> Key: SOLR-1040
> URL: https://issues.apache.org/jira/browse/SOLR-1040
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
>Reporter: Noble Paul
>Assignee: Shalin Shekhar Mangar
> Fix For: 1.4
>
> Attachments: SOLR-1040.patch
>
>
> If an XPath expression is
> {code}
> /feed/entry/li...@type='text/html']/@href
> {code}
> the xpath does not work
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: Stax-API jar
also note -- if you are using java6, you can remove the two stax jars and use the default implementation. On Feb 26, 2009, at 6:54 AM, Tricia Williams wrote: Hi Folks, I think I've identified a bug in stax-api-1.0.jar. Specifically javax.xml.stream.XMLStreamReader::getTextStart(). I'm just wonder who owns/manages the source of the implementation that Solr uses? https://stax-utils.dev.java.net/ gives four implementations, I just need to know which one so that I can take up my issue in that space. Is there any easy way to tell? Tricia
[jira] Updated: (SOLR-1040) XPathEntityProcessor fails with an xpath like /feed/entry/li...@type='text/html']/@href
[
https://issues.apache.org/jira/browse/SOLR-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shalin Shekhar Mangar updated SOLR-1040:
Affects Version/s: 1.3
> XPathEntityProcessor fails with an xpath like
> /feed/entry/li...@type='text/html']/@href
> ---
>
> Key: SOLR-1040
> URL: https://issues.apache.org/jira/browse/SOLR-1040
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
>Affects Versions: 1.3
>Reporter: Noble Paul
>Assignee: Shalin Shekhar Mangar
> Fix For: 1.4
>
> Attachments: SOLR-1040.patch
>
>
> If an XPath expression is
> {code}
> /feed/entry/li...@type='text/html']/@href
> {code}
> the xpath does not work
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (SOLR-1040) XPathEntityProcessor fails with an xpath like /feed/entry/li...@type='text/html']/@href
[
https://issues.apache.org/jira/browse/SOLR-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shalin Shekhar Mangar resolved SOLR-1040.
-
Resolution: Fixed
Committed revision 748117.
Thanks Noble!
> XPathEntityProcessor fails with an xpath like
> /feed/entry/li...@type='text/html']/@href
> ---
>
> Key: SOLR-1040
> URL: https://issues.apache.org/jira/browse/SOLR-1040
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
>Affects Versions: 1.3
>Reporter: Noble Paul
>Assignee: Shalin Shekhar Mangar
> Fix For: 1.4
>
> Attachments: SOLR-1040.patch
>
>
> If an XPath expression is
> {code}
> /feed/entry/li...@type='text/html']/@href
> {code}
> the xpath does not work
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Is there a built in keyword report (Tag Cloud) feature on Solr ?
I am developing a Solr based search application and need to get a kind of a keyword report for tag cloud generation. If there is anyone here who has ever had that necessity and has somehow found the way through, I would really appreciate some help. Thanks in advance -- View this message in context: http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-feature-on-Solr---tp9677p9677.html Sent from the Solr - Dev mailing list archive at Nabble.com.
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
A solution that I'd considering implementing for Drupal's ApacheSolr module is to do a *:* search and then make tag clouds from all of the facets. Pretty easy to sort all the facet terms into bins based on the number of documents they match, and then to translate bins to font sizes. Tag clouds make a nice alternate representation of facet blocks. Robert Douglass The RobsHouse.net Newsletter: http://robshouse.net/newsletter/robshousenet-newsletter Follow me on Twitter: http://twitter.com/robertDouglass On Feb 26, 2009, at 6:50 PM, Emmanuel Castro Santana wrote: I am developing a Solr based search application and need to get a kind of a keyword report for tag cloud generation. If there is anyone here who has ever had that necessity and has somehow found the way through, I would really appreciate some help. Thanks in advance -- View this message in context: http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-feature-on-Solr---tp9677p9677.html Sent from the Solr - Dev mailing list archive at Nabble.com.
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
That info is already available via Luke, right? --wunder On 2/26/09 9:55 AM, "Robert Douglass" wrote: > A solution that I'd considering implementing for Drupal's ApacheSolr > module is to do a *:* search and then make tag clouds from all of the > facets. Pretty easy to sort all the facet terms into bins based on the > number of documents they match, and then to translate bins to font > sizes. Tag clouds make a nice alternate representation of facet blocks. > > Robert Douglass > > The RobsHouse.net Newsletter: > http://robshouse.net/newsletter/robshousenet-newsletter > Follow me on Twitter: http://twitter.com/robertDouglass > > On Feb 26, 2009, at 6:50 PM, Emmanuel Castro Santana wrote: > >> >> I am developing a Solr based search application and need to get a >> kind of a >> keyword report for tag cloud generation. If there is anyone here who >> has >> ever had that necessity and has somehow found the way through, I would >> really appreciate some help. >> Thanks in advance >> -- >> View this message in context: >> http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-feat >> ure-on-Solr---tp9677p9677.html >> Sent from the Solr - Dev mailing list archive at Nabble.com. >> >
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
Oops, missed that you wanted it by facet. Never mind. --wunder On 2/26/09 9:57 AM, "Walter Underwood" wrote: > That info is already available via Luke, right? --wunder > > On 2/26/09 9:55 AM, "Robert Douglass" wrote: > >> A solution that I'd considering implementing for Drupal's ApacheSolr >> module is to do a *:* search and then make tag clouds from all of the >> facets. Pretty easy to sort all the facet terms into bins based on the >> number of documents they match, and then to translate bins to font >> sizes. Tag clouds make a nice alternate representation of facet blocks. >> >> Robert Douglass >> >> The RobsHouse.net Newsletter: >> http://robshouse.net/newsletter/robshousenet-newsletter >> Follow me on Twitter: http://twitter.com/robertDouglass >> >> On Feb 26, 2009, at 6:50 PM, Emmanuel Castro Santana wrote: >> >>> >>> I am developing a Solr based search application and need to get a >>> kind of a >>> keyword report for tag cloud generation. If there is anyone here who >>> has >>> ever had that necessity and has somehow found the way through, I would >>> really appreciate some help. >>> Thanks in advance >>> -- >>> View this message in context: >>> http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-fea>>> t >>> ure-on-Solr---tp9677p9677.html >>> Sent from the Solr - Dev mailing list archive at Nabble.com. >>> >> >
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
Thanks the help "... do a *:* search and then make tag clouds from all of the facets ..." I may have not made myself clear. When I say keyword report, I mean a kind of a most popular tag cloud, showing in bigger sizes the most searched terms. Therefore I need information about how many times specific terms have been searched and I can't see how I could accomplish that with this solution Walter Underwood wrote: > > Oops, missed that you wanted it by facet. Never mind. --wunder > > On 2/26/09 9:57 AM, "Walter Underwood" wrote: > >> That info is already available via Luke, right? --wunder >> >> On 2/26/09 9:55 AM, "Robert Douglass" wrote: >> >>> A solution that I'd considering implementing for Drupal's ApacheSolr >>> module is to do a *:* search and then make tag clouds from all of the >>> facets. Pretty easy to sort all the facet terms into bins based on the >>> number of documents they match, and then to translate bins to font >>> sizes. Tag clouds make a nice alternate representation of facet blocks. >>> >>> Robert Douglass >>> >>> The RobsHouse.net Newsletter: >>> http://robshouse.net/newsletter/robshousenet-newsletter >>> Follow me on Twitter: http://twitter.com/robertDouglass >>> >>> On Feb 26, 2009, at 6:50 PM, Emmanuel Castro Santana wrote: >>> I am developing a Solr based search application and need to get a kind of a keyword report for tag cloud generation. If there is anyone here who has ever had that necessity and has somehow found the way through, I would really appreciate some help. Thanks in advance -- View this message in context: > http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-fea>>> > t ure-on-Solr---tp9677p9677.html Sent from the Solr - Dev mailing list archive at Nabble.com. >>> >> > > > -- View this message in context: http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-feature-on-Solr---tp9677p22230655.html Sent from the Solr - Dev mailing list archive at Nabble.com.
[jira] Commented: (SOLR-764) Support facet.sort=false (index order) with distributed search
[ https://issues.apache.org/jira/browse/SOLR-764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12677132#action_12677132 ] Yonik Seeley commented on SOLR-764: --- bq. I would expect it to return something like 1, 10, 11, 2, 20, 3, 4, 5 etc. as this is the lexicographic order Not for a field like sint, which is manipulated so that the lexicographic order is equal to the numeric order. Looks like we need to do FieldType.toInternal() to go back to the indexed form before doing string compares. > Support facet.sort=false (index order) with distributed search > -- > > Key: SOLR-764 > URL: https://issues.apache.org/jira/browse/SOLR-764 > Project: Solr > Issue Type: New Feature >Affects Versions: 1.3 >Reporter: Wojtek Piaseczny > Fix For: 1.4 > > Attachments: SOLR-764.patch, SOLR-764.patch > > > Distributed search does not currently support sorting facets by index order > (facet.sort=false). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Re: /trunk java.lang.InterruptedException
no core reloading. But this is a non-standard core/schema loading
process.
Reverting to an older copy of solr/lucene makes this go away (at least
not show up)
any thoughts where to look? I have not looked too deeply.
ryan
On Feb 25, 2009, at 11:47 PM, Yonik Seeley wrote:
Hmmm, I don't believe Solr calls interrupt anywhere itself...
Would shutting down the executor cause that? Are you doing any core
reloading?
-Yonik
http://www.lucidimagination.com
On Wed, Feb 25, 2009 at 6:01 PM, Ryan McKinley
wrote:
I just upgraded to /trunk from a nightly a few weeks ago. I am now
seeing
an error I did not see before:
2009-02-25 02:50:48,756 ERROR org.apache.solr.update.UpdateHandler -
java.lang.InterruptedException
at
java
.util
.concurrent
.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(Unknown
Source)
at java.util.concurrent.FutureTask$Sync.innerGet(Unknown
Source)
at java.util.concurrent.FutureTask.get(Unknown Source)
at
org
.apache
.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:
404)
at
org
.apache
.solr
.update
.processor
.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:78)
at
org
.apache
.solr
.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:
105)
at
org
.apache
.solr
.handler
.ContentStreamHandlerBase
.handleRequestBody(ContentStreamHandlerBase.java:48)
at
org
.apache
.solr
.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:
131)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1333)
at
org
.apache
.solr
.client
.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:
139)
at
org
.apache
.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:
243)
at
org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:85)
at
org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:74)
...
This points to:
// if we are supposed to wait for the searcher to be registered,
then we
should do it
// outside of the synchronized block so that other update
operations can
proceed.
if (waitSearcher!=null && waitSearcher[0] != null) {
try {
waitSearcher[0].get();
}
any thoughts on what could be going on?
ryan
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
: I may have not made myself clear. When I say keyword report, I mean a kind : of a most popular tag cloud, showing in bigger sizes the most searched : terms. Therefore I need information about how many times specific terms have : been searched and I can't see how I could accomplish that with this : solution you have to be more explicit about what you ask for. I've never heard anyone refer to a tag cloud as being based on how often a term is searched for -- everyone i know uses the frequency of words in the corpus, sometimes with a decay function to promote words mentioned in more recent docs. Solr doesn't keep any record of the searches performed, so to build a tag cloud based on query popularity you would need to mine your logs. if you want a tag cloud based on the frequency of words in your corpus, the faceting approach mentioned would work -- but a simpler way to get term counts for the whole index (*:*) would be the TermsComponent. you only really need the facet based solution if you want a cloud based on a subset of documents, (ie: a cloud for all documents matching category:computer) -Hoss
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
If you want a tag cloud based on query freqency, start with your HTTP log analysis tools. Most of those generate a list of top queries and top words in queries. wunder On 2/26/09 2:54 PM, "Chris Hostetter" wrote: > > : I may have not made myself clear. When I say keyword report, I mean a kind > : of a most popular tag cloud, showing in bigger sizes the most searched > : terms. Therefore I need information about how many times specific terms have > : been searched and I can't see how I could accomplish that with this > : solution > > you have to be more explicit about what you ask for. I've never heard > anyone refer to a tag cloud as being based on how often a term is searched > for -- everyone i know uses the frequency of words in the corpus, > sometimes with a decay function to promote words mentioned in more recent > docs. > > Solr doesn't keep any record of the searches performed, so to build a tag > cloud based on query popularity you would need to mine your logs. > > if you want a tag cloud based on the frequency of words in your corpus, > the faceting approach mentioned would work -- but a simpler way to get > term counts for the whole index (*:*) would be the TermsComponent. you > only really need the facet based solution if you want a cloud based on a > subset of documents, (ie: a cloud for all documents matching > category:computer) > > > > -Hoss >
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
Sorry for that. Most searched terms tag cloud is kind of common around here. "Solr doesn't keep any record of the searches performed, so to build a tag cloud based on query popularity you would need to mine your logs." Do you know if there is already a tool or a Solr plugin for that ? Thanks hossman wrote: > > > : I may have not made myself clear. When I say keyword report, I mean a > kind > : of a most popular tag cloud, showing in bigger sizes the most searched > : terms. Therefore I need information about how many times specific terms > have > : been searched and I can't see how I could accomplish that with this > : solution > > you have to be more explicit about what you ask for. I've never heard > anyone refer to a tag cloud as being based on how often a term is searched > for -- everyone i know uses the frequency of words in the corpus, > sometimes with a decay function to promote words mentioned in more recent > docs. > > Solr doesn't keep any record of the searches performed, so to build a tag > cloud based on query popularity you would need to mine your logs. > > if you want a tag cloud based on the frequency of words in your corpus, > the faceting approach mentioned would work -- but a simpler way to get > term counts for the whole index (*:*) would be the TermsComponent. you > only really need the facet based solution if you want a cloud based on a > subset of documents, (ie: a cloud for all documents matching > category:computer) > > > > -Hoss > > > -- View this message in context: http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-feature-on-Solr---tp9677p22236934.html Sent from the Solr - Dev mailing list archive at Nabble.com.
Re: /trunk java.lang.InterruptedException
Trying to think what could cause an interrupt (other than another
thread calling .interrupt())... if it is the executor shutting down
early, perhaps some sort of reference counting issue on the core?
-Yonik
On Thu, Feb 26, 2009 at 5:40 PM, Ryan McKinley wrote:
> no core reloading. But this is a non-standard core/schema loading process.
>
> Reverting to an older copy of solr/lucene makes this go away (at least not
> show up)
>
> any thoughts where to look? I have not looked too deeply.
>
> ryan
>
>
> On Feb 25, 2009, at 11:47 PM, Yonik Seeley wrote:
>
>> Hmmm, I don't believe Solr calls interrupt anywhere itself...
>> Would shutting down the executor cause that? Are you doing any core
>> reloading?
>>
>> -Yonik
>> http://www.lucidimagination.com
>>
>>
>> On Wed, Feb 25, 2009 at 6:01 PM, Ryan McKinley wrote:
>>>
>>> I just upgraded to /trunk from a nightly a few weeks ago. I am now
>>> seeing
>>> an error I did not see before:
>>>
>>> 2009-02-25 02:50:48,756 ERROR org.apache.solr.update.UpdateHandler -
>>> java.lang.InterruptedException
>>> at
>>>
>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(Unknown
>>> Source)
>>> at java.util.concurrent.FutureTask$Sync.innerGet(Unknown Source)
>>> at java.util.concurrent.FutureTask.get(Unknown Source)
>>> at
>>>
>>> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:404)
>>> at
>>>
>>> org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:78)
>>> at
>>>
>>> org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:105)
>>> at
>>>
>>> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:48)
>>> at
>>>
>>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
>>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1333)
>>> at
>>>
>>> org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:139)
>>> at
>>>
>>> org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:243)
>>> at
>>> org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:85)
>>> at
>>> org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:74)
>>> ...
>>>
>>> This points to:
>>> // if we are supposed to wait for the searcher to be registered, then
>>> we
>>> should do it
>>> // outside of the synchronized block so that other update operations
>>> can
>>> proceed.
>>> if (waitSearcher!=null && waitSearcher[0] != null) {
>>> try {
waitSearcher[0].get();
>>>
>>> }
>>>
>>>
>>> any thoughts on what could be going on?
>>>
>>> ryan
>
>
--
-Yonik
http://www.lucidimagination.com
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
To do that, your best option is to do it "outside" of solr. I.e., when someone enters a query in your webapplication, you store the search in for instance a db (or even in a separate solr-index). If you go with a solr-index for "queries", you can simply do facets on the queries and for instance a facet.limit=50 (which will give you the top 50 most frequently entered queries). - Aleksander On Thu, 26 Feb 2009 19:35:49 +0100, Emmanuel Castro Santana wrote: Thanks the help "... do a *:* search and then make tag clouds from all of the facets ..." I may have not made myself clear. When I say keyword report, I mean a kind of a most popular tag cloud, showing in bigger sizes the most searched terms. Therefore I need information about how many times specific terms have been searched and I can't see how I could accomplish that with this solution Walter Underwood wrote: Oops, missed that you wanted it by facet. Never mind. --wunder On 2/26/09 9:57 AM, "Walter Underwood" wrote: That info is already available via Luke, right? --wunder On 2/26/09 9:55 AM, "Robert Douglass" wrote: A solution that I'd considering implementing for Drupal's ApacheSolr module is to do a *:* search and then make tag clouds from all of the facets. Pretty easy to sort all the facet terms into bins based on the number of documents they match, and then to translate bins to font sizes. Tag clouds make a nice alternate representation of facet blocks. Robert Douglass The RobsHouse.net Newsletter: http://robshouse.net/newsletter/robshousenet-newsletter Follow me on Twitter: http://twitter.com/robertDouglass On Feb 26, 2009, at 6:50 PM, Emmanuel Castro Santana wrote: I am developing a Solr based search application and need to get a kind of a keyword report for tag cloud generation. If there is anyone here who has ever had that necessity and has somehow found the way through, I would really appreciate some help. Thanks in advance -- View this message in context: http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-fea>>> t ure-on-Solr---tp9677p9677.html Sent from the Solr - Dev mailing list archive at Nabble.com. -- Aleksander M. Stensby Senior software developer Integrasco A/S www.integrasco.no Please consider the environment before printing all or any of this e-mail
Re: Is there a built in keyword report (Tag Cloud) feature on Solr ?
Sorry, that mail got stuck in my outbox. Anyways. On a side-note, i think it is called a search-cloud when refering to top-searches, and a tag-cloud when refering to top-occuring terms in the corpus, as Chris said. Since you are only after creating a search-cloud, i think my answer is a pretty straightforward and simple (and fast) approach to doing so. And as Chris mentions, if you want to create a tag cloud with those words that are a.) occuring frequently in the corpus, or b.) more advanced, those terms that are actually "important" to your corpus (score-based / tf-idf etc.) you can simply use the TermsComponent. As the trunk version of Solr introduces the TermVectorComponent, you can also retrieve information for specific search-results etc. Another thing you could do with your search-cloud is to for instance add a date-dimension to the solr-index (where you store all the queries), and then out of the box you get the possibility of creating evolving-search-clouds! I.e., you can visualize how "what is being searched for" changes over time! -> now thats a neat feature :) And best of all - Solr gives you this for free with facets once you have those queries indexed :) Hope that helps! Best regards, Aleksander On Fri, 27 Feb 2009 08:12:19 +0100, Aleksander M. Stensby wrote: To do that, your best option is to do it "outside" of solr. I.e., when someone enters a query in your webapplication, you store the search in for instance a db (or even in a separate solr-index). If you go with a solr-index for "queries", you can simply do facets on the queries and for instance a facet.limit=50 (which will give you the top 50 most frequently entered queries). - Aleksander On Thu, 26 Feb 2009 19:35:49 +0100, Emmanuel Castro Santana wrote: Thanks the help "... do a *:* search and then make tag clouds from all of the facets ..." I may have not made myself clear. When I say keyword report, I mean a kind of a most popular tag cloud, showing in bigger sizes the most searched terms. Therefore I need information about how many times specific terms have been searched and I can't see how I could accomplish that with this solution Walter Underwood wrote: Oops, missed that you wanted it by facet. Never mind. --wunder On 2/26/09 9:57 AM, "Walter Underwood" wrote: That info is already available via Luke, right? --wunder On 2/26/09 9:55 AM, "Robert Douglass" wrote: A solution that I'd considering implementing for Drupal's ApacheSolr module is to do a *:* search and then make tag clouds from all of the facets. Pretty easy to sort all the facet terms into bins based on the number of documents they match, and then to translate bins to font sizes. Tag clouds make a nice alternate representation of facet blocks. Robert Douglass The RobsHouse.net Newsletter: http://robshouse.net/newsletter/robshousenet-newsletter Follow me on Twitter: http://twitter.com/robertDouglass On Feb 26, 2009, at 6:50 PM, Emmanuel Castro Santana wrote: I am developing a Solr based search application and need to get a kind of a keyword report for tag cloud generation. If there is anyone here who has ever had that necessity and has somehow found the way through, I would really appreciate some help. Thanks in advance -- View this message in context: http://www.nabble.com/Is-there-a-built-in-keyword-report-%28Tag-Cloud%29-fea>>> t ure-on-Solr---tp9677p9677.html Sent from the Solr - Dev mailing list archive at Nabble.com. -- Aleksander M. Stensby Senior software developer Integrasco A/S www.integrasco.no Please consider the environment before printing all or any of this e-mail
