Front end framework

[Serenity Trust]

Dear all,
I've upgraded my application from Lucene to Nutch/Solr. The 
Nutch indexing system looks powerful as does Solr. My app is written in 
java/jsp. Can anyone point me to a working example front a front end in jsp or 
even struts? Is this viable? I can see there is solrj but I was hoping for a 
working example.

Regards
Ed Murray
Manager
--
SERENITY TRUST
Network Administration & I.T. Services
THIS MESSAGE CONTAINS CONFIDENTIAL INFORMATION AND IS INTENDED FOR THE 
ADDRESSED RECIPIENT(S) ONLY. IF YOU ARE NOT THE INTENDED RECIPIENT YOU ARE 
NOTIFIED THAT DISCLOSING, COPYING, DISTRIBUTING OR TAKING ANY ACTION IN 
RELIANCE ON THE CONTENTS OF THIS INFORMATION IS STRICTLY PROHIBITED.

Solr UI

[serenity]

Hi,

I installed Solr 3.2 and able to search results successfully from the
crawled data, however , I would like to develop UI for the http or json
response.  Can anyone guide me with the tutorial or sample ?
I referred few thing like Ajax Solr but am not sure how to do the things.


Serenity 

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-UI-tp3182594p3182594.html
Sent from the Solr - User mailing list archive at Nabble.com.

Can we use crawled data by Nutch 0.9 in other versions of Nutch

[serenity keningston]

Hello,

I have a question and I apologize if it sounds stupid. I just want to know,
if we can use the crawled data by Nutch 0.9 in Nutch 1.3 because search has
been delegated to Solr in Nutch 1.3 and I want to get the search results
from the crawled data by Nutch 0.9 in Nutch 1.3

Serenity

fetcher no agents listed in 'http.agent.name' property

[serenity keningston]

Hello Friends,


I am experiencing this error message  fetcher no agents listed in '
http.agent.name' property when I am trying to crawl with Nutch 1.3
I referred other mails regarding the same error message and tried to change
the nutch-default.xml and nutch-site.xml file details with

property
  namehttp.agent.name/name
  valueMy Nutch Spider/value
  descriptionEMPTY/description
/property

I also filled out the other property details without blank and still getting
the same error. May I know my mistake ?


Serenity

Re: fetcher no agents listed in 'http.agent.name' property

[serenity keningston]

Thank you very much, I never tried to modify the config files from
NUTCH_HOME/runtime/local/conf .

In Nutch-0.9, we will just modify from NUTCH-HOME/conf  directory. I
appreciate your time and help.

Merci

On Thu, Jul 7, 2011 at 12:05 PM, Way Cool way1.wayc...@gmail.com wrote:

 Just make sure you did change the files under
 NUTCH_HOME/runtime/local/conf if you are running from runtime/local.

 On Thu, Jul 7, 2011 at 8:34 AM, serenity keningston 
 serenity.kenings...@gmail.com wrote:

  Hello Friends,
 
 
  I am experiencing this error message  fetcher no agents listed in '
  http.agent.name' property when I am trying to crawl with Nutch 1.3
  I referred other mails regarding the same error message and tried to
 change
  the nutch-default.xml and nutch-site.xml file details with
 
  property
   namehttp.agent.name/name
   valueMy Nutch Spider/value
   descriptionEMPTY/description
  /property
 
  I also filled out the other property details without blank and still
  getting
  the same error. May I know my mistake ?
 
 
  Serenity
 

Apache Nutch and Solr Integration

[serenity keningston]

Hello Friends,


I am a newbie to Solr and trying to integrate Apache Nutch 1.3 and Solr 3.2
. I did the steps explained in the following two URL's :

http://wiki.apache.org/nutch/RunningNutchAndSolr

http://thetechietutorials.blogspot.com/2011/06/how-to-build-and-start-apache-solr.html


I downloaded both the softwares, however, I am getting error (*solrUrl is
not set, indexing will be skipped..*) when I am trying to crawl using
Cygwin.

Can anyone please help me out to fix this issue ?
Else any other website suggesting for Apache Nutch and Solr integration
would be greatly helpful.



Thanks  Regards,
Serenity

Re: Apache Nutch and Solr Integration

[serenity keningston]

Please find attached screenshot

On Tue, Jul 5, 2011 at 11:53 AM, Way Cool way1.wayc...@gmail.com wrote:

 Can you let me know when and where you were getting the error? A
 screen-shot
 will be helpful.

 On Tue, Jul 5, 2011 at 8:15 AM, serenity keningston 
 serenity.kenings...@gmail.com wrote:

  Hello Friends,
 
 
  I am a newbie to Solr and trying to integrate Apache Nutch 1.3 and Solr
 3.2
  . I did the steps explained in the following two URL's :
 
  http://wiki.apache.org/nutch/RunningNutchAndSolr
 
 
 
 http://thetechietutorials.blogspot.com/2011/06/how-to-build-and-start-apache-solr.html
 
 
  I downloaded both the softwares, however, I am getting error (*solrUrl is
  not set, indexing will be skipped..*) when I am trying to crawl using
  Cygwin.
 
  Can anyone please help me out to fix this issue ?
  Else any other website suggesting for Apache Nutch and Solr integration
  would be greatly helpful.
 
 
 
  Thanks  Regards,
  Serenity
 

Re: Apache Nutch and Solr Integration

[serenity keningston]

On Tue, Jul 5, 2011 at 1:11 PM, Way Cool way1.wayc...@gmail.com wrote:

 Sorry, Serenity, somehow I don't see the attachment.

 On Tue, Jul 5, 2011 at 11:23 AM, serenity keningston 
 serenity.kenings...@gmail.com wrote:

  Please find attached screenshot
 
 
  On Tue, Jul 5, 2011 at 11:53 AM, Way Cool way1.wayc...@gmail.com
 wrote:
 
  Can you let me know when and where you were getting the error? A
  screen-shot
  will be helpful.
 
  On Tue, Jul 5, 2011 at 8:15 AM, serenity keningston 
  serenity.kenings...@gmail.com wrote:
 
   Hello Friends,
  
  
   I am a newbie to Solr and trying to integrate Apache Nutch 1.3 and
 Solr
  3.2
   . I did the steps explained in the following two URL's :
  
   http://wiki.apache.org/nutch/RunningNutchAndSolr
  
  
  
 
 http://thetechietutorials.blogspot.com/2011/06/how-to-build-and-start-apache-solr.html
  
  
   I downloaded both the softwares, however, I am getting error (*solrUrl
  is
   not set, indexing will be skipped..*) when I am trying to crawl using
   Cygwin.
  
   Can anyone please help me out to fix this issue ?
   Else any other website suggesting for Apache Nutch and Solr
 integration
   would be greatly helpful.
  
  
  
   Thanks  Regards,
   Serenity
  
 
 
 

Unable to use DataImportHandler

[serenity keningston]

Hello Friends,


I am new to Solr and experiencing issue while trying to use
DataImportHandler. I added the required fields to schema.xml file and here
is my data-config.xml file :

dataConfig
  dataSource driver=com.mysql.jdbc.Driver
url=jdbc:mysql://localhost:3306/mp3
   user=root
   password=root /
  document
entity name=file pk=fileNo query=select fname, lname, file from
mp3.file
 field column=fileNo name=id/
 field column=fname name=fname /
 field column=lname name=lname /
 field column=file name=file /
/entity
  /document
/dataConfig

I am getting the following errors :

org.apache.solr.common.SolrException: Document [null] missing required
field: id

solr home defaulted to 'solr/' (could not find system property or JNDI)
May 3, 2011 9:59:08 AM org.apache.solr.core.SolrResourceLoader init
INFO: Solr home set to 'solr/'

DataImportHandler can extract the information from the database and it is
displayed in log file, however, it is not indexing the data. Can anyone
please let me know, where I am commiting mistake ?

Regards,
Serenity

Re: Unable to use DataImportHandler

[serenity keningston]

Dear Stefan,

Am still getting the following error message even after including the
pk-Attribute to the query :

WARNING: Error creating document :
SolrInputDocument[{lname=lname(1.0)={cindy}, file=file(1.0)={
http://localhost:8084/Access/UploadFiles/laura.mp3},
fname=fname(1.0)={troutman}}]
org.apache.solr.common.SolrException: Document [null] missing required
field: id
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:305)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60)
at
org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:75)
at
org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:292)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:392)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:242)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:180)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:331)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:389)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:370)


and here is the data-config.xml file :

dataConfig
  dataSource driver=com.mysql.jdbc.Driver
url=jdbc:mysql://localhost:3306/mp3
   user=root
   password=root /
  document
entity name=file pk=fileNo query=select fname, lname, file, fileNo
from mp3.file

 field column=fname name=fname /
 field column=lname name=lname /
 field column=file name=file /
/entity
  /document
/dataConfig

Regards,
Serenity

On Tue, May 3, 2011 at 10:43 AM, Stefan Matheis 
matheis.ste...@googlemail.com wrote:

 Serenity,

 there is no field fileNo in your SELECT-Query? you've defined it in
 the pk-Attribut of the entity Tag, but it's also required in the
 Query itself. just to note it: you can skip your field definition,
 if the query returns the field with exactly the same name as the
 solr-schema requires it.

 Regards
 Stefan

 On Tue, May 3, 2011 at 5:38 PM, serenity keningston
 serenity.kenings...@gmail.com wrote:
  Hello Friends,
 
 
  I am new to Solr and experiencing issue while trying to use
  DataImportHandler. I added the required fields to schema.xml file and
 here
  is my data-config.xml file :
 
  dataConfig
   dataSource driver=com.mysql.jdbc.Driver
 url=jdbc:mysql://localhost:3306/mp3
user=root
password=root /
   document
 entity name=file pk=fileNo query=select fname, lname, file from
  mp3.file
  field column=fileNo name=id/
  field column=fname name=fname /
  field column=lname name=lname /
  field column=file name=file /
 /entity
   /document
  /dataConfig
 
  I am getting the following errors :
 
  org.apache.solr.common.SolrException: Document [null] missing required
  field: id
 
  solr home defaulted to 'solr/' (could not find system property or JNDI)
  May 3, 2011 9:59:08 AM org.apache.solr.core.SolrResourceLoader init
  INFO: Solr home set to 'solr/'
 
  DataImportHandler can extract the information from the database and it is
  displayed in log file, however, it is not indexing the data. Can anyone
  please let me know, where I am commiting mistake ?
 
  Regards,
  Serenity
 

Re: Unable to use DataImportHandler

[serenity keningston]

Dear Erick,

I am using Solr 1.4 version. Yes, for each row , we will get one fileNo
which is the primary key for the table file.
No, I intentionally removed the  field column=fileNo name=id from the
data-config.xml

I tried opening the dataimport.jsp to debug but I don't know, it doesn't
show any result but it updates the log file every time I tried to debug.

Regards,
Serenity

On Tue, May 3, 2011 at 11:42 AM, Erick Erickson erickerick...@gmail.comwrote:

 The next thing to check is if your select statement returns the
 fileNo for every field.

 Wait.. You took out the field column=fileNo name=id bit of your
 entity
 definition, is that a cut/paste error?

 You might get some joy from the DIH debug page at:
 solr homesolr/admin/dataimport.jsp
 it's not very well known, but it's a debug console for
 your SQL data import process.


 BTW, what version of Solr are you using?

 Best
 Erick

 On Tue, May 3, 2011 at 12:04 PM, serenity keningston
 serenity.kenings...@gmail.com wrote:
  Dear Stefan,
 
  Am still getting the following error message even after including the
  pk-Attribute to the query :
 
  WARNING: Error creating document :
  SolrInputDocument[{lname=lname(1.0)={cindy}, file=file(1.0)={
  http://localhost:8084/Access/UploadFiles/laura.mp3},
  fname=fname(1.0)={troutman}}]
  org.apache.solr.common.SolrException: Document [null] missing required
  field: id
 at
 
 org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:305)
 at
 
 org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60)
 at
  org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:75)
 at
 
 org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:292)
 at
 
 org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:392)
 at
 
 org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:242)
 at
 
 org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:180)
 at
 
 org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:331)
 at
 
 org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:389)
 at
 
 org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:370)
 
 
  and here is the data-config.xml file :
 
  dataConfig
   dataSource driver=com.mysql.jdbc.Driver
 url=jdbc:mysql://localhost:3306/mp3
user=root
password=root /
   document
 entity name=file pk=fileNo query=select fname, lname, file,
 fileNo
  from mp3.file
 
  field column=fname name=fname /
  field column=lname name=lname /
  field column=file name=file /
 /entity
   /document
  /dataConfig
 
  Regards,
  Serenity
 
  On Tue, May 3, 2011 at 10:43 AM, Stefan Matheis 
  matheis.ste...@googlemail.com wrote:
 
  Serenity,
 
  there is no field fileNo in your SELECT-Query? you've defined it in
  the pk-Attribut of the entity Tag, but it's also required in the
  Query itself. just to note it: you can skip your field definition,
  if the query returns the field with exactly the same name as the
  solr-schema requires it.
 
  Regards
  Stefan
 
  On Tue, May 3, 2011 at 5:38 PM, serenity keningston
  serenity.kenings...@gmail.com wrote:
   Hello Friends,
  
  
   I am new to Solr and experiencing issue while trying to use
   DataImportHandler. I added the required fields to schema.xml file and
  here
   is my data-config.xml file :
  
   dataConfig
dataSource driver=com.mysql.jdbc.Driver
  url=jdbc:mysql://localhost:3306/mp3
 user=root
 password=root /
document
  entity name=file pk=fileNo query=select fname, lname, file
 from
   mp3.file
   field column=fileNo name=id/
   field column=fname name=fname /
   field column=lname name=lname /
   field column=file name=file /
  /entity
/document
   /dataConfig
  
   I am getting the following errors :
  
   org.apache.solr.common.SolrException: Document [null] missing required
   field: id
  
   solr home defaulted to 'solr/' (could not find system property or
 JNDI)
   May 3, 2011 9:59:08 AM org.apache.solr.core.SolrResourceLoader init
   INFO: Solr home set to 'solr/'
  
   DataImportHandler can extract the information from the database and it
 is
   displayed in log file, however, it is not indexing the data. Can
 anyone
   please let me know, where I am commiting mistake ?
  
   Regards,
   Serenity