[jira] Commented: (SOLR-680) StatsComponent - get min, max, sum, qt, avg of number fields

2009-06-20 Thread David Smiley (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722302#action_12722302
 ] 

David Smiley commented on SOLR-680:
---

Harish, given that this issue is closed, it seems your patch has fallen off the 
radar.  I recommend convincing the committers to re-open this issue OR you 
should create a new issue.

> StatsComponent - get min, max, sum, qt, avg of number fields
> 
>
> Key: SOLR-680
> URL: https://issues.apache.org/jira/browse/SOLR-680
> Project: Solr
>  Issue Type: New Feature
>  Components: search
>Reporter: Koji Sekiguchi
>Assignee: Ryan McKinley
>Priority: Minor
> Fix For: 1.4
>
> Attachments: SOLR-680-remove-bad-median-calculation.patch, 
> SOLR-680.patch, SOLR-680.patch, SOLR-680.patch, SOLR-680.patch, 
> SOLR-680.patch, SOLR-680.patch, SOLR-680.patch
>
>
> StatsComponent - it returns min,max,sum,qt,avg of specified number fields:
> request parameters:
> &stats=on&stats.field=price
> {code:xml}
> 
>  
>
>10
>30
>20
>60
>3
>
>  
> 
> {code}
> WRT "stats", the component can output sum and avg, but not sd and var.
> USE CASE:
> StatsComponent can be used to get "market price" of DocSet e.g. rental 
> housing site, package tour site.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



Re: Solr Specification Version

2009-06-20 Thread Chris Hostetter
 
: I think we should change 1.3.0 to 1.4.0 for spec version in Solr trunk.
: Thought?

Solr's build file(s) are actually correct.

The spec version of a jar has to be purely numeric ("-dev" is illegal) and 
must increase as things change ... so we use the *last* version plus a 
long date+time stamp to get a unique version for each successive change on 
the trunk.  on official releases you bump the "specversion" property up to 
indicate that it's an official release.  (which is why the 1.3 branch has 
it baked as 1.3.0 -- that's the spec version of hte APIs in the jar, only 
bug fix/implementation changes will ever be made on the 1.3 branch)

Impl version can be anything, hence a lot of stats about the build are put 
there.

If you set specversion to 1.4.0 now, then (in theory) apps that inspect 
the versions of jars they load could get confused if any API changes are 
made between now and when the official 1.4.0 release comes out -- but 
other then some old applet stuff, i've never actually heard of anything 
that pays attention to jar versioning and will drive behavior based on 
what the specversion says (or how it compares to the spec version of 
previous versions) so it's mostly an academic argument.

There is a breif comment about this in common-build.xml (direclty above 
where the specfile property is set) and the links in the comment in the 
 task go into a lot more detail about this.

: > Lucene Specification Version: 2.9-dev
: > Lucene Implementation Version: 2.9-dev 779312 - 2009-05-27 17:19:55

...that's definitely broken according to the jar documentation ... but 
like i said, it's an esoteric thing to worry about.



-Hoss



Re: Solr Specification Version

2009-06-20 Thread Koji Sekiguchi
It seems that the difference between spec and impl version in Solr came in
at the beginning of common-build.xml:




http://svn.apache.org/viewvc/lucene/solr/trunk/common-build.xml?revision=671021&pathrev=786508

And the difference inherited when started 1.4-dev:

http://svn.apache.org/viewvc/lucene/solr/trunk/common-build.xml?r1=685497&r2=689968&pathrev=786508&diff_format=h

But seeing 1.3.0 branch, there is not difference:

http://svn.apache.org/viewvc/lucene/solr/tags/release-1.3.0/common-build.xml?revision=695557&pathrev=786508

I think we should change 1.3.0 to 1.4.0 for spec version in Solr trunk.
Thought?

Koji


Koji Sekiguchi wrote:
> With Solr trunk, "admin > info" shows the following Solr Specification &
> Implementation Version:
>
> Solr Specification Version: *1.3.0*.2009.06.20.10.07.10
> Solr Implementation Version: *1.4-dev* 782215M - koji - 2009-06-20 10:07:10
>
> Solr has 1.4-dev impl version but 1.3.0 spec version.
> But Lucene has 2.9-dev version for both spec and impl:
>
> Lucene Specification Version: 2.9-dev
> Lucene Implementation Version: 2.9-dev 779312 - 2009-05-27 17:19:55
>
> Why is Solr's specification version bit old?
>
> Thank you,
>
> Koji
>
>
>   



[jira] Updated: (SOLR-1229) deletedPkQuery feature does not work when pk and uniqueKey field do not have the same value

2009-06-20 Thread Erik Hatcher (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Erik Hatcher updated SOLR-1229:
---

Attachment: SOLR-1229.patch

Noble - that looks like the right thing to add for delta queries, but that 
didn't help with the deleted one.  I've attached a patch that fixes things in 
my limited test.  

We really need to add some unit tests for this - tricky business though.  Lance 
- do you have some unit tests to add that shows it broken and then fixed with 
this patch?

> deletedPkQuery feature does not work when pk and uniqueKey field do not have 
> the same value
> ---
>
> Key: SOLR-1229
> URL: https://issues.apache.org/jira/browse/SOLR-1229
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - DataImportHandler
>Affects Versions: 1.4
>Reporter: Erik Hatcher
> Fix For: 1.4
>
> Attachments: SOLR-1229.patch, SOLR-1229.patch
>
>
> Problem doing a delta-import such that records marked as "deleted" in the 
> database are removed from Solr using deletedPkQuery.
> Here's a config I'm using against a mocked test database:
> 
>  
>  
>pk="board_id"
>transformer="TemplateTransformer"
>deletedPkQuery="select board_id from boards where deleted = 'Y'"
>query="select * from boards where deleted = 'N'"
>deltaImportQuery="select * from boards where deleted = 'N'"
>deltaQuery="select * from boards where deleted = 'N'"
>preImportDeleteQuery="datasource:board">
>  
>  
>  
>
>  
> 
> Note that the uniqueKey in Solr is the "id" field.  And its value is a 
> template board-.
> I noticed the javadoc comments in DocBuilder#collectDelta it says "Note: In 
> our definition, unique key of Solr document is the primary key of the top 
> level entity".  This of course isn't really an appropriate assumption.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (SOLR-1191) NullPointerException in delta import

2009-06-20 Thread Erik Hatcher (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Erik Hatcher updated SOLR-1191:
---

Fix Version/s: 1.4

> NullPointerException in delta import
> 
>
> Key: SOLR-1191
> URL: https://issues.apache.org/jira/browse/SOLR-1191
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - DataImportHandler
>Affects Versions: 1.3, 1.4
> Environment: OS: Windows & Linux.
> Java: 1.6
> DB: MySQL & SQL Server 
>Reporter: Ali Syed
> Fix For: 1.4
>
>
> Seeing few of these NullPointerException during delta imports. Once this 
> happens delta import stops working and keeps giving the same error.
> java.lang.NullPointerException
> at 
> org.apache.solr.handler.dataimport.DocBuilder.collectDelta(DocBuilder.java:622)
> at 
> org.apache.solr.handler.dataimport.DocBuilder.doDelta(DocBuilder.java:240)
> at 
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:159)
> at 
> org.apache.solr.handler.dataimport.DataImporter.doDeltaImport(DataImporter.java:337)
> at 
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:376)
> at 
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355)
> Running delta import for a particular entity fixes the problem and delta 
> import start working again.
> Here is the log just before & after the exception
> 05/27 11:59:29 86987686 INFO  btpool0-538 org.apache.solr.core.SolrCore  - 
> [localhost] webapp=/solr path=/dataimport 
> params={command=delta-import&optimize=false} status=0 QTime=0
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.SolrWriter  - Read dataimport.properties
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DataImporter  - Starting Delta Import
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.SolrWriter  - Read dataimport.properties
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Starting delta collection.
> 05/27 11:59:29 86987690 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Running ModifiedRowKey() for 
> Entity: content
> 05/27 11:59:29 86987690 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed ModifiedRowKey for 
> Entity: content rows obtained : 0
> 05/27 11:59:29 86987690 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed DeletedRowKey for 
> Entity: content rows obtained : 0
> 05/27 11:59:29 86987692 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed parentDeltaQuery 
> for Entity: content
> 05/27 11:59:29 86987692 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Running ModifiedRowKey() for 
> Entity: job
> 05/27 11:59:29 86987692 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Creating a connection 
> for entity job with URL: jdbc:sqlserver://localhost;databaseName=TestDB
> 05/27 11:59:29 86987704 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Time taken for 
> getConnection(): 12
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed ModifiedRowKey for 
> Entity: job rows obtained : 0
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed DeletedRowKey for 
> Entity: job rows obtained : 0
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed parentDeltaQuery 
> for Entity: job
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Delta Import completed 
> successfully
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Starting delta collection.
> 05/27 11:59:29 86987709 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Running ModifiedRowKey() for 
> Entity: user
> 05/27 11:59:29 86987709 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Creating a connection 
> for entity user with URL: jdbc:sqlserver://localhost;databaseName=TestDB
> 05/27 11:59:29 86987716 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Time taken for 
> getConnection(): 7
> 05/27 11:59:29 86987873 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed ModifiedRowKey for 
> Entity: user rows obtained : 46
> 05/27 11:59:29 86987873 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed DeletedRowKey for 
> Entity: user rows obtained : 0
> 05/27 11:59:29 86987873 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed parentDeltaQuery 
> for Entity: us

[jira] Commented: (SOLR-1191) NullPointerException in delta import

2009-06-20 Thread Lance Norskog (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722259#action_12722259
 ] 

Lance Norskog commented on SOLR-1191:
-


This error should appear in the user-visible output as a "User Error".

Please mark this "to be fixed in Solr 1.4". 


> NullPointerException in delta import
> 
>
> Key: SOLR-1191
> URL: https://issues.apache.org/jira/browse/SOLR-1191
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - DataImportHandler
>Affects Versions: 1.3, 1.4
> Environment: OS: Windows & Linux.
> Java: 1.6
> DB: MySQL & SQL Server 
>Reporter: Ali Syed
>
> Seeing few of these NullPointerException during delta imports. Once this 
> happens delta import stops working and keeps giving the same error.
> java.lang.NullPointerException
> at 
> org.apache.solr.handler.dataimport.DocBuilder.collectDelta(DocBuilder.java:622)
> at 
> org.apache.solr.handler.dataimport.DocBuilder.doDelta(DocBuilder.java:240)
> at 
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:159)
> at 
> org.apache.solr.handler.dataimport.DataImporter.doDeltaImport(DataImporter.java:337)
> at 
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:376)
> at 
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355)
> Running delta import for a particular entity fixes the problem and delta 
> import start working again.
> Here is the log just before & after the exception
> 05/27 11:59:29 86987686 INFO  btpool0-538 org.apache.solr.core.SolrCore  - 
> [localhost] webapp=/solr path=/dataimport 
> params={command=delta-import&optimize=false} status=0 QTime=0
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.SolrWriter  - Read dataimport.properties
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DataImporter  - Starting Delta Import
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.SolrWriter  - Read dataimport.properties
> 05/27 11:59:29 86987687 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Starting delta collection.
> 05/27 11:59:29 86987690 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Running ModifiedRowKey() for 
> Entity: content
> 05/27 11:59:29 86987690 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed ModifiedRowKey for 
> Entity: content rows obtained : 0
> 05/27 11:59:29 86987690 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed DeletedRowKey for 
> Entity: content rows obtained : 0
> 05/27 11:59:29 86987692 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed parentDeltaQuery 
> for Entity: content
> 05/27 11:59:29 86987692 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Running ModifiedRowKey() for 
> Entity: job
> 05/27 11:59:29 86987692 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Creating a connection 
> for entity job with URL: jdbc:sqlserver://localhost;databaseName=TestDB
> 05/27 11:59:29 86987704 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Time taken for 
> getConnection(): 12
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed ModifiedRowKey for 
> Entity: job rows obtained : 0
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed DeletedRowKey for 
> Entity: job rows obtained : 0
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed parentDeltaQuery 
> for Entity: job
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Delta Import completed 
> successfully
> 05/27 11:59:29 86987707 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Starting delta collection.
> 05/27 11:59:29 86987709 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Running ModifiedRowKey() for 
> Entity: user
> 05/27 11:59:29 86987709 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Creating a connection 
> for entity user with URL: jdbc:sqlserver://localhost;databaseName=TestDB
> 05/27 11:59:29 86987716 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.JdbcDataSource  - Time taken for 
> getConnection(): 7
> 05/27 11:59:29 86987873 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed ModifiedRowKey for 
> Entity: user rows obtained : 46
> 05/27 11:59:29 86987873 INFO  Thread-4162 
> org.apache.solr.handler.dataimport.DocBuilder  - Completed DeletedRowKey for 
> Entity: user rows obtained : 0
> 05/27 11:59:2

[jira] Updated: (SOLR-1229) deletedPkQuery feature does not work when pk and uniqueKey field do not have the same value

2009-06-20 Thread Erik Hatcher (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Erik Hatcher updated SOLR-1229:
---

Fix Version/s: 1.4

> deletedPkQuery feature does not work when pk and uniqueKey field do not have 
> the same value
> ---
>
> Key: SOLR-1229
> URL: https://issues.apache.org/jira/browse/SOLR-1229
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - DataImportHandler
>Affects Versions: 1.4
>Reporter: Erik Hatcher
> Fix For: 1.4
>
> Attachments: SOLR-1229.patch
>
>
> Problem doing a delta-import such that records marked as "deleted" in the 
> database are removed from Solr using deletedPkQuery.
> Here's a config I'm using against a mocked test database:
> 
>  
>  
>pk="board_id"
>transformer="TemplateTransformer"
>deletedPkQuery="select board_id from boards where deleted = 'Y'"
>query="select * from boards where deleted = 'N'"
>deltaImportQuery="select * from boards where deleted = 'N'"
>deltaQuery="select * from boards where deleted = 'N'"
>preImportDeleteQuery="datasource:board">
>  
>  
>  
>
>  
> 
> Note that the uniqueKey in Solr is the "id" field.  And its value is a 
> template board-.
> I noticed the javadoc comments in DocBuilder#collectDelta it says "Note: In 
> our definition, unique key of Solr document is the primary key of the top 
> level entity".  This of course isn't really an appropriate assumption.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (SOLR-1229) deletedPkQuery feature does not work when pk and uniqueKey field do not have the same value

2009-06-20 Thread Lance Norskog (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722258#action_12722258
 ] 

Lance Norskog commented on SOLR-1229:
-

Someone with magic powers, please mark this as "to be fixed in Solr 1.4".

> deletedPkQuery feature does not work when pk and uniqueKey field do not have 
> the same value
> ---
>
> Key: SOLR-1229
> URL: https://issues.apache.org/jira/browse/SOLR-1229
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - DataImportHandler
>Affects Versions: 1.4
>Reporter: Erik Hatcher
> Attachments: SOLR-1229.patch
>
>
> Problem doing a delta-import such that records marked as "deleted" in the 
> database are removed from Solr using deletedPkQuery.
> Here's a config I'm using against a mocked test database:
> 
>  
>  
>pk="board_id"
>transformer="TemplateTransformer"
>deletedPkQuery="select board_id from boards where deleted = 'Y'"
>query="select * from boards where deleted = 'N'"
>deltaImportQuery="select * from boards where deleted = 'N'"
>deltaQuery="select * from boards where deleted = 'N'"
>preImportDeleteQuery="datasource:board">
>  
>  
>  
>
>  
> 
> Note that the uniqueKey in Solr is the "id" field.  And its value is a 
> template board-.
> I noticed the javadoc comments in DocBuilder#collectDelta it says "Note: In 
> our definition, unique key of Solr document is the primary key of the top 
> level entity".  This of course isn't really an appropriate assumption.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (SOLR-1173) Let contrib projects modify web.xml when running dist-war

2009-06-20 Thread Erik Hatcher (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722175#action_12722175
 ] 

Erik Hatcher commented on SOLR-1173:


Jacob - your use case makes sense for sure, though we don't have such a contrib 
in Solr's codebase currently and if we did we'd just hardcode wire it into 
solr.war just like we do the dataimport JSP pages currently.  It's not the 
cleanest most componentized way, to be sure.  

But at least now you simply can maintain your own plugin and your own web.xml 
and Solr's build allows you to incorporate it.

> Let contrib projects modify web.xml when running dist-war
> -
>
> Key: SOLR-1173
> URL: https://issues.apache.org/jira/browse/SOLR-1173
> Project: Solr
>  Issue Type: New Feature
>Reporter: Jacob Singh
> Fix For: 1.5
>
> Attachments: xmltask_contrib_build.diff, xmltask_contrib_build.diff
>
>
> Original problem:
> I just wrote a Servlet Filter to handle authentication for our
> service.  Here's what I did:
> 1. Created a dir in contrib
> 2. Put my project in there, I took the dataimporthandler build.xml as
> an example and modified it to suit my needs.  Worked great!
> 3. ant dist now builds my jar and includes it
> I now need to modify web.xml to add my filter-mapping, init params,
> etc.  How can I do this cleanly?  Or do I need to manually open up the
> archive and edit it and then re-war it?
> In common-build I don't see a target for dist-war, so don't see how it
> is possible...
> See: 
> http://mail-archives.apache.org/mod_mbox/lucene-solr-user/200905.mbox/%3c4ed43c6d-320d-4e0d-835d-4366b0f08...@ehatchersolutions.com%3e

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (SOLR-1229) deletedPkQuery feature does not work when pk and uniqueKey field do not have the same value

2009-06-20 Thread Noble Paul (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-1229:
-

Attachment: SOLR-1229.patch

Erik plz let me know if this helps.



> deletedPkQuery feature does not work when pk and uniqueKey field do not have 
> the same value
> ---
>
> Key: SOLR-1229
> URL: https://issues.apache.org/jira/browse/SOLR-1229
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - DataImportHandler
>Affects Versions: 1.4
>Reporter: Erik Hatcher
> Attachments: SOLR-1229.patch
>
>
> Problem doing a delta-import such that records marked as "deleted" in the 
> database are removed from Solr using deletedPkQuery.
> Here's a config I'm using against a mocked test database:
> 
>  
>  
>pk="board_id"
>transformer="TemplateTransformer"
>deletedPkQuery="select board_id from boards where deleted = 'Y'"
>query="select * from boards where deleted = 'N'"
>deltaImportQuery="select * from boards where deleted = 'N'"
>deltaQuery="select * from boards where deleted = 'N'"
>preImportDeleteQuery="datasource:board">
>  
>  
>  
>
>  
> 
> Note that the uniqueKey in Solr is the "id" field.  And its value is a 
> template board-.
> I noticed the javadoc comments in DocBuilder#collectDelta it says "Note: In 
> our definition, unique key of Solr document is the primary key of the top 
> level entity".  This of course isn't really an appropriate assumption.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



Build failed in Hudson: Solr-trunk #838

2009-06-20 Thread Apache Hudson Server
See http://hudson.zones.apache.org/hudson/job/Solr-trunk/838/changes

Changes:

[ehatcher] Added ${web.xml} parameter allowing a custom web.xml to be packaged 
in

[ehatcher] SOLR-1230: Enhance data import developer console to work with all 
DataImportHandler request handlers

[ehatcher] SOLR-1233: remove /select?qt=/whatever restriction on /-prefixed 
request handlers.

[noble] SOLR-1222 should handle multiple calls

[noble] SOLR-1222 add convenience methods for deleteById to take a list of 
strings

[noble] SOLR-1214

[noble] SOLR-1121 missed to add php and phps response writers

--
[...truncated 2184 lines...]
[junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.543 sec
[junit] Running org.apache.solr.analysis.TestMappingCharFilterFactory
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.445 sec
[junit] Running org.apache.solr.analysis.TestPatternReplaceFilter
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 2.798 sec
[junit] Running org.apache.solr.analysis.TestPatternTokenizerFactory
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.021 sec
[junit] Running org.apache.solr.analysis.TestPhoneticFilter
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.21 sec
[junit] Running org.apache.solr.analysis.TestRemoveDuplicatesTokenFilter
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.601 sec
[junit] Running org.apache.solr.analysis.TestStopFilterFactory
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.238 sec
[junit] Running org.apache.solr.analysis.TestSynonymFilter
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 3.594 sec
[junit] Running org.apache.solr.analysis.TestSynonymMap
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 2.629 sec
[junit] Running org.apache.solr.analysis.TestTrimFilter
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.222 sec
[junit] Running org.apache.solr.analysis.TestWordDelimiterFilter
[junit] Tests run: 12, Failures: 0, Errors: 0, Time elapsed: 19.459 sec
[junit] Running org.apache.solr.client.solrj.SolrExceptionTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.162 sec
[junit] Running org.apache.solr.client.solrj.SolrQueryTest
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.404 sec
[junit] Running org.apache.solr.client.solrj.TestBatchUpdate
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 11.881 sec
[junit] Running org.apache.solr.client.solrj.TestLBHttpSolrServer
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 9.364 sec
[junit] Running org.apache.solr.client.solrj.beans.TestDocumentObjectBinder
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.888 sec
[junit] Running org.apache.solr.client.solrj.embedded.JettyWebappTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.412 sec
[junit] Running 
org.apache.solr.client.solrj.embedded.LargeVolumeBinaryJettyTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.821 sec
[junit] Running 
org.apache.solr.client.solrj.embedded.LargeVolumeEmbeddedTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.81 sec
[junit] Running org.apache.solr.client.solrj.embedded.LargeVolumeJettyTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.028 sec
[junit] Running 
org.apache.solr.client.solrj.embedded.MergeIndexesEmbeddedTest
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 1.602 sec
[junit] Test org.apache.solr.client.solrj.embedded.MergeIndexesEmbeddedTest 
FAILED
[junit] Running org.apache.solr.client.solrj.embedded.MultiCoreEmbeddedTest
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 1.601 sec
[junit] Test org.apache.solr.client.solrj.embedded.MultiCoreEmbeddedTest 
FAILED
[junit] Running 
org.apache.solr.client.solrj.embedded.MultiCoreExampleJettyTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.837 sec
[junit] Running 
org.apache.solr.client.solrj.embedded.SolrExampleEmbeddedTest
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 7.548 sec
[junit] Running org.apache.solr.client.solrj.embedded.SolrExampleJettyTest
[junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 13.101 sec
[junit] Running 
org.apache.solr.client.solrj.embedded.SolrExampleStreamingTest
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 14.826 sec
[junit] Running org.apache.solr.client.solrj.embedded.TestSolrProperties
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.01 sec
[junit] Running org.apache.solr.client.solrj.request.TestUpdateRequestCodec
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.411 sec
[junit] Running 
org.apache.solr.client.solrj.response.AnlysisResponseBaseTest
[junit]

Solr nightly build failure

2009-06-20 Thread solr-dev

init-forrest-entities:
[mkdir] Created dir: /tmp/apache-solr-nightly/build
[mkdir] Created dir: /tmp/apache-solr-nightly/build/web

compile-solrj:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/solrj
[javac] Compiling 83 source files to /tmp/apache-solr-nightly/build/solrj
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

compile:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/solr
[javac] Compiling 375 source files to /tmp/apache-solr-nightly/build/solr
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

compileTests:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/tests
[javac] Compiling 162 source files to /tmp/apache-solr-nightly/build/tests
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

junit:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/test-results
[junit] Running org.apache.solr.BasicFunctionalityTest
[junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 15.878 sec
[junit] Running org.apache.solr.ConvertedLegacyTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.831 sec
[junit] Running org.apache.solr.DisMaxRequestHandlerTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 5.37 sec
[junit] Running org.apache.solr.EchoParamsTest
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 2.558 sec
[junit] Running org.apache.solr.OutputWriterTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.714 sec
[junit] Running org.apache.solr.SampleTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 2.428 sec
[junit] Running org.apache.solr.SolrInfoMBeanTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.948 sec
[junit] Running org.apache.solr.TestDistributedSearch
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 25.148 sec
[junit] Running org.apache.solr.TestTrie
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 7.567 sec
[junit] Running org.apache.solr.analysis.DoubleMetaphoneFilterFactoryTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.395 sec
[junit] Running org.apache.solr.analysis.DoubleMetaphoneFilterTest
[junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.41 sec
[junit] Running org.apache.solr.analysis.EnglishPorterFilterFactoryTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.579 sec
[junit] Running org.apache.solr.analysis.HTMLStripReaderTest
[junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 0.988 sec
[junit] Running org.apache.solr.analysis.LengthFilterTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.163 sec
[junit] Running org.apache.solr.analysis.SnowballPorterFilterFactoryTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.669 sec
[junit] Running org.apache.solr.analysis.TestBufferedTokenStream
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.512 sec
[junit] Running org.apache.solr.analysis.TestCapitalizationFilter
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.634 sec
[junit] Running org.apache.solr.analysis.TestCharFilter
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.501 sec
[junit] Running org.apache.solr.analysis.TestHyphenatedWordsFilter
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.214 sec
[junit] Running org.apache.solr.analysis.TestKeepFilterFactory
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.06 sec
[junit] Running org.apache.solr.analysis.TestKeepWordFilter
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.229 sec
[junit] Running org.apache.solr.analysis.TestMappingCharFilter
[junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.414 sec
[junit] Running org.apache.solr.analysis.TestMappingCharFilterFactory
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.429 sec
[junit] Running org.apache.solr.analysis.TestPatternReplaceFilter
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 2.276 sec
[junit] Running org.apache.solr.analysis.TestPatternTokenizerFactory
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.443 sec
[junit] Running org.apache.solr.analysis.TestPhoneticFilter