Re: GPU acceleration

2011-03-13 Thread Earwin Burrfoot
On Sun, Mar 13, 2011 at 00:15, Ken O'Brien wrote: > To clarify, I've not yet written any code. I aim to bring a large speedup to > any functionality that is computationally expensive. I'm wondering which > components are candidates for this. > > I'll be looking through the code but if anyone is aw

[HUDSON] Lucene-Solr-tests-only-trunk - Build # 5887 - Failure

2011-03-13 Thread Apache Hudson Server
Build: https://hudson.apache.org/hudson/job/Lucene-Solr-tests-only-trunk/5887/ 2 tests failed. REGRESSION: org.apache.solr.uima.processor.UIMAUpdateRequestProcessorTest.testProcessing Error Message: org.apache.uima.analysis_engine.AnalysisEngineProcessException Stack Trace: java.lang.RuntimeEx

[jira] Commented: (LUCENE-2308) Separately specify a field's type

2011-03-13 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006182#comment-13006182 ] Simon Willnauer commented on LUCENE-2308: - Brief Summary for GSoC Students: Fiel

[jira] Commented: (LUCENE-2621) Extend Codec to handle also stored fields and term vectors

2011-03-13 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006181#comment-13006181 ] Simon Willnauer commented on LUCENE-2621: - Brief Summary for GSoC Students: This

[jira] Commented: (LUCENE-2621) Extend Codec to handle also stored fields and term vectors

2011-03-13 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006180#comment-13006180 ] Simon Willnauer commented on LUCENE-2621: - Brief Summary for GSoC Students: This

[jira] Commented: (LUCENE-2308) Separately specify a field's type

2011-03-13 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006184#comment-13006184 ] Simon Willnauer commented on LUCENE-2308: - bq. I'm surprised to barely even see a

Re: Participating in GSoC'11 with Lucene

2011-03-13 Thread Simon Willnauer
On Sun, Mar 13, 2011 at 12:11 AM, Michael McCandless wrote: > Simon these are great summaries -- can you post them on the issues too?   > Thanks! done! simon > > On Sat, Mar 12, 2011 at 4:35 PM, Simon Willnauer > wrote: >> Hey, >> >> On Sat, Mar 12, 2011 at 5:32 PM, Zhijie Shen wrote: >>> Hi d

[jira] Commented: (LUCENE-2308) Separately specify a field's type

2011-03-13 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006185#comment-13006185 ] Robert Muir commented on LUCENE-2308: - {quote} Moving stuff from Solr to Lucene invol

[jira] Commented: (LUCENE-2308) Separately specify a field's type

2011-03-13 Thread Chris Male (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006187#comment-13006187 ] Chris Male commented on LUCENE-2308: bq. I'm surprised to barely even see a mention t

[jira] Commented: (LUCENE-2944) BytesRef reuse bugs in QueryParser and analysis.jsp

2011-03-13 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006188#comment-13006188 ] Robert Muir commented on LUCENE-2944: - guys, any comments on the api? I am no good a

[HUDSON] Lucene-Solr-tests-only-3.x - Build # 5874 - Failure

2011-03-13 Thread Apache Hudson Server
Build: https://hudson.apache.org/hudson/job/Lucene-Solr-tests-only-3.x/5874/ 1 tests failed. REGRESSION: org.apache.solr.client.solrj.embedded.SolrExampleStreamingTest.testCommitWithin Error Message: expected:<0> but was:<1> Stack Trace: junit.framework.AssertionFailedError: expected:<0> but w

[jira] Commented: (LUCENE-2944) BytesRef reuse bugs in QueryParser and analysis.jsp

2011-03-13 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006192#comment-13006192 ] Simon Willnauer commented on LUCENE-2944: - I had a brief review - naming looks go

Lucene & Solr a one way street?

2011-03-13 Thread Simon Willnauer
Hey folks, I have recently tried to push some refactorings towards moving stuff from Solr to modules land to enable users of Lucene to benefit from the developments that have been made in Solr land during the past with very little success. Actually, it was a really disappointing experience wheneve

[jira] Commented: (LUCENE-2958) WriteLineDocTask improvements

2011-03-13 Thread Doron Cohen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006211#comment-13006211 ] Doron Cohen commented on LUCENE-2958: - bq. So let's keep the current impl as optimize

Re: Lucene & Solr a one way street?

2011-03-13 Thread Grant Ingersoll
On Mar 13, 2011, at 10:23 AM, Simon Willnauer wrote: > Hey folks, > > I have recently tried to push some refactorings towards moving stuff > from Solr to modules land to enable users of Lucene to benefit from > the developments that have been made in Solr land during the past with > very little

[jira] Commented: (LUCENE-2308) Separately specify a field's type

2011-03-13 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006213#comment-13006213 ] Yonik Seeley commented on LUCENE-2308: -- bq. I think there is a lot of overlap but So

[jira] Commented: (LUCENE-2960) Allow (or bring back) the ability to setRAMBufferSizeMB on an open IndexWriter

2011-03-13 Thread Shay Banon (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006214#comment-13006214 ] Shay Banon commented on LUCENE-2960: Just a note regarding the IWC and being able to

[jira] Commented: (LUCENE-2308) Separately specify a field's type

2011-03-13 Thread Simon Willnauer (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006215#comment-13006215 ] Simon Willnauer commented on LUCENE-2308: - {quote} I think there is a lot of over

Re: Lucene & Solr a one way street?

2011-03-13 Thread Mattmann, Chris A (388J)
On Mar 13, 2011, at 8:47 AM, Grant Ingersoll wrote: > > On Mar 13, 2011, at 10:23 AM, Simon Willnauer wrote: > >> Hey folks, >> >> I have recently tried to push some refactorings towards moving stuff >> from Solr to modules land to enable users of Lucene to benefit from >> the developments that

Re: Lucene & Solr a one way street?

2011-03-13 Thread Robert Muir
On Sun, Mar 13, 2011 at 11:47 AM, Grant Ingersoll wrote: > I guess the question people w/ Solr only hats on have (if there are such > people), is which way is that street going?  It seems like most people want > to pull stuff out of Solr, but they don't seem to want to put into it.   > That's pr

[jira] Commented: (LUCENE-2749) Co-occurrence filter

2011-03-13 Thread Elmar Pitschke (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006222#comment-13006222 ] Elmar Pitschke commented on LUCENE-2749: Hi, i am fairly new to Lucene developmen

[jira] Commented: (LUCENE-2621) Extend Codec to handle also stored fields and term vectors

2011-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006223#comment-13006223 ] Zhijie Shen commented on LUCENE-2621: - I've some questions here to make sure I'm look

[jira] Commented: (LUCENE-2960) Allow (or bring back) the ability to setRAMBufferSizeMB on an open IndexWriter

2011-03-13 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006227#comment-13006227 ] Earwin Burrfoot commented on LUCENE-2960: - {quote} Why such purity? What do we ga

[jira] Commented: (LUCENE-2958) WriteLineDocTask improvements

2011-03-13 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006251#comment-13006251 ] Shai Erera commented on LUCENE-2958: A thought -- how about we do the following: # Li

[jira] Commented: (LUCENE-2749) Co-occurrence filter

2011-03-13 Thread Steven Rowe (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006254#comment-13006254 ] Steven Rowe commented on LUCENE-2749: - Hi Elmar, I haven't had a chance to do more t

Re: Lucene & Solr a one way street?

2011-03-13 Thread Grant Ingersoll
On Mar 13, 2011, at 11:47 AM, Robert Muir wrote: > On Sun, Mar 13, 2011 at 11:47 AM, Grant Ingersoll wrote: >> I guess the question people w/ Solr only hats on have (if there are such >> people), is which way is that street going? It seems like most people want >> to pull stuff out of Solr, b

[jira] Updated: (LUCENE-2958) WriteLineDocTask improvements

2011-03-13 Thread Doron Cohen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doron Cohen updated LUCENE-2958: Attachment: LUCENE-2958.patch bq. Will that be simpler? It will be simpler, I admit, but it will h

[jira] Commented: (LUCENE-2958) WriteLineDocTask improvements

2011-03-13 Thread Doron Cohen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006269#comment-13006269 ] Doron Cohen commented on LUCENE-2958: - Rethinking this suggestion, I am afraid it wil

Re: Lucene & Solr a one way street?

2011-03-13 Thread David Smiley (@MITRE.org)
It's good to see this discussion finally happen. Some things are in Solr (e.g. faceting, function queries, Yonik's recent join patch, ...) that probably belong in Lucene. As someone contributing functionality to Lucene/Solr in SOLR-2155 (Geospatial search via geohash prefix techniques), anecdotal

Re: GPU acceleration

2011-03-13 Thread k...@kenobrien.org
Vectorizable code would be the major target, yes. Do you know if the guys from Yandex were using CUDA or OpenCL approaches? or the old kind of opengl hacks. On Sun, Mar 13, 2011 at 8:31 AM, Earwin Burrfoot wrote: > On Sun, Mar 13, 2011 at 00:15, Ken O'Brien wrote: > > To clarify, I've not yet

[jira] Commented: (SOLR-1725) Script based UpdateRequestProcessorFactory

2011-03-13 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006284#comment-13006284 ] David Smiley commented on SOLR-1725: This capability is awesome, just as it's DIH equiv

[jira] Updated: (SOLR-2347) Use InputStream and not Reader for XML parsing

2011-03-13 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe Schindler updated SOLR-2347: Component/s: contrib - DataImportHandler Fix Version/s: 4.0 3.2 > Use Input

[jira] Commented: (SOLR-2347) Use InputStream and not Reader for XML parsing

2011-03-13 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006285#comment-13006285 ] Uwe Schindler commented on SOLR-2347: - This now only affects DIH anymore. DIH have to

[jira] Commented: (SOLR-2347) Use InputStream and not Reader for XML parsing

2011-03-13 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006286#comment-13006286 ] Mark Miller commented on SOLR-2347: --- bq. which is no problem as DIH is contrib and experi

[jira] Commented: (LUCENE-2960) Allow (or bring back) the ability to setRAMBufferSizeMB on an open IndexWriter

2011-03-13 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006287#comment-13006287 ] Mark Miller commented on LUCENE-2960: - bq. Maybe its just me, but it feels nicer to h

[jira] Created: (SOLR-2425) firstSearcher Listener of SpellChecker can be never called

2011-03-13 Thread Koji Sekiguchi (JIRA)
firstSearcher Listener of SpellChecker can be never called -- Key: SOLR-2425 URL: https://issues.apache.org/jira/browse/SOLR-2425 Project: Solr Issue Type: Bug Components: spe

[jira] Commented: (SOLR-2425) firstSearcher Listener of SpellChecker can be never called

2011-03-13 Thread Koji Sekiguchi (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006313#comment-13006313 ] Koji Sekiguchi commented on SOLR-2425: -- bq. At the time, firstSearcherListeners includ

Re: GPU acceleration

2011-03-13 Thread Lance Norskog
"There were experiments with moving both pieces of code to the GPU, and GPU did well in terms of speed, but they say getting data in and out of GPU made the approach unfeasible." That would be the problem with GPUs :) Co-processors always have this problem. GPUs were designed for 3d video games- t

Re: GPU acceleration

2011-03-13 Thread k...@kenobrien.org
I see. I will conduct my own experiments with more recent GPU libraries. Thanks for everyone's input. On Mar 14, 2011 2:30 AM, "Lance Norskog" wrote: > "There were experiments with moving both pieces of code to the GPU, and > GPU did well in terms of speed, but they say getting data in and out > o

[jira] Commented: (SOLR-2337) Solr needs hits= added to the log when using grouping

2011-03-13 Thread Bill Bell (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006330#comment-13006330 ] Bill Bell commented on SOLR-2337: - The only downfall with this patch, is the hits=10 means