[jira] Issue Comment Edited: (SOLR-1065) Add a ContenStreamDataSource to DIH to accept post data
[
https://issues.apache.org/jira/browse/SOLR-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12682140#action_12682140
]
Noble Paul edited comment on SOLR-1065 at 3/15/09 9:59 PM:
---
regular update handler can only handle xml in the standard format. With DIH you
can post any xml or any other file . Moreover DIH lets you have custom
transformations to the data.
It is also possible to mix the uploaded data with other DatSources (DB) before
creating the documents
was (Author: noble.paul):
regular update handler can only handle xml in the standard format. With DIH
you can post any xml or any other file . Moreover DIH lets you have custom
transformations to the data.
> Add a ContenStreamDataSource to DIH to accept post data
> ---
>
> Key: SOLR-1065
> URL: https://issues.apache.org/jira/browse/SOLR-1065
> Project: Solr
> Issue Type: New Feature
> Components: contrib - DataImportHandler
>Reporter: Noble Paul
> Fix For: 1.4
>
> Attachments: SOLR-1065.patch, SOLR-1065.patch
>
>
> It is a common requirement to push data to DIH. Currently it is not possible
> . If we have a ContentStreamDataSource it can easily solve this problem
> sample configuration
> {code:xml}
>
> {code}
> This datasource does not need any extra configuration. Make a normal POST
> request with the data as the body. The params remain same.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (SOLR-1061) Improve RegexTransformer to create multiple columns from regex groups
[
https://issues.apache.org/jira/browse/SOLR-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noble Paul updated SOLR-1061:
-
Attachment: SOLR-1061.patch
there was a bug in the last patch
> Improve RegexTransformer to create multiple columns from regex groups
> -
>
> Key: SOLR-1061
> URL: https://issues.apache.org/jira/browse/SOLR-1061
> Project: Solr
> Issue Type: Improvement
> Components: contrib - DataImportHandler
>Reporter: Noble Paul
> Fix For: 1.4
>
> Attachments: SOLR-1061.patch, SOLR-1061.patch
>
>
> example
> {code:xml}
> groupNames="firstName,secondName"/>
> {code}
> This is more efficient in extracting multiple values from a single String. if
> some groups need to be omitted just leave it empty
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: Solr nightly build failure
On Sun, Mar 15, 2009 at 8:25 PM, Yonik Seeley wrote: > Fixed. > SimpleDateFormat needed it's timezone set to UTC in the test (it was > formatting in local time and sticking on a 'Z'). > > Thanks Yonik! -- Regards, Shalin Shekhar Mangar.
Re: Solr nightly build failure
Fixed.
SimpleDateFormat needed it's timezone set to UTC in the test (it was
formatting in local time and sticking on a 'Z').
-Yonik
http://www.lucidimagination.com
On Sun, Mar 15, 2009 at 3:32 AM, Shalin Shekhar Mangar
wrote:
> On Sat, Mar 14, 2009 at 1:49 PM, wrote:
>
>>
>> [junit] Running org.apache.solr.TestTrie
>> [junit]
>> [junit] 0> name="QTime">2> start="0">0.0> name="tdate">2009-03-14T00:00:00Z> name="id">1.0> name="tdate">2009-03-15T00:00:00Z> name="id">2.0> name="tdate">2009-03-16T00:00:00Z> name="id">3.0> name="tdate">2009-03-17T00:00:00Z> name="id">4.0> name="tdate">2009-03-18T00:00:00Z> name="id">5.0> name="tdate">2009-03-19T00:00:00Z
>> [junit]
>> [junit] )
>> [junit] Tests run: 7, Failures: 1, Errors: 0, Time elapsed: 7.421 sec
>> [junit] Test org.apache.solr.TestTrie FAILED
>>
>
> Is anybody else seeing this test fail on their local box? It passes on my
> box.
>
> In case anybody is curious, I'm indexing 10 dates (NOW/DAY to NOW/DAY+9
> DAYS) and querying for tdate:[NOW/DAY TO NOW/DAY+5DAYS]. The bounds are
> supposed to inclusive so it should give 6 results. But I get only 5 on my
> local box but the hudson build returns 6. I'm not able to explain it.
>
> Here's the code for indexing:
>
> SimpleDateFormat format = new SimpleDateFormat("-MM-dd'T'HH:mm:ss'Z'");
> assertU(delQ("*:*"));
> DateMathParser dmp = new DateMathParser(DateField.UTC, Locale.US);
> for (int i = 0; i < 10; i++) {
> // index 10 days starting with today
> assertU(adoc("id", String.valueOf(i), "tdate", format.format(i == 0 ?
> dmp.parseMath("/DAY") : dmp.parseMath("/DAY+" + i + "DAYS";
> }
> assertU(commit());
>
> Here's the test:
> req = req("q", "*:*", "fq", "tdate:[NOW/DAY TO NOW/DAY+5DAYS]");
> assertQ("Range filter must match only 5 documents", req,
> "//*...@numfound='5']");
>
> --
> Regards,
> Shalin Shekhar Mangar.
>
[jira] Commented: (SOLR-1065) Add a ContenStreamDataSource to DIH to accept post data
[
https://issues.apache.org/jira/browse/SOLR-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12682140#action_12682140
]
Noble Paul commented on SOLR-1065:
--
regular update handler can only handle xml in the standard format. With DIH you
can post any xml or any other file . Moreover DIH lets you have custom
transformations to the data.
> Add a ContenStreamDataSource to DIH to accept post data
> ---
>
> Key: SOLR-1065
> URL: https://issues.apache.org/jira/browse/SOLR-1065
> Project: Solr
> Issue Type: New Feature
> Components: contrib - DataImportHandler
>Reporter: Noble Paul
> Fix For: 1.4
>
> Attachments: SOLR-1065.patch, SOLR-1065.patch
>
>
> It is a common requirement to push data to DIH. Currently it is not possible
> . If we have a ContentStreamDataSource it can easily solve this problem
> sample configuration
> {code:xml}
>
> {code}
> This datasource does not need any extra configuration. Make a normal POST
> request with the data as the body. The params remain same.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Build failed in Hudson: Solr-trunk #743
See http://hudson.zones.apache.org/hudson/job/Solr-trunk/743/ -- [...truncated 1932 lines...] [junit] Running org.apache.solr.SolrInfoMBeanTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.76 sec [junit] Running org.apache.solr.TestDistributedSearch [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 57.148 sec [junit] Running org.apache.solr.TestTrie [junit] [junit] 020.02009-03-15T00:00:00Z1.02009-03-16T00:00:00Z2.02009-03-17T00:00:00Z3.02009-03-18T00:00:00Z4.02009-03-19T00:00:00Z5.02009-03-20T00:00:00Z [junit] [junit] ) [junit] Tests run: 7, Failures: 1, Errors: 0, Time elapsed: 8.641 sec [junit] Test org.apache.solr.TestTrie FAILED [junit] Running org.apache.solr.analysis.DoubleMetaphoneFilterFactoryTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.552 sec [junit] Running org.apache.solr.analysis.DoubleMetaphoneFilterTest [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.518 sec [junit] Running org.apache.solr.analysis.EnglishPorterFilterFactoryTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.567 sec [junit] Running org.apache.solr.analysis.HTMLStripReaderTest [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 1.128 sec [junit] Running org.apache.solr.analysis.LengthFilterTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.379 sec [junit] Running org.apache.solr.analysis.SnowballPorterFilterFactoryTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.639 sec [junit] Running org.apache.solr.analysis.TestBufferedTokenStream [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.386 sec [junit] Running org.apache.solr.analysis.TestCapitalizationFilter [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.597 sec [junit] Running org.apache.solr.analysis.TestCharFilter [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.5 sec [junit] Running org.apache.solr.analysis.TestHyphenatedWordsFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.08 sec [junit] Running org.apache.solr.analysis.TestKeepWordFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.433 sec [junit] Running org.apache.solr.analysis.TestMappingCharFilter [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.475 sec [junit] Running org.apache.solr.analysis.TestMappingCharFilterFactory [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.442 sec [junit] Running org.apache.solr.analysis.TestPatternReplaceFilter [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 2.058 sec [junit] Running org.apache.solr.analysis.TestPatternTokenizerFactory [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.74 sec [junit] Running org.apache.solr.analysis.TestPhoneticFilter [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.761 sec [junit] Running org.apache.solr.analysis.TestRemoveDuplicatesTokenFilter [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.307 sec [junit] Running org.apache.solr.analysis.TestSynonymFilter [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 3.048 sec [junit] Running org.apache.solr.analysis.TestSynonymMap [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 2.219 sec [junit] Running org.apache.solr.analysis.TestTrimFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.3 sec [junit] Running org.apache.solr.analysis.TestWordDelimiterFilter [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 14.189 sec [junit] Running org.apache.solr.client.solrj.SolrExceptionTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.591 sec [junit] Running org.apache.solr.client.solrj.SolrQueryTest [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.441 sec [junit] Running org.apache.solr.client.solrj.beans.TestDocumentObjectBinder [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.75 sec [junit] Running org.apache.solr.client.solrj.embedded.JettyWebappTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 9.911 sec [junit] Running org.apache.solr.client.solrj.embedded.LargeVolumeBinaryJettyTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.623 sec [junit] Running org.apache.solr.client.solrj.embedded.LargeVolumeEmbeddedTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.352 sec [junit] Running org.apache.solr.client.solrj.embedded.LargeVolumeJettyTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 9.308 sec [junit] Running org.apache.solr.client.solrj.embedded.MultiCoreEmbeddedTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.47 sec [junit] Running org.apache.solr.client.solrj.
Solr nightly build failure
init-forrest-entities: [mkdir] Created dir: /tmp/apache-solr-nightly/build [mkdir] Created dir: /tmp/apache-solr-nightly/build/web compile-solrj: [mkdir] Created dir: /tmp/apache-solr-nightly/build/solrj [javac] Compiling 74 source files to /tmp/apache-solr-nightly/build/solrj [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. compile: [mkdir] Created dir: /tmp/apache-solr-nightly/build/solr [javac] Compiling 361 source files to /tmp/apache-solr-nightly/build/solr [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. compileTests: [mkdir] Created dir: /tmp/apache-solr-nightly/build/tests [javac] Compiling 143 source files to /tmp/apache-solr-nightly/build/tests [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. junit: [mkdir] Created dir: /tmp/apache-solr-nightly/build/test-results [junit] Running org.apache.solr.BasicFunctionalityTest [junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 27.083 sec [junit] Running org.apache.solr.ConvertedLegacyTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 12.713 sec [junit] Running org.apache.solr.DisMaxRequestHandlerTest [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 7.183 sec [junit] Running org.apache.solr.EchoParamsTest [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 3.595 sec [junit] Running org.apache.solr.OutputWriterTest [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.649 sec [junit] Running org.apache.solr.SampleTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.5 sec [junit] Running org.apache.solr.SolrInfoMBeanTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.256 sec [junit] Running org.apache.solr.TestDistributedSearch [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 42.871 sec [junit] Running org.apache.solr.TestTrie [junit] [junit] 020.02009-03-15T00:00:00Z1.02009-03-16T00:00:00Z2.02009-03-17T00:00:00Z3.02009-03-18T00:00:00Z4.02009-03-19T00:00:00Z5.02009-03-20T00:00:00Z [junit] [junit] ) [junit] Tests run: 7, Failures: 1, Errors: 0, Time elapsed: 13.077 sec [junit] Test org.apache.solr.TestTrie FAILED [junit] Running org.apache.solr.analysis.DoubleMetaphoneFilterFactoryTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.451 sec [junit] Running org.apache.solr.analysis.DoubleMetaphoneFilterTest [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.47 sec [junit] Running org.apache.solr.analysis.EnglishPorterFilterFactoryTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.718 sec [junit] Running org.apache.solr.analysis.HTMLStripReaderTest [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 1.324 sec [junit] Running org.apache.solr.analysis.LengthFilterTest [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.417 sec [junit] Running org.apache.solr.analysis.SnowballPorterFilterFactoryTest [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.818 sec [junit] Running org.apache.solr.analysis.TestBufferedTokenStream [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 4.127 sec [junit] Running org.apache.solr.analysis.TestCapitalizationFilter [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.517 sec [junit] Running org.apache.solr.analysis.TestCharFilter [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.508 sec [junit] Running org.apache.solr.analysis.TestHyphenatedWordsFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.4 sec [junit] Running org.apache.solr.analysis.TestKeepWordFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.49 sec [junit] Running org.apache.solr.analysis.TestMappingCharFilter [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.551 sec [junit] Running org.apache.solr.analysis.TestMappingCharFilterFactory [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.495 sec [junit] Running org.apache.solr.analysis.TestPatternReplaceFilter [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.184 sec [junit] Running org.apache.solr.analysis.TestPatternTokenizerFactory [junit] Tests run: 1, Failures: 0, Err
Re: Solr nightly build failure
On Sat, Mar 14, 2009 at 1:49 PM, wrote:
>
>[junit] Running org.apache.solr.TestTrie
>[junit]
>[junit] 0 name="QTime">2 start="0">0.0 name="tdate">2009-03-14T00:00:00Z name="id">1.0 name="tdate">2009-03-15T00:00:00Z name="id">2.0 name="tdate">2009-03-16T00:00:00Z name="id">3.0 name="tdate">2009-03-17T00:00:00Z name="id">4.0 name="tdate">2009-03-18T00:00:00Z name="id">5.0 name="tdate">2009-03-19T00:00:00Z
>[junit]
>[junit] )
>[junit] Tests run: 7, Failures: 1, Errors: 0, Time elapsed: 7.421 sec
>[junit] Test org.apache.solr.TestTrie FAILED
>
Is anybody else seeing this test fail on their local box? It passes on my
box.
In case anybody is curious, I'm indexing 10 dates (NOW/DAY to NOW/DAY+9
DAYS) and querying for tdate:[NOW/DAY TO NOW/DAY+5DAYS]. The bounds are
supposed to inclusive so it should give 6 results. But I get only 5 on my
local box but the hudson build returns 6. I'm not able to explain it.
Here's the code for indexing:
SimpleDateFormat format = new SimpleDateFormat("-MM-dd'T'HH:mm:ss'Z'");
assertU(delQ("*:*"));
DateMathParser dmp = new DateMathParser(DateField.UTC, Locale.US);
for (int i = 0; i < 10; i++) {
// index 10 days starting with today
assertU(adoc("id", String.valueOf(i), "tdate", format.format(i == 0 ?
dmp.parseMath("/DAY") : dmp.parseMath("/DAY+" + i + "DAYS";
}
assertU(commit());
Here's the test:
req = req("q", "*:*", "fq", "tdate:[NOW/DAY TO NOW/DAY+5DAYS]");
assertQ("Range filter must match only 5 documents", req,
"//*...@numfound='5']");
--
Regards,
Shalin Shekhar Mangar.
