Re: [Solr Wiki] Update of "QueryElevationComponent" by Yoni kSeeley

[Chris Hostetter]

: + Note: The uniqueKey field must currently be of type string for the 
QueryElevationComponent to operate properly.
: + 

Should we enforce this in code?

QueryElevationComponent.inform(SolrCore) already throws an exception if 
there is no uniqueKey, it would only be another 2 lines of code 
to do an instanceOf check on the class.

it's kludgy, but failing loudly seems better then failing silently.

(see also SOLR-1520)

-Hoss

[jira] Resolved: (SOLR-1521) eliminate contrib/clustering/example by moving to main example disabled by default

[Hoss Man (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SOLR-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man resolved SOLR-1521.


Resolution: Fixed
  Assignee: Hoss Man

Committed revision 829493.
also updated the wiki...
http://wiki.apache.org/solr/ClusteringComponent

> eliminate contrib/clustering/example by moving to main example disabled by 
> default
> --
>
> Key: SOLR-1521
> URL: https://issues.apache.org/jira/browse/SOLR-1521
> Project: Solr
>  Issue Type: Improvement
>Reporter: Hoss Man
>Assignee: Hoss Man
> Fix For: 1.4
>
> Attachments: SOLR-1521.patch
>
>
> As noted in email, there is a tenuous connection between the main example and 
> the clustering example in that they both use the same dataDir, so their 
> schema files have to be kept in sync or the example will break...
> http://www.nabble.com/clustering-schema-td25982682.html

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (SOLR-822) CharFilter - normalize characters before tokenizer

[Koji Sekiguchi (JIRA)]

[ 
https://issues.apache.org/jira/browse/SOLR-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769741#action_12769741
 ] 

Koji Sekiguchi commented on SOLR-822:
-

bq. Please update the Wiki for this feature. 

Done. :)

> CharFilter - normalize characters before tokenizer
> --
>
> Key: SOLR-822
> URL: https://issues.apache.org/jira/browse/SOLR-822
> Project: Solr
>  Issue Type: New Feature
>  Components: Analysis
>Affects Versions: 1.3
>Reporter: Koji Sekiguchi
>Assignee: Koji Sekiguchi
>Priority: Minor
> Fix For: 1.4
>
> Attachments: character-normalization.JPG, 
> japanese-h-to-k-mapping.txt, sample_mapping_ja.txt, sample_mapping_ja.txt, 
> SOLR-822-for-1.3.patch, SOLR-822-renameMethod.patch, SOLR-822.patch, 
> SOLR-822.patch, SOLR-822.patch, SOLR-822.patch, SOLR-822.patch
>
>
> A new plugin which can be placed in front of .
> {code:xml}
>  positionIncrementGap="100" >
>   
>  mapping="mapping_ja.txt" />
> 
>  words="stopwords.txt"/>
> 
>   
> 
> {code}
>  can be multiple (chained). I'll post a JPEG file to show 
> character normalization sample soon.
> MOTIVATION:
> In Japan, there are two types of tokenizers -- N-gram (CJKTokenizer) and 
> Morphological Analyzer.
> When we use morphological analyzer, because the analyzer uses Japanese 
> dictionary to detect terms,
> we need to normalize characters before tokenization.
> I'll post a patch soon, too.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Created: (SOLR-1523) Destructive Solr operations accept HTTP GET requests

[Lance Norskog (JIRA)]

Destructive Solr operations accept HTTP GET requests 
-

 Key: SOLR-1523
 URL: https://issues.apache.org/jira/browse/SOLR-1523
 Project: Solr
  Issue Type: Improvement
Affects Versions: 1.4
Reporter: Lance Norskog


GET v.s. POST/PUT/DELETE

The multicore implementation allows HTTP GET requests to perform system 
administration commands. This means that an URL which alters the system can be 
bookmarked/e-mailed/etc. This is dangerous in a production system.

A clean implementation should give every request handler the ability to accept 
some HTTP verbs and reject others. It could be just a boolean for whether it 
accepts a GET, or the interface might actually have a list of verbs it accepts. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (SOLR-822) CharFilter - normalize characters before tokenizer

[Lance Norskog (JIRA)]

[ 
https://issues.apache.org/jira/browse/SOLR-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769700#action_12769700
 ] 

Lance Norskog commented on SOLR-822:


Please update the Wiki for this feature.

[http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters?highlight=char+filters]



> CharFilter - normalize characters before tokenizer
> --
>
> Key: SOLR-822
> URL: https://issues.apache.org/jira/browse/SOLR-822
> Project: Solr
>  Issue Type: New Feature
>  Components: Analysis
>Affects Versions: 1.3
>Reporter: Koji Sekiguchi
>Assignee: Koji Sekiguchi
>Priority: Minor
> Fix For: 1.4
>
> Attachments: character-normalization.JPG, 
> japanese-h-to-k-mapping.txt, sample_mapping_ja.txt, sample_mapping_ja.txt, 
> SOLR-822-for-1.3.patch, SOLR-822-renameMethod.patch, SOLR-822.patch, 
> SOLR-822.patch, SOLR-822.patch, SOLR-822.patch, SOLR-822.patch
>
>
> A new plugin which can be placed in front of .
> {code:xml}
>  positionIncrementGap="100" >
>   
>  mapping="mapping_ja.txt" />
> 
>  words="stopwords.txt"/>
> 
>   
> 
> {code}
>  can be multiple (chained). I'll post a JPEG file to show 
> character normalization sample soon.
> MOTIVATION:
> In Japan, there are two types of tokenizers -- N-gram (CJKTokenizer) and 
> Morphological Analyzer.
> When we use morphological analyzer, because the analyzer uses Japanese 
> dictionary to detect terms,
> we need to normalize characters before tokenization.
> I'll post a patch soon, too.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: Solr nightly build failure

[Yonik Seeley]

The exception:

Testcase: testCacheControl took 6.011 sec
Caused an ERROR
The host did not accept the connection within timeout of 100 ms
org.apache.commons.httpclient.ConnectTimeoutException: The host did
not accept the connection within timeout of 100 ms
at 
org.apache.commons.httpclient.protocol.ReflectionSocketFactory.createSocket(ReflectionSocketFactory.java:155)
at 
org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:125)
at 
org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
at 
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)
at 
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
at 
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
at 
org.apache.solr.servlet.CacheHeaderTest.doCacheControl(CacheHeaderTest.java:218)
at 
org.apache.solr.servlet.CacheHeaderTestBase.testCacheControl(CacheHeaderTestBase.java:154)
Caused by: java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:507)
at 
org.apache.commons.httpclient.protocol.ReflectionSocketFactory.createSocket(ReflectionSocketFactory.java:140)



-Yonik
http://www.lucidimagination.com



On Sat, Oct 24, 2009 at 4:42 AM,   wrote:
>
> init-forrest-entities:
>    [mkdir] Created dir: /tmp/apache-solr-nightly/build
>    [mkdir] Created dir: /tmp/apache-solr-nightly/build/web
>
> compile-solrj:
>    [mkdir] Created dir: /tmp/apache-solr-nightly/build/solrj
>    [javac] Compiling 87 source files to /tmp/apache-solr-nightly/build/solrj
>    [javac] Note: Some input files use or override a deprecated API.
>    [javac] Note: Recompile with -Xlint:deprecation for details.
>    [javac] Note: Some input files use unchecked or unsafe operations.
>    [javac] Note: Recompile with -Xlint:unchecked for details.
>
> compile:
>    [mkdir] Created dir: /tmp/apache-solr-nightly/build/solr
>    [javac] Compiling 389 source files to /tmp/apache-solr-nightly/build/solr
>    [javac] Note: Some input files use or override a deprecated API.
>    [javac] Note: Recompile with -Xlint:deprecation for details.
>    [javac] Note: Some input files use unchecked or unsafe operations.
>    [javac] Note: Recompile with -Xlint:unchecked for details.
>
> compileTests:
>    [mkdir] Created dir: /tmp/apache-solr-nightly/build/tests
>    [javac] Compiling 177 source files to /tmp/apache-solr-nightly/build/tests
>    [javac] Note: Some input files use or override a deprecated API.
>    [javac] Note: Recompile with -Xlint:deprecation for details.
>    [javac] Note: Some input files use unchecked or unsafe operations.
>    [javac] Note: Recompile with -Xlint:unchecked for details.
>
> dist-contrib:
>
> init:
>    [mkdir] Created dir: 
> /tmp/apache-solr-nightly/contrib/clustering/build/classes
>    [mkdir] Created dir: 
> /tmp/apache-solr-nightly/contrib/clustering/lib/downloads
>    [mkdir] Created dir: /tmp/apache-solr-nightly/build/docs/api
>
> init-forrest-entities:
>
> compile-solrj:
>
> compile:
>    [javac] Compiling 1 source file to /tmp/apache-solr-nightly/build/solr
>    [javac] Note: 
> /tmp/apache-solr-nightly/src/java/org/apache/solr/search/DocSetHitCollector.java
>  uses or overrides a deprecated API.
>    [javac] Note: Recompile with -Xlint:deprecation for details.
>
> make-manifest:
>    [mkdir] Created dir: /tmp/apache-solr-nightly/build/META-INF
>
> proxy.setup:
>
> check-files:
>
> get-colt:
>      [get] Getting: 
> http://repo1.maven.org/maven2/colt/colt/1.2.0/colt-1.2.0.jar
>      [get] To: 
> /tmp/apache-solr-nightly/contrib/clustering/lib/downloads/colt-1.2.0.jar
>
> get-pcj:
>      [get] Getting: http://repo1.maven.org/maven2/pcj/pcj/1.2/pcj-1.2.jar
>      [get] To: 
> /tmp/apache-solr-nightly/contrib/clustering/lib/downloads/pcj-1.2.jar
>
> get-nni:
>      [get] Getting: 
> http://download.carrot2.org/maven2/org/carrot2/nni/1.0.0/nni-1.0.0.jar
>      [get] To: 
> /tmp/apache-solr-nightly/contrib/clustering/lib/downloads/nni-1.0.0.jar
>
> get-simple-xml:
>      [get] Getting: 
> http://mirrors.ibiblio.org/pub/mirrors/maven2/org/simpleframework/simple-xml/1.7.3/simple-xml-1.7.3.jar
>      [get] To: 
> /tmp/apache-solr-nightly/contrib/clustering/lib/downloads/simple-xml-1.7

Hudson build is back to normal: Solr-trunk #965

[Apache Hudson Server]

See 

Solr nightly build failure

[solr-dev]

init-forrest-entities:
[mkdir] Created dir: /tmp/apache-solr-nightly/build
[mkdir] Created dir: /tmp/apache-solr-nightly/build/web

compile-solrj:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/solrj
[javac] Compiling 87 source files to /tmp/apache-solr-nightly/build/solrj
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

compile:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/solr
[javac] Compiling 389 source files to /tmp/apache-solr-nightly/build/solr
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

compileTests:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/tests
[javac] Compiling 177 source files to /tmp/apache-solr-nightly/build/tests
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

dist-contrib:

init:
[mkdir] Created dir: 
/tmp/apache-solr-nightly/contrib/clustering/build/classes
[mkdir] Created dir: 
/tmp/apache-solr-nightly/contrib/clustering/lib/downloads
[mkdir] Created dir: /tmp/apache-solr-nightly/build/docs/api

init-forrest-entities:

compile-solrj:

compile:
[javac] Compiling 1 source file to /tmp/apache-solr-nightly/build/solr
[javac] Note: 
/tmp/apache-solr-nightly/src/java/org/apache/solr/search/DocSetHitCollector.java
 uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

make-manifest:
[mkdir] Created dir: /tmp/apache-solr-nightly/build/META-INF

proxy.setup:

check-files:

get-colt:
  [get] Getting: 
http://repo1.maven.org/maven2/colt/colt/1.2.0/colt-1.2.0.jar
  [get] To: 
/tmp/apache-solr-nightly/contrib/clustering/lib/downloads/colt-1.2.0.jar

get-pcj:
  [get] Getting: http://repo1.maven.org/maven2/pcj/pcj/1.2/pcj-1.2.jar
  [get] To: 
/tmp/apache-solr-nightly/contrib/clustering/lib/downloads/pcj-1.2.jar

get-nni:
  [get] Getting: 
http://download.carrot2.org/maven2/org/carrot2/nni/1.0.0/nni-1.0.0.jar
  [get] To: 
/tmp/apache-solr-nightly/contrib/clustering/lib/downloads/nni-1.0.0.jar

get-simple-xml:
  [get] Getting: 
http://mirrors.ibiblio.org/pub/mirrors/maven2/org/simpleframework/simple-xml/1.7.3/simple-xml-1.7.3.jar
  [get] To: 
/tmp/apache-solr-nightly/contrib/clustering/lib/downloads/simple-xml-1.7.3.jar

get-libraries:

compile:
[javac] Compiling 7 source files to 
/tmp/apache-solr-nightly/contrib/clustering/build/classes
[javac] Note: 
/tmp/apache-solr-nightly/contrib/clustering/src/main/java/org/apache/solr/handler/clustering/carrot2/CarrotClusteringEngine.java
 uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

build:
  [jar] Building jar: 
/tmp/apache-solr-nightly/contrib/clustering/build/apache-solr-clustering-1.4-dev.jar

dist:
 [copy] Copying 1 file to /tmp/apache-solr-nightly/dist

init:
[mkdir] Created dir: 
/tmp/apache-solr-nightly/contrib/dataimporthandler/target/classes

init-forrest-entities:

compile-solrj:

compile:
[javac] Compiling 1 source file to /tmp/apache-solr-nightly/build/solr
[javac] Note: 
/tmp/apache-solr-nightly/src/java/org/apache/solr/search/DocSetHitCollector.java
 uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.

make-manifest:

compile:
[javac] Compiling 43 source files to 
/tmp/apache-solr-nightly/contrib/dataimporthandler/target/classes
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

compileExtras:
[mkdir] Created dir: 
/tmp/apache-solr-nightly/contrib/dataimporthandler/target/extras/classes
[javac] Compiling 1 source file to 
/tmp/apache-solr-nightly/contrib/dataimporthandler/target/extras/classes
[javac] Note: 
/tmp/apache-solr-nightly/contrib/dataimporthandler/src/extras/main/java/org/apache/solr/handler/dataimport/MailEntityProcessor.java
 uses unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

build:
  [jar] Building jar: 
/tmp/apache-solr-nightly/contrib/dataimporthandler/target/apache-solr-dataimporthandler-1.4-dev.jar
  [jar] Building jar: 
/tmp/apache-solr-nightly/contrib/dataimporthandler/target/apache-solr-dataimporthand