Re: Schema Parsing Failed: unknown field 'id' [Zookeeper, SolrCloud]

2014-09-22 Thread Chris Hostetter

: Thanks. There is definitely a field name=id .../ in each of the schemas.
: 
: I am using 4.7.2.

if this conig is working for you when you don't use zookeeper/hdfs then 
you must be using a newer version of Solr when you test w/ zk/hdfs


4.8.0 is when the fields and type section tags were deprecated.

in 4.7.x and earlier you *must* enclose all of your field and 
fieldType tags in the appropriate sections.

See the 4.7.2 example configs and compare to yours.


From the 4.8.0 upgrade notes...

fields and types tags have been deprecated. There is no longer any 
reason to keep them in the schema file, they may be safely removed. This 
allows intermixing of fieldType, field and copyField definitions if 
desired. Currently, these tags are supported so either style may be 
implemented. TBD is whether they'll be deprecated formally for 5.0 

https://issues.apache.org/jira/browse/SOLR-5228



: 
: Here is one of the *schema.xml* (the others are similar):
: 
: 
: schema name=medline-citations version=1.5
:field name=_version_ type=long indexed=true stored=true/
:field name=_root_ type=string indexed=true stored=false/
:field name=id type=string indexed=true stored=true
: required=true multiValued=false / 
:field name=medline_journal_title type=text_en indexed=true
: stored=true /
:field name=medline_article_title type=text_en indexed=true
: stored=true termVectors=true termPositions=true termOffsets=true/
:field name=medline_pub_year type=int indexed=true stored=true /
:field name=medline_author_lastname type=string indexed=true
: stored=true multiValued=true/
:field name=medline_author_forename type=string indexed=true
: stored=true multiValued=true/
:field name=medline_descriptor_name type=string indexed=true
: stored=true multiValued=true docValues=true/
:field name=medline_abstract_text type=text_en indexed=true
: stored=true termVectors=true termPositions=true termOffsets=true/
:field name=medline_e_id type=string indexed=true stored=true/
:   field name=sentences type=text_en indexed=true stored=true
: multiValued=true required=false /
:   field name=genes type=string indexed=true stored=true
: multiValued=true required=false /
:   field name=phenotypes type=text_en indexed=true stored=true
: multiValued=true required=false / 
:field name=catchall type=text_general indexed=true stored=false
: multiValued=true/
:field name=suggestions indexed=true multiValued=false
: stored=true type=textSpell/
:field name=medline_journal_title_facets indexed=true stored=false
: type=string multiValued=true docValues=true/
: 
:  uniqueKeyid/uniqueKey
: 
:copyField source=medline_journal_title
: dest=medline_journal_title_facets/
: 
: fieldType class=solr.TextField name=textSpell
: positionIncrementGap=100
: analyzer
:   tokenizer class=solr.KeywordTokenizerFactory/
:   filter class=solr.LowerCaseFilterFactory/
:/analyzer
:   /fieldType
: 
: fieldType name=string class=solr.StrField sortMissingLast=true /
: 
: fieldType name=boolean class=solr.BoolField
: sortMissingLast=true/
: 
: fieldType name=int class=solr.TrieIntField precisionStep=0
: positionIncrementGap=0/
: fieldType name=float class=solr.TrieFloatField precisionStep=0
: positionIncrementGap=0/
: fieldType name=long class=solr.TrieLongField precisionStep=0
: positionIncrementGap=0/
: fieldType name=double class=solr.TrieDoubleField precisionStep=0
: positionIncrementGap=0/
: fieldType name=tint class=solr.TrieIntField precisionStep=8
: positionIncrementGap=0/
: fieldType name=tfloat class=solr.TrieFloatField precisionStep=8
: positionIncrementGap=0/
: fieldType name=tlong class=solr.TrieLongField precisionStep=8
: positionIncrementGap=0/
: fieldType name=tdouble class=solr.TrieDoubleField precisionStep=8
: positionIncrementGap=0/
: fieldType name=date class=solr.TrieDateField precisionStep=0
: positionIncrementGap=0/
: fieldType name=tdate class=solr.TrieDateField precisionStep=6
: positionIncrementGap=0/
: fieldtype name=binary class=solr.BinaryField/
: fieldType name=random class=solr.RandomSortField indexed=true /
: fieldType name=text_general class=solr.TextField
: positionIncrementGap=100
:   analyzer type=index
: tokenizer class=solr.StandardTokenizerFactory/
: filter class=solr.StopFilterFactory ignoreCase=true
: words=stopwords.txt /
: filter class=solr.LowerCaseFilterFactory/
:   /analyzer
:   analyzer type=query
: tokenizer class=solr.StandardTokenizerFactory/
: filter class=solr.StopFilterFactory ignoreCase=true
: words=stopwords.txt /
: filter class=solr.SynonymFilterFactory synonyms=synonyms.txt
: ignoreCase=true expand=true/
: filter class=solr.LowerCaseFilterFactory/
:   /analyzer
: /fieldType
: 
: fieldType name=text_en class=solr.TextField
: positionIncrementGap=100
:   analyzer type=index
: tokenizer 

Re: Schema Parsing Failed: unknown field 'id' [Zookeeper, SolrCloud]

2014-09-22 Thread Erick Erickson
One other possibility in addition to Hoss' comments.
Did you load a version of your configs to ZooKeeper
sometime that didn't have these fields? I don't quite
know where the schema and solrconfig files came
from, but the fact that they're on a local disk says
nothing about what's in ZooKeeper. When you
follow the SolrCloud tutorial, the -Dbootstrap_confdir
loads the Solr configuration files up to ZK, and
thereafter any Solr starting up will use them
(assuming they're linked). So it's possible that you
uploaded something some time ago that you're using
every time you try to start SolrCloud.

P.S. You can pull them down from ZK with the
scripts in the example/scripts/cloud-scripts

FWIW,
Erick

On Mon, Sep 22, 2014 at 12:19 PM, Chris Hostetter
hossman_luc...@fucit.org wrote:

 : Thanks. There is definitely a field name=id .../ in each of the schemas.
 :
 : I am using 4.7.2.

 if this conig is working for you when you don't use zookeeper/hdfs then
 you must be using a newer version of Solr when you test w/ zk/hdfs


 4.8.0 is when the fields and type section tags were deprecated.

 in 4.7.x and earlier you *must* enclose all of your field and
 fieldType tags in the appropriate sections.

 See the 4.7.2 example configs and compare to yours.


 From the 4.8.0 upgrade notes...

 fields and types tags have been deprecated. There is no longer any
 reason to keep them in the schema file, they may be safely removed. This
 allows intermixing of fieldType, field and copyField definitions if
 desired. Currently, these tags are supported so either style may be
 implemented. TBD is whether they'll be deprecated formally for 5.0

 https://issues.apache.org/jira/browse/SOLR-5228



 :
 : Here is one of the *schema.xml* (the others are similar):
 :
 :
 : schema name=medline-citations version=1.5
 :field name=_version_ type=long indexed=true stored=true/
 :field name=_root_ type=string indexed=true stored=false/
 :field name=id type=string indexed=true stored=true
 : required=true multiValued=false /
 :field name=medline_journal_title type=text_en indexed=true
 : stored=true /
 :field name=medline_article_title type=text_en indexed=true
 : stored=true termVectors=true termPositions=true termOffsets=true/
 :field name=medline_pub_year type=int indexed=true stored=true /
 :field name=medline_author_lastname type=string indexed=true
 : stored=true multiValued=true/
 :field name=medline_author_forename type=string indexed=true
 : stored=true multiValued=true/
 :field name=medline_descriptor_name type=string indexed=true
 : stored=true multiValued=true docValues=true/
 :field name=medline_abstract_text type=text_en indexed=true
 : stored=true termVectors=true termPositions=true termOffsets=true/
 :field name=medline_e_id type=string indexed=true stored=true/
 :   field name=sentences type=text_en indexed=true stored=true
 : multiValued=true required=false /
 :   field name=genes type=string indexed=true stored=true
 : multiValued=true required=false /
 :   field name=phenotypes type=text_en indexed=true stored=true
 : multiValued=true required=false /
 :field name=catchall type=text_general indexed=true stored=false
 : multiValued=true/
 :field name=suggestions indexed=true multiValued=false
 : stored=true type=textSpell/
 :field name=medline_journal_title_facets indexed=true stored=false
 : type=string multiValued=true docValues=true/
 :
 :  uniqueKeyid/uniqueKey
 :
 :copyField source=medline_journal_title
 : dest=medline_journal_title_facets/
 :
 : fieldType class=solr.TextField name=textSpell
 : positionIncrementGap=100
 : analyzer
 :   tokenizer class=solr.KeywordTokenizerFactory/
 :   filter class=solr.LowerCaseFilterFactory/
 :/analyzer
 :   /fieldType
 :
 : fieldType name=string class=solr.StrField sortMissingLast=true /
 :
 : fieldType name=boolean class=solr.BoolField
 : sortMissingLast=true/
 :
 : fieldType name=int class=solr.TrieIntField precisionStep=0
 : positionIncrementGap=0/
 : fieldType name=float class=solr.TrieFloatField precisionStep=0
 : positionIncrementGap=0/
 : fieldType name=long class=solr.TrieLongField precisionStep=0
 : positionIncrementGap=0/
 : fieldType name=double class=solr.TrieDoubleField precisionStep=0
 : positionIncrementGap=0/
 : fieldType name=tint class=solr.TrieIntField precisionStep=8
 : positionIncrementGap=0/
 : fieldType name=tfloat class=solr.TrieFloatField precisionStep=8
 : positionIncrementGap=0/
 : fieldType name=tlong class=solr.TrieLongField precisionStep=8
 : positionIncrementGap=0/
 : fieldType name=tdouble class=solr.TrieDoubleField precisionStep=8
 : positionIncrementGap=0/
 : fieldType name=date class=solr.TrieDateField precisionStep=0
 : positionIncrementGap=0/
 : fieldType name=tdate class=solr.TrieDateField precisionStep=6
 : positionIncrementGap=0/
 : fieldtype name=binary class=solr.BinaryField/
 : fieldType name=random 

Re: Schema Parsing Failed: unknown field 'id' [Zookeeper, SolrCloud]

2014-09-22 Thread paulparsons
Thanks for the suggestions. I actually had both problems. I couldn't figure
out how to remove the configs from zookeeper through the cloud scripts, so I
just manually removed the files in the zookeeper data directory.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Schema-Parsing-Failed-unknown-field-id-Zookeeper-SolrCloud-tp4160478p4160580.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Schema Parsing Failed: unknown field 'id' [Zookeeper, SolrCloud]

2014-09-22 Thread Chris Hostetter

: out how to remove the configs from zookeeper through the cloud scripts, so I
: just manually removed the files in the zookeeper data directory.

https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files
https://cwiki.apache.org/confluence/display/solr/Command+Line+Utilities

Solr's zkcli.sh with -cmd putfile will replace a single file, or you can 
use -cmd upconfig to completley upload a new configset.



-Hoss
http://www.lucidworks.com/