Re: URLDataSource : indexing from other Solr servers

2014-05-16 Thread helder.sepulveda
I will try with the SolrEntityProcessor
 but I'm still intrested to know why will it not work with the
XPathEntityProcessor 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/URLDataSource-indexing-from-other-Solr-servers-tp4135321p4135730.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: URLDataSource : indexing from other Solr servers

2014-05-14 Thread helder.sepulveda
Here is the relevant portion of the schema:

fields
field name=sz_id type=string   indexed=true
stored=true/
field name=batch_address type=string indexed=false
stored=true/
field name=batch_citytype=string   indexed=false
stored=true/
field name=batch_state   type=string   indexed=false
stored=true/
field name=batch_zip type=string   indexed=false
stored=true/
field name=timestamp type=date indexed=false
stored=true /
/fields

Yes the URL is accessible, did you see my previous comment:
I tested calling the URL using curl right on the server, and I get a valid
response and the correct content.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/URLDataSource-indexing-from-other-Solr-servers-tp4135321p4135567.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: URLDataSource : indexing from other Solr servers

2014-05-13 Thread helder.sepulveda
Just in case the url is not available from outside my network, here is how
the url response looks like:


response
lst name=responseHeader
int name=status0/int
int name=QTime1007/int
lst name=params
str name=q*:*/str
/lst
/lst
result name=response numFound=89993613 start=0

doc
str name=address_combo1518 INDIANA CT, IRVING, TX/str
str name=air_conditioningCentral/str
int name=avm200600/int
float name=avm_confidence0.31/float
int name=avm_high230690/int
int name=avm_low170510/int
str name=basementNo Basement/str
str name=batch_address1518 INDIANA CT/str
str name=batch_cityIRVING/str
str name=batch_countryUS/str
str name=batch_stateTX/str
str name=batch_zip75060/str
float name=bath2.0/float
int name=bed4/int
str name=cbsa_labelDallas-Fort Worth-Arlington/str
str name=cityIRVING/str
str name=construction_typeFrame/str
str name=county_labelDallas/str
int name=delta_avm38300/int
date name=delta_avm_timestamp2014-03-11T00:00:01Z/date
int name=delta_home_score-6/int
date name=delta_home_score_timestamp2014-03-11T00:00:01Z/date
int name=delta_investor_score-12/int
date name=delta_investor_score_timestamp2014-03-11T00:00:01Z/date
float name=delta_tax_rate-3.0E-4/float
date name=delta_tax_rate_timestamp2013-07-10T00:00:01Z/date
int name=estimated_rent1550/int
str name=exterior_wallBrick veneer/str
str name=fireplace1/str
str name=foundationSlab/str
int name=garage4/int
str name=heatingCentral/str
int name=home_score29/int
float name=hpi146.7849/float
int name=investor_score38/int
date name=last_tran_date2010-01-13T00:00:01Z/date
int name=last_tran_price0/int
double name=lat32.79920959472656/double
str name=latlng_combo32.799209594726562,-96.926918029785156/str
double name=lng-96.92691802978516/double
str name=place_labelIRVING/str
str name=property_typeSFH/str
int name=sqft2348/int
long name=sqft_lot0/long
str name=stateTX/str
str name=state_labelTexas/str
str name=street_address1518 INDIANA CT/str
str name=street_nameINDIANA CT/str
str name=street_name_szINDIANA CT/str
str name=street_no_sz1518/str
long name=sz_id500018666323/long
float name=tax_rate0.0178/float
float name=taxes3893.0/float
str name=tract_labelIRVING 015000/str
int name=ttl_assessed0/int
int name=year_built2002/int
str name=zip75060/str
date name=timestamp2014-04-20T16:28:52.467Z/date
/doc

doc
str name=address_combo2600 ASH CRK, MESQUITE, TX/str
str name=air_conditioningCentral/str
int name=avm144200/int
float name=avm_confidence0.28/float
int name=avm_high165830/int
int name=avm_low122570/int
str name=basementNo Basement/str
str name=batch_address2600 ASH CREEK/str
str name=batch_cityMESQUITE/str
str name=batch_countryUS/str
str name=batch_stateTX/str
str name=batch_zip75181/str
float name=bath2.0/float
int name=bed4/int
str name=cbsa_labelDallas-Fort Worth-Arlington/str
str name=cityMESQUITE/str
str name=construction_typeFrame/str
str name=county_labelDallas/str
int name=delta_avm100/int
date name=delta_avm_timestamp2014-04-11T00:00:01Z/date
int name=delta_home_score-1/int
date name=delta_home_score_timestamp2014-03-11T00:00:01Z/date
int name=delta_investor_score-1/int
date name=delta_investor_score_timestamp2014-04-11T00:00:01Z/date
float name=delta_tax_rate-3.0E-4/float
date name=delta_tax_rate_timestamp2013-07-10T00:00:01Z/date
int name=estimated_rent1470/int
str name=exterior_wallBrick veneer/str
str name=fireplace1/str
str name=foundationSlab/str
int name=garage1/int
str name=heatingCentral/str
int name=home_score35/int
float name=hpi153.4116/float
int name=investor_score54/int
date name=last_tran_date2006-01-20T00:00:01Z/date
int name=last_tran_price0/int
double name=lat32.7484283447266/double
str name=latlng_combo32.7484283447266,-96.5575180053711/str
double name=lng-96.5575180053711/double
str name=place_labelMESQUITE/str
str name=property_typeSFH/str
int name=sqft2189/int
long name=sqft_lot0/long
str name=stateTX/str
str name=state_labelTexas/str
str name=street_address2600 ASH CRK/str
str name=street_nameASH CRK/str
str name=street_name_szASH CRK/str
str name=street_no_sz2600/str
long name=sz_id500018666324/long
float name=tax_rate0.0178/float
float name=taxes3345.0/float
str name=tract_labelMESQUITE 017304/str
int name=ttl_assessed0/int
int name=year_built1996/int
str name=zip75181/str
date name=timestamp2014-04-20T16:28:52.467Z/date
/doc

/result
/response





--
View this message in context: 
http://lucene.472066.n3.nabble.com/URLDataSource-indexing-from-other-Solr-servers-tp4135321p4135332.html
Sent from the Solr - User mailing list archive at Nabble.com.


URLDataSource : indexing from other Solr servers

2014-05-12 Thread helder.sepulveda
I been trying to index data from other solr servers but the import always
shows:
Indexing completed. Added/Updated: 0 documents. Deleted 0 documents.
Requests: 1, Fetched: 0, Skipped: 0, Processed

My data config looks like this:



Any help will be greatly appreciated



--
View this message in context: 
http://lucene.472066.n3.nabble.com/URLDataSource-indexing-from-other-Solr-servers-tp4135321.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: URLDataSource : indexing from other Solr servers

2014-05-12 Thread helder.sepulveda
Here is the data config:

dataConfig
dataSource type=URLDataSource /

document name=listingcore
entity name=listing pk=link
url=http://slszip11.as.homes.com/solr/select?q=*:*;
processor=XPathEntityProcessor
forEach=/response/result/doc
transformer=DateFormatTransformer
field column=batch_address  
xpath=/response/result/doc/str[@name='batch_address']/ 
field column=batch_state
xpath=/response/result/doc/str[@name='batch_state']/ 
field column=batch_city 
xpath=/response/result/doc/str[@name='batch_city']/ 
field column=batch_zip  
xpath=/response/result/doc/str[@name='batch_zip']/ 
field column=sz_id  
xpath=/response/result/doc/long[@name='sz_id']/ 
/entity
/document
/dataConfig






--
View this message in context: 
http://lucene.472066.n3.nabble.com/URLDataSource-indexing-from-other-Solr-servers-tp4135321p4135331.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: URLDataSource : indexing from other Solr servers

2014-05-12 Thread helder.sepulveda
I tested calling the URL using curl right on the server, and I get a valid
response and the correct content




--
View this message in context: 
http://lucene.472066.n3.nabble.com/URLDataSource-indexing-from-other-Solr-servers-tp4135321p4135333.html
Sent from the Solr - User mailing list archive at Nabble.com.