Hey,

Sorry for the delay, I had to enable larger head buffers in jetty to do this as a GET query (LOL). Anyway, I have put the results on pastebin to try and make it more presenable, though it's mostly failed.

1st Query: http://pastebin.com/uSGtQjA3 (query with a freshly started solr) 2nd Query: http://pastebin.com/4NbSdEHC (as before, just the same query again)

Seemingly, the slowness happens in 'processing'. But yeah, i'm sure you guys would better understand all of that :)

Cheers,

David

On 14/12/2012 11:13 PM, Markus Jelsma wrote:
Hi,

This is insane indeed! Please enable debugging and report the prepare and 
process times for the query component. I think the prepare time is very high in 
both queries and the process time is slightly less for the second query due to 
caching.

Cheers,

-----Original message-----
From:David Radunz <david.rad...@vimtura.com>
Sent: Fri 14-Dec-2012 13:04
To: solr-user@lucene.apache.org
Subject: Performance improvement in large OR query using boosting (also, cache 
doesn't work?)

Hey Guys,

      I have really been enjoying Solr and I can't really blame the
slowness on solr as this is a pretty insane query. However, I am a
little curious why a repeated query moments later also suffers from the
same load time? Anyway, the queries are:

// 1st Query

INFO: [] webapp=/solr path=/select/
params={facet=on&fl=id,name,url_path,url_key,price,special_price,small_image,thumbnail,sku,stock_qty,release_date,tax_class_id&sort=score+desc,retail_rating+desc,release_date+desc,year_made+desc&start=&q=**+-sku:"1029996"+-movie_id:"2665"+(series_names_attr_opt_id:"426317"^900000000000+OR+cat_id:"307"^10000000+OR+cat_id:"308"^10000000+OR+matching_genres:"Science+Fiction"^20000000+OR+matching_genres:"Action"^10000000+OR+matching_genres:"Thriller"^8000000+OR+matching_keywords:"superhero+team"^4000000+OR+matching_keywords:"superhero"^4000000+OR+matching_keywords:"superheroine"^3000000+OR+matching_keywords:"marvel+comic"^2000000+OR+matching_keywords:"costumed+hero"^1000000+OR+matching_keywords:"alien+life-form"^1000000+OR+matching_keywords:"thor"^1000000+OR+matching_keywords:"captain+america"^1000000+OR+matching_keywords:"the+incredible+hulk"^1000000+OR+matching_keywords:"iron+man"^1000000+OR+matching_keywords:"shape+shifting+alien"^500000+OR+matching_keywords:"worl
  
d+domination"^500000+OR+matching_keywords:"human+alien"^500000+OR+matching_keywords:"alien+invasion"^250000+OR+matching_keywords:"super+strength"^250000+OR+matching_keywords:"invisibility+cloak"^100000+OR+matching_keywords:"warrior+race"^100000+OR+matching_keywords:"alien+race"^50000+OR+matching_keywords:"super+speed"^50000+OR+matching_keywords:"flying+fortress"^50000+OR+matching_keywords:"teleportation"^50000+OR+matching_keywords:"creature"^50000+OR+matching_keywords:"electromagnetic+pulse"^50000+OR+matching_keywords:"immortality"^50000+OR+matching_keywords:"mothership"^50000+OR+matching_keywords:"mind+control"^50000+OR+matching_keywords:"god"^50000+OR+matching_keywords:"inventor"^50000+OR+matching_keywords:"space+travel"^50000+OR+matching_keywords:"fictional+government+agency"^50000+OR+matching_keywords:"beautiful+woman"^50000+OR+matching_keywords:"based+on+comic+book"^50000+OR+matching_keywords:"army"^50000+OR+matching_keywords:"blockbuster"^50000+OR+matching_keywords:"me
  
rcenary"^50000+OR+matching_keywords:"martial+arts"^50000+OR+matching_keywords:"shield"^50000+OR+matching_keywords:"captain"^50000+OR+matching_keywords:"shot+in+the+head"^50000+OR+matching_keywords:"shootout"^50000+OR+matching_keywords:"flashback"^50000+OR+matching_keywords:"pistol"^50000+OR+matching_keywords:"airplane"^50000+OR+matching_keywords:"helmet"^50000+OR+matching_keywords:"car+accident"^50000+OR+matching_keywords:"body+landing+on+a+car"^50000+OR+matching_keywords:"spear"^50000+OR+matching_keywords:"laboratory"^50000+OR+matching_keywords:"warrior+woman"^50000+OR+matching_keywords:"punching+bag"^50000+OR+matching_keywords:"banquet"^50000+OR+matching_keywords:"macguffin"^50000+OR+matching_keywords:"mission"^50000+OR+matching_keywords:"attack"^50000+OR+matching_keywords:"hand+to+hand+combat"^50000+OR+matching_keywords:"police+officer"^50000+OR+matching_keywords:"robot"^50000+OR+matching_keywords:"disguise"^50000+OR+matching_keywords:"beating"^50000+OR+matching_keywords:
  
"falling+from+height"^50000+OR+matching_keywords:"government+agent"^50000+OR+matching_keywords:"battleship"^50000+OR+matching_keywords:"parking+garage"^50000+OR+matching_keywords:"head+butt"^50000+OR+matching_keywords:"forest"^50000+OR+matching_keywords:"crushed+to+death"^50000+OR+matching_keywords:"deception"^50000+OR+matching_keywords:"philanthropist"^50000+OR+matching_keywords:"knife+fight"^50000+OR+matching_keywords:"portal"^50000+OR+matching_keywords:"knife"^50000+OR+matching_keywords:"underwater+scene"^50000+OR+matching_keywords:"exploding+plane"^50000+OR+matching_keywords:"robot+suit"^50000+OR+matching_keywords:"outer+space"^50000+OR+matching_keywords:"stabbed+in+the+stomach"^50000+OR+matching_keywords:"bodyguard"^50000+OR+matching_keywords:"disaster+in+new+york"^50000+OR+matching_keywords:"shot+in+the+chest"^50000+OR+matching_keywords:"security+camera"^50000+OR+matching_keywords:"rocket+launcher"^50000+OR+matching_keywords:"tough+guy"^50000+OR+matching_keywords:"secr
  
etary"^50000+OR+matching_keywords:"monster"^50000+OR+matching_keywords:"elevator"^50000+OR+matching_keywords:"severed+arm"^50000+OR+matching_keywords:"revenge"^50000+OR+matching_keywords:"missile"^50000+OR+matching_keywords:"kneeling"^50000+OR+matching_keywords:"brawl"^50000+OR+matching_keywords:"russian"^50000+OR+matching_keywords:"scientist"^50000+OR+matching_keywords:"super+computer"^50000+OR+matching_keywords:"assault+rifle"^50000+OR+matching_keywords:"adopted+brother"^50000+OR+matching_keywords:"villain+arrested"^50000+OR+matching_keywords:"man+punching+a+woman"^50000+OR+matching_keywords:"soldier"^50000+OR+matching_keywords:"national+guard"^50000+OR+matching_keywords:"hammer"^50000+OR+matching_keywords:"chase"^50000+OR+matching_keywords:"thrown+through+a+wall"^50000+OR+matching_keywords:"woman+punching+a+man"^50000+OR+matching_keywords:"bank"^50000+OR+matching_keywords:"super+soldier"^50000+OR+matching_keywords:"battle"^50000+OR+matching_keywords:"brought+to+justice"^5
  
0000+OR+matching_keywords:"helicopter+crash"^50000+OR+matching_keywords:"costume"^50000+OR+matching_keywords:"eye+patch"^50000+OR+matching_keywords:"brother+brother+relationship"^50000+OR+matching_keywords:"lightning"^50000+OR+matching_keywords:"evacuation"^50000+OR+matching_keywords:"billionaire"^50000+OR+matching_keywords:"hit+with+a+hammer"^50000+OR+matching_keywords:"returning+character+killed+off"^50000+OR+matching_keywords:"demi+god"^50000+OR+matching_keywords:"combat"^50000+OR+matching_keywords:"fighter+pilot"^50000+OR+matching_keywords:"evil+sorcerer"^50000+OR+matching_keywords:"cameo"^50000+OR+matching_keywords:"exploding+body"^50000+OR+matching_keywords:"car+crash"^50000+OR+matching_keywords:"secret+agent"^50000+OR+matching_keywords:"fist+fight"^50000+OR+matching_keywords:"giant"^50000+OR+matching_keywords:"slum"^50000+OR+matching_keywords:"bow+and+arrow"^50000+OR+matching_keywords:"fish+out+of+water"^50000+OR+matching_keywords:"redemption"^50000+OR+matching_keywor
  
ds:"spy"^50000+OR+matching_keywords:"archer"^50000+OR+matching_keywords:"stabbed+to+death"^50000+OR+matching_keywords:"nuclear+missile"^50000+OR+matching_keywords:"hostage"^50000+OR+matching_keywords:"action+heroine"^50000+OR+matching_keywords:"lens+flare"^50000+OR+matching_keywords:"hydra"^50000+OR+matching_keywords:"guilt"^50000+OR+matching_keywords:"world+war+two+veteran"^50000+OR+matching_keywords:"alien+attack"^50000+OR+matching_keywords:"parachute"^50000+OR+matching_keywords:"thunder"^50000+OR+matching_keywords:"rescue+mission"^50000+OR+matching_keywords:"brooklyn+bridge"^50000+OR+matching_keywords:"jumping+from+an+airplane"^50000+OR+matching_keywords:"aircraft+carrier"^50000+OR+matching_keywords:"german"^50000+OR+matching_keywords:"long+take"^50000+OR+matching_keywords:"cube"^50000+OR+matching_keywords:"exploding+truck"^50000+OR+matching_keywords:"kolkata+india"^50000+OR+matching_keywords:"cell+phone"^50000+OR+matching_keywords:"dual+wield"^50000+OR+matching_keywords:
  
"american+abroad"^50000+OR+matching_keywords:"mask"^50000+OR+matching_keywords:"female+killer"^50000+OR+matching_keywords:"bomb"^50000+OR+matching_keywords:"sorcerer"^50000+OR+matching_keywords:"secret+government+organisation"^50000+OR+matching_keywords:"surveillance"^50000+OR+matching_keywords:"high+tech"^50000+OR+matching_keywords:"beaten+to+death"^50000+OR+matching_keywords:"reference+to+stephen+hawking"^50000+OR+matching_keywords:"nuclear+explosion"^50000+OR+matching_keywords:"rivalry"^50000+OR+matching_keywords:"supernatural+powers"^50000+OR+matching_keywords:"one+eyed+man"^50000+OR+matching_keywords:"arrest"^50000+OR+matching_keywords:"hit+by+car"^50000+OR+matching_keywords:"explosion"^50000+OR+matching_keywords:"spaceship"^50000+OR+matching_keywords:"female+spy"^50000+OR+matching_keywords:"forcefield"^50000+OR+matching_keywords:"gymnasium"^50000+OR+matching_keywords:"good+versus+evil"^50000+OR+matching_keywords:"shot+in+the+face"^50000+OR+matching_keywords:"blood"^500
  
00+OR+matching_keywords:"eye+gouging"^50000+OR+matching_keywords:"cat+suit"^50000+OR+matching_keywords:"sabotage"^50000+OR+matching_keywords:"interrogation"^50000+OR+matching_keywords:"humanity+in+peril"^50000+OR+matching_keywords:"cnn+reporter"^50000+OR+matching_keywords:"prisoner"^50000+OR+matching_keywords:"hit+with+a+chair"^50000+OR+matching_keywords:"stabbed+in+the+chest"^50000+OR+matching_keywords:"scepter"^50000+OR+matching_keywords:"action+hero"^50000+OR+matching_keywords:"plane+crash"^50000+OR+matching_keywords:"escape"^50000+OR+matching_keywords:"walkie+talkie"^50000+OR+matching_keywords:"transformation"^50000+OR+matching_keywords:"fighter+jet"^50000+OR+matching_keywords:"rocket"^50000+OR+matching_keywords:"exploding+car"^50000+OR+matching_keywords:"news+report"^50000+OR+matching_keywords:"gatling+gun"^50000+OR+matching_keywords:"orchestra"^50000+OR+matching_keywords:"wormhole"^50000+OR+matching_keywords:"lasersight"^50000+OR+matching_keywords:"laser"^50000+OR+matc
  
hing_keywords:"fighting+in+the+air"^50000+OR+matching_keywords:"war+veteran"^50000+OR+matching_keywords:"masked+hero"^50000+OR+matching_keywords:"fictional+war"^50000+OR+matching_keywords:"female+assassin"^50000+OR+matching_keywords:"war+hero"^50000+OR+matching_keywords:"mixed+martial+arts"^50000+OR+matching_keywords:"shapeshifting"^50000+OR+matching_keywords:"female+agent"^50000+OR+matching_keywords:"exploding+bus"^50000+OR+matching_keywords:"eye+scanning"^50000+OR+matching_keywords:"machinegun"^50000+OR+matching_keywords:"laser+gun"^50000+OR+matching_keywords:"electrocution"^50000+OR+matching_keywords:"title+appears+in+text"^50000+OR+matching_keywords:"super+villain"^50000+OR+matching_keywords:"ejector+seat"^50000+OR+matching_keywords:"impalement"^50000+OR+matching_keywords:"artificial+intelligence"^50000+OR+matching_keywords:"manipulation"^50000+OR+matching_keywords:"car+chase"^50000+OR+matching_keywords:"technology"^50000+OR+matching_keywords:"grenade"^50000+OR+matching_
  
keywords:"masked+man"^50000+OR+matching_keywords:"fight"^50000+OR+matching_keywords:"manhattan+new+york+city"^50000+OR+matching_keywords:"ex+soldier"^50000+OR+matching_keywords:"rescue"^50000+OR+matching_keywords:"shot+to+death"^50000+OR+matching_keywords:"shot+in+the+throat"^50000+OR+matching_keywords:"warrior"^50000+OR+matching_keywords:"held+at+gunpoint"^50000+OR+matching_keywords:"betrayal"^50000+OR+matching_keywords:"fighting+brothers"^50000+OR+matching_keywords:"drone"^50000+OR+matching_keywords:"critically+acclaimed"^50000+OR+matching_keywords:"hologram"^50000+OR+matching_keywords:"stabbed+in+the+back"^50000+OR+matching_keywords:"death+of+friend"^50000+OR+directors_attr_opt_id:"389553"^20+OR+writers_attr_opt_id:"389555"^10+OR+writers_attr_opt_id:"386357"^10+OR+writers_attr_opt_id:"433326"^10+OR+writers_attr_opt_id:"418867"^10+OR+producers_attr_opt_id:"414426"^10+OR+producers_attr_opt_id:"374643"^10+OR+producers_attr_opt_id:"435974"^10+OR+producers_attr_opt_id:"453901"
  
^10+OR+producers_attr_opt_id:"453902"^10+OR+producers_attr_opt_id:"435975"^10+OR+producers_attr_opt_id:"413760"^10+OR+actors_attr_opt_id:"378011"^50+OR+actors_attr_opt_id:"393240"^50+OR+actors_attr_opt_id:"380532"^50+OR+actors_attr_opt_id:"381965"^50+OR+actors_attr_opt_id:"374641"^5+OR+actors_attr_opt_id:"380065"^5+OR+actors_attr_opt_id:"378007"^5+OR+actors_attr_opt_id:"375604"^5+OR+actors_attr_opt_id:"384913"^5+OR+actors_attr_opt_id:"374116"^5+OR+actors_attr_opt_id:"389785"^5+OR+actors_attr_opt_id:"431500"^5+OR+actors_attr_opt_id:"375806"^5+OR+actors_attr_opt_id:"388110"^5+OR+actors_attr_opt_id:"386208"^5+OR+actors_attr_opt_id:"456229"^5+OR+actors_attr_opt_id:"372628"^5+OR+actors_attr_opt_id:"387507"^5+OR+actors_attr_opt_id:"391970"^5+OR+actors_attr_opt_id:"456230"^5+OR+actors_attr_opt_id:"386655"^5+OR+actors_attr_opt_id:"385701"^5+OR+actors_attr_opt_id:"381993"^5+OR+actors_attr_opt_id:"456231"^5+OR+actors_attr_opt_id:"403517"^5+OR+actors_attr_opt_id:"456232"^5+OR+actors_at
  
tr_opt_id:"451976"^5+OR+year_made:[2010+TO+2014]^500)&wt=php&fq=website_id:"1"+AND+avail_status_attr_opt_id:"available"+AND+(format_attr_opt_id:"372745")&rows=4}
hits=2319 status=0 QTime=1095

// 2nd Query (exactly the same, included to show QTime)

INFO: [] webapp=/solr path=/select/
params={facet=on&fl=id,name,url_path,url_key,price,special_price,small_image,thumbnail,sku,stock_qty,release_date,tax_class_id&sort=score+desc,retail_rating+desc,release_date+desc,year_made+desc&start=&q=**+-sku:"1029996"+-movie_id:"2665"+(series_names_attr_opt_id:"426317"^900000000000+OR+cat_id:"307"^10000000+OR+cat_id:"308"^10000000+OR+matching_genres:"Science+Fiction"^20000000+OR+matching_genres:"Action"^10000000+OR+matching_genres:"Thriller"^8000000+OR+matching_keywords:"superhero+team"^4000000+OR+matching_keywords:"superhero"^4000000+OR+matching_keywords:"superheroine"^3000000+OR+matching_keywords:"marvel+comic"^2000000+OR+matching_keywords:"costumed+hero"^1000000+OR+matching_keywords:"alien+life-form"^1000000+OR+matching_keywords:"thor"^1000000+OR+matching_keywords:"captain+america"^1000000+OR+matching_keywords:"the+incredible+hulk"^1000000+OR+matching_keywords:"iron+man"^1000000+OR+matching_keywords:"shape+shifting+alien"^500000+OR+matching_keywords:"worl
  
d+domination"^500000+OR+matching_keywords:"human+alien"^500000+OR+matching_keywords:"alien+invasion"^250000+OR+matching_keywords:"super+strength"^250000+OR+matching_keywords:"invisibility+cloak"^100000+OR+matching_keywords:"warrior+race"^100000+OR+matching_keywords:"alien+race"^50000+OR+matching_keywords:"super+speed"^50000+OR+matching_keywords:"flying+fortress"^50000+OR+matching_keywords:"teleportation"^50000+OR+matching_keywords:"creature"^50000+OR+matching_keywords:"electromagnetic+pulse"^50000+OR+matching_keywords:"immortality"^50000+OR+matching_keywords:"mothership"^50000+OR+matching_keywords:"mind+control"^50000+OR+matching_keywords:"god"^50000+OR+matching_keywords:"inventor"^50000+OR+matching_keywords:"space+travel"^50000+OR+matching_keywords:"fictional+government+agency"^50000+OR+matching_keywords:"beautiful+woman"^50000+OR+matching_keywords:"based+on+comic+book"^50000+OR+matching_keywords:"army"^50000+OR+matching_keywords:"blockbuster"^50000+OR+matching_keywords:"me
  
rcenary"^50000+OR+matching_keywords:"martial+arts"^50000+OR+matching_keywords:"shield"^50000+OR+matching_keywords:"captain"^50000+OR+matching_keywords:"shot+in+the+head"^50000+OR+matching_keywords:"shootout"^50000+OR+matching_keywords:"flashback"^50000+OR+matching_keywords:"pistol"^50000+OR+matching_keywords:"airplane"^50000+OR+matching_keywords:"helmet"^50000+OR+matching_keywords:"car+accident"^50000+OR+matching_keywords:"body+landing+on+a+car"^50000+OR+matching_keywords:"spear"^50000+OR+matching_keywords:"laboratory"^50000+OR+matching_keywords:"warrior+woman"^50000+OR+matching_keywords:"punching+bag"^50000+OR+matching_keywords:"banquet"^50000+OR+matching_keywords:"macguffin"^50000+OR+matching_keywords:"mission"^50000+OR+matching_keywords:"attack"^50000+OR+matching_keywords:"hand+to+hand+combat"^50000+OR+matching_keywords:"police+officer"^50000+OR+matching_keywords:"robot"^50000+OR+matching_keywords:"disguise"^50000+OR+matching_keywords:"beating"^50000+OR+matching_keywords:
  
"falling+from+height"^50000+OR+matching_keywords:"government+agent"^50000+OR+matching_keywords:"battleship"^50000+OR+matching_keywords:"parking+garage"^50000+OR+matching_keywords:"head+butt"^50000+OR+matching_keywords:"forest"^50000+OR+matching_keywords:"crushed+to+death"^50000+OR+matching_keywords:"deception"^50000+OR+matching_keywords:"philanthropist"^50000+OR+matching_keywords:"knife+fight"^50000+OR+matching_keywords:"portal"^50000+OR+matching_keywords:"knife"^50000+OR+matching_keywords:"underwater+scene"^50000+OR+matching_keywords:"exploding+plane"^50000+OR+matching_keywords:"robot+suit"^50000+OR+matching_keywords:"outer+space"^50000+OR+matching_keywords:"stabbed+in+the+stomach"^50000+OR+matching_keywords:"bodyguard"^50000+OR+matching_keywords:"disaster+in+new+york"^50000+OR+matching_keywords:"shot+in+the+chest"^50000+OR+matching_keywords:"security+camera"^50000+OR+matching_keywords:"rocket+launcher"^50000+OR+matching_keywords:"tough+guy"^50000+OR+matching_keywords:"secr
  
etary"^50000+OR+matching_keywords:"monster"^50000+OR+matching_keywords:"elevator"^50000+OR+matching_keywords:"severed+arm"^50000+OR+matching_keywords:"revenge"^50000+OR+matching_keywords:"missile"^50000+OR+matching_keywords:"kneeling"^50000+OR+matching_keywords:"brawl"^50000+OR+matching_keywords:"russian"^50000+OR+matching_keywords:"scientist"^50000+OR+matching_keywords:"super+computer"^50000+OR+matching_keywords:"assault+rifle"^50000+OR+matching_keywords:"adopted+brother"^50000+OR+matching_keywords:"villain+arrested"^50000+OR+matching_keywords:"man+punching+a+woman"^50000+OR+matching_keywords:"soldier"^50000+OR+matching_keywords:"national+guard"^50000+OR+matching_keywords:"hammer"^50000+OR+matching_keywords:"chase"^50000+OR+matching_keywords:"thrown+through+a+wall"^50000+OR+matching_keywords:"woman+punching+a+man"^50000+OR+matching_keywords:"bank"^50000+OR+matching_keywords:"super+soldier"^50000+OR+matching_keywords:"battle"^50000+OR+matching_keywords:"brought+to+justice"^5
  
0000+OR+matching_keywords:"helicopter+crash"^50000+OR+matching_keywords:"costume"^50000+OR+matching_keywords:"eye+patch"^50000+OR+matching_keywords:"brother+brother+relationship"^50000+OR+matching_keywords:"lightning"^50000+OR+matching_keywords:"evacuation"^50000+OR+matching_keywords:"billionaire"^50000+OR+matching_keywords:"hit+with+a+hammer"^50000+OR+matching_keywords:"returning+character+killed+off"^50000+OR+matching_keywords:"demi+god"^50000+OR+matching_keywords:"combat"^50000+OR+matching_keywords:"fighter+pilot"^50000+OR+matching_keywords:"evil+sorcerer"^50000+OR+matching_keywords:"cameo"^50000+OR+matching_keywords:"exploding+body"^50000+OR+matching_keywords:"car+crash"^50000+OR+matching_keywords:"secret+agent"^50000+OR+matching_keywords:"fist+fight"^50000+OR+matching_keywords:"giant"^50000+OR+matching_keywords:"slum"^50000+OR+matching_keywords:"bow+and+arrow"^50000+OR+matching_keywords:"fish+out+of+water"^50000+OR+matching_keywords:"redemption"^50000+OR+matching_keywor
  
ds:"spy"^50000+OR+matching_keywords:"archer"^50000+OR+matching_keywords:"stabbed+to+death"^50000+OR+matching_keywords:"nuclear+missile"^50000+OR+matching_keywords:"hostage"^50000+OR+matching_keywords:"action+heroine"^50000+OR+matching_keywords:"lens+flare"^50000+OR+matching_keywords:"hydra"^50000+OR+matching_keywords:"guilt"^50000+OR+matching_keywords:"world+war+two+veteran"^50000+OR+matching_keywords:"alien+attack"^50000+OR+matching_keywords:"parachute"^50000+OR+matching_keywords:"thunder"^50000+OR+matching_keywords:"rescue+mission"^50000+OR+matching_keywords:"brooklyn+bridge"^50000+OR+matching_keywords:"jumping+from+an+airplane"^50000+OR+matching_keywords:"aircraft+carrier"^50000+OR+matching_keywords:"german"^50000+OR+matching_keywords:"long+take"^50000+OR+matching_keywords:"cube"^50000+OR+matching_keywords:"exploding+truck"^50000+OR+matching_keywords:"kolkata+india"^50000+OR+matching_keywords:"cell+phone"^50000+OR+matching_keywords:"dual+wield"^50000+OR+matching_keywords:
  
"american+abroad"^50000+OR+matching_keywords:"mask"^50000+OR+matching_keywords:"female+killer"^50000+OR+matching_keywords:"bomb"^50000+OR+matching_keywords:"sorcerer"^50000+OR+matching_keywords:"secret+government+organisation"^50000+OR+matching_keywords:"surveillance"^50000+OR+matching_keywords:"high+tech"^50000+OR+matching_keywords:"beaten+to+death"^50000+OR+matching_keywords:"reference+to+stephen+hawking"^50000+OR+matching_keywords:"nuclear+explosion"^50000+OR+matching_keywords:"rivalry"^50000+OR+matching_keywords:"supernatural+powers"^50000+OR+matching_keywords:"one+eyed+man"^50000+OR+matching_keywords:"arrest"^50000+OR+matching_keywords:"hit+by+car"^50000+OR+matching_keywords:"explosion"^50000+OR+matching_keywords:"spaceship"^50000+OR+matching_keywords:"female+spy"^50000+OR+matching_keywords:"forcefield"^50000+OR+matching_keywords:"gymnasium"^50000+OR+matching_keywords:"good+versus+evil"^50000+OR+matching_keywords:"shot+in+the+face"^50000+OR+matching_keywords:"blood"^500
  
00+OR+matching_keywords:"eye+gouging"^50000+OR+matching_keywords:"cat+suit"^50000+OR+matching_keywords:"sabotage"^50000+OR+matching_keywords:"interrogation"^50000+OR+matching_keywords:"humanity+in+peril"^50000+OR+matching_keywords:"cnn+reporter"^50000+OR+matching_keywords:"prisoner"^50000+OR+matching_keywords:"hit+with+a+chair"^50000+OR+matching_keywords:"stabbed+in+the+chest"^50000+OR+matching_keywords:"scepter"^50000+OR+matching_keywords:"action+hero"^50000+OR+matching_keywords:"plane+crash"^50000+OR+matching_keywords:"escape"^50000+OR+matching_keywords:"walkie+talkie"^50000+OR+matching_keywords:"transformation"^50000+OR+matching_keywords:"fighter+jet"^50000+OR+matching_keywords:"rocket"^50000+OR+matching_keywords:"exploding+car"^50000+OR+matching_keywords:"news+report"^50000+OR+matching_keywords:"gatling+gun"^50000+OR+matching_keywords:"orchestra"^50000+OR+matching_keywords:"wormhole"^50000+OR+matching_keywords:"lasersight"^50000+OR+matching_keywords:"laser"^50000+OR+matc
  
hing_keywords:"fighting+in+the+air"^50000+OR+matching_keywords:"war+veteran"^50000+OR+matching_keywords:"masked+hero"^50000+OR+matching_keywords:"fictional+war"^50000+OR+matching_keywords:"female+assassin"^50000+OR+matching_keywords:"war+hero"^50000+OR+matching_keywords:"mixed+martial+arts"^50000+OR+matching_keywords:"shapeshifting"^50000+OR+matching_keywords:"female+agent"^50000+OR+matching_keywords:"exploding+bus"^50000+OR+matching_keywords:"eye+scanning"^50000+OR+matching_keywords:"machinegun"^50000+OR+matching_keywords:"laser+gun"^50000+OR+matching_keywords:"electrocution"^50000+OR+matching_keywords:"title+appears+in+text"^50000+OR+matching_keywords:"super+villain"^50000+OR+matching_keywords:"ejector+seat"^50000+OR+matching_keywords:"impalement"^50000+OR+matching_keywords:"artificial+intelligence"^50000+OR+matching_keywords:"manipulation"^50000+OR+matching_keywords:"car+chase"^50000+OR+matching_keywords:"technology"^50000+OR+matching_keywords:"grenade"^50000+OR+matching_
  
keywords:"masked+man"^50000+OR+matching_keywords:"fight"^50000+OR+matching_keywords:"manhattan+new+york+city"^50000+OR+matching_keywords:"ex+soldier"^50000+OR+matching_keywords:"rescue"^50000+OR+matching_keywords:"shot+to+death"^50000+OR+matching_keywords:"shot+in+the+throat"^50000+OR+matching_keywords:"warrior"^50000+OR+matching_keywords:"held+at+gunpoint"^50000+OR+matching_keywords:"betrayal"^50000+OR+matching_keywords:"fighting+brothers"^50000+OR+matching_keywords:"drone"^50000+OR+matching_keywords:"critically+acclaimed"^50000+OR+matching_keywords:"hologram"^50000+OR+matching_keywords:"stabbed+in+the+back"^50000+OR+matching_keywords:"death+of+friend"^50000+OR+directors_attr_opt_id:"389553"^20+OR+writers_attr_opt_id:"389555"^10+OR+writers_attr_opt_id:"386357"^10+OR+writers_attr_opt_id:"433326"^10+OR+writers_attr_opt_id:"418867"^10+OR+producers_attr_opt_id:"414426"^10+OR+producers_attr_opt_id:"374643"^10+OR+producers_attr_opt_id:"435974"^10+OR+producers_attr_opt_id:"453901"
  
^10+OR+producers_attr_opt_id:"453902"^10+OR+producers_attr_opt_id:"435975"^10+OR+producers_attr_opt_id:"413760"^10+OR+actors_attr_opt_id:"378011"^50+OR+actors_attr_opt_id:"393240"^50+OR+actors_attr_opt_id:"380532"^50+OR+actors_attr_opt_id:"381965"^50+OR+actors_attr_opt_id:"374641"^5+OR+actors_attr_opt_id:"380065"^5+OR+actors_attr_opt_id:"378007"^5+OR+actors_attr_opt_id:"375604"^5+OR+actors_attr_opt_id:"384913"^5+OR+actors_attr_opt_id:"374116"^5+OR+actors_attr_opt_id:"389785"^5+OR+actors_attr_opt_id:"431500"^5+OR+actors_attr_opt_id:"375806"^5+OR+actors_attr_opt_id:"388110"^5+OR+actors_attr_opt_id:"386208"^5+OR+actors_attr_opt_id:"456229"^5+OR+actors_attr_opt_id:"372628"^5+OR+actors_attr_opt_id:"387507"^5+OR+actors_attr_opt_id:"391970"^5+OR+actors_attr_opt_id:"456230"^5+OR+actors_attr_opt_id:"386655"^5+OR+actors_attr_opt_id:"385701"^5+OR+actors_attr_opt_id:"381993"^5+OR+actors_attr_opt_id:"456231"^5+OR+actors_attr_opt_id:"403517"^5+OR+actors_attr_opt_id:"456232"^5+OR+actors_at
  
tr_opt_id:"451976"^5+OR+year_made:[2010+TO+2014]^500)&wt=php&fq=website_id:"1"+AND+avail_status_attr_opt_id:"available"+AND+(format_attr_opt_id:"372745")&rows=4}
hits=2319 status=0 QTime=713


      As you may have guessed what I am trying to do is produce a dynamic
related products list based on keywords and other things. Now, this
seems to work really well - but as you can see it's very slow. As you
might also notice the boost figure gradually decreases for each type
(which is configurable, like 1st keyword might have 1000, the next one
900, the next 800, the next 700.. and so on.. then the rest say 200 --
so it matches the most appropriate result.. being ones with higher rated
keywords/genres to this one). This kind of needs to happen like this
because we have 30,000 products and some products can have up to 200
keywords. As I said, it works pretty well -- just slow :(

Is there anything I can do to improve the load time? Also, any ideas why
the second query is about as slow as the first?

Thanks heaps,

David




Reply via email to