Hi all,
We encountered slow response times when querying solr with additional raw
queries.
The response times decrease by a factor of 10 after deleting and rebuilding the
index from scratch. After some minor modifications , the queries response times
increase by a factor of 10 again.
Some information:
* solr index size is about 7GB
* 3,1 Mio documents
* Document/filter cache seem to be correctly used (hit count increases when
we execute the same query twice)
* We can't use the result query cache for our query (see below)
* q: containers:80
* fq: (createdBy:106 assetStatus:0) ((allowPermissions:80
allowPermissions:22 allowPermissions:106) -assetStatus:0)
* rows: 100
* 20 Raw query parameters ( e.g
qq_viewFieldPermission_customFields_202={!v='(((viewFieldPermission_customFields_202:80
viewFieldPermission_customFields_202:22
viewFieldPermission_customFields_202:106)))'})
* 20 additional fl values for raw query parameters ( e.g
permission_customFields_date_202:exists(query($qq_viewFieldPermission_customFields_202))
)
* wt: json ( but xml does not make a difference)
Request:
<solr>/solr/assets/select?fl=id%2Cname%2Cpermission_customFields_date_200%3Aexists(query(%24qq_viewFieldPermission_customFields_200))%2Cpermission_customFields_date_201%3Aexists(query(%24qq_viewFieldPermission_customFields_201))%2Cpermission_customFields_date_202%3Aexists(query(%24qq_viewFieldPermission_customFields_202))%2Cpermission_customFields_date_207%3Aexists(query(%24qq_viewFieldPermission_customFields_207))%2Cpermission_customFields_date_208%3Aexists(query(%24qq_viewFieldPermission_customFields_208))%2Cpermission_customFields_date_209%3Aexists(query(%24qq_viewFieldPermission_customFields_209))%2Cpermission_customFields_date_216%3Aexists(query(%24qq_viewFieldPermission_customFields_216))%2Cpermission_customFields_date_217%3Aexists(query(%24qq_viewFieldPermission_customFields_217))%2Cpermission_customFields_date_218%3Aexists(query(%24qq_viewFieldPermission_customFields_218))%2Cpermission_customFields_date_219%3Aexists(query(%24qq_viewFieldPermission_customFields_219))%2Cpermission_customFields_date_222%3Aexists(query(%24qq_viewFieldPermission_customFields_222))%2Cpermission_customFields_date_223%3Aexists(query(%24qq_viewFieldPermission_customFields_223))%2Cpermission_customFields_date_160%3Aexists(query(%24qq_viewFieldPermission_customFields_160))%2Cpermission_customFields_date_224%3Aexists(query(%24qq_viewFieldPermission_customFields_224))%2Cpermission_customFields_date_225%3Aexists(query(%24qq_viewFieldPermission_customFields_225))%2Cpermission_customFields_date_226%3Aexists(query(%24qq_viewFieldPermission_customFields_226))%2Cpermission_customFields_date_100%3Aexists(query(%24qq_viewFieldPermission_customFields_100))%2Cpermission_customFields_date_231%3Aexists(query(%24qq_viewFieldPermission_customFields_231))%2Cpermission_customFields_date_170%3Aexists(query(%24qq_viewFieldPermission_customFields_170))%2Cpermission_customFields_date_235%3Aexists(query(%24qq_viewFieldPermission_customFields_235))&fq=(createdBy%3A106%20assetStatus%3A0)%20((allowPermissions%3A80%20allowPermissions%3A22%20allowPermissions%3A106)%20-assetStatus%3A0)&q=containers%3A80&qq_viewFieldPermission_customFields_100=%7B!v%3D%27(((viewFieldPermission_customFields_100%3A80%20viewFieldPermission_customFields_100%3A22%20viewFieldPermission_customFields_100%3A106)))%27%7D&qq_viewFieldPermission_customFields_110=%7B!v%3D%27(((viewFieldPermission_customFields_110%3A80%20viewFieldPermission_customFields_110%3A22%20viewFieldPermission_customFields_110%3A106)))%27%7D&qq_viewFieldPermission_customFields_120=%7B!v%3D%27(((viewFieldPermission_customFields_120%3A80%20viewFieldPermission_customFields_120%3A22%20viewFieldPermission_customFields_120%3A106)))%27%7D&qq_viewFieldPermission_customFields_130=%7B!v%3D%27(((viewFieldPermission_customFields_130%3A80%20viewFieldPermission_customFields_130%3A22%20viewFieldPermission_customFields_130%3A106)))%27%7D&qq_viewFieldPermission_customFields_160=%7B!v%3D%27(((viewFieldPermission_customFields_160%3A80%20viewFieldPermission_customFields_160%3A22%20viewFieldPermission_customFields_160%3A106)))%27%7D&qq_viewFieldPermission_customFields_170=%7B!v%3D%27(((viewFieldPermission_customFields_170%3A80%20viewFieldPermission_customFields_170%3A22%20viewFieldPermission_customFields_170%3A106)))%27%7D&qq_viewFieldPermission_customFields_180=%7B!v%3D%27(((viewFieldPermission_customFields_180%3A80%20viewFieldPermission_customFields_180%3A22%20viewFieldPermission_customFields_180%3A106)))%27%7D&qq_viewFieldPermission_customFields_190=%7B!v%3D%27(((viewFieldPermission_customFields_190%3A80%20viewFieldPermission_customFields_190%3A22%20viewFieldPermission_customFields_190%3A106)))%27%7D&qq_viewFieldPermission_customFields_200=%7B!v%3D%27(((viewFieldPermission_customFields_200%3A80%20viewFieldPermission_customFields_200%3A22%20viewFieldPermission_customFields_200%3A106)))%27%7D&qq_viewFieldPermission_customFields_201=%7B!v%3D%27(((viewFieldPermission_customFields_201%3A80%20viewFieldPermission_customFields_201%3A22%20viewFieldPermission_customFields_201%3A106)))%27%7D&qq_viewFieldPermission_customFields_202=%7B!v%3D%27(((viewFieldPermission_customFields_202%3A80%20viewFieldPermission_customFields_202%3A22%20viewFieldPermission_customFields_202%3A106)))%27%7D&qq_viewFieldPermission_customFields_207=%7B!v%3D%27(((viewFieldPermission_customFields_207%3A80%20viewFieldPermission_customFields_207%3A22%20viewFieldPermission_customFields_207%3A106)))%27%7D&qq_viewFieldPermission_customFields_208=%7B!v%3D%27(((viewFieldPermission_customFields_208%3A80%20viewFieldPermission_customFields_208%3A22%20viewFieldPermission_customFields_208%3A106)))%27%7D&qq_viewFieldPermission_customFields_209=%7B!v%3D%27(((viewFieldPermission_customFields_209%3A80%20viewFieldPermission_customFields_209%3A22%20viewFieldPermission_customFields_209%3A106)))%27%7D&qq_viewFieldPermission_customFields_216=%7B!v%3D%27(((viewFieldPermission_customFields_216%3A80%20viewFieldPermission_customFields_216%3A22%20viewFieldPermission_customFields_216%3A106)))%27%7D&qq_viewFieldPermission_customFields_217=%7B!v%3D%27(((viewFieldPermission_customFields_217%3A80%20viewFieldPermission_customFields_217%3A22%20viewFieldPermission_customFields_217%3A106)))%27%7D&qq_viewFieldPermission_customFields_218=%7B!v%3D%27(((viewFieldPermission_customFields_218%3A80%20viewFieldPermission_customFields_218%3A22%20viewFieldPermission_customFields_218%3A106)))%27%7D&qq_viewFieldPermission_customFields_219=%7B!v%3D%27(((viewFieldPermission_customFields_219%3A80%20viewFieldPermission_customFields_219%3A22%20viewFieldPermission_customFields_219%3A106)))%27%7D&qq_viewFieldPermission_customFields_222=%7B!v%3D%27(((viewFieldPermission_customFields_222%3A80%20viewFieldPermission_customFields_222%3A22%20viewFieldPermission_customFields_222%3A106)))%27%7D&qq_viewFieldPermission_customFields_223=%7B!v%3D%27(((viewFieldPermission_customFields_223%3A80%20viewFieldPermission_customFields_223%3A22%20viewFieldPermission_customFields_223%3A106)))%27%7D&qq_viewFieldPermission_customFields_224=%7B!v%3D%27(((viewFieldPermission_customFields_224%3A80%20viewFieldPermission_customFields_224%3A22%20viewFieldPermission_customFields_224%3A106)))%27%7D&qq_viewFieldPermission_customFields_225=%7B!v%3D%27(((viewFieldPermission_customFields_225%3A80%20viewFieldPermission_customFields_225%3A22%20viewFieldPermission_customFields_225%3A106)))%27%7D&qq_viewFieldPermission_customFields_226=%7B!v%3D%27(((viewFieldPermission_customFields_226%3A80%20viewFieldPermission_customFields_226%3A22%20viewFieldPermission_customFields_226%3A106)))%27%7D&qq_viewFieldPermission_customFields_231=%7B!v%3D%27(((viewFieldPermission_customFields_231%3A80%20viewFieldPermission_customFields_231%3A22%20viewFieldPermission_customFields_231%3A106)))%27%7D&qq_viewFieldPermission_customFields_235=%7B!v%3D%27(((viewFieldPermission_customFields_235%3A80%20viewFieldPermission_customFields_235%3A22%20viewFieldPermission_customFields_235%3A106)))%27%7D&qq_viewFieldPermission_customFields_236=%7B!v%3D%27(((viewFieldPermission_customFields_236%3A80%20viewFieldPermission_customFields_236%3A22%20viewFieldPermission_customFields_236%3A106)))%27%7D&qq_viewFieldPermission_customFields_237=%7B!v%3D%27(((viewFieldPermission_customFields_237%3A80%20viewFieldPermission_customFields_237%3A22%20viewFieldPermission_customFields_237%3A106)))%27%7D&qq_viewFieldPermission_customFields_238=%7B!v%3D%27(((viewFieldPermission_customFields_238%3A80%20viewFieldPermission_customFields_238%3A22%20viewFieldPermission_customFields_238%3A106)))%27%7D&qq_viewFieldPermission_customFields_241=%7B!v%3D%27(((viewFieldPermission_customFields_241%3A80%20viewFieldPermission_customFields_241%3A22%20viewFieldPermission_customFields_241%3A106)))%27%7D&qq_viewFieldPermission_customFields_242=%7B!v%3D%27(((viewFieldPermission_customFields_242%3A80%20viewFieldPermission_customFields_242%3A22%20viewFieldPermission_customFields_242%3A106)))%27%7D&rows=100&sort=id%20asc&start=300
When it is executed a second time the QTime is about 4 - 11 but the total
response time is about 15 seconds !!
[cid:[email protected]]
When it does NOT come from cache the QTime is about 1 second which seems
realistic (see below): But the total response time is 15 seconds and approx.
the same as above ( ~ 140 KB)!
{
"responseHeader":{
"status":0,
"QTime":914,
"params":{
"qq_viewFieldPermission_customFields_209":"{!v='(((viewFieldPermission_customFields_209:80
viewFieldPermission_customFields_209:22
viewFieldPermission_customFields_209:106)))'}",
"fl":"id,name,permission_customFields_date_200:exists(query($qq_viewFieldPermission_customFields_200)),permission_customFields_date_201:exists(query($qq_viewFieldPermission_customFields_201)),permission_customFields_date_202:exists(query($qq_viewFieldPermission_customFields_202)),permission_customFields_date_207:exists(query($qq_viewFieldPermission_customFields_207)),permission_customFields_date_208:exists(query($qq_viewFieldPermission_customFields_208)),permission_customFields_date_209:exists(query($qq_viewFieldPermission_customFields_209)),permission_customFields_date_216:exists(query($qq_viewFieldPermission_customFields_216)),permission_customFields_date_217:exists(query($qq_viewFieldPermission_customFields_217)),permission_customFields_date_218:exists(query($qq_viewFieldPermission_customFields_218)),permission_customFields_date_219:exists(query($qq_viewFieldPermission_customFields_219)),permission_customFields_date_222:exists(query($qq_viewFieldPermission_customFields_222)),permission_customFields_date_223:exists(query($qq_viewFieldPermission_customFields_223)),permission_customFields_date_160:exists(query($qq_viewFieldPermission_customFields_160)),permission_customFields_date_224:exists(query($qq_viewFieldPermission_customFields_224)),permission_customFields_date_225:exists(query($qq_viewFieldPermission_customFields_225)),permission_customFields_date_226:exists(query($qq_viewFieldPermission_customFields_226)),permission_customFields_date_100:exists(query($qq_viewFieldPermission_customFields_100)),permission_customFields_date_231:exists(query($qq_viewFieldPermission_customFields_231)),permission_customFields_date_170:exists(query($qq_viewFieldPermission_customFields_170)),permission_customFields_date_235:exists(query($qq_viewFieldPermission_customFields_235))",
"fq":"(createdBy:106 assetStatus:0) ((allowPermissions:80
allowPermissions:22 allowPermissions:106) -assetStatus:0)",
"qq_viewFieldPermission_customFields_170":"{!v='(((viewFieldPermission_customFields_170:80
viewFieldPermission_customFields_170:22
viewFieldPermission_customFields_170:106)))'}",
"qq_viewFieldPermission_customFields_190":"{!v='(((viewFieldPermission_customFields_190:80
viewFieldPermission_customFields_190:22
viewFieldPermission_customFields_190:106)))'}",
"qq_viewFieldPermission_customFields_130":"{!v='(((viewFieldPermission_customFields_130:80
viewFieldPermission_customFields_130:22
viewFieldPermission_customFields_130:106)))'}",
"qq_viewFieldPermission_customFields_110":"{!v='(((viewFieldPermission_customFields_110:80
viewFieldPermission_customFields_110:22
viewFieldPermission_customFields_110:106)))'}",
"qq_viewFieldPermission_customFields_231":"{!v='(((viewFieldPermission_customFields_231:80
viewFieldPermission_customFields_231:22
viewFieldPermission_customFields_231:106)))'}",
"qq_viewFieldPermission_customFields_236":"{!v='(((viewFieldPermission_customFields_236:80
viewFieldPermission_customFields_236:22
viewFieldPermission_customFields_236:106)))'}",
"qq_viewFieldPermission_customFields_237":"{!v='(((viewFieldPermission_customFields_237:80
viewFieldPermission_customFields_237:22
viewFieldPermission_customFields_237:106)))'}",
"qq_viewFieldPermission_customFields_235":"{!v='(((viewFieldPermission_customFields_235:80
viewFieldPermission_customFields_235:22
viewFieldPermission_customFields_235:106)))'}",
"qq_viewFieldPermission_customFields_218":"{!v='(((viewFieldPermission_customFields_218:80
viewFieldPermission_customFields_218:22
viewFieldPermission_customFields_218:106)))'}",
"qq_viewFieldPermission_customFields_219":"{!v='(((viewFieldPermission_customFields_219:80
viewFieldPermission_customFields_219:22
viewFieldPermission_customFields_219:106)))'}",
"qq_viewFieldPermission_customFields_216":"{!v='(((viewFieldPermission_customFields_216:80
viewFieldPermission_customFields_216:22
viewFieldPermission_customFields_216:106)))'}",
"qq_viewFieldPermission_customFields_238":"{!v='(((viewFieldPermission_customFields_238:80
viewFieldPermission_customFields_238:22
viewFieldPermission_customFields_238:106)))'}",
"qq_viewFieldPermission_customFields_217":"{!v='(((viewFieldPermission_customFields_217:80
viewFieldPermission_customFields_217:22
viewFieldPermission_customFields_217:106)))'}",
"debug":"true",
"start":"0",
"sort":"id asc",
"qq_viewFieldPermission_customFields_180":"{!v='(((viewFieldPermission_customFields_180:80
viewFieldPermission_customFields_180:22
viewFieldPermission_customFields_180:106)))'}",
"rows":"100",
"q":"containers:80",
"qq_viewFieldPermission_customFields_160":"{!v='(((viewFieldPermission_customFields_160:80
viewFieldPermission_customFields_160:22
viewFieldPermission_customFields_160:106)))'}",
"qq_viewFieldPermission_customFields_100":"{!v='(((viewFieldPermission_customFields_100:80
viewFieldPermission_customFields_100:22
viewFieldPermission_customFields_100:106)))'}",
"qq_viewFieldPermission_customFields_200":"{!v='(((viewFieldPermission_customFields_200:80
viewFieldPermission_customFields_200:22
viewFieldPermission_customFields_200:106)))'}",
"qq_viewFieldPermission_customFields_222":"{!v='(((viewFieldPermission_customFields_222:80
viewFieldPermission_customFields_222:22
viewFieldPermission_customFields_222:106)))'}",
"qq_viewFieldPermission_customFields_120":"{!v='(((viewFieldPermission_customFields_120:80
viewFieldPermission_customFields_120:22
viewFieldPermission_customFields_120:106)))'}",
"qq_viewFieldPermission_customFields_241":"{!v='(((viewFieldPermission_customFields_241:80
viewFieldPermission_customFields_241:22
viewFieldPermission_customFields_241:106)))'}",
"qq_viewFieldPermission_customFields_242":"{!v='(((viewFieldPermission_customFields_242:80
viewFieldPermission_customFields_242:22
viewFieldPermission_customFields_242:106)))'}",
"qq_viewFieldPermission_customFields_225":"{!v='(((viewFieldPermission_customFields_225:80
viewFieldPermission_customFields_225:22
viewFieldPermission_customFields_225:106)))'}",
"qq_viewFieldPermission_customFields_226":"{!v='(((viewFieldPermission_customFields_226:80
viewFieldPermission_customFields_226:22
viewFieldPermission_customFields_226:106)))'}",
"qq_viewFieldPermission_customFields_201":"{!v='(((viewFieldPermission_customFields_201:80
viewFieldPermission_customFields_201:22
viewFieldPermission_customFields_201:106)))'}",
"qq_viewFieldPermission_customFields_223":"{!v='(((viewFieldPermission_customFields_223:80
viewFieldPermission_customFields_223:22
viewFieldPermission_customFields_223:106)))'}",
"qq_viewFieldPermission_customFields_202":"{!v='(((viewFieldPermission_customFields_202:80
viewFieldPermission_customFields_202:22
viewFieldPermission_customFields_202:106)))'}",
"qq_viewFieldPermission_customFields_224":"{!v='(((viewFieldPermission_customFields_224:80
viewFieldPermission_customFields_224:22
viewFieldPermission_customFields_224:106)))'}",
"qq_viewFieldPermission_customFields_207":"{!v='(((viewFieldPermission_customFields_207:80
viewFieldPermission_customFields_207:22
viewFieldPermission_customFields_207:106)))'}",
"qq_viewFieldPermission_customFields_208":"{!v='(((viewFieldPermission_customFields_208:80
viewFieldPermission_customFields_208:22
viewFieldPermission_customFields_208:106)))'}"}},
"response":{"numFound":927,"start":0,"numFoundExact":true,"docs":[
{
"id":20,
"name":"b301112_27_u_32_u_40.tif",
"permission_customFields_date_200":false,
"permission_customFields_date_201":true,
"permission_customFields_date_202":true,
"permission_customFields_date_207":true,
"permission_customFields_date_208":true,
"permission_customFields_date_209":true,
"permission_customFields_date_216":false,
"permission_customFields_date_217":false,
"permission_customFields_date_218":false,
"permission_customFields_date_219":false,
"permission_customFields_date_222":false,
"permission_customFields_date_223":false,
"permission_customFields_date_160":false,
"permission_customFields_date_224":false,
"permission_customFields_date_225":false,
"permission_customFields_date_226":false,
"permission_customFields_date_100":false,
"permission_customFields_date_231":true,
"permission_customFields_date_170":false,
"permission_customFields_date_235":false},
[2 ... 99 other documents in response]
{
"id":4930,
"name":"b307682_03-10.tif",
"permission_customFields_date_200":false,
"permission_customFields_date_201":true,
"permission_customFields_date_202":true,
"permission_customFields_date_207":true,
"permission_customFields_date_208":true,
"permission_customFields_date_209":true,
"permission_customFields_date_216":false,
"permission_customFields_date_217":false,
"permission_customFields_date_218":false,
"permission_customFields_date_219":false,
"permission_customFields_date_222":false,
"permission_customFields_date_223":false,
"permission_customFields_date_160":false,
"permission_customFields_date_224":false,
"permission_customFields_date_225":false,
"permission_customFields_date_226":false,
"permission_customFields_date_100":false,
"permission_customFields_date_231":true,
"permission_customFields_date_170":false,
"permission_customFields_date_235":false}]
},
"debug":{
"rawquerystring":"containers:80",
"querystring":"containers:80",
"parsedquery":"IndexOrDocValuesQuery(containers:[80 TO 80])",
"parsedquery_toString":"containers:[80 TO 80]",
"explain":{
"20":"\n1.0 = containers:[80 TO 80]\n",
"76":"\n1.0 = containers:[80 TO 80]\n",
"1514":"\n1.0 = containers:[80 TO 80]\n",
"1565":"\n1.0 = containers:[80 TO 80]\n",
"1566":"\n1.0 = containers:[80 TO 80]\n",
"1607":"\n1.0 = containers:[80 TO 80]\n",
"1675":"\n1.0 = containers:[80 TO 80]\n",
"2489":"\n1.0 = containers:[80 TO 80]\n",
"2642":"\n1.0 = containers:[80 TO 80]\n",
"2643":"\n1.0 = containers:[80 TO 80]\n",
"2680":"\n1.0 = containers:[80 TO 80]\n",
"2681":"\n1.0 = containers:[80 TO 80]\n",
"2682":"\n1.0 = containers:[80 TO 80]\n",
"2683":"\n1.0 = containers:[80 TO 80]\n",
"2684":"\n1.0 = containers:[80 TO 80]\n",
"2685":"\n1.0 = containers:[80 TO 80]\n",
"2686":"\n1.0 = containers:[80 TO 80]\n",
"2696":"\n1.0 = containers:[80 TO 80]\n",
"2697":"\n1.0 = containers:[80 TO 80]\n",
"2698":"\n1.0 = containers:[80 TO 80]\n",
"2699":"\n1.0 = containers:[80 TO 80]\n",
"2700":"\n1.0 = containers:[80 TO 80]\n",
"2701":"\n1.0 = containers:[80 TO 80]\n",
"2702":"\n1.0 = containers:[80 TO 80]\n",
"2719":"\n1.0 = containers:[80 TO 80]\n",
"2720":"\n1.0 = containers:[80 TO 80]\n",
"2727":"\n1.0 = containers:[80 TO 80]\n",
"2739":"\n1.0 = containers:[80 TO 80]\n",
"2740":"\n1.0 = containers:[80 TO 80]\n",
"2741":"\n1.0 = containers:[80 TO 80]\n",
"2742":"\n1.0 = containers:[80 TO 80]\n",
"2743":"\n1.0 = containers:[80 TO 80]\n",
"2744":"\n1.0 = containers:[80 TO 80]\n",
"2745":"\n1.0 = containers:[80 TO 80]\n",
"2746":"\n1.0 = containers:[80 TO 80]\n",
"2747":"\n1.0 = containers:[80 TO 80]\n",
"2748":"\n1.0 = containers:[80 TO 80]\n",
"2749":"\n1.0 = containers:[80 TO 80]\n",
"2750":"\n1.0 = containers:[80 TO 80]\n",
"2755":"\n1.0 = containers:[80 TO 80]\n",
"2756":"\n1.0 = containers:[80 TO 80]\n",
"2757":"\n1.0 = containers:[80 TO 80]\n",
"2758":"\n1.0 = containers:[80 TO 80]\n",
"2759":"\n1.0 = containers:[80 TO 80]\n",
"2760":"\n1.0 = containers:[80 TO 80]\n",
"2761":"\n1.0 = containers:[80 TO 80]\n",
"2762":"\n1.0 = containers:[80 TO 80]\n",
"2763":"\n1.0 = containers:[80 TO 80]\n",
"2799":"\n1.0 = containers:[80 TO 80]\n",
"2800":"\n1.0 = containers:[80 TO 80]\n",
"2801":"\n1.0 = containers:[80 TO 80]\n",
"2802":"\n1.0 = containers:[80 TO 80]\n",
"2803":"\n1.0 = containers:[80 TO 80]\n",
"2804":"\n1.0 = containers:[80 TO 80]\n",
"2805":"\n1.0 = containers:[80 TO 80]\n",
"2829":"\n1.0 = containers:[80 TO 80]\n",
"2838":"\n1.0 = containers:[80 TO 80]\n",
"2839":"\n1.0 = containers:[80 TO 80]\n",
"2840":"\n1.0 = containers:[80 TO 80]\n",
"2841":"\n1.0 = containers:[80 TO 80]\n",
"2842":"\n1.0 = containers:[80 TO 80]\n",
"2843":"\n1.0 = containers:[80 TO 80]\n",
"2878":"\n1.0 = containers:[80 TO 80]\n",
"2889":"\n1.0 = containers:[80 TO 80]\n",
"2911":"\n1.0 = containers:[80 TO 80]\n",
"2945":"\n1.0 = containers:[80 TO 80]\n",
"2946":"\n1.0 = containers:[80 TO 80]\n",
"2947":"\n1.0 = containers:[80 TO 80]\n",
"2972":"\n1.0 = containers:[80 TO 80]\n",
"2973":"\n1.0 = containers:[80 TO 80]\n",
"2974":"\n1.0 = containers:[80 TO 80]\n",
"2975":"\n1.0 = containers:[80 TO 80]\n",
"2976":"\n1.0 = containers:[80 TO 80]\n",
"2999":"\n1.0 = containers:[80 TO 80]\n",
"3001":"\n1.0 = containers:[80 TO 80]\n",
"3062":"\n1.0 = containers:[80 TO 80]\n",
"3063":"\n1.0 = containers:[80 TO 80]\n",
"4335":"\n1.0 = containers:[80 TO 80]\n",
"4604":"\n1.0 = containers:[80 TO 80]\n",
"4606":"\n1.0 = containers:[80 TO 80]\n",
"4608":"\n1.0 = containers:[80 TO 80]\n",
"4705":"\n1.0 = containers:[80 TO 80]\n",
"4706":"\n1.0 = containers:[80 TO 80]\n",
"4707":"\n1.0 = containers:[80 TO 80]\n",
"4723":"\n1.0 = containers:[80 TO 80]\n",
"4724":"\n1.0 = containers:[80 TO 80]\n",
"4732":"\n1.0 = containers:[80 TO 80]\n",
"4736":"\n1.0 = containers:[80 TO 80]\n",
"4748":"\n1.0 = containers:[80 TO 80]\n",
"4749":"\n1.0 = containers:[80 TO 80]\n",
"4764":"\n1.0 = containers:[80 TO 80]\n",
"4766":"\n1.0 = containers:[80 TO 80]\n",
"4768":"\n1.0 = containers:[80 TO 80]\n",
"4769":"\n1.0 = containers:[80 TO 80]\n",
"4792":"\n1.0 = containers:[80 TO 80]\n",
"4793":"\n1.0 = containers:[80 TO 80]\n",
"4794":"\n1.0 = containers:[80 TO 80]\n",
"4815":"\n1.0 = containers:[80 TO 80]\n",
"4883":"\n1.0 = containers:[80 TO 80]\n",
"4930":"\n1.0 = containers:[80 TO 80]\n"},
"QParser":"LuceneQParser",
"filter_queries":["(createdBy:106 assetStatus:0) ((allowPermissions:80
allowPermissions:22 allowPermissions:106) -assetStatus:0)"],
"parsed_filter_queries":["(IndexOrDocValuesQuery(createdBy:[106 TO 106])
IndexOrDocValuesQuery(assetStatus:[0 TO 0]))
((IndexOrDocValuesQuery(allowPermissions:[80 TO 80])
IndexOrDocValuesQuery(allowPermissions:[22 TO 22])
IndexOrDocValuesQuery(allowPermissions:[106 TO 106]))
-IndexOrDocValuesQuery(assetStatus:[0 TO 0]))"],
"timing":{
"time":912.0,
"prepare":{
"time":36.0,
"query":{
"time":35.0},
"facet":{
"time":0.0},
"facet_module":{
"time":0.0},
"mlt":{
"time":0.0},
"highlight":{
"time":0.0},
"stats":{
"time":0.0},
"expand":{
"time":0.0},
"terms":{
"time":0.0},
"debug":{
"time":0.0}},
"process":{
"time":870.0,
"query":{
"time":845.0},
"facet":{
"time":0.0},
"facet_module":{
"time":0.0},
"mlt":{
"time":0.0},
"highlight":{
"time":0.0},
"stats":{
"time":0.0},
"expand":{
"time":0.0},
"terms":{
"time":0.0},
"debug":{
"time":23.0}}}}}
I cannot explain the very long waiting times to download or deliver the http
chunks on localhost. Even the TTFB is much higher than QTime.
Moreover I have no further idea what I can do to improve the response times.
Additionally I have measured solr with yourkit. it takes obviously about 11
seconds to process (BKDReader.intersect):
[cid:[email protected]]
When we remove more and more of the raw query evaluations
(permission_customFields_date_202:exists(query($qq_viewFieldPermission_customFields_202))
etc.) from fl the following linear response times could be observed:
* keep only 10 instead of 15 -> total time of 7 seconds to response
* keep only 5 -> total time of 2,7 seconds to Response
* remove completely, then only a few milliseconds are measured (20 - 30 ms)
* [cid:[email protected]]
It is comprehensible that the query evaluation and fl parameters influence the
processing, but it is not clear why the performance degrades that dramatic
after some modifications in index.
As mentioned if I drop the whole index and rebuild everything again, the
response times are about 1,5 seconds instead of 15 seconds. "Optimize index"
didn't help.
Please let me know if someone has some ideas what causes the described problems
or what we can change to improve.
Please also let me know if any additional details are required from my end.
Thanks in advance,
ako
