Re: [Dev] What web request data should publish to the BAM as web statistics
We have already updated the component to ignore request comes for js, css and images. We look at the accept of response header and distinguish content type of the response. If the accept of the response header is null, then we looked at request content type. This helps us to drop a lot of unnecessary requests being published to BAM. *G. K. S. Munasinghe * *Software Engineer,* *WSO2, Inc. http://wso2.com * *lean.enterprise.middleware.* * * email: ge...@wso2.com phone:(+94) 777911226 On Mon, Aug 12, 2013 at 3:27 PM, Kasun Gajasinghe kas...@wso2.com wrote: Hi, We have already improved the BAM Stat publisher valve to not publish images, css, js etc. Geeth, please update the thread with the details. Thanks, KasunG On Mon, Aug 12, 2013 at 3:22 PM, Shariq Muhammed sha...@wso2.com wrote: On Wed, Aug 7, 2013 at 5:44 PM, Asanka Vithanage asan...@wso2.comwrote: Hi All, With current web stat gathering implementation, when access a (web statistics enabled) web app one time, BAM Event_KS getting updated more than one time. As observed, reason is AS publishing all web request it made within a page load. So it counts all CSS,Image requests as well. Due to this showing final web statistics are not accurate IMO. One thing I can think of is that we can set the requestCount to 1 only for the page (html/jsp) provided we can distinguish between the page and css, images etc. Images, style sheets, script stats are useful when measuring the request / response sizes ... Is there any possibility to improve this? WDYT? - Asanka Vithanage Senior Software Engineer -QA Mobile: +94 0716286708 Email: asan...@wso2.com WSO2 Inc. www.wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thanks, Shariq. Phone: +94 777 202 225 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Kasun Gajasinghe* Software Engineer; Development Technologies Team, WSO2 Inc.; http://wso2.com , *email: **kasung AT spamfree wso2.com ** cell: **+94 (77) 678-0813* *linked-in: *http://lk.linkedin.com/in/gajasinghe * * *blog: **http://kasunbg.org* http://kasunbg.org * twitter: **http://twitter.com/kasunbg* http://twitter.com/kasunbg * * ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] What web request data should publish to the BAM as web statistics
I cannot think of a generic way of distinguishing between different urls, whether a request for a image or for css style sheets. we cannot recognize a css request just by looking .css at the end of the url. Sometimes even css request goes with query parameter at the end of the url. AFAIK there is no generic way to recognize different of the urls. And if we do string pattern matching would affect the performance. Thanks *G. K. S. Munasinghe * *Software Engineer,* *WSO2, Inc. http://wso2.com * *lean.enterprise.middleware.* * * email: ge...@wso2.com phone:(+94) 777911226 On Wed, Aug 7, 2013 at 5:44 PM, Asanka Vithanage asan...@wso2.com wrote: Hi All, With current web stat gathering implementation, when access a (web statistics enabled) web app one time, BAM Event_KS getting updated more than one time. As observed, reason is AS publishing all web request it made within a page load. So it counts all CSS,Image requests as well. Due to this showing final web statistics are not accurate IMO. Is there any possibility to improve this? WDYT? - Asanka Vithanage Senior Software Engineer -QA Mobile: +94 0716286708 Email: asan...@wso2.com WSO2 Inc. www.wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] What web request data should publish to the BAM as web statistics
Found this article[1] on hits, views and unique visitors, might help to understand the accuracy of web stats. [1] http://support.tigertech.net/stats-hits On Wed, Aug 7, 2013 at 6:00 PM, Geeth Munasinghe ge...@wso2.com wrote: I cannot think of a generic way of distinguishing between different urls, whether a request for a image or for css style sheets. we cannot recognize a css request just by looking .css at the end of the url. Sometimes even css request goes with query parameter at the end of the url. AFAIK there is no generic way to recognize different of the urls. And if we do string pattern matching would affect the performance. Thanks *G. K. S. Munasinghe * *Software Engineer,* *WSO2, Inc. http://wso2.com * *lean.enterprise.middleware.* * * email: ge...@wso2.com phone:(+94) 777911226 On Wed, Aug 7, 2013 at 5:44 PM, Asanka Vithanage asan...@wso2.com wrote: Hi All, With current web stat gathering implementation, when access a (web statistics enabled) web app one time, BAM Event_KS getting updated more than one time. As observed, reason is AS publishing all web request it made within a page load. So it counts all CSS,Image requests as well. Due to this showing final web statistics are not accurate IMO. Is there any possibility to improve this? WDYT? - Asanka Vithanage Senior Software Engineer -QA Mobile: +94 0716286708 Email: asan...@wso2.com WSO2 Inc. www.wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Udara Rathnayake* Software Engineer WSO2 Inc. : http://wso2.com Mobile : +94 772207239 Twitter : http://twitter.com/udarakr Blog: http://udarakr.blogspot.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
