[analog-help] Analyze CSV File
Hey all, I was wondering if Analog can analyze CSV data. We are getting log files for another type of service. The first line of the csv file are some field names: REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER PRODUCT PROVIDER KEY TITLE Is there a way for Analog to decipher this information and put it into a web type report? Thanks. + | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +
RE: [analog-help] Analyze CSV File
I haven't tried it yet...just wondering if it could be done =) Should I just research custom logformatting? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Aengus Sent: Monday, September 17, 2007 12:04 PM To: Support for analog web log analyzer Subject: Re: [analog-help] Analyze CSV File Raj Hungund <[EMAIL PROTECTED]> wrote: > Hey all, I was wondering if Analog can analyze CSV data. We are > getting log files for another type of service. > > The first line of the csv file are some field names: > REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER PRODUCT PROVIDER KEY TITLE > > Is there a way for Analog to decipher this information and put it into > a web type report? I don't see not. What happened when you created a custom logformat mapping the fields that are useful to you into fields that Analog recognises? Aengus +--- +- | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html List | archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +--- +- + | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +
RE: [analog-help] Analyze CSV File
Here's the full string: REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER MAC_ADDRESS PRODUCT PROVIDERASSET_KEY TITLE AUSTIN 1-Jul-070:00:23 XX XXX ProductName X Some Title Thanks! -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Aengus Sent: Monday, September 17, 2007 12:26 PM To: Support for analog web log analyzer Subject: Re: [analog-help] Analyze CSV File Raj Hungund wrote: > I haven't tried it yet...just wondering if it could be done =) > > Should I just research custom logformatting? You could post an example of the actual data. But just at a wild guess LOGFORMAT (%j %y:%m:d %h:%n:%j %u %r %f %j %B) might work (though I have no idea how your PLAY_DATE and PLAY_TIME fields are laid out, so they probably won't match, and Analog might spit out the referrer and Borwser fields because they aren't formatted properly). Logformats are documented at http://analog.cx/docs/logfmt.html Aengus +--- +- | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html List | archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +--- +- + | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +
Re: [analog-help] Analyze CSV File
Raj Hungund <[EMAIL PROTECTED]> wrote: > Hey all, I was wondering if Analog can analyze CSV data. We are > getting log files for another type of service. > > The first line of the csv file are some field names: > REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER PRODUCT PROVIDER > KEY TITLE > > Is there a way for Analog to decipher this information and put it > into a web type report? I don't see not. What happened when you created a custom logformat mapping the fields that are useful to you into fields that Analog recognises? Aengus + | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +
Re: [analog-help] Analyze CSV File
Raj Hungund <[EMAIL PROTECTED]> wrote: > I haven't tried it yet...just wondering if it could be done =) > > Should I just research custom logformatting? You could post an example of the actual data. But just at a wild guess LOGFORMAT (%j %y:%m:d %h:%n:%j %u %r %f %j %B) might work (though I have no idea how your PLAY_DATE and PLAY_TIME fields are laid out, so they probably won't match, and Analog might spit out the referrer and Borwser fields because they aren't formatted properly). Logformats are documented at http://analog.cx/docs/logfmt.html Aengus + | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +
Re: [analog-help] Analyze CSV File
Raj Hungund <[EMAIL PROTECTED]> wrote: > Here's the full string: > > REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER MAC_ADDRESS > PRODUCT PROVIDER ASSET_KEY TITLE > AUSTIN 1-Jul-07 0:00:23 XX XXX ProductName > X Some Title Which fields do you actually care about? Do you care about the Region? Do you need both Account Number and MAC address? What's the different between Product and Title? If I throw away the Region field, and use the Account number as the User field, the Product as the Virtual Host field, and the Title field as the Request field, I get something like this: Region: %j Play_Date: %d-%M-%y Play_Time: %h:%n:%j Account Number: %u MAC Address: %j Product: %v Provider: %j Asset_Key: %j Product Name: %r Your data is Tab delimited, which can make for a cluttered LOGFORMAT string, like this: LOGFORMAT (%j\t%d-%M-%y\t%h:%n:%j\t%u\t%j\t%v\t%j\t%j\t%r) If you turn on the User Report (USER ON) and the Virtual Host Report (VHOST ON), and set the appropriate "floors", then you'll get something useful in the report. Add these commands USER ON VHOST ON VHOSTFLOOR 1r VHOSTSORTBY R REQFLOOR 1r Aengus > > Thanks! > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of Aengus > Sent: Monday, September 17, 2007 12:26 PM > To: Support for analog web log analyzer > Subject: Re: [analog-help] Analyze CSV File > > Raj Hungund wrote: >> I haven't tried it yet...just wondering if it could be done =) >> >> Should I just research custom logformatting? > > You could post an example of the actual data. But just at a wild guess > > LOGFORMAT (%j %y:%m:d %h:%n:%j %u %r %f %j %B) > > might work (though I have no idea how your PLAY_DATE and PLAY_TIME > fields are laid out, so they probably won't match, and Analog might > spit out the referrer and Borwser fields because they aren't formatted > properly). > > Logformats are documented at http://analog.cx/docs/logfmt.html > > Aengus > > > +--- > +- >> TO UNSUBSCRIBE from this list: >>http://lists.meer.net/mailman/listinfo/analog-help >> >> Analog Documentation: http://analog.cx/docs/Readme.html List >> archives: http://www.analog.cx/docs/mailing.html#listarchives >> Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > +--- > +- > > + >> TO UNSUBSCRIBE from this list: >>http://lists.meer.net/mailman/listinfo/analog-help >> >> Analog Documentation: http://analog.cx/docs/Readme.html >> List archives: http://www.analog.cx/docs/mailing.html#listarchives >> Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > + + | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +
Re: [analog-help] Analyze CSV File
Aengus <[EMAIL PROTECTED]> wrote: > Raj Hungund <[EMAIL PROTECTED]> wrote: >> Here's the full string: >> >> REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER MAC_ADDRESS >> PRODUCT PROVIDER ASSET_KEY TITLE >> AUSTIN 1-Jul-07 0:00:23 XX XXX ProductName >> X Some Title > > Which fields do you actually care about? Do you care about the Region? > Do you need both Account Number and MAC address? What's the different > between Product and Title? > > If I throw away the Region field, and use the Account number as the > User field, the Product as the Virtual Host field, and the Title > field as the Request field, I get something like this: > > Region: %j You can report on the Regions as well by using the Browser report. Use %B instead of %j > Play_Date: %d-%M-%y > Play_Time: %h:%n:%j > Account Number: %u > MAC Address: %j > Product: %v > Provider: %j > Asset_Key: %j > Product Name: %r Add these lines to your analog.cfg: LOGFORMAT (REGION%j) LOGFORMAT (%B\t%d-%M-%y\t%h:%n:%j\t%u\t%j\t%v\t%j\t%j\t%r) LOGFILE cvs.log REQFLOOR 1r USER ON VHOST ON VHOSTFLOOR 1r VHOSTSORTBY requests ( I had this wrong in the original message) FULLBROWSER ON FULLBROWFLOOR 1r FULLBROWSORTBY requests You can turn off any reports that aren't useful. Analog.cx/docs/hierreps.html Analog.cx/docs/timereps.html Analog.cx/docs/othreps.html Aengus + | TO UNSUBSCRIBE from this list: |http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +
