RE: Keeping state with JavaScript
I've an article on my site here that might help: http://www.depressedpress.com/DepressedPress/Content/ColdFusion/Essays/GIFAs Pipe/Index.cfm Basically it describes a simple technique (and offers sample code) to allow you to write information back to the server without needed a page refresh. This will let you notify the server whenever your client-side controls are clicked (and, in your case, presumably save them). As an added bonus you could also use the technique to track which of your client-controlled content elements are being used most. This is always one of the problems with dynamic, client-side code - you often lose the metrics needed to determine usage patterns and content popularity. Of course if ALL you want to do is save state this technique may be going a little overboard - there's really no reason for CF to be involved at all since _javascript_ can access cookies just as well as anything - you could just store the information you want in a cookie (as an aside even with this method CF can still catch the information since the cookies set client-side will be sent to the server on the next request). Hope this helps, Jim Davis _ From: Jim McAtee [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 3:03 AM To: CF-Talk Subject: Keeping state with _javascript_ Maybe not the best subject line. Here's what I'm trying to do: I've got a CF generated page that uses _javascript_ & CSS to expand & contract (hide & unhide, actually) several blocks containing numerous html links. When the user expands a block and then clicks a link, the new URL is displayed in the same windows (target=_top). Right now what happens is that when the user returns to the page, all of the blocks are reset to their contracted (hidden) state. That's as expected. For convenience, what I'd like to do is maintain the state of the page for a short time period, say 5 minutes, in case the user comes back to the main page. Which is very likely since it's the topmost launching page for a host of related applications. If for instance there were three such expandable blocks on the page, I'd need CF to see three variables (or elements of an array or struct) that contain the state of the three blocks so that I could set their CSS 'display' property accordingly when generating the page. Any ideas how I might do this? _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Grouping help
Not sure if that would help. I'll have to check it out, since I'm using Access. Thanks! >If you are using dates to group by, make sure to get rid of any extraneous >information from the datefield. If you are using SQL Server, a datetime >field will return the date, hours, minutes, seconds, and milliseconds. You >can use a CAST or CONVERT function in your SQL statement to limit what is >returned to just year, month and day. > > > >SELECT theTitle, CONVERT(varchar(10), theDate, 101) AS dateasstring >FROM theTable >ORDER BY theDate > > > >Would this help any? > > > >Jeff Garza > > > > _ > >From: Jake . [mailto:[EMAIL PROTECTED] >Sent: Saturday, April 03, 2004 10:00 AM >To: CF-Talk >Subject: Re: Grouping help > > > >Thanks, I appreciate the help. Looks like part of my problem is (as always) >the fact that I'm using dates. Does this method work with dates? > > > _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
query for all records in this week
I have a MySQL database table that has a date column , how can I query for all records in this week and group on day of week. [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Keeping state with JavaScript
>>Any ideas how I might do this? Yes, (if I understand well). I've done something similar, and even more complex. The trick is to generate from _javascript_ the code in _javascript_ to create the variables and their content, then store the code in a hidden field and send it to CF. The next time it will generate the page, it will insert to JS code to create the page in the proper state. -- ___ See some cool custom tags here: http://www.contentbox.com/claude/customtags/tagstore.cfm Please send any spam to this address: [EMAIL PROTECTED] Thanks. [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: query for all records in this week
JT said: > I have a MySQL database table that has a date column , how can I > query for all records in this week and group on day of week. Define "this week" :-) This week of this year: SELECT datefld FROM table WHERE EXTRACT(WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) AND EXTRACT(YEAR FROM datefld) = EXTRACT(YEAR FROM CURRENT_DATE) GROUP BY EXTRACT(DAY FROM datefld) This week of each year: SELECT datefld FROM table WHERE EXTRACT(WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) GROUP BY EXTRACT(DAY FROM datefld) The last 7 days: SELECT datefld FROM table WHERE datefld BETWEEN CURRENT_DATE AND CURRENT_DATE - INTERVAL 7 DAY GROUP BY EXTRACT(DAY FROM datefld) Be carefull though, a week doesn't start on the same day everywhere. Jochem [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: query for all records in this week
I get this error Syntax error or access violation: You have an error in your SQL syntax near 'WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) AND EXT' at line 3 this is the code SELECT date as datefld FROM completedtest WHERE EXTRACT(WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) AND EXTRACT(YEAR FROM datefld) = EXTRACT(YEAR FROM CURRENT_DATE) GROUP BY EXTRACT(DAY FROM datefld) -Original Message- From: Jochem van Dieten [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 7:27 AM To: CF-Talk Subject: Re: query for all records in this week JT said: > I have a MySQL database table that has a date column , how can I > query for all records in this week and group on day of week. Define "this week" :-) This week of this year: SELECT datefld FROM table WHERE EXTRACT(WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) AND EXTRACT(YEAR FROM datefld) = EXTRACT(YEAR FROM CURRENT_DATE) GROUP BY EXTRACT(DAY FROM datefld) This week of each year: SELECT datefld FROM table WHERE EXTRACT(WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) GROUP BY EXTRACT(DAY FROM datefld) The last 7 days: SELECT datefld FROM table WHERE datefld BETWEEN CURRENT_DATE AND CURRENT_DATE - INTERVAL 7 DAY GROUP BY EXTRACT(DAY FROM datefld) Be carefull though, a week doesn't start on the same day everywhere. Jochem [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Grouping help
Jake: What's the query look like now? > -Original Message- > From: Jake . [mailto:[EMAIL PROTECTED] > Sent: Sunday, April 04, 2004 5:09 AM > To: CF-Talk > Subject: Re: Grouping help > > > Not sure if that would help. I'll have to check it out, since > I'm using Access. Thanks! > > >If you are using dates to group by, make sure to get rid of any > >extraneous information from the datefield. If you are using SQL > >Server, a datetime field will return the date, hours, > minutes, seconds, > >and milliseconds. You can use a CAST or CONVERT function in > your SQL > >statement to limit what is returned to just year, month and day. > > > > > > > >SELECT theTitle, CONVERT(varchar(10), theDate, 101) AS dateasstring > >FROM theTable ORDER BY theDate > > > > > > > >Would this help any? > > > > > > > >Jeff Garza > > > > > > > > _ > > > >From: Jake . [mailto:[EMAIL PROTECTED] > >Sent: Saturday, April 03, 2004 10:00 AM > >To: CF-Talk > >Subject: Re: Grouping help > > > > > > > >Thanks, I appreciate the help. Looks like part of my problem is (as > >always) the fact that I'm using dates. Does this method work with > >dates? > > > > > > _ > > [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: query for all records in this week
JT said: > I get this error > > Syntax error or access violation: You have an error in your SQL > syntax near 'WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) > AND EXT' at line 3 > > SELECT date as datefld Date is a reserved word. Change it while you still can. > FROM completedtest > WHERE EXTRACT(WEEK FROM datefld) = EXTRACT(WEEK FROM > CURRENT_DATE) I don't think you can use a column alias in the WHERE. > AND > EXTRACT(YEAR FROM datefld) = EXTRACT(YEAR FROM > CURRENT_DATE) > GROUP BY EXTRACT(DAY FROM datefld) > Jochem [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: query for all records in this week
Okay I did it .. still does not work new code is SELECT testdate FROM completedtest WHERE EXTRACT(WEEK FROM testdate) = EXTRACT(WEEK FROM CURRENT_DATE) AND EXTRACT(YEAR FROM testdate) = EXTRACT(YEAR FROM CURRENT_DATE) GROUP BY EXTRACT(DAY FROM testdate) The ERROR is : Error Executing Database Query. Syntax error or access violation: You have an error in your SQL syntax near 'WEEK FROM testdate) = EXTRACT(WEEK FROM CURRENT_DATE) AND EX' at line 3 ANY IDEAs -Original Message- From: Jochem van Dieten [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 7:59 AM To: CF-Talk Subject: RE: query for all records in this week JT said: > I get this error > > Syntax error or access violation: You have an error in your SQL > syntax near 'WEEK FROM datefld) = EXTRACT(WEEK FROM CURRENT_DATE) > AND EXT' at line 3 > > SELECT date as datefld Date is a reserved word. Change it while you still can. > FROM completedtest > WHERE EXTRACT(WEEK FROM datefld) = EXTRACT(WEEK FROM > CURRENT_DATE) I don't think you can use a column alias in the WHERE. > AND > EXTRACT(YEAR FROM datefld) = EXTRACT(YEAR FROM > CURRENT_DATE) > GROUP BY EXTRACT(DAY FROM datefld) > Jochem [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: query for all records in this week
JT said: > > > SELECT testdate > FROM completedtest > WHERE EXTRACT(WEEK FROM testdate) = EXTRACT(WEEK FROM > CURRENT_DATE) > AND > EXTRACT(YEAR FROM testdate) = EXTRACT(YEAR FROM > CURRENT_DATE) > GROUP BY EXTRACT(DAY FROM testdate) > > > The ERROR is : > Error Executing Database Query. > Syntax error or access violation: You have an error in your > SQL syntax > near 'WEEK FROM testdate) = EXTRACT(WEEK FROM CURRENT_DATE) AND EX' > at line 3 I think you would have to take this up with MySQL, since it should work according to the manual: http://www.mysql.com/doc/en/Date_and_time_functions.html Jochem [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: query for all records in this week
I just happen to be playing with some MySQL dbs with an interactive db
client ---
I tried the syntax
>
> EXTRACT(WEEK FROM testdate)
and get the same error, while:
EXTRACT(DAY FROM testdate)
works fine
Checking the MySQL docs at:
http://webdocs.math.univ-rennes1.fr/MySQL/mysql-3.23.52/
manual_Date_and_time_functions.html
about 1/3 way down the page, shows the types supported for EXTRACT
Week is not mentioned.
However, MySQL does support
mysql> select WEEK('1998-02-20');
-> 7
So that is likely the cause of confusion;
HTH
Dick
On Apr 4, 2004, at 8:21 AM, Jochem van Dieten wrote:
> JT said:
> >
> >
> > SELECT testdate
> > FROM completedtest
> > WHERE EXTRACT(WEEK FROM testdate) = EXTRACT(WEEK FROM
> > CURRENT_DATE)
> > AND
> > EXTRACT(YEAR FROM testdate) = EXTRACT(YEAR FROM
> > CURRENT_DATE)
> > GROUP BY EXTRACT(DAY FROM testdate)
> >
> >
> > The ERROR is :
> > Error Executing Database Query.
> > Syntax error or access violation: You have an error in your
> > SQL syntax
> > near 'WEEK FROM testdate) = EXTRACT(WEEK FROM CURRENT_DATE) AND EX'
> > at line 3
>
> I think you would have to take this up with MySQL, since it should
> work according to the manual:
> http://www.mysql.com/doc/en/Date_and_time_functions.html
>
> Jochem
>
[Todays Threads]
[This Message]
[Subscription]
[Fast Unsubscribe]
[User Settings]
Re: query for all records in this week
Oops, forgot the best part---
you can use
WHERE WEEK(BuyDate)
But be careful ---
WEEK("1998-01-01") AS WK, gives 0
WEEK("2000-12-31") AS WK1, gives 53
If you have an interactive db client, you might want to experiment.
HTH
Dick
On Apr 4, 2004, at 9:00 AM, Dick Applebaum wrote:
> I just happen to be playing with some MySQL dbs with an interactive
> db
> client ---
>
> I tried the syntax
>
> >
> > EXTRACT(WEEK FROM testdate)
>
> and get the same error, while:
>
> EXTRACT(DAY FROM testdate)
>
> works fine
>
> Checking the MySQL docs at:
>
> http://webdocs.math.univ-rennes1.fr/MySQL/mysql-3.23.52/
> manual_Date_and_time_functions.html
>
> about 1/3 way down the page, shows the types supported for EXTRACT
>
> Week is not mentioned.
>
> However, MySQL does support
>
> mysql> select WEEK('1998-02-20');
> -> 7
>
> So that is likely the cause of confusion;
>
> HTH
>
> Dick
>
> On Apr 4, 2004, at 8:21 AM, Jochem van Dieten wrote:
>
> > JT said:
> > >
> > >
> > > SELECT testdate
> > > FROM completedtest
> > > WHERE EXTRACT(WEEK FROM testdate) = EXTRACT(WEEK FROM
> > > CURRENT_DATE)
> > > AND
> > > EXTRACT(YEAR FROM testdate) = EXTRACT(YEAR FROM
> > > CURRENT_DATE)
> > > GROUP BY EXTRACT(DAY FROM testdate)
> > >
> > >
> > > The ERROR is :
> > > Error Executing Database Query.
> > > Syntax error or access violation: You have an error in your
> > > SQL syntax
> > > near 'WEEK FROM testdate) = EXTRACT(WEEK FROM CURRENT_DATE) AND
> EX'
> > > at line 3
> >
> > I think you would have to take this up with MySQL, since it should
> > work according to the manual:
> > http://www.mysql.com/doc/en/Date_and_time_functions.html
> >
> > Jochem
> >
>
[Todays Threads]
[This Message]
[Subscription]
[Fast Unsubscribe]
[User Settings]
RE: Grouping help
Jake, Alright, didn't know that you were on Access. it's been a while since I've used Access but I'm pretty sure that you want to parse out each part of your date, concatenate it together and return it as a string using CStr(). The whole SQL query would look like this. SELECT theTitle CStr(Month(theDate) & '/' & Day(theDate) & '/' & Year(theDate)) AS theDate FROM theTable ORDER BY theDate This will return the date as a string with no timestamp on it. Performance might suck just a little bit, but this is access after all. . Hope this helps, -- Jeff Garza _ From: Jake . [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 5:09 AM To: CF-Talk Subject: Re: Grouping help Not sure if that would help. I'll have to check it out, since I'm using Access. Thanks! >If you are using dates to group by, make sure to get rid of any extraneous >information from the datefield. If you are using SQL Server, a datetime >field will return the date, hours, minutes, seconds, and milliseconds. You >can use a CAST or CONVERT function in your SQL statement to limit what is >returned to just year, month and day. > > > >SELECT theTitle, CONVERT(varchar(10), theDate, 101) AS dateasstring >FROM theTable >ORDER BY theDate > > > >Would this help any? > > > >Jeff Garza > > > > _ > >From: Jake . [mailto:[EMAIL PROTECTED] >Sent: Saturday, April 03, 2004 10:00 AM >To: CF-Talk >Subject: Re: Grouping help > > > >Thanks, I appreciate the help. Looks like part of my problem is (as always) >the fact that I'm using dates. Does this method work with dates? > > > _ _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: query for all records in this week
This did it.
select * from Skills.completedtest
where week(date) = #week#-1
order by date,time
But I am confused . why doesnt set this week to
this weeks number?
I had to use where week(date) = #week# -1
to get correct records
-Original Message-
From: Dick Applebaum [mailto:[EMAIL PROTECTED]
Sent: Sunday, April 04, 2004 9:10 AM
To: CF-Talk
Subject: Re: query for all records in this week
Oops, forgot the best part---
you can use
WHERE WEEK(BuyDate)
But be careful ---
WEEK("1998-01-01") AS WK, gives 0
WEEK("2000-12-31") AS WK1, gives 53
If you have an interactive db client, you might want to experiment.
HTH
Dick
On Apr 4, 2004, at 9:00 AM, Dick Applebaum wrote:
> I just happen to be playing with some MySQL dbs with an interactive
> db
> client ---
>
> I tried the syntax
>
> >
> > EXTRACT(WEEK FROM testdate)
>
> and get the same error, while:
>
> EXTRACT(DAY FROM testdate)
>
> works fine
>
> Checking the MySQL docs at:
>
> http://webdocs.math.univ-rennes1.fr/MySQL/mysql-3.23.52/
> manual_Date_and_time_functions.html
>
> about 1/3 way down the page, shows the types supported for EXTRACT
>
> Week is not mentioned.
>
> However, MySQL does support
>
> mysql> select WEEK('1998-02-20');
> -> 7
>
> So that is likely the cause of confusion;
>
> HTH
>
> Dick
>
> On Apr 4, 2004, at 8:21 AM, Jochem van Dieten wrote:
>
> > JT said:
> > >
> > >
> > > SELECT testdate
> > > FROM completedtest
> > > WHERE EXTRACT(WEEK FROM testdate) = EXTRACT(WEEK FROM
> > > CURRENT_DATE)
> > > AND
> > > EXTRACT(YEAR FROM testdate) = EXTRACT(YEAR FROM
> > > CURRENT_DATE)
> > > GROUP BY EXTRACT(DAY FROM testdate)
> > >
> > >
> > > The ERROR is :
> > > Error Executing Database Query.
> > > Syntax error or access violation: You have an error in your
> > > SQL syntax
> > > near 'WEEK FROM testdate) = EXTRACT(WEEK FROM CURRENT_DATE) AND
> EX'
> > > at line 3
> >
> > I think you would have to take this up with MySQL, since it should
> > work according to the manual:
> > http://www.mysql.com/doc/en/Date_and_time_functions.html
> >
> > Jochem
> >
>
[Todays Threads]
[This Message]
[Subscription]
[Fast Unsubscribe]
[User Settings]
Help! can't get Oracle connection
I have installed CF 6.1 professional on Win 2003 and installed the Oracle 9i client. Created the TNS names file and datasource. Used the MS ODBC Data Source Administrator on Win2003 and created the Oracle ODBC Driver Configuration and tested connection good. My problem: The Oracle datasource does not show up in the CF Administrator Datasource page like it did with CF 5 in the Connected Datasources panel. Any help would be appreciated. Jim Watkins [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: query for all records in this week
JT wrote: > This did it. > > > > > > > select * from Skills.completedtest > where week(date) = #week#-1 > order by date,time > > > But I am confused . why doesnt set this week to > this weeks number? Because week numbering is locale dependent. Jochem -- I don't get it immigrants don't work and steal our jobs - Loesje [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
user agent checking and spidering...
Cf talkers, I have a client with many many similar sites on a single server using CFMX. Each of the sites is part of a "network" of sites that all link together - about 150 to 200 sites in all. Each home page has links to other sites in the network. Periodically, it appears that google or a similar search engine hits a home page and spiders the links - which of course leads it to other sites on the server and other links. This generates (again - this is my hypothesus from examining the logs and behaviour) concurrent requests for similar pages that all hit the same "news" database (in access). Sequelink (the access service for Jrun I think) locks up quickly trying to service hundreds of requests at once to the same access file. This results in a climbing request queue that climbs into the thousands and requires a restart of the CFMX services. To fix this issue I am migrating the databases over to SQL server which will help greatly with stability, but this will take a little time and there is still the problem of trying to avoid letting a spider hit this single server with so many requests at once. Each site has a pretty well thought out robots.txt file, but it doesn't help because the links in question are to external sites - not pages on THIS site (even though these external sites are virtuals on the same server). I'm considering suggesting a "mask" be installed for spider agents that eliminates the absolute links and only exposes the "internal" links - which are controlled by the robots.txt. I'd like to know if: A) in anyone's experience my hypothesis may be correct and B) Is there anything I should watch out for in masking these links C) Does anyone know of a link that gives me the string values of the various user-agents I'm trying to look for. Any help will be appreciated - thanks! -Mark Mark A. Kruger, MCSE, CFG www.cfwebtools.com www.necfug.com http://blog.mxconsulting.com ...what the web can be! [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: user agent checking and spidering...
I'm not sure if it's the best way to do things but I may be able to help with the user agents. Basically what I've done is capture all the user agents to hit my sites over the past few years. I go through periodically and (using a bit column in the table) mark whether the agents are bots or not. I'm not saying its 100% accurate (or complete) but whatever is? I can send you the data if you like (let me know how you'd like it). It's sizable. there are many thousands of rows. I use the table to determine which session on the application are generated by bots and a prevent those sessions from being stored in my metrics application (reduces clutter significantly). If you want more accuracy/completeness you may also consider checking out browserhawk (forgot the company name) - it's a user-agent parsing component that works from a regularly updated database of agent information. It'll give you much more than just "isBot" but will also cost you. Let me know if you want my database. Jim Davis _ From: Mark A. Kruger - CFG [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 2:06 PM To: CF-Talk Subject: user agent checking and spidering... Cf talkers, I have a client with many many similar sites on a single server using CFMX. Each of the sites is part of a "network" of sites that all link together - about 150 to 200 sites in all. Each home page has links to other sites in the network. Periodically, it appears that google or a similar search engine hits a home page and spiders the links - which of course leads it to other sites on the server and other links. This generates (again - this is my hypothesus from examining the logs and behaviour) concurrent requests for similar pages that all hit the same "news" database (in access). Sequelink (the access service for Jrun I think) locks up quickly trying to service hundreds of requests at once to the same access file. This results in a climbing request queue that climbs into the thousands and requires a restart of the CFMX services. To fix this issue I am migrating the databases over to SQL server which will help greatly with stability, but this will take a little time and there is still the problem of trying to avoid letting a spider hit this single server with so many requests at once. Each site has a pretty well thought out robots.txt file, but it doesn't help because the links in question are to external sites - not pages on THIS site (even though these external sites are virtuals on the same server). I'm considering suggesting a "mask" be installed for spider agents that eliminates the absolute links and only exposes the "internal" links - which are controlled by the robots.txt. I'd like to know if: A) in anyone's experience my hypothesis may be correct and B) Is there anything I should watch out for in masking these links C) Does anyone know of a link that gives me the string values of the various user-agents I'm trying to look for. Any help will be appreciated - thanks! -Mark Mark A. Kruger, MCSE, CFG www.cfwebtools.com www.necfug.com http://blog.mxconsulting.com ...what the web can be! _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: user agent checking and spidering...
Jim, Thanks - that might be a good place to start. Can you send it to my email? thanks! -Mark -Original Message- From: Jim Davis [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 1:27 PM To: CF-Talk Subject: RE: user agent checking and spidering... I'm not sure if it's the best way to do things but I may be able to help with the user agents. Basically what I've done is capture all the user agents to hit my sites over the past few years. I go through periodically and (using a bit column in the table) mark whether the agents are bots or not. I'm not saying its 100% accurate (or complete) but whatever is? I can send you the data if you like (let me know how you'd like it). It's sizable. there are many thousands of rows. I use the table to determine which session on the application are generated by bots and a prevent those sessions from being stored in my metrics application (reduces clutter significantly). If you want more accuracy/completeness you may also consider checking out browserhawk (forgot the company name) - it's a user-agent parsing component that works from a regularly updated database of agent information. It'll give you much more than just "isBot" but will also cost you. Let me know if you want my database. Jim Davis _ From: Mark A. Kruger - CFG [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 2:06 PM To: CF-Talk Subject: user agent checking and spidering... Cf talkers, I have a client with many many similar sites on a single server using CFMX. Each of the sites is part of a "network" of sites that all link together - about 150 to 200 sites in all. Each home page has links to other sites in the network. Periodically, it appears that google or a similar search engine hits a home page and spiders the links - which of course leads it to other sites on the server and other links. This generates (again - this is my hypothesus from examining the logs and behaviour) concurrent requests for similar pages that all hit the same "news" database (in access). Sequelink (the access service for Jrun I think) locks up quickly trying to service hundreds of requests at once to the same access file. This results in a climbing request queue that climbs into the thousands and requires a restart of the CFMX services. To fix this issue I am migrating the databases over to SQL server which will help greatly with stability, but this will take a little time and there is still the problem of trying to avoid letting a spider hit this single server with so many requests at once. Each site has a pretty well thought out robots.txt file, but it doesn't help because the links in question are to external sites - not pages on THIS site (even though these external sites are virtuals on the same server). I'm considering suggesting a "mask" be installed for spider agents that eliminates the absolute links and only exposes the "internal" links - which are controlled by the robots.txt. I'd like to know if: A) in anyone's experience my hypothesis may be correct and B) Is there anything I should watch out for in masking these links C) Does anyone know of a link that gives me the string values of the various user-agents I'm trying to look for. Any help will be appreciated - thanks! -Mark Mark A. Kruger, MCSE, CFG www.cfwebtools.com www.necfug.com http://blog.mxconsulting.com ...what the web can be! _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Help! can't get Oracle connection
Why NOT just use the JDBC Driver that comes with Oracle Or the one that comes with CFMX. The JDBC driver is much more stable and faster... from tests i did a while ago. HTH Joe Eugene -Original Message- From: Jim Watkins [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 12:58 PM To: CF-Talk Subject: Help! can't get Oracle connection I have installed CF 6.1 professional on Win 2003 and installed the Oracle 9i client. Created the TNS names file and datasource. Used the MS ODBC Data Source Administrator on Win2003 and created the Oracle ODBC Driver Configuration and tested connection good. My problem: The Oracle datasource does not show up in the CF Administrator Datasource page like it did with CF 5 in the Connected Datasources panel. Any help would be appreciated. Jim Watkins [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: user agent checking and spidering...
I've emailed it to you.
Just in case you don't get it (or anybody else wants it as well) I've also
posted it here:
ftp://ftp.depressedpress.com/UserAgents.zip
I haven't gone through the new entries in a long while. there were
three-thousand more rows (there's around 6.5 thousand now). I've just gone
through them and marked the obvious ones. Some notes however:
1) Many of the agents are obviously bogus (there are many that are just
random strings of characters). There's no way to tell if these are bots or
not.
2) Many of the strings are programmatic interfaces ("CURL", "COLDFUSION",
etc) - there's really no way to tell if these are homemade bots or homemade
browsers.
Hope this helps,
Jim Davis
_
From: Mark A. Kruger - CFG [mailto:[EMAIL PROTECTED]
Sent: Sunday, April 04, 2004 2:35 PM
To: CF-Talk
Subject: RE: user agent checking and spidering...
Jim,
Thanks - that might be a good place to start. Can you send it to my email?
thanks!
-Mark
-Original Message-
From: Jim Davis [mailto:[EMAIL PROTECTED]
Sent: Sunday, April 04, 2004 1:27 PM
To: CF-Talk
Subject: RE: user agent checking and spidering...
I'm not sure if it's the best way to do things but I may be able to help
with the user agents. Basically what I've done is capture all the user
agents to hit my sites over the past few years. I go through periodically
and (using a bit column in the table) mark whether the agents are bots or
not.
I'm not saying its 100% accurate (or complete) but whatever is? I can
send
you the data if you like (let me know how you'd like it). It's sizable.
there are many thousands of rows.
I use the table to determine which session on the application are
generated
by bots and a prevent those sessions from being stored in my metrics
application (reduces clutter significantly).
If you want more accuracy/completeness you may also consider checking out
browserhawk (forgot the company name) - it's a user-agent parsing
component
that works from a regularly updated database of agent information. It'll
give you much more than just "isBot" but will also cost you.
Let me know if you want my database.
Jim Davis
_
From: Mark A. Kruger - CFG [mailto:[EMAIL PROTECTED]
Sent: Sunday, April 04, 2004 2:06 PM
To: CF-Talk
Subject: user agent checking and spidering...
Cf talkers,
I have a client with many many similar sites on a single server using
CFMX.
Each of the sites is part of a "network" of
sites that all link together - about 150 to 200 sites in all. Each home
page has links to other sites in the network.
Periodically, it appears that google or a similar search engine hits a
home
page and spiders the links - which of
course leads it to other sites on the server and other links. This
generates
(again - this is my hypothesus from
examining the logs and behaviour) concurrent requests for similar pages
that
all hit the same "news" database (in
access). Sequelink (the access service for Jrun I think) locks up quickly
trying to service hundreds of requests at once
to the same access file. This results in a climbing request queue that
climbs into the thousands and requires a restart
of the CFMX services.
To fix this issue I am migrating the databases over to SQL server which
will
help greatly with stability, but this will
take a little time and there is still the problem of trying to avoid
letting
a spider hit this single server with so
many requests at once. Each site has a pretty well thought out robots.txt
file, but it doesn't help because the links
in question are to external sites - not pages on THIS site (even though
these external sites are virtuals on the same
server).
I'm considering suggesting a "mask" be installed for spider agents that
eliminates the absolute links and only exposes
the "internal" links - which are controlled by the robots.txt. I'd like
to
know if:
A) in anyone's experience my hypothesis may be correct and
B) Is there anything I should watch out for in masking these links
C) Does anyone know of a link that gives me the string values of the
various
user-agents I'm trying to look for.
Any help will be appreciated - thanks!
-Mark
Mark A. Kruger, MCSE, CFG
www.cfwebtools.com
www.necfug.com
http://blog.mxconsulting.com
...what the web can be!
_
_
[Todays Threads]
[This Message]
[Subscription]
[Fast Unsubscribe]
[User Settings]
RE: user agent checking and spidering...
> Sequelink (the access service for Jrun I think) locks up > quickly trying to service hundreds of requests at once to > the same access file. As a short-term fix, have you considered a more aggressive caching strategy? That might be pretty easy to implement. > Each site has a pretty well thought out robots.txt file, but > it doesn't help because the links in question are to external > sites - not pages on THIS site (even though these external > sites are virtuals on the same server). I don't think I understand this. It shouldn't matter whether the links are internal or external - before a well-written spider requests the link, it should check that server's robots.txt file first. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Help! can't get Oracle connection
> I have installed CF 6.1 professional on Win 2003 and > installed the Oracle 9i client. Created the TNS names > file and datasource. Used the MS ODBC Data Source > Administrator on Win2003 and created the Oracle ODBC > Driver Configuration and tested connection good. My > problem: > > The Oracle datasource does not show up in the CF > Administrator Datasource page like it did with CF 5 in > the Connected Datasources panel. As Joe Eugene mentioned, you probably should use the JDBC drivers from either MM or Oracle instead. Oracle has spent a lot of money making sure that JDBC clients work well with Oracle databases. In any case, your ODBC datasources won't show up automatically within the CF Administrator. You'll have to choose "ODBC Socket" to use an existing ODBC datasource, and you'll have to provide the appropriate information about that datasource within the configuration screen for your CF datasource. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Help! can't get Oracle connection
Would you tell me how to set up the JDBC driver? Jim Watkins - Original Message - From: Joe Eugene To: CF-Talk Sent: Sunday, April 04, 2004 5:13 PM Subject: RE: Help! can't get Oracle connection Why NOT just use the JDBC Driver that comes with Oracle Or the one that comes with CFMX. The JDBC driver is much more stable and faster... from tests i did a while ago. HTH Joe Eugene -Original Message- From: Jim Watkins [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 12:58 PM To: CF-Talk Subject: Help! can't get Oracle connection I have installed CF 6.1 professional on Win 2003 and installed the Oracle 9i client. Created the TNS names file and datasource. Used the MS ODBC Data Source Administrator on Win2003 and created the Oracle ODBC Driver Configuration and tested connection good. My problem: The Oracle datasource does not show up in the CF Administrator Datasource page like it did with CF 5 in the Connected Datasources panel. Any help would be appreciated. Jim Watkins [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Farcry Content Management 6.1 Standard
David Brown wrote: > We are looking to upgrade to CF MX (6.1) from CF 5.0 professional. > We are also considering using FarCry CMS. Does anyone know if Farcry > will work with CF MX 6.1 standard or do we need enterprise version? The team behind FarCry (http://farcry.daemon.com.au/) have worked very hard to ensure that the solution runs on CFMX Standard. For the frugal, we also support the mySQL database platform for content storage, and there are a number of hosts offering very economical FarCry shared-hosting including: http://www.austiger.com.au/ http://www.fasthit.net/ Best regards, -- geoff http://www.daemon.com.au/ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Help! can't get Oracle connection
Which version of Oracle are you running -- what I did for Oracle 9.2 is download the ORA92 ODBC driver from Oracle (the one with CFMX is for Oracle 8 I believe) and installed it. Next I went to the Control Panel/Administrative Tools/Data Sources (ODBC). In this screen click on the System DSN tab and pres the button. Then scroll down to the entry that should say "Oracle in OraHome92" -- the fill out the fields on "Oracle ODBC Driver Configuration" screen and press the "Test Connection" button -- if you got the entries right, then the connection should test out okay. With the test connection working, you can then go to CFMX Admin and the DNS will appear in the list ready to use. As least that is what I recall happened to me a couple of months ago when I installed in on my laptop... [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: DWMX generated CF Login/Logout code
> I have a CF site that I developped in DWMX. As it is a > freebie, I made use of a lot of the automatic code > generation features of DWMX to save time. I would recommend that you avoid the DWMX server behaviors for login/logout functionality. In general, most of the server behaviors work well enough, although I have issues with most of them, but the login/logout server behaviors don't take advantage of the new CFLOGIN framework that comes with CFMX 6.x, and they have other flaws as well. > The new box does not appear to have the that broblem, but my > logout code is now causing some weird issues. Users can log > in no problem. But when you click the logout link or try to > access a protected page when not logged in, I get a "Page > cannot be displayed" error in IE and a white page in > Netscape. The sessions are invalidated, but the requests are > not redirected to the target pages after logout. The logout URL you provided just outputs a META tag to the browser: Can you post the code for that page? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: desktop application
> > ahhh ... if only we had CFAnywhere. :) > > > ~cough~ bluedragon > Thats what CFAnywhere became. CFAnywhere was a product of Live Software, the makers of Jrun, who were purchased by Allaire. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: desktop application
> Unfortuately doesn't really help John with a cross-platform > desktop application. Yeah I know it should run everywhere, > but nothing is ever quite that simple and in this instance > cf/php/etc are all a little on the heavy side. Mini flash app > should be more than sufficient. (he says sticking to the thread) I agree with Stephen here - server-side technologies (CF/PHP/etc) are far more complex than necessary, and don't provide a useful way to build a GUI either. If Flash doesn't cut it, though, there are cross-platform languages and tools that will, such as Python and wxWindows together. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
CFmail and DB storage of Russian fonts?
I have a project where a site administrator would fill in a web based form and I'd process it using CF - posting content to a database (either SQL or Access) and send that out by CFMail. The issue is this - the admin would enter their content using a Russian font (windows encoded True Type font) into the web form. Can SQL or Access store this in-tact and can CFMail handle sending this out properly so someone with the ability to receive Russian text can open the email and read it? [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Help! can't get Oracle connection
> Would you tell me how to set up the JDBC driver? There's very little to it. If you're using CFMX Enterprise, just select "Oracle" from the database list within CF Administrator, then fill in the blanks appropriately. You don't need to install the Oracle client beforehand to use this. If you don't have the MM Oracle driver, you can download JDBC drivers from Oracle. If I recall correctly, they have two - one that requires the Oracle client and one that doesn't. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Help! can't get Oracle connection
If I recall what I was told correctly, you had to be running the Enterprise version of CFMX to support Oracle with direct drivers -- hence the reason going with the ORA92 ODBC drivers for version 9.2 of Oracle -- I am running CFMX Standard/Professional or what it is now called and it works great with the ORA92 ODBC driver... [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Help! can't get Oracle connection
> If I recall what I was told correctly, you had to be running > the Enterprise version of CFMX to support Oracle with direct > drivers -- hence the reason going with the ORA92 ODBC drivers > for version 9.2 of Oracle -- I am running CFMX > Standard/Professional or what it is now called and it works > great with the ORA92 ODBC driver... I'm pretty sure that you can use the Oracle JDBC driver successfully with CFMX Standard. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Coldfusion charts and graphs
Hi I'm doing some research on ColdFusion add on tools such as high performance in chart graphic and report tools for my project. Any information would be greatly appreciated. [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Coldfusion charts and graphs
well that is pretty generic. do you have any requirements or any more information on what you are looking for? Are you looking for info on coldfusions built-in charting or on alternatives to it? If looking for the former, check out livedocs.macromedia.com...if the latter, I don't have any first hand experience with any, but others on this list may...If you can be more specific I am sure there are many who would help! --- Exciteworks -- expert hosting for less! http://exciteworks.com specializing in reseller accounts sura R wrote: > Hi > I'm doing some research on ColdFusion add on tools such as high > performance in chart graphic and report tools for my project. Any > information would be greatly appreciated. > [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Coldfusion charts and graphs
> I'm doing some research on ColdFusion add on tools such as > high performance in chart graphic and report tools for my > project. Any information would be greatly appreciated. Without more clarification, it is hard to tell what exactly you are looking for. I have used Corda's POPCHART alongside ColdFusion. It is quite pricy and tricky to use at first, but does do a great job once you get up to speed. In terms of reporting tools Not sure what to tell you other than CF itself can be an awesome reporting tool if you use it that way. Mike [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Help! can't get Oracle connection
Just configue the Oracle JDBC using the "Other" Option. Yes, i think CFMX Standard might Not come with Data Direct Oracle JDBC Drivers but you can download the ORACLE Driver and just Configure it. Joe Eugene -Original Message- From: Arden Weiss [mailto:[EMAIL PROTECTED] Sent: Sunday, April 04, 2004 6:49 PM To: CF-Talk Subject: Re: Help! can't get Oracle connection If I recall what I was told correctly, you had to be running the Enterprise version of CFMX to support Oracle with direct drivers -- hence the reason going with the ORA92 ODBC drivers for version 9.2 of Oracle -- I am running CFMX Standard/Professional or what it is now called and it works great with the ORA92 ODBC driver... [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
