RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
My company currently has multiple load balanced web servers. Each time we deploy code, we have to manually FTP it to each server. We'd love to be able to upload (or SVN) code to one location and have an automated process to replicate the code to the other servers. I've used Super Flexible File Synchronizer on a couple of projects: http://www.superflexible.com/ Andy ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:269040 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
The last time i worked on a site with multiple servers, they had a simple scheduled task set up to run every half hour or so. It looks for files in an upload directory, and if it finds anything, copies the files over to the production servers, creating new folders if necessary, then deleting the file from the uploads directory.. So to deploy to production all we developers had to do was dump the new file in this 'uploads' folder. The only time we had to go from server to server was in the rare case if the change was to delete a file where there was no new file. It's not perfect, but it's simple, and takes care of the vast majority of code deployment tasks on a working productoin web site, leaving only a few jobs to be done manually. Cheers Mike Kear Windsor, NSW, Australia Adobe Certified Advanced ColdFusion Developer AFP Webworks http://afpwebworks.com ColdFusion, PHP, ASP, ASP.NET hosting from AUD$15/month On 2/8/07, Andrew Tyrone [EMAIL PROTECTED] wrote: My company currently has multiple load balanced web servers. Each time we deploy code, we have to manually FTP it to each server. We'd love to be able to upload (or SVN) code to one location and have an automated process to replicate the code to the other servers. I've used Super Flexible File Synchronizer on a couple of projects: http://www.superflexible.com/ Andy ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:269100 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
Andy, We use SVN to deploy to code to a single server, and then we use DFS to automatically propagate the changes. Once you set it up, it doesn't require any intervention, unless it breaks, which happened to me a few times to date. It is, however, very useful in that once you push the code to one of the servers through svn, unless you are changing a bunch of files, the files are replicated almost instantly to the other server. Russ -Original Message- From: Andy Matthews [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 06, 2007 11:11 AM To: CF-Talk Subject: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough? Paul... My company currently has multiple load balanced web servers. Each time we deploy code, we have to manually FTP it to each server. We'd love to be able to upload (or SVN) code to one location and have an automated process to replicate the code to the other servers. You mentioned a program called Robocopy in this post. Can you provide some additional information? Andy matthews -Original Message- From: Paul Vernon [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 06, 2007 4:13 AM To: CF-Talk Subject: RE: Client variables? reliable enough? We solved the bandwidth issue by moving the source code onto the web servers instead of them using the filestore server and used robocopy to keep them in sync... Nowadays I'd use SVN to deploy :) ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268837 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
My company currently has multiple load balanced web servers. Each time we deploy code, we have to manually FTP it to each server. We'd love to be able to upload (or SVN) code to one location and have an automated process to replicate the code to the other servers. We currently have a similar setup and are looking to use SVN to automate this portion of our process. We're currently looking to use a bat file to SVN Update / Checkout the code on the remote servers. We have an integration server where we currently checkout our repository to then copy the code to the remote servers. We are trying to do away with this method as we are using a large amount of bandwidth that is not really necessary. Using the SVN update / Checkout method, only the files that are needed will be transmitted to the production servers, or at least that is our thought. Is there something we're missing with this method? Rich Kroll ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268840 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
If you use SVN + DFS, you will only pull the files you need from a remote server (SVN) once, and then DFS will propagate only the changes between your local servers. Doing svn update on every server will load the changes once for every server from the remote location (unless your svn server is on site there as well). Either way, the beauty of DFS is that it auto replicates things without your intervention, unless it breaks. Russ -Original Message- From: Richard Kroll [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 06, 2007 11:23 AM To: CF-Talk Subject: RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough? My company currently has multiple load balanced web servers. Each time we deploy code, we have to manually FTP it to each server. We'd love to be able to upload (or SVN) code to one location and have an automated process to replicate the code to the other servers. We currently have a similar setup and are looking to use SVN to automate this portion of our process. We're currently looking to use a bat file to SVN Update / Checkout the code on the remote servers. We have an integration server where we currently checkout our repository to then copy the code to the remote servers. We are trying to do away with this method as we are using a large amount of bandwidth that is not really necessary. Using the SVN update / Checkout method, only the files that are needed will be transmitted to the production servers, or at least that is our thought. Is there something we're missing with this method? Rich Kroll ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268843 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
You mentioned a program called Robocopy in this post. Can you provide some additional information? Robocopy is in the Windows Resource Kit AFAIK, it's a pretty powerful command line tool that you can script to keep folders in sync. As an example, robocopy C:\source \\server\C$\source *.cf* /E /XD .svn This would copy *everything* from C:\source to the destination that matched the *.cf* file pattern and would eXclude Directories that have .svn in their names. You could use the /MIR command to mirror a directory structure too... If you are deploying to multiple servers, you'd still have to FTP (but only to one) then script a batch file using robocopy to mirror the latest code to all the other servers Eg to mirror to 3 servers your batch file would look something like this... robocopy C:\source \\server1\C$\source *.* /MIR robocopy C:\source \\server2\C$\source *.* /MIR robocopy C:\source \\server3\C$\source *.* /MIR Of course robocopy is a very powerful tool and I haven't even scratched the surface of what it can do here... It also requires that you have full control over your servers so you can run scripts on them and that they can all see each other in a Windows Network and can access shares (hidden or not). If it were possible though, I really would recommend using SVN or similar... So many less headaches so much more spare time! Paul ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268868 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
We use SVN to deploy to code to a single server, and then we use DFS to automatically propagate the changes. That of course is the better option if your environment supports it :) Paul ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268869 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
We use UNC shares in our current enviroment but now we are integrating Linux Apache boxes on the front end so in the interim we have a 1TB File (750Mb Raid 5) Server that does NFS and CIFS shares. We are moving to a Netapps Filer in a bit so we just picked up a SNAP Server to hold us over Eric On 2/6/07, Paul Vernon [EMAIL PROTECTED] wrote: We use SVN to deploy to code to a single server, and then we use DFS to automatically propagate the changes. That of course is the better option if your environment supports it :) Paul ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268873 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
And as long as you have Windows and your servers are members of the domain, then your environment should support it. I'm still looking for a similar thing for linux. Russ -Original Message- From: Paul Vernon [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 06, 2007 11:32 AM To: CF-Talk Subject: RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough? We use SVN to deploy to code to a single server, and then we use DFS to automatically propagate the changes. That of course is the better option if your environment supports it :) Paul ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268880 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
I originally set up everything using UNC shares with DFS, but I felt it was a bit slow. I've since ended up using DFS just to replicate the data, and I still access all the data locally. We don't have a huge amount of data though... Lots of files, but total maybe 5gb. Russ -Original Message- From: Eric Haskins [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 06, 2007 2:49 PM To: CF-Talk Subject: Re: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough? We use UNC shares in our current enviroment but now we are integrating Linux Apache boxes on the front end so in the interim we have a 1TB File (750Mb Raid 5) Server that does NFS and CIFS shares. We are moving to a Netapps Filer in a bit so we just picked up a SNAP Server to hold us over Eric On 2/6/07, Paul Vernon [EMAIL PROTECTED] wrote: We use SVN to deploy to code to a single server, and then we use DFS to automatically propagate the changes. That of course is the better option if your environment supports it :) Paul ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268881 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Uploading files to one server, propgating them to many. Was: Client variables? reliable enough?
That SNAP server was the similar solution. Windows boxes can access it as a Mapped Drive or in our case the SNAP server is in the domain so it is a UNC share. The linux boxes access it via NFS so we have one repository for all our files. Now if I can get Serena Mover setup and running it would handle deployment to the File Server. That will require us to get Staging/QA up and running :) Eric On 2/6/07, Russ [EMAIL PROTECTED] wrote: I originally set up everything using UNC shares with DFS, but I felt it was a bit slow. I've since ended up using DFS just to replicate the data, and I still access all the data locally. We don't have a huge amount of data though... Lots of files, but total maybe 5gb. Russ ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:26 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
