Re: Should I use stackless python or threads?
John Nagle schrieb: Minesh Patel wrote: On Fri, Mar 6, 2009 at 3:16 PM, Jean-Paul Calderone wrote: On Fri, 6 Mar 2009 14:50:51 -0800, Minesh Patel wrote: I am trying to figure out the best approach to solve this problem: I want to poll various directories(can be run in the main thread). Once I notice a file has been added to any directory, I grab a lock, spawn a thread to go perform the necessary actions, and then release the lock. That's not a description of a problem. That's a description of a potential solution. What problem are you trying to solve? I have a build system that is outputting various forms of installations in a particular directory structure, e.g. /pxe-installs, /iso-install, /dd-installs, etc... If this is under Windows, there's a Windows function to monitor a directory for changes. This is far more efficient than polling. For various *nixes there is a similar service called "FAM" available. There seems to be a somewhat dated python version, but as it's bundled with ubuntu intrepid, it should be ok. http://python-fam.sourceforge.net/ Diez -- http://mail.python.org/mailman/listinfo/python-list
Re: Should I use stackless python or threads?
John Nagle wrote: Minesh Patel wrote: On Fri, Mar 6, 2009 at 3:16 PM, Jean-Paul Calderone wrote: On Fri, 6 Mar 2009 14:50:51 -0800, Minesh Patel wrote: I am trying to figure out the best approach to solve this problem: I want to poll various directories(can be run in the main thread). Once I notice a file has been added to any directory, I grab a lock, spawn a thread to go perform the necessary actions, and then release the lock. That's not a description of a problem. That's a description of a potential solution. What problem are you trying to solve? I have a build system that is outputting various forms of installations in a particular directory structure, e.g. /pxe-installs, /iso-install, /dd-installs, etc... If this is under Windows, there's a Windows function to monitor a directory for changes. This is far more efficient than polling. You should be aware, however, that this applies only to Windows folders. If you want to monitor, say, a shared Mac folder from a Windows PC then that Windows function will fail and you'll have to fall back to polling. -- http://mail.python.org/mailman/listinfo/python-list
Re: Should I use stackless python or threads?
Minesh Patel wrote: On Fri, Mar 6, 2009 at 3:16 PM, Jean-Paul Calderone wrote: On Fri, 6 Mar 2009 14:50:51 -0800, Minesh Patel wrote: I am trying to figure out the best approach to solve this problem: I want to poll various directories(can be run in the main thread). Once I notice a file has been added to any directory, I grab a lock, spawn a thread to go perform the necessary actions, and then release the lock. That's not a description of a problem. That's a description of a potential solution. What problem are you trying to solve? I have a build system that is outputting various forms of installations in a particular directory structure, e.g. /pxe-installs, /iso-install, /dd-installs, etc... If this is under Windows, there's a Windows function to monitor a directory for changes. This is far more efficient than polling. John Nagle -- http://mail.python.org/mailman/listinfo/python-list
Re: Should I use stackless python or threads?
On Mar 7, 9:35 am, Minesh Patel wrote: > I need to monitor each directory for the latest install, take it and > go perform some tests on a specific machine. I would like these > testing tasks to run concurrently for the obvious reasons. There are two other options to consider: * greenlet, which has come out of the Stackless project: http://codespeak.net/py/dist/greenlet.html * circuits, which comes with an iNotify driver: http://trac.softcircuit.com.au/circuits/browser/circuits/lib/drivers/inotify_driver.py Both of these libraries favour concurrency over threading, I believe. -- http://mail.python.org/mailman/listinfo/python-list
Re: Should I use stackless python or threads?
Minesh Patel wrote: On Fri, Mar 6, 2009 at 3:16 PM, Jean-Paul Calderone wrote: On Fri, 6 Mar 2009 14:50:51 -0800, Minesh Patel wrote: I am trying to figure out the best approach to solve this problem: I want to poll various directories(can be run in the main thread). Once I notice a file has been added to any directory, I grab a lock, spawn a thread to go perform the necessary actions, and then release the lock. That's not a description of a problem. That's a description of a potential solution. What problem are you trying to solve? I have a build system that is outputting various forms of installations in a particular directory structure, e.g. /pxe-installs, /iso-install, /dd-installs, etc... I need to monitor each directory for the latest install, take it and go perform some tests on a specific machine. I would like these testing tasks to run concurrently for the obvious reasons. Why not use subprocess. For each update to the directory you spawn a new subprocess. -- http://mail.python.org/mailman/listinfo/python-list
Re: Should I use stackless python or threads?
On Fri, Mar 6, 2009 at 3:16 PM, Jean-Paul Calderone wrote: > On Fri, 6 Mar 2009 14:50:51 -0800, Minesh Patel wrote: >> >> I am trying to figure out the best approach to solve this problem: >> >> I want to poll various directories(can be run in the main thread). >> Once I notice a file has been added to any directory, I grab a lock, >> spawn a thread to go perform the necessary actions, and then release >> the lock. > > That's not a description of a problem. That's a description of a potential > solution. What problem are you trying to solve? > I have a build system that is outputting various forms of installations in a particular directory structure, e.g. /pxe-installs, /iso-install, /dd-installs, etc... I need to monitor each directory for the latest install, take it and go perform some tests on a specific machine. I would like these testing tasks to run concurrently for the obvious reasons. Thanks again for the help, Minesh -- http://mail.python.org/mailman/listinfo/python-list
Re: Should I use stackless python or threads?
On Fri, 6 Mar 2009 14:50:51 -0800, Minesh Patel wrote: I am trying to figure out the best approach to solve this problem: I want to poll various directories(can be run in the main thread). Once I notice a file has been added to any directory, I grab a lock, spawn a thread to go perform the necessary actions, and then release the lock. That's not a description of a problem. That's a description of a potential solution. What problem are you trying to solve? -- Thanks for the help, Minesh Patel -- http://mail.python.org/mailman/listinfo/python-list -- http://mail.python.org/mailman/listinfo/python-list
Should I use stackless python or threads?
I am trying to figure out the best approach to solve this problem: I want to poll various directories(can be run in the main thread). Once I notice a file has been added to any directory, I grab a lock, spawn a thread to go perform the necessary actions, and then release the lock. -- Thanks for the help, Minesh Patel -- http://mail.python.org/mailman/listinfo/python-list
