Re: except KeyError, everywhere

2011-06-06 Thread Gabriel Genellina

En Fri, 03 Jun 2011 21:02:56 -0300, Nobody nob...@nowhere.com escribió:


On Fri, 03 Jun 2011 22:08:16 +0200, Wilbert Berendsen wrote:

I find myself all over the place associating objects with each other  
using

dicts as caches:


The general concept is called memoization. There isn't an  
implementation

in the standard library


Yes, there is, in Python 3.2:
http://docs.python.org/py3k/library/functools.html#functools.lru_cache


--
Gabriel Genellina

--
http://mail.python.org/mailman/listinfo/python-list


Re: except KeyError, everywhere

2011-06-06 Thread Ben Finney
Gabriel Genellina gagsl-...@yahoo.com.ar writes:

 En Fri, 03 Jun 2011 21:02:56 -0300, Nobody nob...@nowhere.com escribió:

  On Fri, 03 Jun 2011 22:08:16 +0200, Wilbert Berendsen wrote:
 
  I find myself all over the place associating objects with each
  other using dicts as caches:
 
  The general concept is called memoization. There isn't an
  implementation in the standard library

 Yes, there is, in Python 3.2:
 http://docs.python.org/py3k/library/functools.html#functools.lru_cache

Beauty. Thanks!

-- 
 \ “If we don't believe in freedom of expression for people we |
  `\   despise, we don't believe in it at all.” —Noam Chomsky, |
_o__)   1992-11-25 |
Ben Finney
-- 
http://mail.python.org/mailman/listinfo/python-list


Re: except KeyError, everywhere -- memoization

2011-06-04 Thread Wilbert Berendsen
Hi,
Many thanks for everyone's explanations and pointers!
thanks!
Wilbert Berendsen

-- 
http://www.wilbertberendsen.nl/
You must be the change you wish to see in the world.
-- Mahatma Gandhi
-- 
http://mail.python.org/mailman/listinfo/python-list


except KeyError, everywhere

2011-06-03 Thread Wilbert Berendsen
Hi,

I find myself all over the place associating objects with each other using 
dicts as caches:

something like this:

_cache = {}

def get_something(obj):
Returns the frobnicate-plugin for the specified object.
try:
return _cache[obj]
except KeyError:
res = _cache[obj] = LargeClass(obj)
return res


I would like a dict that would do this by itself, so that I could write:

_cache = somelazydict(LargeClass)

def get_something(obj):
Returns the frobnicate-plugin for the specified object.
return _cache[obj]

or even using the dict directly:

plugin_store = somelazydict(LargeClass)

It seems that I can't use defaultdict for this, because it calls the factory 
function without an argument, where I need to have the key as argument.

So I came up with this (using the __missing__ dict hook since Python 2.5):

class cachedict(dict):
A dict, but with a factory function as the first argument.

On lookup, if the key is missing, the function is called with the key as
argument. The returned value is also stored in the dict.


def __init__(self, func, *args, **kwargs):
Creates the dict, with the factory function as the first argument.

All other arguments work just like dict.


dict.__init__(self, *args, **kwargs)
self.func = func

def __missing__(self, key):
res = self[key] = self.func(key)
return res

Are there other peoply using things like this? Is there a solution like this 
in the standard lib that I'm overlooking? Of course 'except KeyError' 
everywhere is not really a big deal...

With best regards,
Wilbert Berendsen

-- 
http://www.wilbertberendsen.nl/
You must be the change you wish to see in the world.
-- Mahatma Gandhi
-- 
http://mail.python.org/mailman/listinfo/python-list


Re: except KeyError, everywhere

2011-06-03 Thread Nobody
On Fri, 03 Jun 2011 22:08:16 +0200, Wilbert Berendsen wrote:

 I find myself all over the place associating objects with each other using 
 dicts as caches:

 Are there other peoply using things like this? Is there a solution like
 this in the standard lib that I'm overlooking?

The general concept is called memoization. There isn't an implementation
in the standard library, but you'll find plenty of examples, e.g. (from
the first page of Google hits for python memoization):

http://wiki.python.org/moin/PythonDecoratorLibrary#Memoize
http://code.activestate.com/recipes/52201-memoizing-cacheing-function-return-values/
http://code.activestate.com/recipes/577219-minimalistic-memoization/

-- 
http://mail.python.org/mailman/listinfo/python-list


Re: except KeyError, everywhere

2011-06-03 Thread Ben Finney
Wilbert Berendsen wbs...@xs4all.nl writes:

 I find myself all over the place associating objects with each other using 
 dicts as caches:

 something like this:

 _cache = {}

 def get_something(obj):
 Returns the frobnicate-plugin for the specified object.
 try:
 return _cache[obj]
 except KeyError:
 res = _cache[obj] = LargeClass(obj)
 return res

You seem to be looking for the Memoize pattern
URL:https://secure.wikimedia.org/wikipedia/en/wiki/Memoization.

It's best to implement Memoize as a Python decorator in one place
URL:http://wiki.python.org/moin/PythonDecoratorLibrary#Memoize.

Once you have that decorator, apply it to any function you like::

@memoized
def get_something(obj):
 Returns the frobnicate-plugin for the specified object. 
res = LargeClass(obj)
return res

-- 
 \ “Faith may be defined briefly as an illogical belief in the |
  `\  occurrence of the improbable.” —Henry L. Mencken |
_o__)  |
Ben Finney
-- 
http://mail.python.org/mailman/listinfo/python-list


Re: except KeyError, everywhere

2011-06-03 Thread Ben Finney
Ben Finney ben+pyt...@benfinney.id.au writes:

 It's best to implement Memoize as a Python decorator in one place
 URL:http://wiki.python.org/moin/PythonDecoratorLibrary#Memoize.

Michele Simionato discusses a better implementation of a Memoize
decorator in the documentation for his useful ‘decorator’ library
URL:http://micheles.googlecode.com/hg/decorator/documentation.html.

-- 
 \“Stop — Drive sideways.” —detour sign, Kyushu, Japan |
  `\   |
_o__)  |
Ben Finney
-- 
http://mail.python.org/mailman/listinfo/python-list