Fil v0.11.0, a memory profiler for scientists and data scientists

2020-11-19 Thread Itamar Turner-Trauring
Your code reads some data, processes it, and uses too much memory. In order to reduce memory usage, you need to figure out: 1. Where peak memory usage is, also known as the high-water mark. 2. What code was responsible for allocating the memory that was present at that peak moment. That's exac

Online training June 11, 12: Docker packaging best practices for Python in production

2020-05-22 Thread Itamar Turner-Trauring
You’re about to ship your Python application into production using Docker: your images are going to be critical infrastructure. And that means you need to follow best practices—if you don’t, you risk wasting quite a lot of money: * You don’t want to waste hours every week waiting for slow build

ANN: Eliot 1.0, logging for distributed and complex systems

2017-04-17 Thread Itamar Turner-Trauring
-- Itamar Turner-Trauring -- https://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/

Crochet 1.5.0: Use Twisted in Django, Flask, or anywhere else

2016-04-13 Thread Itamar Turner-Trauring
). If you need help using Crochet (or just general Twisted or Python help) I am currently available for short-term consulting. You can read the documentation at https://crochet.readthedocs.org/. --Itamar Turner-Trauring -- https://mail.python.org/mailman/listinfo/python-announce-l

ANN: Eliot 0.9, the logging system with causality - now with journald support

2015-10-08 Thread Itamar Turner-Trauring
Eliot 0.9 is out, with a new utility for pretty-printing log messages and native journald support [1]. You can now route Eliot logs to journald and when an error occurs easily find all logged actions that led up to that particular error, as opposed to most logging systems where this would involve

ANN: Eliot 0.8, the logging system with causality

2015-08-11 Thread Itamar Turner-Trauring
Most logging systems can tell you what happened; Eliot tells you *why* it happened: $ python linkcheck.py | eliot-tree 4c42a789-76f5-4f0b-b154-3dd0e3041445 +-- check_links@1/started `-- urls: [u'http://google.com', u'http://nosuchurl'] +-- download@2,1/started `-- url: http://googl

Crochet 1.4.0: use Twisted anywhere!

2015-05-08 Thread Itamar Turner-Trauring
s://pypi.python.org/pypi/crochet for downloads. https://crochet.readthedocs.org/ for documentation. --Itamar Turner-Trauring -- https://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/

Eliot 0.7: Logging for complex and distributed systems

2015-04-28 Thread Itamar Turner-Trauring
Imagine you have a client that sends a request to a server and gets back a 500 error. What caused it? If you're using Eliot you can trace the logs across processes: $ cat server.log client.log | python eliottree.py e076ca50-9abc-44b2-95d8-85cf6956bc33 +-- main@1/started |-- process: cl

Eliot 0.6: Logging for Complex & Distributed Systems

2014-12-10 Thread Itamar Turner-Trauring
Eliot is a logging system designed not only for simple applications but for complex applications as well, including distributed systems. Eliot supports simple structured messages but can also record a causal chain of actions happening within and across process boundaries: a logical trace of the sys

Eliot 0.5.0: Structured Logging as Storytelling

2014-10-22 Thread Itamar Turner-Trauring
Eliot provides a structured logging and tracing system for Python that generates log messages describing a forest of nested actions. Actions start and eventually finish, successfully or not. Log messages thus tell a story: what happened and what caused it. Eliot is released by ClusterHQ

Crochet 1.3.0 - Use Twisted Anywhere!

2014-06-02 Thread Itamar Turner-Trauring
Crochet is an MIT-licensed library that makes it easier to use Twisted from regular blocking code. Some use cases include: * Easily use Twisted from a blocking framework like Django or Flask. * Write a library that provides a blocking API, but uses Twisted for its implementation. * Port bl

Eliot: a framework for Logging as Storytelling

2014-05-19 Thread Itamar Turner-Trauring
Eliot provides a structured logging and tracing system for Python that generates log messages describing a forest of nested actions. Actions start and eventually finish, successfully or not. Log messages thus tell a story: what happened and what caused it. Here's what your logs might look like bef

Crochet 1.2.0 - Use Twisted Anywhere!

2014-04-18 Thread Itamar Turner-Trauring
Crochet is an MIT-licensed library that makes it easier to use Twisted from regular blocking code. Some use cases include: * Easily use Twisted from a blocking framework like Django or Flask. * Write a library that provides a blocking API, but uses Twisted for its implementatio

Crochet 1.1.0 - Use Twisted anywhere!

2014-03-17 Thread Itamar Turner-Trauring
Crochet is an MIT-licensed library that makes it easier for blocking or threaded applications like Flask or Django to use the Twisted networking framework. Crochet provides the following features: * Runs Twisted's reactor in a thread it manages. * The reactor shuts down automatically when the

Two day Twisted training in San Francisco, March 11-12 (right before PyCon)

2013-01-14 Thread Itamar Turner-Trauring
002, and is the maintainer of pyOpenSSL. Itamar Turner-Trauring spent many years working on distributed applications as part of ITA Software by Google's airline reservation system, coding in Python (often using Twisted), C++ and a little bit of Common Lisp. Itamar has also worked on projects ran

giljoy 0.1: Find which C functions are holding the global interpreter lock (GIL)

2010-07-21 Thread Itamar Turner-Trauring
Ever wondered which C extension functions ought to be releasing the global interpreter lock? giljoy might be able to help. http://itamarst.org/software/giljoy-0.1.tar.gz Giljoy helps you find C functions that are holding the GIL; in some cases they could release the GIL, thus making your progra