Hey,
Here is what I've done this week, and the most important changes you'll find in
the code:
- PEP8 fixes - Not all variable names were following our naming standards. It
is ok to have camelCase on variable names that comes from protobuf messages (it
is automatic, and we can't fix that) but when we're setting variable names for
our code, we need to use the regular_lower_with_underscore. Didn't fix all the
code, but fixed a lot in several different places.
- Added _generated_media to gitignore
- Removed some .svn files that were inside the repo for some reason
- Added the filetransfers django module to handle the upload of the report
media into gae datastore
- Removed the geodata module completely, and revamped geoip module. It doesn't
use the binary db anymore, and is got some aggregations and caching to speedup
data fetching.
- Created the dbextra module, that adds the ListField (it is a TextField that
can hold lists of values in different formats… useful for aggregations and
tries to mimmic the datastore original ListType). It is got some cool caching
decorators too and some magic to avoid wasting time creating code to handle
cache.
- Fixed the website report creation: it wasn't saving media files from web
pages.
- Ditched almost all ForeignKey fields that I found. These are evil. Mainly in
non relation databases like datastore. Instead, we need to design our data
model to have more aggregations, de-normalize, use more cache and create
invalidation triggers for the cache.
- Moved media files away from the templates dir and into the real static media
file that is managed by the mediagenerator module
- Created a lib for parsing ips and converting them into binary and back into
human readable format
- Fix the suggestion pages to fetch location names from the new geoip system
aggregations rather than from the old geodata module
The full diff:
http://dev.umitproject.org/projects/icm-aggregator/repository/diff?rev=e7de442b6c0bb7400861079f3bb8715c08570fdd&rev_to=661e148835ebbc6d0f0f7aa42a8cbcb567a96a2a
I still need to fix a couple things on the suggestion site to make use of the
geoip (models). As soon as I get this fixed, I'll push, send another email and
deploy to gae.
Cheers!
---
Adriano Monteiro Marques
http://www.thoughtspad.com
http://www.openmonitor.org
http://www.umitproject.org
http://blog.umitproject.org
"Don't stay in bed, unless you can make money in bed." - George Burns
------------------------------------------------------------------------------
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security
threats, fraudulent activity, and more. Splunk takes this data and makes
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2dcopy2
_______________________________________________
Umit-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/umit-devel
