date:20101101

[web2py] Re: PostgreSQL super slowdowns

2010-11-01 Thread Chris

Don't know for sure, as I haven't seen it as much recently. Perhaps it
goes away with frequent usage, but I don't have any good explanations.

On Oct 30, 4:45 am, Thadeus Burgess thade...@thadeusb.com wrote:
I guess its a problem with a postgresql setting, or old drivers maybe?

--
Thadeus

On Sat, Oct 30, 2010 at 12:45 AM, Chris partyonais...@gmail.com wrote:
I was just trying the home page...some selects are run on every page
but as far as I know that's it. The machine's got plenty of memory and
this is a very basic application with probably less than 1MB data
total.

On Oct 29, 7:59 am, Johann Spies johann.sp...@gmail.com wrote:
On 29 October 2010 08:53, Chris partyonais...@gmail.com wrote:

Hey,

I've noticed some serious slowdowns ever since I switched from SQLite
to Postgres. Pages will take MINUTES to load - it's kind of
fascinating.

I have been using both SQLITE and Postgresql (sometimes with the same
content) and did not notice a slowdown. Some of my datasets are quite
large (a dump of a present project's database is about 3G) and I don't
experience any problem on Postgresql.

What exactly were you doing when you noticed this? Inserts? Queries?
CSV-downloads? How much data? How much ram available?

Regards
Johann

--
May grace and peace be yours in abundance through the full knowledge
of God and of Jesus our Lord! His divine power has given us
everything we need for life and godliness through the full knowledge
of the one who called us by his own glory and excellence.
2 Pet. 1:2b,3a

[web2py] Return as unicode instead of str

2010-11-01 Thread cjrh

Some of the data I return from web2py is unicode.  By default, the
text that is return is converted to str:

Table d'h\u00f4te

As you can see, the unicode has been escaped.   This happens because
simplejson.dumps always returns str.   To solve this, I had to do
this:

import gluon.contrib.simplejson as simplejson
return unicode(simplejson.dumps(make_result_list(msg_out, rows,
success)), 'unicode-escape')

Table d'hôte

I attempted to put my code into serializers.py (the json() method),
but webpy would fail to start up for some reason that I don't have the
time to investigate further.  This isn't an error, because the
behaviour of simplejson.dumps is documented, but it was certainly a
gotcha in the sense that it took me a few hours to figure out what was
happening.

[web2py] Re: TextWidget maximum

2010-11-01 Thread SergeyPo

Thank you guys, it worked!

Don't you know the similar problem: I store an object serialized with
pickle into a text field in database. Everything is fine except when I
want to copy serialized object (text) from one web2py instance and
paste into another. When python tries to materialize the object it
says that object security in broken.

Sergey

On 29 окт, 00:05, howesc how...@umich.edu wrote:
 try adding an IS_LENGTH() validator to the field and set the max
 length high enough.  i don't know for sure, but it sounds like there
 is a default max length for text widgets (unless you already have a
 validator that is limiting the size)

 On Oct 28, 7:11 am, SergeyPo ser...@zarealye.com wrote:

  I need to paste large texts into a db table field using appadmin.
  Table field is defined as 'text' and in MySQL is mapped to 'longtext'.
  Longtext capacity is 4GB or so... I need to paste approx. 1 Mb of text
  into the field.

  When I do it in web2py appadmin I get an error enter from 0 to 65536
  characters. I believe this is produced by a widget? How is it
  possible to disable this limit?

[web2py] Re: Return as unicode instead of str

2010-11-01 Thread cjrh

On Nov 1, 11:45 am, cjrh caleb.hatti...@gmail.com wrote:
 Some of the data I return from web2py is unicode.  

Apologies, I meant to specify: using response.json()

Re: [web2py] Re: web2py 1.88.1 is OUT

2010-11-01 Thread Martín Mulone

I'm going to start an w2p-app, called app by an example or testing app. The
idea is to have in one app some code for testing pourpose, that make for
example insert,select,delete like the code in the bottom of sql.py. What do
you think?.

2010/10/30 rochacbruno rochacbr...@gmail.com

 At my company we started to use this

 http://www.reviewboard.org/

 Integrated with hg

 I suggest to start using this integrated with the main web2py repository.

 Enviado via iPhone

 Em 30/10/2010, às 21:33, mart msenecal...@gmail.com escreveu:

  BTW - have you seen Mondrian? - is built on Perforce.
 
  http://video.google.com/videoplay?docid=-8502904076440714866#
 
  Mart
 
 
  On Oct 30, 7:24 pm, mart msenecal...@gmail.com wrote:
  Hey,
 
  Would it make sense not to pull the apps that get built against #head
  revision (unless the goal is to test the apps themselves) and
  preferably just pull the code line it self @ #head revision? (follow
  up on this in next paragraph) And also, I don't know where things
  stand wrt bug tracking, but an important consideration are the bug
  fixes (does this build contain the fix for Bug X?). Typically when
  bugs get resolved/closed, they get verified on a clean slate, then
  once validated  blessed (or rejected), the fix can be made public.
 
  I think the process is pretty close to what Thadeus mentioned, but
  would add the integration to bug tracking (this data is usually made
  part of the release notes specifically instead of a description typed
  in @ commit time). if the desire is automation (smoke tests) that I
  would store the raw data of the generic app in some dedicated
  tables, then re-populate the all-encompassing app with current data.
  By always grabbing latest_row, you keep the previous data for the
  previous build/release intact and in the correct place (so you don't
  need to change the test process from release to release, and you have
  the the build process insert a new set of records @ build time
  referencing the current build. With this, you also have
  reproducibility if needed.
 
  Last point, and I know I am persistently annoying with this, but
  mercurial, IMHO, sucks, sucks a lot. Personally I would use nothing
  less then the best out there, Perforce, specially if considering
  automated testing (again IMHO, but at least a fairly well supported
  statement :)). web2py is Open source, Perforce does give additional
  user licenses to open source projects (I'm sure Massimo would only
  need to make the request (which is online @ perforce .com btw). I
  mention that here because, good testing processes should be well
  integrated to source control. and for the web2py user, offering time
  for testing, a local instance of the perforce server can be installed,
  absolutely free of charge (with a max of 2 user licenses per server -
  more than enough for remote workers who can very easily keep in sync
  with the main web2py server (I work from home (Quebec, Canada), work
  for an American based company (HQ in Sunnyvale) - and that is how I do
  my work, with my local p4D. works like a charm). Anyways, enough of
  that, just thought I'd find another reason to slide that in ;)
 
  regards,
  Mart :)
 
  On Oct 30, 2:58 pm, Luther Goh Lu Feng elf...@yahoo.com wrote:
 
  It is reasonable to suggest a universal test app that will assist in
  the quality assurance of web2py. But I wonder if this will always have
  100% test coverage, given that bugs may appear even when writing test
  cases. This is still a good idea compared to not having a test suite.
 
  However, I think I would have a greater sense of security if I am able
  to test the apps I have written against the nightly/trunk build.
 
  On Oct 31, 1:46 am, Thadeus Burgess thade...@thadeusb.com wrote:
 
  Where should the list of apps come from? I think this is the biggest
  question.
 
  --
  Thadeus
 
  On Sat, Oct 30, 2010 at 12:46 PM, Thadeus Burgess 
 thade...@thadeusb.comwrote:
 
  Someone writes a script to automate the process. Have a list of apps
 that
  we want to be sure are tested and working. The script will download
 web2py
  testing, copy the apps to the downloaded version, fire a process fork
 to
  start that web2py, use urllib or httplib to navigate to each of the
 apps
  pages to verify that things are working. If a response code of 500 is
 ever
  received then go get the error ticket and store it somewhere central
  including which app it came from.
 
  --
  Thadeus
 
  On Sat, Oct 30, 2010 at 9:25 AM, Luther Goh Lu Feng 
 elf...@yahoo.comwrote:
 
  On Oct 30, 7:05 am, mdipierro mdipie...@cs.depaul.edu wrote:
  Normally it goes to the nightly build, perhaps not exactly the
 latest
  but something very close. The bug in question has been there for
 about
  one week. The problem is that nobody tests the nightly build.
 
  Massimo
 
  I would love to have a way to test non stable builds easily with my
  existing apps. How does one do so besides downloading the trunk/
  nightly build,

[web2py] GAE orderby multiple fields

2010-11-01 Thread MicLee

Is it possible to order by multiple fields on GAE?

I tried this (both title and subtitle are strings):
pages = db().select(db.page.ALL,orderby=db.page.title|
db.page.subtitle)

But apparently the results are ordered by the title field only.

Looking into the index.yaml, there is NO composite index for those 2
fields generated.

Thank you.

[web2py] Re: TextWidget maximum

2010-11-01 Thread DenesL

Hi Sergey,

hard to tell without more details.


On Nov 1, 6:10 am, SergeyPo ser...@zarealye.com wrote:
 Thank you guys, it worked!

 Don't you know the similar problem: I store an object serialized with
 pickle into a text field in database. Everything is fine except when I
 want to copy serialized object (text) from one web2py instance and
 paste into another. When python tries to materialize the object it
 says that object security in broken.

 Sergey

 On 29 ÏËÔ, 00:05, howesc how...@umich.edu wrote:

  try adding an IS_LENGTH() validator to the field and set the max
  length high enough. ši don't know for sure, but it sounds like there
  is a default max length for text widgets (unless you already have a
  validator that is limiting the size)

  On Oct 28, 7:11šam, SergeyPo ser...@zarealye.com wrote:

   I need to paste large texts into a db table field using appadmin.
   Table field is defined as 'text' and in MySQL is mapped to 'longtext'.
   Longtext capacity is 4GB or so... I need to paste approx. 1 Mb of text
   into the field.

   When I do it in web2py appadmin I get an error enter from 0 to 65536
   characters. I believe this is produced by a widget? How is it
   possible to disable this limit?

[web2py] rallying developers who are combining Web2py and the Pyjamas compiler

2010-11-01 Thread Carl

hi all,

I've set-up a group on LinkedIn to publicize that developers are
combining Web2py with the Pyjamas compiler*.

If you are using both, please consider joining Web2Pyjamas at
linkedin.com/groups?gid=3634078

This can, I hope, act as a beacon for developers who have found one
side of the equation and are looking for the other.

* Pyjamas (pyjs.org) compiles Python code into JavaScript and can be
easily communicate back and forth to Web2Py server code using jsonrpc.
A short example app can get one started: web2py.com/book/default/
chapter/09

If we can prove a large enough groundswell of use we could then
consider a Google Groups discussion group.

C

Re: [web2py] rallying developers who are combining Web2py and the Pyjamas compiler

2010-11-01 Thread Stef Mientki

On 01-11-2010 13:38, Carl wrote:
 hi all,

 I've set-up a group on LinkedIn to publicize that developers are
 combining Web2py with the Pyjamas compiler*.

 If you are using both, please consider joining Web2Pyjamas at
 linkedin.com/groups?gid=3634078

good idea !
but why again another group ?
The traffic on both PyJamas and Web2Py isn't that high,
couldn't we just use one of these (maybe by using a special tag).

 This can, I hope, act as a beacon for developers who have found one
 side of the equation and are looking for the other.

 * Pyjamas (pyjs.org) compiles Python code into JavaScript and can be
 easily communicate back and forth to Web2Py server code using jsonrpc.
 A short example app can get one started: web2py.com/book/default/
 chapter/09

another demo

http://www.student.tue.nl/W/r.mientki/web2py_cc_pyjamas_css.html
(1200*800, 16 MB, 5 minutes)


 If we can prove a large enough groundswell of use we could then
 consider a Google Groups discussion group.

 C

my 2 cents,
Stef Mientki

[web2py] Re: web2py 1.88.1 is OUT

2010-11-01 Thread mdipierro

I think this is a good idea.

On Nov 1, 7:24 am, Martín Mulone mulone.mar...@gmail.com wrote:
 I'm going to start an w2p-app, called app by an example or testing app. The
 idea is to have in one app some code for testing pourpose, that make for
 example insert,select,delete like the code in the bottom of sql.py. What do
 you think?.

 2010/10/30 rochacbruno rochacbr...@gmail.com



  At my company we started to use this

 http://www.reviewboard.org/

  Integrated with hg

  I suggest to start using this integrated with the main web2py repository.

  Enviado via iPhone

  Em 30/10/2010, às 21:33, mart msenecal...@gmail.com escreveu:

   BTW - have you seen Mondrian? - is built on Perforce.

  http://video.google.com/videoplay?docid=-8502904076440714866#

   Mart

   On Oct 30, 7:24 pm, mart msenecal...@gmail.com wrote:
   Hey,

   Would it make sense not to pull the apps that get built against #head
   revision (unless the goal is to test the apps themselves) and
   preferably just pull the code line it self @ #head revision? (follow
   up on this in next paragraph) And also, I don't know where things
   stand wrt bug tracking, but an important consideration are the bug
   fixes (does this build contain the fix for Bug X?). Typically when
   bugs get resolved/closed, they get verified on a clean slate, then
   once validated  blessed (or rejected), the fix can be made public.

   I think the process is pretty close to what Thadeus mentioned, but
   would add the integration to bug tracking (this data is usually made
   part of the release notes specifically instead of a description typed
   in @ commit time). if the desire is automation (smoke tests) that I
   would store the raw data of the generic app in some dedicated
   tables, then re-populate the all-encompassing app with current data.
   By always grabbing latest_row, you keep the previous data for the
   previous build/release intact and in the correct place (so you don't
   need to change the test process from release to release, and you have
   the the build process insert a new set of records @ build time
   referencing the current build. With this, you also have
   reproducibility if needed.

   Last point, and I know I am persistently annoying with this, but
   mercurial, IMHO, sucks, sucks a lot. Personally I would use nothing
   less then the best out there, Perforce, specially if considering
   automated testing (again IMHO, but at least a fairly well supported
   statement :)). web2py is Open source, Perforce does give additional
   user licenses to open source projects (I'm sure Massimo would only
   need to make the request (which is online @ perforce .com btw). I
   mention that here because, good testing processes should be well
   integrated to source control. and for the web2py user, offering time
   for testing, a local instance of the perforce server can be installed,
   absolutely free of charge (with a max of 2 user licenses per server -
   more than enough for remote workers who can very easily keep in sync
   with the main web2py server (I work from home (Quebec, Canada), work
   for an American based company (HQ in Sunnyvale) - and that is how I do
   my work, with my local p4D. works like a charm). Anyways, enough of
   that, just thought I'd find another reason to slide that in ;)

   regards,
   Mart :)

   On Oct 30, 2:58 pm, Luther Goh Lu Feng elf...@yahoo.com wrote:

   It is reasonable to suggest a universal test app that will assist in
   the quality assurance of web2py. But I wonder if this will always have
   100% test coverage, given that bugs may appear even when writing test
   cases. This is still a good idea compared to not having a test suite.

   However, I think I would have a greater sense of security if I am able
   to test the apps I have written against the nightly/trunk build.

   On Oct 31, 1:46 am, Thadeus Burgess thade...@thadeusb.com wrote:

   Where should the list of apps come from? I think this is the biggest
   question.

   --
   Thadeus

   On Sat, Oct 30, 2010 at 12:46 PM, Thadeus Burgess 
  thade...@thadeusb.comwrote:

   Someone writes a script to automate the process. Have a list of apps
  that
   we want to be sure are tested and working. The script will download
  web2py
   testing, copy the apps to the downloaded version, fire a process fork
  to
   start that web2py, use urllib or httplib to navigate to each of the
  apps
   pages to verify that things are working. If a response code of 500 is
  ever
   received then go get the error ticket and store it somewhere central
   including which app it came from.

   --
   Thadeus

   On Sat, Oct 30, 2010 at 9:25 AM, Luther Goh Lu Feng 
  elf...@yahoo.comwrote:

   On Oct 30, 7:05 am, mdipierro mdipie...@cs.depaul.edu wrote:
   Normally it goes to the nightly build, perhaps not exactly the
  latest
   but something very close. The bug in question has been there for
  about
   one week. The problem is that nobody tests the nightly build.

[web2py] Re: GAE orderby multiple fields

2010-11-01 Thread mdipierro

This is the code in web2py/gluon/contrib/gql.py

if orderby:
if isinstance(orderby, (list, tuple)):
orderby = gluon.sql.xorify(orderby)
assert_filter_fields(orderby)
if orderby.type == 'id':
orders = ['__key__']
else:
orders = orderby.name.split('|')
for order in orders:
items = items.order(order)


I think web2py handles it correctly. Either there is a problem on the
gae side or the indices have not been created.

On Nov 1, 7:04 am, MicLee lmlll...@gmail.com wrote:
 Is it possible to order by multiple fields on GAE?

 I tried this (both title and subtitle are strings):
 pages = db().select(db.page.ALL,orderby=db.page.title|
 db.page.subtitle)

 But apparently the results are ordered by the title field only.

 Looking into the index.yaml, there is NO composite index for those 2
 fields generated.

 Thank you.

[web2py] I may have missed some posts....

2010-11-01 Thread mdipierro

If there is any open that I missed please ping me.

Re: [web2py] new admin layout

2010-11-01 Thread Albert Abril

Love it.
Better than older, IMHO.

On Mon, Nov 1, 2010 at 6:56 PM, mdipierro mdipie...@cs.depaul.edu wrote:

 There is a new admin layout/style in trunk. I think it looks more
 professional. Feedback... not sure we need another contest (although
 we could). For now I am interested in knowing whether you think this
 is better or worse.

 Massimo

Re: [web2py] new admin layout

2010-11-01 Thread Albert Abril

Just say that in
   changeset:   1108:9d9d4de746af
there's no ...
  img src=/admin/static/gae.pnghttp://127.0.0.1:8000/admin/static/gae.png

..then the img link is broken.

The rest seems OK.


On Mon, Nov 1, 2010 at 7:11 PM, Albert Abril albert.ab...@gmail.com wrote:

 Love it.
 Better than older, IMHO.


 On Mon, Nov 1, 2010 at 6:56 PM, mdipierro mdipie...@cs.depaul.edu wrote:

 There is a new admin layout/style in trunk. I think it looks more
 professional. Feedback... not sure we need another contest (although
 we could). For now I am interested in knowing whether you think this
 is better or worse.

 Massimo

Re: [web2py] I may have missed some posts....

2010-11-01 Thread Branko Vukelic

On Mon, Nov 1, 2010 at 6:57 PM, mdipierro mdipie...@cs.depaul.edu wrote:
 If there is any open that I missed please ping me.

Ping!

http://groups.google.com/group/web2py/browse_thread/thread/af6bbc7f92ed5ce2#

-- 
Branko Vukelić

bg.bra...@gmail.com
stu...@brankovukelic.com

Check out my blog: http://www.brankovukelic.com/
Check out my portfolio: http://www.flickr.com/photos/foxbunny/
Registered Linux user #438078 (http://counter.li.org/)
I hang out on identi.ca: http://identi.ca/foxbunny

Gimp Brushmakers Guild
http://bit.ly/gbg-group

Re: [web2py] new admin layout

2010-11-01 Thread Martín Mulone

Yes, looking great, a way better than the old one!. +1

2010/11/1 Albert Abril albert.ab...@gmail.com

 Just say that in
changeset:   1108:9d9d4de746af
 there's no ...
   img src=/admin/static/gae.pnghttp://127.0.0.1:8000/admin/static/gae.png
 
 ..then the img link is broken.

 The rest seems OK.


 On Mon, Nov 1, 2010 at 7:11 PM, Albert Abril albert.ab...@gmail.comwrote:

 Love it.
 Better than older, IMHO.


 On Mon, Nov 1, 2010 at 6:56 PM, mdipierro mdipie...@cs.depaul.eduwrote:

 There is a new admin layout/style in trunk. I think it looks more
 professional. Feedback... not sure we need another contest (although
 we could). For now I am interested in knowing whether you think this
 is better or worse.

 Massimo






-- 
My blog: http://martin.tecnodoc.com.ar
My portfolio *spanish*: http://www.tecnodoc.com.ar
Checkout my last proyect instant-press: http://www.instant2press.com

Re: [web2py] new admin layout

2010-11-01 Thread Branko Vukelic

Maybe it's just me, and I'm definitely speaking for myself, but the
new orange is difficult to read. I'd prefer a darker shade or a darker
color.

On Mon, Nov 1, 2010 at 7:16 PM, Albert Abril albert.ab...@gmail.com wrote:
 Just say that in
    changeset:   1108:9d9d4de746af
 there's no ...
   img src=/admin/static/gae.png
 ..then the img link is broken.
 The rest seems OK.

 On Mon, Nov 1, 2010 at 7:11 PM, Albert Abril albert.ab...@gmail.com wrote:

 Love it.
 Better than older, IMHO.

 On Mon, Nov 1, 2010 at 6:56 PM, mdipierro mdipie...@cs.depaul.edu wrote:

 There is a new admin layout/style in trunk. I think it looks more
 professional. Feedback... not sure we need another contest (although
 we could). For now I am interested in knowing whether you think this
 is better or worse.

 Massimo





-- 
Branko Vukelić

bg.bra...@gmail.com
stu...@brankovukelic.com

Check out my blog: http://www.brankovukelic.com/
Check out my portfolio: http://www.flickr.com/photos/foxbunny/
Registered Linux user #438078 (http://counter.li.org/)
I hang out on identi.ca: http://identi.ca/foxbunny

Gimp Brushmakers Guild
http://bit.ly/gbg-group

[web2py] Re: new admin layout

2010-11-01 Thread Jose

I like it better than the last.
I made this change because it was hard to distinguish the orange
button:

-- .button {background-color: #DD; padding: 2px 5px 2px 5px; line-
height: 25px;   -moz-border-radius: 3px;-webkit-border-radius:
3px;}

++ .button {background-color: #302D25; padding: 2px 5px 2px 5px; line-
height: 25px;   -moz-border-radius: 3px;-webkit-border-radius:
3px;}

#302D25 is the color of the top bar

Jose

72 matches

Mail list logo