RE: [web2py] Re: bulk_insert

2011-12-15 Thread Mark Breedveld
I am planning on implementing mongodb bulk inserts. They should be a bit faster.

 

Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens nick name
Verzonden: donderdag 15 december 2011 23:11
Aan: web2py@googlegroups.com
Onderwerp: [web2py] Re: bulk_insert

 

bulk insert is not really bulk except on GAE, although it might potentially be 
in the future. The non GAE implementation at this point is:

def bulk_insert(self, table, items):
return [self.insert(table,item) for item in items]

No database seems to override it.

  _  

Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1890 / Virusdatabase: 2108/4681 - datum van uitgifte: 12/14/11



RE: [web2py] Re: Progress update on Mongodb adapter now forked GIT repo

2011-12-10 Thread Mark Breedveld
I have solved it. The current version didn't offer support for auth.
But now it should have support for every option except connecting without a
database.
I have only tested auth, but it uses
http://www.mongodb.org/display/DOCS/Connections mongodb uri as connection
string. So all options should work.

The new version is in the trunk my forked repo.

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens Alan
Etkin
Verzonden: vrijdag 9 december 2011 15:53
Aan: web2py-users
Onderwerp: [web2py] Re: Progress update on Mongodb adapter now forked GIT
repo

I tried to connect to a MongoHQ with the last web2py source from Google
Code. It raises an exception:

Traceback (most recent call last):
  File /home/alan/web2py-hg/gluon/restricted.py, line 204, in restricted
exec ccode in environment
  File /home/alan/web2py-hg/applications/mongo/models/db.py, line 10, in
module
db = DAL('mongodb://spametki:...@staff.mongohq.com:10039/
spametki')
  File /home/alan/web2py-hg/gluon/dal.py, line 4283, in __init__
self._adapter = ADAPTERS[self._dbname](*args)
  File /home/alan/web2py-hg/gluon/dal.py, line 3770, in __init__
raise SyntaxError, Invalid URI string in DAL: %s % self.uri
SyntaxError: Invalid URI string in DAL:
mongodb://spametki:...@staff.mongohq.com:10039/spametki

Note: i replaced the account password from the connection string with dots
(anyway i could share the password for development if needed)

Thanks

On 8 dic, 17:23, Mark Breedveld markbr...@hotmail.com wrote:
 Yes, that's all

 -Oorspronkelijk bericht-
 Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens 
 Massimo Di Pierro
 Verzonden: donderdag 8 december 2011 16:25
 Aan: web2py-users
 Onderwerp: [web2py] Re: Progress update on Mongodb adapter now forked 
 GIT repo

 I am happy to include this. Do I just need the adapter from your dal?

 On Dec 8, 5:42 am, Mark Breedveld m.breedv...@solcon.nl wrote:



  The GIT repository below contains the Mongodb 
  adapter.https://github.com/MarkBreedveld/web2py

  Currently working
  - Select with
     - startswith, endswith,contains, like,   = = = !=  | IN NOT 
  EQ LIMIT ORDER
     - Snapshot switch
     - safe switch
  - truncate
  - count()
  - drop()
  - create_table()

  TODO
  - update
  - capped collections
  - embedded collections
  - MOD, DIV, SUB, ADD, MUL, AS

  TESTS
  - with AUTH
  - against official SQL LIKE, STARTSWITH, ENDSWITH operators
  - BELONGS
  - writing tests

 -
 Geen virus gevonden in dit bericht.
 Gecontroleerd door AVG -www.avg.com
 Versie: 2012.0.1873 / Virusdatabase: 2102/4667 - datum van uitgifte:
 12/08/11

-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1873 / Virusdatabase: 2102/4668 - datum van uitgifte:
12/08/11



[web2py] Progress update on Mongodb adapter now forked GIT repo

2011-12-08 Thread Mark Breedveld
The GIT repository below contains the Mongodb adapter.
https://github.com/MarkBreedveld/web2py

Currently working
- Select with
   - startswith, endswith,contains, like,   = = = !=  | IN NOT EQ
LIMIT ORDER
   - Snapshot switch
   - safe switch
- truncate
- count()
- drop()
- create_table()

TODO
- update
- capped collections
- embedded collections
- MOD, DIV, SUB, ADD, MUL, AS

TESTS
- with AUTH
- against official SQL LIKE, STARTSWITH, ENDSWITH operators
- BELONGS
- writing tests


[web2py] idea for embedded documents for document stores which is compatible with SQL

2011-12-08 Thread Mark Breedveld
Hi all,

I would like your opinion on the following matter.
There are currently two document store adapters in web2py.
CouchDB and Mongodb, both still highly experimental.

Now would it be nice if there was a way in which we could define
embedded documents in a way that is still compatible with SQL.
My first thoughts on this topic are that we could map them like this.

db.define_table(MAIN,FIELD(subdoc,reference SUBDOC,embed=True))
db.define_table(SUBDOC,FIELD(one,'string')

De SQL databases will solve this with a one-many table relation and
the document store will embed it.
But this definition leaves room for mistakes.
- The definition could embed the same subdoc twice, which will work in
the document store, but not in web2py.
- The statement would be implemented in alle SQL adapers
- A definition before the main document will lead to troube

My alternative thoughts on this are like this.
Fields=
[FIELD('fieldone','string',notnull=True),FIELD('fieldtwo','string',notnull=True)]
db.define_table(MAIN,FIELD(subdoc,define_table SUBDOC,Fields))
Again the field gets embedded on document stores and translated into
one-many relationship for SQL stores.

You're comments, ideas or critics please.

regards Mark Breedveld,


RE: [web2py] Re: Progress update on Mongodb adapter now forked GIT repo

2011-12-08 Thread Mark Breedveld
Yes, that's all

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens Massimo
Di Pierro
Verzonden: donderdag 8 december 2011 16:25
Aan: web2py-users
Onderwerp: [web2py] Re: Progress update on Mongodb adapter now forked GIT
repo

I am happy to include this. Do I just need the adapter from your dal?

On Dec 8, 5:42 am, Mark Breedveld m.breedv...@solcon.nl wrote:
 The GIT repository below contains the Mongodb 
 adapter.https://github.com/MarkBreedveld/web2py

 Currently working
 - Select with
    - startswith, endswith,contains, like,   = = = !=  | IN NOT EQ 
 LIMIT ORDER
    - Snapshot switch
    - safe switch
 - truncate
 - count()
 - drop()
 - create_table()

 TODO
 - update
 - capped collections
 - embedded collections
 - MOD, DIV, SUB, ADD, MUL, AS

 TESTS
 - with AUTH
 - against official SQL LIKE, STARTSWITH, ENDSWITH operators
 - BELONGS
 - writing tests

-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1873 / Virusdatabase: 2102/4667 - datum van uitgifte:
12/08/11



RE: [web2py] Re: Converting mongodb collection to row

2011-12-05 Thread Mark Breedveld
Paul Robinson solved it by just inserted the dict from
connection['table'].find() in to an overridden parse function. I have to
figure out how he exactly did it, but I don't think it will take to long
before we have an experimental working mongodb adapter. I'll keep you all
posted.

Regards Mark,

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens Alan
Etkin
Verzonden: zondag 4 december 2011 16:58
Aan: web2py-users
Onderwerp: [web2py] Re: Converting mongodb collection to row

Sorry for the repeated posts:

There is a a couple of mistakes in the last message.

 parse() DAL.BaseAdapter (wich is called by dal's instance .select()

parse() in called by the adapter instance

 method)  receives a rows argument (suposedly a dict returned by 
 ._select()?) and a colnames (a list of fields retrieved from the

the rows parse argument is a row dictionary sequence converted in a
enumerated sequence ((0, first_row_dict), ... (n, nth_row_dict))

I recommend you to follow the actual code, because this can be inaccurate

-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1873 / Virusdatabase: 2102/4654 - datum van uitgifte:
12/03/11



RE: [web2py] mongodb and web2py

2011-12-03 Thread Mark Breedveld
I have also been working on the select matter, so maybe it would be wise to
cooperate?
I can add you to my dropbox and we can work together?

Regards Mark
-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens Paul
Verzonden: zaterdag 3 december 2011 12:03
Aan: web2py-users
Onderwerp: [web2py] mongodb and web2py

Hi All,

Since I'm interested in python, web2py and recently mongodb and after seeing
breedvel...@gmail.com post
http://code.google.com/p/web2py/issues/detail?id=497
to get inserts on the MongoDBAdapter working I've been hacking the
MongoDBAdapter code further to get select (and,or,eq,gt,lt,le,ge,ne
including orderby attribute), count, update and delete, drop and truncate
working. The code is very much a hack, is only going to work for a subset of
the available field types etc, as I'm still learning the dal code and had
issues around the dal using 'id' as a primary key and mongodb using '_id' of
type objectid, pymongo's required syntax etc.. Let me know where to post the
code/changes so others can check this out, I'm not sure if Massimo still had
any plans to implement this adapter?

Thanks

Paul

-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1873 / Virusdatabase: 2102/4653 - datum van uitgifte:
12/02/11



RE: [web2py] Re: Converting mongodb collection to row

2011-12-03 Thread Mark Breedveld
I'm currently modifing the DAL.py file to get DAL working with mongoDB. I
got the insert part working, but the of the select method. So __select is
working, but select() ain't. Because I need to convert a pymongo collection
to a row. The line I point to has been written by Massimo, but isn't
working. I have no idea's at the moment to do this in a general way. The
returned value is a dict or a list of dict's, but of course not formatted in
a DAL way.

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens Alan
Etkin
Verzonden: zaterdag 3 december 2011 17:14
Aan: web2py-users
Onderwerp: [web2py] Re: Converting mongodb collection to row

Mark, i don't understand your post. Did you modify web2py code? Could you
provide a little background on the interface you are working on?
Thank you

On Nov 30, 10:50 am, Mark Breedveld m.breedv...@solcon.nl wrote:
 I have got the select function of mongodb adapter working, but know I 
 need to convert a pymongo cursor to row.
 The point is the pymongo supports nested documents and that can be a 
 bit hard to convert for a parameter of the parse method.

 Here is the select function a have ajusted, but this one won't work 
 with yours because I also altered a lot of other functions. But this 
 is to get the idea. The line that has to be changed is pointed to with
 --
     def select(self,query,fields,attributes):
         #if not isinstance(query,Query):
         #    raise SyntaxError, Not Supported
         definition = self._select(query,fields,attributes)

         ctable = self.connection[str(definition['tablename'])]
         if ((definition['sort'] == None)  (definition['skip'] ==
 None)):
             result = ctable.find(definition['query'])
         elif((definition['sort'] != None)  (definition['skip'] ==
 None)):
             result =
 ctable.find(definition['query']).sort(definition['sort'])
         elif((definition['sort'] == None)  (definition['skip'] !=
 None)):
             result =
 ctable.find(definition['query']).skip(definition['skip'])
         elif((definition['sort'] != None)  (definition['skip'] !=
 None)):
             result =
 ctable.find(definition['query']).sort(definition['sort']).skip(definit
 ion['skip'])
         else:
             raise RuntimeError, No valid query information found
         print str(result)
         #rows = [cols['value'] for cols in result] --- This line 
 converts the result to be parsed
         return self.parse(rows, definition['colnames'], False)

 Anyone with advise on the matter or ideas?

-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1873 / Virusdatabase: 2102/4653 - datum van uitgifte:
12/02/11



RE: [web2py] Re: Converting mongodb collection to row

2011-12-03 Thread Mark Breedveld
It is even more straight forward then that. The result is a list of dict's.
The parsing therefor is not needed. It is simply re-ordering the dict. But
you put the question mark on the right spot. The collections are now equal
to tables, but I not that familiar to python to know how it is done in a
compact and save matter. Cause if a field is empty, then it is not returned
by mongo. Result['fieldname'] would not work. Do result.get('fieldname')
will work, but returns a None value.
I don't want to support sub documents, but maybe later.

There are two questions here.
1. What is the parse function expecting? (you can find it's definition in
baseadapter.parse)

2. What to do with None values, since empty field will not be returned?

regards

Mark,
-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens Alan
Etkin
Verzonden: zondag 4 december 2011 0:36
Aan: web2py-users
Onderwerp: [web2py] Re: Converting mongodb collection to row

When you say that you try to convert a collection to a row, isn't there a
conflict with database systems?

I looking for the first time the mongodb database design, and i assume there
is got to be some sort of mapping of objects:

- A DAL Table is like a Collection
- A DAL Row is (more or less) like a Document
- A DAL Field is like any object stored inside the Document at the root
Document level

As long as there is not more depth in the mongodb object than the described,
the parsing by using a json like simplejson or similar interface should be
straightforward. I think this goes beyond my database skills but i would
like to see the interface implemented if it is available (and shared)
somewhere.

Thanks for your feedback

On Dec 3, 12:35 pm, Mark Breedveld markbr...@hotmail.com wrote:
 I'm currently modifing the DAL.py file to get DAL working withmongoDB. 
 I got the insert part working, but the of the select method. So 
 __select is working, but select() ain't. Because I need to convert a 
 pymongo collection to arow. The line I point to has been written by 
 Massimo, but isn't working. I have no idea's at the moment to do this 
 in a general way. The returned value is a dict or a list of dict's, 
 but of course not formatted in a DAL way.

 -Oorspronkelijk bericht-
 Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens 
 Alan Etkin
 Verzonden: zaterdag 3 december 2011 17:14
 Aan: web2py-users
 Onderwerp: [web2py] Re: Convertingmongodbcollection torow

 Mark, i don't understand your post. Did you modify web2py code? Could 
 you provide a little background on the interface you are working on?
 Thank you

 On Nov 30, 10:50 am, Mark Breedveld m.breedv...@solcon.nl wrote:



  I have got the select function ofmongodbadapter working, but know I 
  need to convert a pymongo cursor torow.
  The point is the pymongo supports nested documents and that can be a 
  bit hard to convert for a parameter of the parse method.

  Here is the select function a have ajusted, but this one won't work 
  with yours because I also altered a lot of other functions. But this 
  is to get the idea. The line that has to be changed is pointed to 
  with
  --
      def select(self,query,fields,attributes):
          #if not isinstance(query,Query):
          #    raise SyntaxError, Not Supported
          definition = self._select(query,fields,attributes)

          ctable = self.connection[str(definition['tablename'])]
          if ((definition['sort'] == None)  (definition['skip'] ==
  None)):
              result = ctable.find(definition['query'])
          elif((definition['sort'] != None)  (definition['skip'] ==
  None)):
              result =
  ctable.find(definition['query']).sort(definition['sort'])
          elif((definition['sort'] == None)  (definition['skip'] !=
  None)):
              result =
  ctable.find(definition['query']).skip(definition['skip'])
          elif((definition['sort'] != None)  (definition['skip'] !=
  None)):
              result =
  ctable.find(definition['query']).sort(definition['sort']).skip(defin
  it
  ion['skip'])
          else:
              raise RuntimeError, No valid query information found
          print str(result)
          #rows = [cols['value'] for cols in result] --- This line 
  converts the result to be parsed
          return self.parse(rows, definition['colnames'], False)

  Anyone with advise on the matter or ideas?

 -
 Geen virus gevonden in dit bericht.
 Gecontroleerd door AVG -www.avg.com
 Versie: 2012.0.1873 / Virusdatabase: 2102/4653 - datum van uitgifte:
 12/02/11

-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1873 / Virusdatabase: 2102/4654 - datum van uitgifte:
12/03/11



RE: [web2py] Re: Converting mongodb collection to row

2011-12-03 Thread Mark Breedveld
That was indeed a bit help full, but I think the parse() functions takes
care of that. Do I'm not sure what that function is expecting, but more
tomorrow. I'm from Europe, so a bit of a hour gab there.

Regards Mark,

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens Alan
Etkin
Verzonden: zondag 4 december 2011 2:21
Aan: web2py-users
Onderwerp: [web2py] Re: Converting mongodb collection to row

I see your point now, you meant a Rows instance (kind of a subset of a
table)
Would you post the exception (if any), when trying to read the query result?

The point is that the select method has to instantiate properly a Rows
object

Have you read this web2py API section?
http://web2py.com/examples/static/epydoc/web2py.gluon.dal.Rows-class.html

I think it could help. That is the object wich is to be returned by a
correct select

Note that the Rows instance is normally returned by this web2py
statement:
dal_instance(query_object).select(*arguments)

On Dec 3, 7:36 pm, Alan Etkin spame...@gmail.com wrote:
 When you say that you try to convert a collection to arow, isn't there 
 a conflict with database systems?

 I looking for the first time themongodbdatabase design, and i assume 
 there is got to be some sort of mapping of objects:

 - A DAL Table is like a Collection
 - A DALRowis (more or less) like a Document
 - A DAL Field is like any object stored inside the Document at the 
 root Document level

 As long as there is not more depth in themongodbobject than the 
 described, the parsing by using a json like simplejson or similar 
 interface should be straightforward. I think this goes beyond my 
 database skills but i would like to see the interface implemented if 
 it is available (and shared) somewhere.

 Thanks for your feedback

 On Dec 3, 12:35 pm, Mark Breedveld markbr...@hotmail.com wrote:

  I'm currently modifing the DAL.py file to get DAL working 
  withmongoDB. I got the insert part working, but the of the select 
  method. So __select is working, but select() ain't. Because I need 
  to convert a pymongo collection to arow. The line I point to has 
  been written by Massimo, but isn't working. I have no idea's at the 
  moment to do this in a general way. The returned value is a dict or 
  a list of dict's, but of course not formatted in a DAL way.

  -Oorspronkelijk bericht-
  Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens 
  Alan Etkin
  Verzonden: zaterdag 3 december 2011 17:14
  Aan: web2py-users
  Onderwerp: [web2py] Re: Convertingmongodbcollection torow

  Mark, i don't understand your post. Did you modify web2py code? 
  Could you provide a little background on the interface you are working
on?
  Thank you

  On Nov 30, 10:50 am, Mark Breedveld m.breedv...@solcon.nl wrote:

   I have got the select function ofmongodbadapter working, but know 
   I need to convert a pymongo cursor torow.
   The point is the pymongo supports nested documents and that can be 
   a bit hard to convert for a parameter of the parse method.

   Here is the select function a have ajusted, but this one won't 
   work with yours because I also altered a lot of other functions. 
   But this is to get the idea. The line that has to be changed is 
   pointed to with
   --
       def select(self,query,fields,attributes):
           #if not isinstance(query,Query):
           #    raise SyntaxError, Not Supported
           definition = self._select(query,fields,attributes)

           ctable = self.connection[str(definition['tablename'])]
           if ((definition['sort'] == None)  (definition['skip'] ==
   None)):
               result = ctable.find(definition['query'])
           elif((definition['sort'] != None)  (definition['skip'] ==
   None)):
               result =
   ctable.find(definition['query']).sort(definition['sort'])
           elif((definition['sort'] == None)  (definition['skip'] !=
   None)):
               result =
   ctable.find(definition['query']).skip(definition['skip'])
           elif((definition['sort'] != None)  (definition['skip'] !=
   None)):
               result =
   ctable.find(definition['query']).sort(definition['sort']).skip(def
   init
   ion['skip'])
           else:
               raise RuntimeError, No valid query information found
           print str(result)
           #rows = [cols['value'] for cols in result] --- This line 
   converts the result to be parsed
           return self.parse(rows, definition['colnames'], False)

   Anyone with advise on the matter or ideas?

  -
  Geen virus gevonden in dit bericht.
  Gecontroleerd door AVG -www.avg.com
  Versie: 2012.0.1873 / Virusdatabase: 2102/4653 - datum van uitgifte:
  12/02/11



-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1873 / Virusdatabase: 2102/4654 - datum van uitgifte:
12/03/11



[web2py] Converting mongodb collection to row

2011-11-30 Thread Mark Breedveld
I have got the select function of mongodb adapter working, but know I
need to convert a pymongo cursor to row.
The point is the pymongo supports nested documents and that can be a
bit hard to convert for a parameter of the parse method.

Here is the select function a have ajusted, but this one won't work
with yours because I also altered a lot of other functions. But this
is to get the idea. The line that has to be changed is pointed to with
--
def select(self,query,fields,attributes):
#if not isinstance(query,Query):
#raise SyntaxError, Not Supported
definition = self._select(query,fields,attributes)

ctable = self.connection[str(definition['tablename'])]
if ((definition['sort'] == None)  (definition['skip'] ==
None)):
result = ctable.find(definition['query'])
elif((definition['sort'] != None)  (definition['skip'] ==
None)):
result =
ctable.find(definition['query']).sort(definition['sort'])
elif((definition['sort'] == None)  (definition['skip'] !=
None)):
result =
ctable.find(definition['query']).skip(definition['skip'])
elif((definition['sort'] != None)  (definition['skip'] !=
None)):
result =
ctable.find(definition['query']).sort(definition['sort']).skip(definition['skip'])
else:
raise RuntimeError, No valid query information found
print str(result)
#rows = [cols['value'] for cols in result] --- This line
converts the result to be parsed
return self.parse(rows, definition['colnames'], False)

Anyone with advise on the matter or ideas?


[web2py] Mongodb - inserts working-but some comments on the code are welcome

2011-11-09 Thread Mark Breedveld
Hi, MongoDB users

 

I currently working on the mongoDB adapter, but I need some feed back.

http://code.google.com/p/web2py/issues/list

Issue 497,499 and 500 will make the inserts in mongodb possible.

But I'm from origin a C# programmer and not used to programming in python.

So maybe that some of the solutions I propose need to be written a bit
different.

 

I have seen a few testers here, so comments are welcome.

 

Mark Breedveld,

Student at University of Rotterdam,



RE: [web2py] Re: Auth in MongoDB

2011-11-05 Thread Mark Breedveld
Hi

Currently MongoDBAdapter in dal can only connect:P
But I have four issue with fixes in the issue list which makes currently
inserts possible.
Next thing I'm going to try is to get select working, but it takes times
because I have to get used to DAL and some features of Python.
I Jave/C# programmer from origin, so it takes some time for me to adapt...
but the works continues since it is part of my university project.
I finaly got it! 

Regards,

Mark

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web2py@googlegroups.com] Namens
Francisco Costa
Verzonden: vrijdag 28 oktober 2011 22:12
Aan: web2py-users
Onderwerp: [web2py] Re: Auth in MongoDB

Hi Samuele, thanks for your answer.
Do you have any idea whats the status of the mongodb adapter development?

 You will be able to do that using DAL with the mongodb adapter (once 
 it is finished); you get that error since Auth() expects a DAL object 
 as the second argument to constructor, in order to access the 
 database; instead, you are passing a pymongo.Collection object that 
 Auth doesn't know how to use..

 For now, the two solutions I see are:
 - temporarily use a sqlite database just to store users/auth stuff
 - write a custom (maybe inheriting) MongoAuth object that acts like 
 Auth but uses mongodb collections to store data

 --
 Samuele ~redShadow~ Santi

-
Geen virus gevonden in dit bericht.
Gecontroleerd door AVG - www.avg.com
Versie: 2012.0.1869 / Virusdatabase: 2092/4597 - datum van uitgifte:
11/04/11



[web2py] Re: MongoDB testing and development

2011-10-28 Thread Mark Breedveld
Found another error, but I can't figure out an solution.
But it must be rather simple.

I use the following model and without auth ofcourse
if not request.env.web2py_runtime_gae:
## if NOT running on Google App Engine use SQLite or other DB
dbp = DAL('mysql://root:MerMB#2#@192.168.2.29/performance') --
this one doesn't matter right know
tdb = DAL('mongodb://mb1/db') -- Connects perfectly, but

tdb.define_table('blog',
Field('name','string'))
tdb.define_table('category',
Field('name',string))
tdb.define_table('post',
Field('category',tdb.category),
Field('blog',tdb.blog),
Field('title',string),
Field('createdt',datetime,default=datetime.datetime.now))
tdb.define_table('comment',
Field('content', text),
Field('createdt',datetime,default=datetime.datetime.now))
tdb.define_table('likepost',
Field('likescomment','boolean'),
Field('comment',tdb.comment))
tdb.define_table('postgps',
Field('latitude',double),
Field('longitude',double),
Field('post',tdb.post))

#Modifications too DAL

def insert(self,table,fields):
ctable = self.connection[table._tablename]
values = dict((k,self.represent(v,table[k].type)) for k,v in
fields) -- This doesn't work
ctable.insert(values)
return uuid2int(id)

def create_table(self, table, migrate=True, fake_migrate=False,
polymodel=None):
capped=0 #process a general solution for this in the table
name?
if capped==0:
pass
else: -- This peace of code will not run, but I'll explain
later
try:
if capped  100 or capped  1:

#TODO throw new Error that this is an illigal
size?
#http://api.mongodb.org/python/current/api/pymongo/
database.html (create_collection())
If I understood well, then capped collections are
quite limited in size
But they also clean themselves, so maybe we could
implement a general log structure on this type of collections
This part of the method cant't be reached right
now, since we can not implement the capped argument

pass
else:
self.connection.create_collection(table,
size=capped, capped=True)
except CollectionInvalid:
pass
#TODO converted uncapped collection to capped
collection
#create capped tables with a fixed length for performance


Traceback (most recent call last):
  File /home/beheerder/web2py/gluon/restricted.py, line 204, in
restricted
exec ccode in environment
  File /home/beheerder/web2py/applications/pt/controllers/
default.py, line 112, in module
  File /home/beheerder/web2py/gluon/globals.py, line 149, in
lambda
self._caller = lambda f: f()
  File /home/beheerder/web2py/applications/pt/controllers/
default.py, line 73, in add_blog
tdb.blog.insert(name=request.vars.name)
  File /home/beheerder/web2py/gluon/dal.py, line 5091, in insert
return self._db._adapter.insert(self,self._listify(fields))
  File /home/beheerder/web2py/gluon/dal.py, line 3754, in insert
values = dict((k,self.represent(v,table[k].type)) for k,v in
fields)
  File /home/beheerder/web2py/gluon/dal.py, line 3754, in genexpr
values = dict((k,self.represent(v,table[k].type)) for k,v in
fields)
  File /home/beheerder/web2py/gluon/dal.py, line 4976, in
__getitem__
return dict.__getitem__(self, str(key))
KeyError: 'blog.name'

Any idea? My suggestion is that the fields are not loaded some how,
because of the create function?

On 21 okt, 17:01, Massimo Di Pierro massimo.dipie...@gmail.com
wrote:
 yes.

 On Oct 21, 2:55 am,MarkBreedveld m.breedv...@solcon.nl wrote:







  Dear Massimo,

  I downloaded the trunk and I am currently testing the MongoDB Adapter
  and I can tell that inserting currently isn't working. Also the
  creation of tables doesn't work.

  First question, shall I put the bugs and improvements that I find in
  the Issue list or just in this discussion?

  Secondly, the create_table method, is it possible to just skip the
  function with a pass command? Cause collection in mongodb are created
  on first insert of an document. There are capped collections in
  MongoDB which offer better performance, but there data size is fixed.
  My advise would be that by default the model is just passed(if not
  needed somewhere else in web2py) and we could later implement the
  capped collections. Because I want to have the adapter working first.

  def create_table(self, table, migrate=True, fake_migrate=False,
  polymodel=None):
          pass
                  #May capped collection 
  here?http://www.mongodb.org/display/DOCS/Capped+Collections
                  #because pymongo create collection on first insert 
  (inserting a
  document)http://api.mongodb.org/python/2.0/tutorial.html

  RegardsMark,


[web2py] MongoDB testing and development

2011-10-21 Thread Mark Breedveld
Dear Massimo,

I downloaded the trunk and I am currently testing the MongoDB Adapter
and I can tell that inserting currently isn't working. Also the
creation of tables doesn't work.

First question, shall I put the bugs and improvements that I find in
the Issue list or just in this discussion?

Secondly, the create_table method, is it possible to just skip the
function with a pass command? Cause collection in mongodb are created
on first insert of an document. There are capped collections in
MongoDB which offer better performance, but there data size is fixed.
My advise would be that by default the model is just passed(if not
needed somewhere else in web2py) and we could later implement the
capped collections. Because I want to have the adapter working first.

def create_table(self, table, migrate=True, fake_migrate=False,
polymodel=None):
pass
#May capped collection here? 
http://www.mongodb.org/display/DOCS/Capped+Collections
#because pymongo create collection on first insert (inserting a
document) http://api.mongodb.org/python/2.0/tutorial.html

Regards Mark,


[web2py] Re: Packaging web2py for Debian

2010-10-16 Thread Mark Breedveld
Some packager told as that libraries should be in some directory
according too the guidelines. I checked it back then and he was right.
But I don't now how heavy that counts.

It would also be easier to update several instances of web2py since
the most updates will happen there.

But if you say you can pass the guidelines, please do so.
Because it makes it more complex than necessary.

Mark

On Oct 15, 7:06 pm, José L. jredr...@gmail.com wrote:
 On 15 oct, 13:32, Mark Breedveld m.breedv...@solcon.nl wrote:



  You have the idea. Thanks for clearing it towards the others.

  My guesses it we need to do both.
  Because Jose goal is general purpose and mine aswell,
  but comes with overkill in the most cases.

  In Jose case I would suggest a slight change.
 web2py-core
 web2py-gluon

  This has been discusses before, I recall you where in those
  discussions 
  Jose.http://groups.google.com/group/web2py/browse_frm/thread/45ea4327d713b...

 http://groups.google.com/group/web2py/browse_frm/thread/51b731d9abb52...

  There are some other topics, search for turnkeylinux, where this is
  mentioned.

  I recall Dimo Barsky was busy withpackagingGluon, but I've been out
  for a while.
  I don't know him, but he might help with this.

  It was chaos post again, but I hope this one helps:p.

  Mark,

 Thanks, but after looking for more info in the links you provided, I
 have not been able to find the rationale
 for a separate gluon and core packages.

 can anybody enlight me?


[web2py] Re: Packaging web2py for Debian

2010-10-16 Thread Mark Breedveld
 apache2-web2py
Well I originally launched the same plan as you and we also came too
the same conclusion as you. No way too do it, because of the three
reasons I mentioned before.
guidelines, maintainable, etc

So stick to the original plan. Get a simple version of web2py on air.
With documentation.

And if my project succeeds, it will operate as management layer on top
of it. But that's for later and has an other goal.

If that is done, then we could do the apache package.
apache2-wsgi-web2py
apache2-fastgci-web2py
apache2-proxy-web2py
It is possible, but the last time the packaging got stuck on it.

 A pending question is how to deal with the needed writing permisions.
If you want a per user instance, don't separate the admin. And keep
the ports in mind. You can't run every instance on the same port and
you can't give all user the same instance. Would be a major security
leak.

Suggestion: don't do per user instance. But use the same structure as
apache. One instance, one user/group.
If needed users can manual create there own instance.


Just too keep it going and to keep focus. I have simple question,
because I'm loosing track of the discussion.
Can you package web2py as you have in mind, besides the writing
rights? Which you will discuss later on I guess.

Mark,


[web2py] Re: Packaging web2py for Debian

2010-10-15 Thread Mark Breedveld
You have the idea. Thanks for clearing it towards the others.

My guesses it we need to do both.
Because Jose goal is general purpose and mine aswell,
but comes with overkill in the most cases.

In Jose case I would suggest a slight change.
web2py-core
web2py-gluon

This has been discusses before, I recall you where in those
discussions Jose.
http://groups.google.com/group/web2py/browse_frm/thread/45ea4327d713bdd8/f4a9c8160432cfbb?hl=enlnk=gstq=debian#f4a9c8160432cfbb

http://groups.google.com/group/web2py/browse_frm/thread/51b731d9abb5270d/550ed09fbf7af9f2?hl=enlnk=gstq=debian#550ed09fbf7af9f2

There are some other topics, search for turnkeylinux, where this is
mentioned.

I recall Dimo Barsky was busy with packaging Gluon, but I've been out
for a while.
I don't know him, but he might help with this.

It was chaos post again, but I hope this one helps:p.

Mark,

On 14 okt, 23:51, Christopher Steel chris.st...@gmail.com wrote:
 If your break things down into one or more “debian” packages and at
 least one web2py application you could end up with a phenomenally
 powerful and easy to maintain setup that could have resounding
 repercussions, so to speak, for all parties.

 How does the following example sound?

 Package 1, web2py

 sudo apt-get install web2py

         unpacks a stable version of web2py to the users home directory if one
 does not exist.

         /home/mary/web2py/web2py

 Adds scripts for starting, stopping and restarting web2py using the
 web2py *built in* web server. An option to install to a directory
 other than the “default” can be made available as well.

 Advantages
 - Always works
 - Does not break anything, ever
 - Easy to customize
 - Highly portable
 - Can start developing right away
 - Easy to implement
 - easy to clean up via apt-get purge and so on.
 - easy to backup, delete, upgrade etc.

 Disadvantages
 - Might be hard to justify doing a dissertation on this, but using
 Package X the sky is the limit ;)

 Package X example, web2py universal installer

 sudo apt-get install universal-web2py

 If the web2py package is not installed it gets installed, if mercurial
 is not already installed it gets installed. If a clone of the web2py
 application called “universal installer” does not exist, it is created
 in ${HOME}/web2py/web2py/applications. if web2py is not running it
 starts it and opens default browser to the universal application.

 The universal application can do almost anything you like then and you
 would easily create additional packages and so forth in this way.

 People who want a “server installer” can create a “server installer”
 web2py application and /or debian package that could be made available
 via your universal installer.

 Sounds cool!

 Cheers,

 Christopher Steel

 Voice of Access

 On Oct 14, 3:36 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

  Well that makes a hope clear.
  I learned a lot from your explanation.

  You did rule out almost the obstacles.
  And the last one should solve able.
  Changing some process within web2py.

  I need this for my project.
  So if you need anything, please let me know.
  Direct mail will grantee answer...

  and all try to follow this topic.

  Mark,

  On 14 okt, 20:03, José L. jredr...@gmail.com wrote:

   On 14 oct, 17:24, Mark Breedveld m.breedv...@solcon.nl wrote:

I've not so much time.
But we have done this discussion before.
There where three problems with packaging web2py.

- Really frequent release period (not impossible for someone with a
lot time)

   I've already answer this before: Debian sid for frequent uploads,
   debian stable for stable servers (with security patches). The
   frequency the package is updated will depend on how much web2py
   changes between releases. With a good packaging it may take five
   minutes recompiling the package. Also, if the packaging is done via a
   group of people working together in alioth.debian.org it may be
   updated very often.

- Difficult to implement according the packaging guidelines

   That's where I think I can help, with the help of others who know
   better the internals of web2py to solve the problems that may arise.

- Difficult to implement with user separation

   It's related to the above problem, but I think it can be done.

- (Too) many configuration possible

   From my point of view the package only should provide one possible
   configuration, the less intrusive (in terms of changing user
   configurations): use the rocket server and sqlite. It may also provide
   Readme or example files to configure apache, or other servers, but
   that's something not needed to begin to work with web2py. Configuring
   a server is done to put a server in production, and that's something
   that, in my opinion, should always be done manually, not automatically
   by installing a package.

If we solve the above and find someone with enough time. Yes, that
would be perfect and I would support

[web2py] Re: Packaging web2py for Debian

2010-10-14 Thread Mark Breedveld
I've not so much time.
But we have done this discussion before.
There where three problems with packaging web2py.

- Really frequent release period (not impossible for someone with a
lot time)
- Difficult to implement according the packaging guidelines
- Difficult to implement with user separation
- (Too) many configuration possible

If we solve the above and find someone with enough time. Yes, that
would be perfect and I would support that.

The application I have in mind looks like webmin, ecplipse IDE (plugin
framework), netbeans (plugin framework). A kind of universal installer
for web2py. This situation would mean the web2py is plugin in the
system. Every plugin has its own capability's and configuration. like
- Apache ( wsgi+ web2py + mysql + jailroot )
- http ligth + web2py + postgres

But the first release would contain a simple plugin.
Just web2py in some folder under some user.

And the internal updater of web2py is used to update it.

But if you say that this is not allowed.
Then there is only one thing to do.
Find a company or person which has explicit benefit or/and willing to
contribute a large amount of time by packaging.
He/They would become the Release manager of web2py.

regards Mark,

On 14 okt, 08:38, José L. jredr...@gmail.com wrote:
 On 14 oct, 02:36, Mark Breedveld m.breedv...@solcon.nl wrote:



  Hello Guys,

  My apologise for my late update on the project.
  Had to get my propedeuse  :p.

  And next 1 - 1,5 year I hope to do my graduation project on HRO.
  Which I hope is implement or extends web2py manager.

  In other topics we discussed the complexity and problems.
  Some of us agreed that we would make an application that maintains the
  web2py instances.

  I've set up some main features. (MoSCoW)
  - The application must be cross-platform too keep it maintainable for
  us.
  - The application must be run by its own user or the system user
  - The application could support the multiple connectors
  - The application could check/install/config on multiple platforms
  multiple depencies like database/frontend servers

  This is very hard too accomplish. And that's why I want too spend a
  hole year on it.

 That's not a packaging of an application for a distribution. What you
 want to do doesn't exist and, as far as I know, has never being
 integrated in a linux distribution.

 I don't mean you must not do it, I just mean that I don't think your
 work will be accepted in any distribution, but it may be useful as a
 package to be downloaded from the web2py site. But, a package that
 works is different from a package that can be accepted in the official
 repository of a linux distribution.


[web2py] Re: Packaging web2py for Debian

2010-10-14 Thread Mark Breedveld
Well that makes a hope clear.
I learned a lot from your explanation.

You did rule out almost the obstacles.
And the last one should solve able.
Changing some process within web2py.

I need this for my project.
So if you need anything, please let me know.
Direct mail will grantee answer...

and all try to follow this topic.

Mark,



On 14 okt, 20:03, José L. jredr...@gmail.com wrote:
 On 14 oct, 17:24, Mark Breedveld m.breedv...@solcon.nl wrote:

  I've not so much time.
  But we have done this discussion before.
  There where three problems with packaging web2py.

  - Really frequent release period (not impossible for someone with a
  lot time)

 I've already answer this before: Debian sid for frequent uploads,
 debian stable for stable servers (with security patches). The
 frequency the package is updated will depend on how much web2py
 changes between releases. With a good packaging it may take five
 minutes recompiling the package. Also, if the packaging is done via a
 group of people working together in alioth.debian.org it may be
 updated very often.

  - Difficult to implement according the packaging guidelines

 That's where I think I can help, with the help of others who know
 better the internals of web2py to solve the problems that may arise.

  - Difficult to implement with user separation

 It's related to the above problem, but I think it can be done.

  - (Too) many configuration possible

 From my point of view the package only should provide one possible
 configuration, the less intrusive (in terms of changing user
 configurations): use the rocket server and sqlite. It may also provide
 Readme or example files to configure apache, or other servers, but
 that's something not needed to begin to work with web2py. Configuring
 a server is done to put a server in production, and that's something
 that, in my opinion, should always be done manually, not automatically
 by installing a package.





  If we solve the above and find someone with enough time. Yes, that
  would be perfect and I would support that.

  The application I have in mind looks like webmin, ecplipse IDE (plugin
  framework), netbeans (plugin framework). A kind of universal installer
  for web2py. This situation would mean the web2py is plugin in the
  system. Every plugin has its own capability's and configuration. like
  - Apache ( wsgi+ web2py + mysql + jailroot )
  - http ligth + web2py + postgres

  But the first release would contain a simple plugin.
  Just web2py in some folder under some user.

  And the internal updater of web2py is used to update it.

  But if you say that this is not allowed.

 It's not allowed as a Debian package inside Debian repositories, but
 you can do a Debian package with it inside for your personal use, or
 to put it in a web2py download page.

  Then there is only one thing to do.
  Find a company or person which has explicit benefit or/and willing to
  contribute a large amount of time by packaging.
  He/They would become the Release manager of web2py.

 I think I don't understand what you mean or what you would like to do.
 A package maintainer is not a release manager of the application. The
 package maintainer always works with upstream, and after upstream has
 released. It doesn't matter the way upstream releases, and, obviously,
 the release manager must be some of the upstream team. The package
 maintainer doesn't need to be part of the upstream team. He just pick
 up the sources and make a package that fullfils the distribution
 packaging guidelines. I want to have a Debian package of web2py, so I
 volunteer to work on it, but I do not want to be part of the web2py
 release team. I think Massimo is doing a great work with the help of
 many people who know of Python and web development much more than me .
 Also, I don't have any interest in releasing for Mac, windows, or even
 Red Hat. I am just a Debian Developer who is using web2py, knows the
 internal of packaging, has permissions to upload new software to the
 official Debian repository,  and would like to have it in Debian. So
 far, so good. No more ambitions, no more needs.

 Regards
 José L.


[web2py] Re: Packaging web2py for Debian

2010-10-13 Thread Mark Breedveld
Hello Guys,

My apologise for my late update on the project.
Had to get my propedeuse  :p.

And next 1 - 1,5 year I hope to do my graduation project on HRO.
Which I hope is implement or extends web2py manager.

In other topics we discussed the complexity and problems.
Some of us agreed that we would make an application that maintains the
web2py instances.

I've set up some main features. (MoSCoW)
- The application must be cross-platform too keep it maintainable for
us.
- The application must be run by its own user or the system user
- The application could support the multiple connectors
- The application could check/install/config on multiple platforms
multiple depencies like database/frontend servers

This is very hard too accomplish. And that's why I want too spend a
hole year on it.

If is was only for Ubuntu, I would have stolen mdipierro update
application and changed it slightly into a separate application. Asked
if someone here put it in the Ubuntu repository. Still a possibility
for the 2 years which it takes to the final version. If I get there at
all. I'm still a junior and a student:p.

Next week I hope too give you all the application overview, so we can
discuss it.

greetings and another apologise,

Mark Breedveld,
www.markbreedveld.nl

P.s. mdipierro, would it be possible too do the graduation project as
an exchange student at the DePaul University in Chicago. (I would like
too hear your answer off-topic)

On 14 okt, 01:12, Martin.Mulone mulone.mar...@gmail.com wrote:
 On 13 oct, 18:17, Richard richar...@gmail.com wrote:

  I remember talk about ability to upgrade through admin - is that
  practical?

 In production with wsgi-apache2 is not practical.

 A dream if I can do in the server: sudo apt-get update, sudo apt-get
 upgrade.
 The process of debian is very slow, perhaps a ppa. And I think this is
 important for new users.


[web2py] Re: Debian Packaging

2010-07-02 Thread Mark Breedveld
Thanks, i'm currently busy on a class diagram and a technical report
to make the application clear. Because it's quite complex, but
possible.

But in the mean while, I would like to get a list of currently used
configurations.
Like this.
web2py + apache wsgi + postgreSQL (textual configuration)
web2py (textual configuration) + apache proxy (textual configuration)
+ postgreSQL (textual configuration)
web2py (textual configuration) + tomcat  (XML configuration)  +
postgreSQL  (textual configuration) //This will probably not exist,
just an example



On 18 jun, 15:46, Christopher Steel chris.st...@gmail.com wrote:
 Mark,

 That sounds like a great idea.

 Chris

 On Jun 18, 5:33 am, mdipierro mdipie...@cs.depaul.edu wrote:



  This is an excellent idea.

  On Jun 17, 12:35 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

   Hello everone,

   I've two announcements to make.
   First one is that the Hogeschool Rotterdam (HRO) about to launch a
   test educational environment with web2py.
   Tested on GAE and SUN. So support is on his way.

   Secondly I just got an idea with a hole different approach to
   packaging.
   We make a program that manages (create, delete, update, configures)
   multiple instances of web2py with different users and frontend servers
   like apache.
   With configures, I mean the wsgi, fastgci, proxy, but also passwords,
   clustering. etc.
   We upload that single program into the repo.

   - This is ideal for universities how want to give every student a
   web2py server.
   - Hosting compagnies (same idea as above)
   - Single users
   And of course our packagers who have not to take up against the
   release frequency of web2py (which is to high for industrial
   packaging).
   Also it easier the get compliant to the guidelines ofdebian/novell
   opensuse.

   And last but not least. The current publishing way has not the be
   changed.

   I hope the idea is clear and I hope to hear of you al soon.

   regards Mark Breedveld,

   On May 27, 1:38 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

My excuse for my late reaction, but you all landed up my spambox of my
provider.
Which I've solved now.

Thank you both for your reaction.
You're (Jose) right on the best practices.

In order to set up adebianpackaging proces we should have or do the
following
- The web2py community should have a maintainer (group)
       - Which has manage the releases repo's
       - Ajust web2py for use through the repo
              - example : disables the buildin update function /
splits data into the right locations etc

- We should release a debain version on short notice after the sources
release of Massimo.

- We could usehttp://build.opensuse.orgwhichis/looksverygood

Because the maintainer has to invest a lot of time on regular bases.
My idea is to launch a vacature for it on the community.
And have Massimo make a decide how will become the lead packager,
because he will have to work with him

I will testhttp://build.opensuse.orgtolookifit's usefull for
web2py.
My guesses is that it will be.
I hope to do the testing this weekend.

Dimo has been started to package gluon map.
For futher info on the plans. there is another post on this.
Search fordebianon the web2py group and you will found a hole thread
on this.

I hope i have informed you well.

regards Mark Breedveld,www.markbreedveld.nl

On 21 mei, 07:37, Trollkarlen robbelibob...@gmail.com wrote:

 For packaging i sugest using thehttp://build.opensuse.org.
 Its a service where you can package for all mager distros, and have
 them all in se same repo.

 /T

 On 18 Maj, 08:42, José L. jredr...@gmail.com wrote:

  On 17 mayo, 17:32, Mark Breedveld m.breedv...@solcon.nl wrote:

   I've been through the material and it's quite straight forward.
   So we could keep the current packaging system like it's now.

   But we both now that it ain't suitable fordebianpackaging system.
   So I have a tiny idea.

   We start working with a major and a tiny release.
   The major release will not be up to date, but a proven version.
   And released every quarter or half a year. Just like ubuntu.

   This we make it easier for companies to offer long term support.
   Which is an important issue for customers.

   It also shows that web2py has reached the status of an mature
   webserver/framework.

   My excuse for the long waiting for my answer, but I starting my 
   own
   business.
   While I'm also busy with school.

   But I've made request on Hogeschool Rotterdam to support web2py.
   And they where very positieve, so I keep you all posted.

   regards Mark Breedveld,

   On Apr 20, 7:06 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

Thank you very much,
This are some of the answers I was looking for.

I'll dive

[web2py] Re: Debian Packaging

2010-06-17 Thread Mark Breedveld
Hello everone,

I've two announcements to make.
First one is that the Hogeschool Rotterdam (HRO) about to launch a
test educational environment with web2py.
Tested on GAE and SUN. So support is on his way.

Secondly I just got an idea with a hole different approach to
packaging.
We make a program that manages (create, delete, update, configures)
multiple instances of web2py with different users and frontend servers
like apache.
With configures, I mean the wsgi, fastgci, proxy, but also passwords,
clustering. etc.
We upload that single program into the repo.

- This is ideal for universities how want to give every student a
web2py server.
- Hosting compagnies (same idea as above)
- Single users
And of course our packagers who have not to take up against the
release frequency of web2py (which is to high for industrial
packaging).
Also it easier the get compliant to the guidelines of debian/novell
opensuse.

And last but not least. The current publishing way has not the be
changed.

I hope the idea is clear and I hope to hear of you al soon.

regards Mark Breedveld,


On May 27, 1:38 pm, Mark Breedveld m.breedv...@solcon.nl wrote:
 My excuse for my late reaction, but you all landed up my spambox of my
 provider.
 Which I've solved now.

 Thank you both for your reaction.
 You're (Jose) right on the best practices.

 In order to set up adebianpackaging proces we should have or do the
 following
 - The web2py community should have a maintainer (group)
        - Which has manage the releases repo's
        - Ajust web2py for use through the repo
               - example : disables the buildin update function /
 splits data into the right locations etc

 - We should release a debain version on short notice after the sources
 release of Massimo.

 - We could usehttp://build.opensuse.orgwhich is/looks very good

 Because the maintainer has to invest a lot of time on regular bases.
 My idea is to launch a vacature for it on the community.
 And have Massimo make a decide how will become the lead packager,
 because he will have to work with him

 I will testhttp://build.opensuse.orgto look if it's usefull for
 web2py.
 My guesses is that it will be.
 I hope to do the testing this weekend.

 Dimo has been started to package gluon map.
 For futher info on the plans. there is another post on this.
 Search fordebianon the web2py group and you will found a hole thread
 on this.

 I hope i have informed you well.

 regards Mark Breedveld,www.markbreedveld.nl

 On 21 mei, 07:37, Trollkarlen robbelibob...@gmail.com wrote:

  For packaging i sugest using thehttp://build.opensuse.org.
  Its a service where you can package for all mager distros, and have
  them all in se same repo.

  /T

  On 18 Maj, 08:42, José L. jredr...@gmail.com wrote:

   On 17 mayo, 17:32, Mark Breedveld m.breedv...@solcon.nl wrote:

I've been through the material and it's quite straight forward.
So we could keep the current packaging system like it's now.

But we both now that it ain't suitable fordebianpackaging system.
So I have a tiny idea.

We start working with a major and a tiny release.
The major release will not be up to date, but a proven version.
And released every quarter or half a year. Just like ubuntu.

This we make it easier for companies to offer long term support.
Which is an important issue for customers.

It also shows that web2py has reached the status of an mature
webserver/framework.

My excuse for the long waiting for my answer, but I starting my own
business.
While I'm also busy with school.

But I've made request on Hogeschool Rotterdam to support web2py.
And they where very positieve, so I keep you all posted.

regards Mark Breedveld,

On Apr 20, 7:06 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

 Thank you very much,
 This are some of the answers I was looking for.

 I'll dive into it, tomorrow.
 But this gives me an idea about how the release cicle is done.
 And how we could implement thedebianpackages in it.

 Which has been discussed in an 
 earlier.http://groups.google.com/group/web2py/browse_frm/thread/51b731d9abb52...
 This might give an idea why we want to package web2py.

 And the reason I started this post was because I had the same
 questions as you.
 The frequent releases of Massimo etc.
 More than enough to discuss,
 but first I'll study the answer you give me and come up with an idea
 == more questions :p.

 regards

 Mark Breedveld,

   I've found this thread of discussion today. I'am an officialDebian
   developer and was thinking also of packaging web2py forDebian, but
   I've begun to use web2py only a few weeks ago and I prefer to know
   more the framework before trying to package it.
   Anyway, if I've understood it correctly, I've read in this thread that
   you're planning to add the debianization to the web2py sources, so the
   package can be created easily. That's

[web2py] Re: Debian Packaging

2010-06-02 Thread Mark Breedveld
Hello everyone,

I've took a look at build.opensuse.org and seems to be good.
I haven't tested it, but because I do not have time for that.

But I see how it works and packing web2py should not be a problem.
Because it's mainly moving files around and checking depencies.
But as far as I could see it ment for building rmp.
Which are used by the major distrubutions redhat, mandriva and
opensuse.
This ain't bad, but another topic.
This would make the distrubution of a virtual appliance very easy.
Which we could make also there.

My idea is to first create a debian packaging (process).
Which has the difficultes guidelines.
And copy the main structure to opensuse, so we have one and same
structure.
Change it to there guidelines and get a working process for both.

Are there're any volentares for packaging web2py?

Regards

Mark Breedveld
www.markbreedveld.nl


So we have two biggeste package structures filed in.

On 27 mei, 22:24, Mark Breedveld m.breedv...@solcon.nl wrote:
 Well was affraid you would ask that.
 And there're two very good reasons why I should not be me.

 No expirence
 No time at all, full time student with three jobs to pay it.

 But since we have here at least three expirenceddebianpackagers.
 I'll guess we could arange something there.

 But before we run for president:p.
 First package one to see what kind of work has to be done.
 And to turn that in an endless process.

 I was wondering of who has time to package.
 Dimo started to pack to gluon.

 But web2py-core and some others stuff mentionat here 
 :http://groups.google.nl/group/web2py/browse_thread/thread/51b731d9abb...

 And luke, could you invite your friend to this discussion?
 So we all can put things together.

 After the weekend you here about Novell Suse build.
 It seems quite good and i'll think it also is.
 I have worked before with virtual machine builder of Novell Suse.
 Which is also quite good.

 You all here soon of me.

 regards Mark Breedveld,www.markbreedveld.nl


[web2py] Re: Debian Packaging

2010-06-02 Thread Mark Breedveld
Ps. does anyone know how to contact dimo or his progress on the gluon
packages?

On 2 jun, 09:56, Mark Breedveld m.breedv...@solcon.nl wrote:
 Hello everyone,

 I've took a look at build.opensuse.org and seems to be good.
 I haven't tested it, but because I do not have time for that.

 But I see how it works and packing web2py should not be a problem.
 Because it's mainly moving files around and checking depencies.
 But as far as I could see it ment for building rmp.
 Which are used by the major distrubutions redhat, mandriva and
 opensuse.
 This ain't bad, but another topic.
 This would make the distrubution of a virtual appliance very easy.
 Which we could make also there.

 My idea is to first create adebianpackaging (process).
 Which has the difficultes guidelines.
 And copy the main structure to opensuse, so we have one and same
 structure.
 Change it to there guidelines and get a working process for both.

 Are there're any volentares for packaging web2py?

 Regards

 Mark Breedveldwww.markbreedveld.nl

 So we have two biggeste package structures filed in.

 On 27 mei, 22:24, Mark Breedveld m.breedv...@solcon.nl wrote:

  Well was affraid you would ask that.
  And there're two very good reasons why I should not be me.

  No expirence
  No time at all, full time student with three jobs to pay it.

  But since we have here at least three expirenceddebianpackagers.
  I'll guess we could arange something there.

  But before we run for president:p.
  First package one to see what kind of work has to be done.
  And to turn that in an endless process.

  I was wondering of who has time to package.
  Dimo started to pack to gluon.

  But web2py-core and some others stuff mentionat here 
  :http://groups.google.nl/group/web2py/browse_thread/thread/51b731d9abb...

  And luke, could you invite your friend to this discussion?
  So we all can put things together.

  After the weekend you here about Novell Suse build.
  It seems quite good and i'll think it also is.
  I have worked before with virtual machine builder of Novell Suse.
  Which is also quite good.

  You all here soon of me.

  regards Mark Breedveld,www.markbreedveld.nl


[web2py] Re: Debian Packaging

2010-06-02 Thread Mark Breedveld
Correction his name was Dima

On 2 jun, 09:57, Mark Breedveld m.breedv...@solcon.nl wrote:
 Ps. does anyone know how to contactdimoor his progress on the gluon
 packages?

 On 2 jun, 09:56, Mark Breedveld m.breedv...@solcon.nl wrote:

  Hello everyone,

  I've took a look at build.opensuse.org and seems to be good.
  I haven't tested it, but because I do not have time for that.

  But I see how it works and packing web2py should not be a problem.
  Because it's mainly moving files around and checking depencies.
  But as far as I could see it ment for building rmp.
  Which are used by the major distrubutions redhat, mandriva and
  opensuse.
  This ain't bad, but another topic.
  This would make the distrubution of a virtual appliance very easy.
  Which we could make also there.

  My idea is to first create adebianpackaging (process).
  Which has the difficultes guidelines.
  And copy the main structure to opensuse, so we have one and same
  structure.
  Change it to there guidelines and get a working process for both.

  Are there're any volentares for packaging web2py?

  Regards

  Mark Breedveldwww.markbreedveld.nl

  So we have two biggeste package structures filed in.

  On 27 mei, 22:24, Mark Breedveld m.breedv...@solcon.nl wrote:

   Well was affraid you would ask that.
   And there're two very good reasons why I should not be me.

   No expirence
   No time at all, full time student with three jobs to pay it.

   But since we have here at least three expirenceddebianpackagers.
   I'll guess we could arange something there.

   But before we run for president:p.
   First package one to see what kind of work has to be done.
   And to turn that in an endless process.

   I was wondering of who has time to package.
  Dimostarted to pack to gluon.

   But web2py-core and some others stuff mentionat here 
   :http://groups.google.nl/group/web2py/browse_thread/thread/51b731d9abb...

   And luke, could you invite your friend to this discussion?
   So we all can put things together.

   After the weekend you here about Novell Suse build.
   It seems quite good and i'll think it also is.
   I have worked before with virtual machine builder of Novell Suse.
   Which is also quite good.

   You all here soon of me.

   regards Mark Breedveld,www.markbreedveld.nl


[web2py] Re: Debian Packaging

2010-06-02 Thread Mark Breedveld
Correction; I just find out how to build debian packages with
build.opensuse.org
http://wiki.opensuse.org/openSUSE:Build_Service_Debian_builds

So now it seems is a very good plan.

regards Mark Breedveld

On 2 jun, 09:57, Mark Breedveld m.breedv...@solcon.nl wrote:
 Ps. does anyone know how to contactdimoor his progress on the gluon
 packages?

 On 2 jun, 09:56, Mark Breedveld m.breedv...@solcon.nl wrote:

  Hello everyone,

  I've took a look at build.opensuse.org and seems to be good.
  I haven't tested it, but because I do not have time for that.

  But I see how it works and packing web2py should not be a problem.
  Because it's mainly moving files around and checking depencies.
  But as far as I could see it ment for building rmp.
  Which are used by the major distrubutions redhat, mandriva and
  opensuse.
  This ain't bad, but another topic.
  This would make the distrubution of a virtual appliance very easy.
  Which we could make also there.

  My idea is to first create adebianpackaging (process).
  Which has the difficultes guidelines.
  And copy the main structure to opensuse, so we have one and same
  structure.
  Change it to there guidelines and get a working process for both.

  Are there're any volentares for packaging web2py?

  Regards

  Mark Breedveldwww.markbreedveld.nl

  So we have two biggeste package structures filed in.

  On 27 mei, 22:24, Mark Breedveld m.breedv...@solcon.nl wrote:

   Well was affraid you would ask that.
   And there're two very good reasons why I should not be me.

   No expirence
   No time at all, full time student with three jobs to pay it.

   But since we have here at least three expirenceddebianpackagers.
   I'll guess we could arange something there.

   But before we run for president:p.
   First package one to see what kind of work has to be done.
   And to turn that in an endless process.

   I was wondering of who has time to package.
  Dimostarted to pack to gluon.

   But web2py-core and some others stuff mentionat here 
   :http://groups.google.nl/group/web2py/browse_thread/thread/51b731d9abb...

   And luke, could you invite your friend to this discussion?
   So we all can put things together.

   After the weekend you here about Novell Suse build.
   It seems quite good and i'll think it also is.
   I have worked before with virtual machine builder of Novell Suse.
   Which is also quite good.

   You all here soon of me.

   regards Mark Breedveld,www.markbreedveld.nl


[web2py] Re: Debian Packaging

2010-05-27 Thread Mark Breedveld
My excuse for my late reaction, but you all landed up my spambox of my
provider.
Which I've solved now.

Thank you both for your reaction.
You're (Jose) right on the best practices.

In order to set up a debian packaging proces we should have or do the
following
- The web2py community should have a maintainer (group)
   - Which has manage the releases repo's
   - Ajust web2py for use through the repo
  - example : disables the buildin update function /
splits data into the right locations etc

- We should release a debain version on short notice after the sources
release of Massimo.

- We could use http://build.opensuse.org which is/looks very good

Because the maintainer has to invest a lot of time on regular bases.
My idea is to launch a vacature for it on the community.
And have Massimo make a decide how will become the lead packager,
because he will have to work with him

I will test http://build.opensuse.org to look if it's usefull for
web2py.
My guesses is that it will be.
I hope to do the testing this weekend.

Dimo has been started to package gluon map.
For futher info on the plans. there is another post on this.
Search for debian on the web2py group and you will found a hole thread
on this.

I hope i have informed you well.

regards Mark Breedveld,
www.markbreedveld.nl

On 21 mei, 07:37, Trollkarlen robbelibob...@gmail.com wrote:
 For packaging i sugest using thehttp://build.opensuse.org.
 Its a service where you can package for all mager distros, and have
 them all in se same repo.

 /T

 On 18 Maj, 08:42, José L. jredr...@gmail.com wrote:



  On 17 mayo, 17:32, Mark Breedveld m.breedv...@solcon.nl wrote:

   I've been through the material and it's quite straight forward.
   So we could keep the current packaging system like it's now.

   But we both now that it ain't suitable fordebianpackaging system.
   So I have a tiny idea.

   We start working with a major and a tiny release.
   The major release will not be up to date, but a proven version.
   And released every quarter or half a year. Just like ubuntu.

   This we make it easier for companies to offer long term support.
   Which is an important issue for customers.

   It also shows that web2py has reached the status of an mature
   webserver/framework.

   My excuse for the long waiting for my answer, but I starting my own
   business.
   While I'm also busy with school.

   But I've made request on Hogeschool Rotterdam to support web2py.
   And they where very positieve, so I keep you all posted.

   regards Mark Breedveld,

   On Apr 20, 7:06 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

Thank you very much,
This are some of the answers I was looking for.

I'll dive into it, tomorrow.
But this gives me an idea about how the release cicle is done.
And how we could implement thedebianpackages in it.

Which has been discussed in an 
earlier.http://groups.google.com/group/web2py/browse_frm/thread/51b731d9abb52...
This might give an idea why we want to package web2py.

And the reason I started this post was because I had the same
questions as you.
The frequent releases of Massimo etc.
More than enough to discuss,
but first I'll study the answer you give me and come up with an idea
== more questions :p.

regards

Mark Breedveld,

  I've found this thread of discussion today. I'am an officialDebian
  developer and was thinking also of packaging web2py forDebian, but
  I've begun to use web2py only a few weeks ago and I prefer to know
  more the framework before trying to package it.
  Anyway, if I've understood it correctly, I've read in this thread that
  you're planning to add the debianization to the web2py sources, so the
  package can be created easily. That's a bad practice from theDebian
  point of view, and package maintainers encourage upstream not to do
  it, unless upstream is the package maintainer. In fact, it's very
  usual that, if upstream sources contain adebiandirectory, the
  maintainer removes it before adding the definitive one.

  The oficial maintainer must know and modify the debianization all the
  time, so he (or they) are who must write it, not upstream. It's the
  maintainer responsability having it in a good shape inside thedebian
  repository.

  On the other hand, I've also read that you plan to recheck the package
  every quarter of a year. That's not a good practice either, the
  package should be checked when it's needed. I.e: everytime a new
  upstream version is released, on when a bug in the packaging is
  discovered.

  If you want to do theDebianpackage for web2py I recommend you fill a
  ITP (Intend to Package) bug in bugs.debian.org, so you'll be the
  official maintainer of it, and do all the packaging inDebian. Doing
  it in that way, web2py will be in theDebianarchive and,
  automatically, in all its derivatives, as Ubuntu.

  If you need any help, I can lend you a hand, or even do the
  maintaining of web2py

[web2py] Re: Debian Packaging

2010-05-27 Thread Mark Breedveld

Well was affraid you would ask that.
And there're two very good reasons why I should not be me.

No expirence
No time at all, full time student with three jobs to pay it.

But since we have here at least three expirenced debian packagers.
I'll guess we could arange something there.

But before we run for president:p.
First package one to see what kind of work has to be done.
And to turn that in an endless process.

I was wondering of who has time to package.
Dimo started to pack to gluon.

But web2py-core and some others stuff mentionat here :
http://groups.google.nl/group/web2py/browse_thread/thread/51b731d9abb5270d/9ce194a4cc6a9fd6?hl=nllnk=gst;

And luke, could you invite your friend to this discussion?
So we all can put things together.

After the weekend you here about Novell Suse build.
It seems quite good and i'll think it also is.
I have worked before with virtual machine builder of Novell Suse.
Which is also quite good.

You all here soon of me.

regards Mark Breedveld,
www.markbreedveld.nl


[web2py] Re: Debian Packaging

2010-05-17 Thread Mark Breedveld
I've been through the material and it's quite straight forward.
So we could keep the current packaging system like it's now.

But we both now that it ain't suitable for debian packaging system.
So I have a tiny idea.

We start working with a major and a tiny release.
The major release will not be up to date, but a proven version.
And released every quarter or half a year. Just like ubuntu.

This we make it easier for companies to offer long term support.
Which is an important issue for customers.

It also shows that web2py has reached the status of an mature
webserver/framework.

My excuse for the long waiting for my answer, but I starting my own
business.
While I'm also busy with school.

But I've made request on Hogeschool Rotterdam to support web2py.
And they where very positieve, so I keep you all posted.

regards Mark Breedveld,

On Apr 20, 7:06 pm, Mark Breedveld m.breedv...@solcon.nl wrote:
 Thank you very much,
 This are some of the answers I was looking for.

 I'll dive into it, tomorrow.
 But this gives me an idea about how the release cicle is done.
 And how we could implement thedebianpackages in it.

 Which has been discussed in an 
 earlier.http://groups.google.com/group/web2py/browse_frm/thread/51b731d9abb52...
 This might give an idea why we want to package web2py.

 And the reason I started this post was because I had the same
 questions as you.
 The frequent releases of Massimo etc.
 More than enough to discuss,
 but first I'll study the answer you give me and come up with an idea
 == more questions :p.

 regards

 Mark Breedveld,


[web2py] Debian Packaging

2010-04-20 Thread Mark Breedveld
Hello Massimo,

I'm almost done with my exames, so i've a little sparetime left.
What brings me back to webpy packaging.

Well I'm fairly new to web2p development.
And have no clue how the process goes.

I read somewhere in the mailinglist that you approve changes.
And publish them into a new version.

My question is:
How and where would you like to have the web2py packaging system
developt?
and
How would you like to have the packaging system to work?

Because if the above statement is right, then you would be the end
user of the packaging system.

I hope you can get me on the road.

regards,

Mark Breedveld,


-- 
Subscription settings: http://groups.google.com/group/web2py/subscribe?hl=en


[web2py] Re: Debian Packaging

2010-04-20 Thread Mark Breedveld
My excuses, that was not what I ment.

I ment was.

How do you package the application before publish it?
Is there a repo? Do have a script to do that?

It is a question about the process, not a technical web2py question.

And my second question was how should we develop the deb package? Is
there a repo that we could use for package code/script? Who approves
or creates the debian packages for every release? And how should we
use it?

I'm new to the opensource, so any advice would be welcome.

regards Mark,

On Apr 20, 4:09 pm, mdipierro mdipie...@cs.depaul.edu wrote:
 This is partially true. I approves changes in the web2py source code
 but I am not convinced that packaging fordebianrequires changing in
 the web2py source code. In fact, I hope it does not. If it does not,
 there is nothing for me to approve, although I will be happy to review
 your proposal and test it.

 Thanks for your help on this.

 Massimo

 On Apr 20, 3:15 am, Mark Breedveld m.breedv...@solcon.nl wrote:

  Hello Massimo,

  I'm almost done with my exames, so i've a little sparetime left.
  What brings me back to webpy packaging.

  Well I'm fairly new to web2p development.
  And have no clue how the process goes.

  I read somewhere in the mailinglist that you approve changes.
  And publish them into a new version.

  My question is:
  How and where would you like to have the web2py packaging system
  developt?
  and
  How would you like to have the packaging system to work?

  Because if the above statement is right, then you would be the end
  user of the packaging system.

  I hope you can get me on the road.

  regards,

  Mark Breedveld,

  --
  Subscription settings:http://groups.google.com/group/web2py/subscribe?hl=en


[web2py] Re: Debian Packaging

2010-04-20 Thread Mark Breedveld
Thank you very much,
This are some of the answers I was looking for.

I'll dive into it, tomorrow.
But this gives me an idea about how the release cicle is done.
And how we could implement the debian packages in it.

Which has been discussed in an earlier.
http://groups.google.com/group/web2py/browse_frm/thread/51b731d9abb5270d/7eb4e9f60e683e01?hl=enlnk=gstq=debian#7eb4e9f60e683e01
This might give an idea why we want to package web2py.

And the reason I started this post was because I had the same
questions as you.
The frequent releases of Massimo etc.
More than enough to discuss,
but first I'll study the answer you give me and come up with an idea
== more questions :p.

regards

Mark Breedveld,


[web2py] Re: Debian / Ubuntu packager needed!

2010-04-03 Thread Mark Breedveld
Hi Dima,

I have to plan my work for the coming weeks.
Because I was wondering when you could need some help.

Because when there is a concrete plan,
I could try to start a project at my school.
Which could give this project a development boost.

We could also start a document on google docs.
To make it more collaborative and a good spread of the work.

Regards Mark Breedveld,


On Mar 23, 8:40 pm, Dima Barsky d...@debian.org wrote:
 On Mar 23, 6:00 pm, mdipierro mdipie...@cs.depaul.edu wrote:

  I do not have any object. I think I need more details to understand it
  better. I think you should give it a shot and we'll see later if we
  find any problem.

 I'm not very happy about this, I would prefer to reach an agreement
 before I start. I would not want to spend several evenings developing
 something that you eventually reject for some ideological reasons.

 Let's do it one step at a time. I'll package the gluon module anyway,
 there seem to be no problems with  it. After that I'll try to write
 down a small document describing the structure of other web2py related
 packages. If you are happy with it I'll go ahead with the second part.
 If not, we'll just stop there.

 Regards,
 Dima.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: Debian / Ubuntu packager needed!

2010-03-23 Thread Mark Breedveld
I'll see both problems and another solution to work around this.
We could install web2py into /usr/ directories with apt.

Then create a startup script that makes a copy of web2py and the
web2py applications that are installed trough apt  to the /var folder.
A so called runtime version of web2py.

We could let the script also take care of different users/password/
applications.

Then i've one minnor question.
Shall we keep the development versions of under var.
Not best location, because var may get destroyed with an exception
for /var/spool

So Dima, do you know a place where we could put the applications
imported through web2py mechanisme?

regards Mark


On Mar 23, 12:38 am, Dima Barsky d...@debian.org wrote:
  Where would you put php files? I have seen them in /var/www/

 Massimo,

 I'm sorry to disappoint you, but any script you might've seen in /var/
 www was not underDebianpackage control, it was installed there
 manually by the administrator. All php files are also installed under /
 usr. If you try to create a package with script in /var most likely it
 will not be accepted intoDebianfor the reasons I mentioned earlier.
 I don't see any other way to make a clean package rather than put the
 code and the runtime data into different directories.

 I still don't understand, what's wrong with a config file for each
 application? This file would say whether the application is editable,
 and where it's runtime files should be located. It the absense of
 config file, it will default to the current layout, so the backward
 compatibility is preserved.

 Regards,
 Dima.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: Debian / Ubuntu packager needed!

2010-03-23 Thread Mark Breedveld
Hi Dimo,

I agree on the fact that there more roles.

And I want to make a clear separation in the repo.
Web2py applications for production use are put in the usr folder.
And copied and protected by a startup script.
For example you could take the write right from /controllers /models /
views
And store static and upload under var or or the user location
mentioned in a email before.
Web2py applications for development are put in the user location or /
var
Together with the application uploaded from web2py own application
mechanism
Those applications may never ever overwrite each other (I agree with
you on that too)


It is the most advance solution till now,
But it's quite complex.
Because of various way to run web2py.

And it isn't very concrete at the moment,
But it's a start.

Regards Mark,


-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens
Dima Barsky
Verzonden: dinsdag 23 maart 2010 11:26
Aan: web2py@googlegroups.com
Onderwerp: Re: [web2py] Re: Debian / Ubuntu packager needed!


On Tue, 23 Mar 2010 02:06:16 -0700 (PDT), Mark Breedveld
m.breedv...@solcon.nl wrote:
 I'll see both problems and another solution to work around this.
 We could install web2py into /usr/ directories with apt.

 Then create a startup script that makes a copy of web2py and the
 web2py applications that are installed trough apt  to the /var folder.
 A so called runtime version of web2py.

This will work, but why would you want to do this? It will create more
problems than it solves.

Imagine the following scenario: you develop a web2py application
called
XYZ, which is packaged and distributed via Debian. A user installs XYZ
version 1.2.3 and starts playing with the runtime version in /var,
adding
new views and controllers and modifying the existing ones. Some time
later
you release XYZ 1.3.0 which gets installed on the user's computer via
an
automatic update. Now there are two version of XYZ on that computer -
the
mainstream 1.3.0 in /usr and user-modified 1.2.3 in /var. The changes
that
you made in 1.3.0 are incompatible with the user's changes, so there
is no
easy way to merge them together. The startup script can not just
override
the user's changes and install 1.3.0 in /var, that would be cruel.
Let's
assume it leaves 1.2.3 in /var intact. Now the user notices a bug in
your
application and decides to submit a bug report using one of the
standard
bug-reporting tools in Debian. The tool looks at the packaging
database and
reports that the user has XYZ 1.3.0 installed. Imagine your confusion
when
you receive this bug report, you thought you had fixed this problem,
but
it's still there. It's a nightmare, I would not want to maintain such
an
application.

Let's admit that there are different roles: developers develop
applications, users use them. When a user wants to become a developer
he
can install the application in his home dir and start working on it.
There
is another class of users who don't have any intention of modifying
the
application. They just want to use it, they want stability and
predictability, and the packaging system gives them that.

Regards,
Dima.

--
You received this message because you are subscribed to the Google
Groups web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to web2py
+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.


On Mar 23, 11:25 am, Dima Barsky d...@debian.org wrote:
 On Tue, 23 Mar 2010 02:06:16 -0700 (PDT), Mark Breedveld

 m.breedv...@solcon.nl wrote:
  I'll see both problems and another solution to work around this.
  We could install web2py into /usr/ directories with apt.

  Then create a startup script that makes a copy of web2py and the
  web2py applications that are installed trough apt  to the /var folder.
  A so called runtime version of web2py.

 This will work, but why would you want to do this? It will create more
 problems than it solves.

 Imagine the following scenario: you develop a web2py application called
 XYZ, which is packaged and distributed viaDebian. A user installs XYZ
 version 1.2.3 and starts playing with the runtime version in /var, adding
 new views and controllers and modifying the existing ones. Some time later
 you release XYZ 1.3.0 which gets installed on the user's computer via an
 automatic update. Now there are two version of XYZ on that computer - the
 mainstream 1.3.0 in /usr and user-modified 1.2.3 in /var. The changes that
 you made in 1.3.0 are incompatible with the user's changes, so there is no
 easy way to merge them together. The startup script can not just override
 the user's changes and install 1.3.0 in /var, that would be cruel. Let's
 assume it leaves 1.2.3 in /var intact. Now the user notices a bug in your
 application and decides to submit a bug report using one of the standard
 bug-reporting tools inDebian

[web2py] Re: Debian / Ubuntu packager needed!

2010-03-23 Thread Mark Breedveld
Hi Kuba,

Your indeed right that web2py is a higher application.
So we could also decide not to pack any web2py applications into the
apt repository.

This is the most easy solution. Single user web2py server.
And to make it according the guidelines, we make a startup script that
create a runtime version. Might have some issues, but nothing to big.

On the other side is solution descrypted in my reply to Dimo.
Which is highly advanced when correctly implemented.
But also very complex for us, but easy, but still advanced and secure
for repository users.

This is what web2py stand for.
A secure, fast and advanced server.

We have to come with a good plan,
because it is hard to change it.

regards Mark

On Mar 22, 9:10 pm, Kuba Kucharski kuba.kuchar...@gmail.com wrote:
 web2py application are higher level. Like php scripts in www
 directory. They are edtable. They are apps within web2py. They are
 isolated and independent. They sometimes contain sqlite data inside.
 web2py is about user-developers. So in some way applications are user
 data. Applying default security policy to such project is a nonsene
 IMHO.

 My opinion is the application folder should go to the home folder of
 the user which runs web2py. Like in Django /home/user/mycode..

 --
 Kuba

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: Debian / Ubuntu packager needed!

2010-03-23 Thread Mark Breedveld
i'm looking forward to your design plan.
It sounds good and i'm confident that it will.

regards

Mark Breedveld,

On Mar 23, 7:47 pm, mdipierro mdipie...@cs.depaul.edu wrote:
 I understand. You do not have to develop the all thing. Can you show a
 pseudcode example of what the script would do?

 On Mar 23, 1:40 pm, Dima Barsky d...@debian.org wrote:

  On Mar 23, 6:00 pm, mdipierro mdipie...@cs.depaul.edu wrote:

   I do not have any object. I think I need more details to understand it
   better. I think you should give it a shot and we'll see later if we
   find any problem.

  I'm not very happy about this, I would prefer to reach an agreement
  before I start. I would not want to spend several evenings developing
  something that you eventually reject for some ideological reasons.

  Let's do it one step at a time. I'll package the gluon module anyway,
  there seem to be no problems with  it. After that I'll try to write
  down a small document describing the structure of other web2py related
  packages. If you are happy with it I'll go ahead with the second part.
  If not, we'll just stop there.

  Regards,
  Dima.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



RE: [web2py] Re: Debian / Ubuntu packager needed!

2010-03-22 Thread Mark Breedveld
Hi Dima,

I agree on the fact that it is not an elegant solution.
But till now we have we have two possible solutions.

The First one is to create a user web2py and make it a member of www-data. 
And put the application in the home folder which will work.
- No diskprotected multi-user system (or it has be programmed into web2py)
+ easy done with no modification to web2py
 

The second solution
With symlinks (see mail history)
+ multi-user and protected by file system
- possible securite leaks through web2py application data (Massimo?)
+ easy to update through apt

The read only problem could be fixed with the Group rights.
We could grant the www-data only write rights, 
And the web2py user only read rights and member of www-data group.
This will make sure that users can't read each other files, 
but still can write in the app dictory by its Group rights.

I hope to starting testing a few of those things on short notice.
But i'm quite busy at the moment, so it might take a few days.

And there are a few things more to discuss.
Coming in my following mail later this day.

Regards Mark Breedveld, 

Ps. Massimo could you make a seperation between app and user data?

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens Dima
Barsky
Verzonden: zondag 21 maart 2010 17:32
Aan: web2py-users
Onderwerp: [web2py] Re: Debian / Ubuntu packager needed!

Hi Mark,

The idea with symlinks might work, although it's not very elegant.

Packaging individual applications is not easy either, there is another
problem I forgot to mention. Currently web2py assumes that it has
write permissions for the whole web2py directories (including
subdirectories).  It creates various files inside the application's
directory - databases, error tickets, session-related files, and so
on.  That would never work with a debian package, all runtime files
should be created under /var/run.  In short, the web2py code should be
able to run from a read-only directory structure.  I guess it'll take
a fair amount of work to achieve this, I don't feel confident enough
to do this on my own. Any volunteers?

Regards,
Dima.


On Mar 21, 3:08 pm, Mark Breedveld m.breedv...@solcon.nl wrote:
 Thank you for your reply.

 Aldo my first reply suggested that I wanted to seperate the admin app.
 This not my intention.
 With web2py-appname.deb was for verified user apps from web2py.com.

 But still your interpretation of it ain't an wrong idee.
 For securite and vps reasons/situations it's required to run in there
 own directory.

 So if possible, we could link the application to user directory
 which means that every user that is running web2py will get a web2py
 directory.
 somethink like.
 /home/user/web2py/
 which contains a symlink to following directories
 /usr/local/bin/web2py/gluon/
 /usr/local/bin/web2py/scripts/
 and the following files
 /usr/local/bin/web2py/web2py.py
 and all other user independent files /*massimo knows which files that
 would be
 create directory
 /home/user/web2py/application
 put a symlink to
 /usr/local/bin/web2py/application/admin/
 then put under
 /home/user/web2py/
 parameters_8000.py

 Then create a start up entry for that user.

 There are a few problems with this plan.
 Does every user has his own web2py?
 Has web2py problems with symlinks?
 Is the symlink a real bottleneck for web2py and should there be a
 hardlink?
 Are the directories accoording the ubuntu guidlines?

 I fairly interested in your opinion.

 regards Mark Breedveld,

 On Mar 21, 1:15 pm, Dima Barsky d...@debian.org wrote:

  On Mar 20, 5:01 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

   The web2py community is searching help ondebian/ ubuntu packaging.
   The are concrete plans to deploy web2py as Turnkey Appliance.

  Mark,

  I'll see what I can do, although it might be not straightforward.
  There is no clear separation in web2py between the library code and
  the user code.  Take, for example, the admin application: it is
  located under the applications directory nearby the user code, but
  it's really part of the core, as web2py refuses to start without it.

  I would say the first step should be to patch web2py to allow the user
  code to be located somewhere else, not in the web2py directory, which
  is currently not possible. I'll give it a go, but I'm not very
  familiar with web2py internals, so I would appreciate a bit of help
  from somebody more experienced. Once this is done, the actual
  packaging will be quite simple.

  Regards,
  Dima.

-- 
You received this message because you are subscribed to the Google Groups
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/web2py?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email

RE: [web2py] Re: Debian / Ubuntu packager needed!

2010-03-22 Thread Mark Breedveld
Hi everyone,

 

Thought that it was possible to pre-compile applications in web2py.

Never used it before, but I found it out on the website.

 

We could consider pre-compiled applications as production applications.

Which means they may not and cannot be edited.

 

All non compiled application could be considers as source/development
applications.

Which may exist in the apt repo.

 

All pre-compiled application should be in the /opt/ directory, If you define
a web2py application as an extention of web2py.

But there is also a say for a web2py app as indepent application, build on
the os web2py.

Which means it should be in the /usr dictory. 

 

The non pre-compiled applications,

Should all be under /var/, because they change.

 

Well I'm not an expert on this topic,

but this is my first interpretation of the guidelines.

Because we should design it prefect and then create work arounds.

My excuse for putting things in a hurry.

 

Regards,

 

Mark Breedveld,

 

-Oorspronkelijk bericht-

Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens Dima
Barsky

Verzonden: maandag 22 maart 2010 18:55

Aan: web2py-users

Onderwerp: [web2py] Re: Debian / Ubuntu packager needed!

 

On Mar 22, 5:33 pm, Kuba Kucharski  mailto:kuba.kuchar...@gmail.com
kuba.kuchar...@gmail.com wrote:

 There are two type of apps:

 

 the core, web2py itself

 

 applications that runs in the web2py environment. Those have to be 

 editable. This is a hard case, since web2py is kind of an OS itself, 

 this should be solved with /var.

 

Kuba, could you clarify please? Why do you think pre-packaged applications
have to be editable?

 

Debian is not unique in this respect, it is generally not a good idea to
modify applications after they have been deployed.  It makes bug reporting
and investigation much more difficult, it makes the intrusion detection
impossible.. should I continue?

 

Regards,

Dima.

 

--

You received this message because you are subscribed to the Google Groups
web2py-users group.

To post to this group, send email to  mailto:web2py@googlegroups.com
web...@googlegroups.com.

To unsubscribe from this group, send email to
mailto:web2py+unsubscr...@googlegroups.com
web2py+unsubscr...@googlegroups.com.

For more options, visit this group at
http://groups.google.com/group/web2py?hl=en
http://groups.google.com/group/web2py?hl=en.

 

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



RE: [web2py] Re: Debian / Ubuntu packager needed!

2010-03-22 Thread Mark Breedveld
Hi Massimo,

I thought that would be.
Because of the cache and sessions dir for example.

But in order to stay close to the guidelines, (which is required for repo)
We need to define the purpose of web2py application folder structure.

But controllers/models/modules/views/cron are the core of a web2py
application.
And should formal be under /opt/or /usr/, right? (See the point of view
in an earlier mail : extension/application)

The /cache, /errors/,sessions, tests are true /var directories and are even
created instantly when missing.

Doubtful for me are /databases /static /languages, I believe that these
should belong in the /var directory.
Because language ain't static and database contains files which are create
on database connection.
Static could contain files which are dynamic from the app view, so I think a
doubtful /var file.

If Massimo or someone else can confirm this.
Then I believe that Dima is able to define a directory structure for non
compiled apps.
With or without links.

I suggest we first do the non compiled apps.
So we can consider that as done.
Before we continue to discuss the compiled apps,

Regards Mark Breedveld, 

P.s. we could create our own apt-repo (like moovidia in its early day), but
this should our last option...

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens
mdipierro
Verzonden: maandag 22 maart 2010 19:29
Aan: web2py-users
Onderwerp: [web2py] Re: Debian / Ubuntu packager needed!

You can bytecode compile hem but you cannot break the deplyment
mechanism. Even bytecode compiled apps must be under a writable
applications, therefore under /vars/

On Mar 22, 1:20 pm, Mark Breedveld m.breedv...@solcon.nl wrote:
 Hi everyone,

 Thought that it was possible to pre-compile applications in web2py.

 Never used it before, but I found it out on the website.

 We could consider pre-compiled applications as production applications.

 Which means they may not and cannot be edited.

 All non compiled application could be considers as source/development
 applications.

 Which may exist in the apt repo.

 All pre-compiled application should be in the /opt/ directory, If you
define
 a web2py application as an extention of web2py.

 But there is also a say for a web2py app as indepent application, build on
 the os web2py.

 Which means it should be in the /usr dictory.

 The non pre-compiled applications,

 Should all be under /var/, because they change.

 Well I'm not an expert on this topic,

 but this is my first interpretation of the guidelines.

 Because we should design it prefect and then create work arounds.

 My excuse for putting things in a hurry.

 Regards,

 Mark Breedveld,

 -Oorspronkelijk bericht-

 Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens Dima
 Barsky

 Verzonden: maandag 22 maart 2010 18:55

 Aan: web2py-users

 Onderwerp: [web2py] Re: Debian / Ubuntu packager needed!

 On Mar 22, 5:33 pm, Kuba Kucharski  mailto:kuba.kuchar...@gmail.com

 kuba.kuchar...@gmail.com wrote:
  There are two type of apps:

  the core, web2py itself

  applications that runs in the web2py environment. Those have to be
  editable. This is a hard case, since web2py is kind of an OS itself,
  this should be solved with /var.

 Kuba, could you clarify please? Why do you think pre-packaged applications
 have to be editable?

 Debian is not unique in this respect, it is generally not a good idea to
 modify applications after they have been deployed.  It makes bug reporting
 and investigation much more difficult, it makes the intrusion detection
 impossible.. should I continue?

 Regards,

 Dima.

 --

 You received this message because you are subscribed to the Google Groups
 web2py-users group.

 To post to this group, send email to  mailto:web2py@googlegroups.com
 web...@googlegroups.com.

 To unsubscribe from this group, send email to
 mailto:web2py+unsubscr...@googlegroups.com
 web2py+unsubscr...@googlegroups.com.

 For more options, visit this group at

http://groups.google.com/group/web2py?hl=enhttp://groups.google.com/group/
web2py?hl=en.

-- 
You received this message because you are subscribed to the Google Groups
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/web2py?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



RE: [web2py] Re: Debian / Ubuntu packager needed!

2010-03-22 Thread Mark Breedveld
Hi everyone,

I agree that it must become /var/web2py/applications, 
because the hole application is dynamic, except for the gluon folder.
Which could be under the py path.

I heard that is possible to cluster web2py by putting it on a central
server.
And start it through a share on another server.
To keep this easily be possible it recommended to keep the data of a web2py
application together.
So it keep possible to mount applications from anywhere, but also to install
them locally.
This would become
I also tested what happens when you remove the rights of the web2py user on
one application.
This will not prevent webserver to run, but it cannot execute that app.

So we could separate web2py applications from several user by their rights.
In order to run those applications we execute a instance under group
www-data, 
But as the application owner. 
This is possible for wsgi, but it has some difficulties for a standalone
execution.
Because every user will need its own port.

Summary
- The application under /var/web2py
- Except for gluon which comes in the python path (if possible)
- Except for /etc/web2py/options_std.py 
- Applications are by default owned by www-data user and group
- except user depend applications which have themselves as owner 
- There is an deamon/start up entry for www-data on port 8000

Definitions
- Web2py applications are for debian interpretation user data
Which is allowed in the var directory.

Open issue
- Where to put web2py.py? //Because this aint user data, but the
application/webserver
- Who decides which package is allowed in the repo? We might contact them.

I hope this is a right conclusion from all those mails

Regards Mark Breedveld,

  
-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens Kuba
Kucharski
Verzonden: maandag 22 maart 2010 21:24
Aan: web2py@googlegroups.com
Onderwerp: Re: [web2py] Re: Debian / Ubuntu packager needed!

So /var/www..

-- 
Kuba

-- 
You received this message because you are subscribed to the Google Groups
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/web2py?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



RE: [web2py] Re: Debian / Ubuntu packager needed!

2010-03-22 Thread Mark Breedveld
Ill used ms outlook as mailer, but I could return to webmail.
If that is the problem.

Mark 

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens
mdipierro
Verzonden: maandag 22 maart 2010 22:54
Aan: web2py-users
Onderwerp: [web2py] Re: Debian / Ubuntu packager needed!

 - Where to put web2py.py? //Because this aint user data, but the
 application/webserver

Do not know but web2py.py should be called by something like /etc/
init.d/web2py

Why all your emails get blocked pending moderation?
It only happens with your emails and I cannot figure out why.
According to google gruous you are allowed to post yet your messages
get stuck.
If no manager is online your messages will not be posted.
If the problem persists I will make you manager and we see how that
works.

Massimo

On Mar 22, 4:33 pm, Mark Breedveld m.breedv...@solcon.nl wrote:
 Hi everyone,

 I agree that it must become /var/web2py/applications,
 because the hole application is dynamic, except for the gluon folder.
 Which could be under the py path.

 I heard that is possible to cluster web2py by putting it on a central
 server.
 And start it through a share on another server.
 To keep this easily be possible it recommended to keep the data of a
web2py
 application together.
 So it keep possible to mount applications from anywhere, but also to
install
 them locally.
 This would become
 I also tested what happens when you remove the rights of the web2py user
on
 one application.
 This will not prevent webserver to run, but it cannot execute that app.

 So we could separate web2py applications from several user by their
rights.
 In order to run those applications we execute a instance under group
 www-data,
 But as the application owner.
 This is possible for wsgi, but it has some difficulties for a standalone
 execution.
 Because every user will need its own port.

 Summary
 - The application under /var/web2py
 - Except for gluon which comes in the python path (if possible)
 - Except for /etc/web2py/options_std.py
 - Applications are by default owned by www-data user and group
 - except user depend applications which have themselves as owner
 - There is an deamon/start up entry for www-data on port 8000

 Definitions
 - Web2py applications are for debian interpretation user data
         Which is allowed in the var directory.

 Open issue
 - Where to put web2py.py? //Because this aint user data, but the
 application/webserver
 - Who decides which package is allowed in the repo? We might contact them.

 I hope this is a right conclusion from all those mails

 Regards Mark Breedveld,

 -Oorspronkelijk bericht-
 Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens Kuba
 Kucharski
 Verzonden: maandag 22 maart 2010 21:24
 Aan: web2py@googlegroups.com
 Onderwerp: Re: [web2py] Re: Debian / Ubuntu packager needed!

 So /var/www..

 --
 Kuba

 --
 You received this message because you are subscribed to the Google Groups
 web2py-users group.
 To post to this group, send email to web...@googlegroups.com.
 To unsubscribe from this group, send email to
 web2py+unsubscr...@googlegroups.com.
 For more options, visit this group
athttp://groups.google.com/group/web2py?hl=en.

-- 
You received this message because you are subscribed to the Google Groups
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/web2py?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: Debian / Ubuntu packager needed!

2010-03-21 Thread Mark Breedveld
Thank you for your reply.

Aldo my first reply suggested that I wanted to seperate the admin app.
This not my intention.
With web2py-appname.deb was for verified user apps from web2py.com.

But still your interpretation of it ain't an wrong idee.
For securite and vps reasons/situations it's required to run in there
own directory.

So if possible, we could link the application to user directory
which means that every user that is running web2py will get a web2py
directory.
somethink like.
/home/user/web2py/
which contains a symlink to following directories
/usr/local/bin/web2py/gluon/
/usr/local/bin/web2py/scripts/
and the following files
/usr/local/bin/web2py/web2py.py
and all other user independent files /*massimo knows which files that
would be
create directory
/home/user/web2py/application
put a symlink to
/usr/local/bin/web2py/application/admin/
then put under
/home/user/web2py/
parameters_8000.py

Then create a start up entry for that user.

There are a few problems with this plan.
Does every user has his own web2py?
Has web2py problems with symlinks?
Is the symlink a real bottleneck for web2py and should there be a
hardlink?
Are the directories accoording the ubuntu guidlines?

I fairly interested in your opinion.

regards Mark Breedveld,

On Mar 21, 1:15 pm, Dima Barsky d...@debian.org wrote:
 On Mar 20, 5:01 pm, Mark Breedveld m.breedv...@solcon.nl wrote:

  The web2py community is searching help ondebian/ ubuntu packaging.
  The are concrete plans to deploy web2py as Turnkey Appliance.

 Mark,

 I'll see what I can do, although it might be not straightforward.
 There is no clear separation in web2py between the library code and
 the user code.  Take, for example, the admin application: it is
 located under the applications directory nearby the user code, but
 it's really part of the core, as web2py refuses to start without it.

 I would say the first step should be to patch web2py to allow the user
 code to be located somewhere else, not in the web2py directory, which
 is currently not possible. I'll give it a go, but I'm not very
 familiar with web2py internals, so I would appreciate a bit of help
 from somebody more experienced. Once this is done, the actual
 packaging will be quite simple.

 Regards,
 Dima.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



RE: [web2py] Re: turnkeylinux help

2010-03-21 Thread Mark Breedveld
Testing a reply from outlook.
Ignore this message

-Oorspronkelijk bericht-
Van: web2py@googlegroups.com [mailto:web...@googlegroups.com] Namens
mdipierro
Verzonden: vrijdag 12 maart 2010 19:12
Aan: web2py-users
Onderwerp: [web2py] Re: turnkeylinux help

My interest in turnkey is that once made it will be available for
vmware, amazon, xen and will show up in the VPS.net list of available
appliances. The rule is that the machine has to be built by their
patching process.

I hit a block there because my patch fails ad apt-get install a module
that is there.
I do not know were to go from here but I will get back at it next
week.

Massimo

On Mar 12, 10:01 am, Christopher Steel chris.st...@gmail.com wrote:
 I ran a test on a virtual machine with similar results.

 If I understand what you are trying to do correctly and  that echo
 message is valid then perhaps the script 'setup-web2py-ubuntu.sh' is
 being run as part of the ISO patching process?

 A better solution might be to put the script on the ISO being created
 and have it run during the eventual system installation via kickstart
 using some other mechanism.

 I am currently looking for ways to automating setting up Ubuntu web2py
 server (hosting) setups for a new Canadian non-profit.

 Please let me know if I can be of further assistance in this or
 similar activities.

 Thanks,

 Chris

 On Mar 11, 11:15 am, mdipierro mdipie...@cs.depaul.edu wrote:

  keep us posted.

  I had some problems with the one I posted:
  1) the apt-get install get stuck and I have to restart a few times
  2) it is supposed to use the PAM user password for admin but PAM does
  not seem to allow the app to login as root
  3) I am using the LAPP appliance and phpPgAdmin does not appear to be
  running.

  On Mar 11, 9:40 am, Mark Breedveld m.breedv...@solcon.nl wrote:

   I have an Turnkey instance ready and try it as soon as possible.

   greetings,

   Mark,

   On 11 mrt, 16:07, Massimo Di Pierro mdipie...@cs.depaul.edu wrote:

Try this

 web2py_patch.zip
3KWeergevenDownloaden

-- 
You received this message because you are subscribed to the Google Groups
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/web2py?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: trunkeylinux help

2010-03-20 Thread Mark Breedveld
Hello,

I'll have tried it again on a turnkey machine on a ESXi 3.5 machine.
But it returns the same error.

rm cannot remove  'web2py_src.zip*

This ain't strange, because you want to remove a file in an folder you
just created.

My suggestions are as following.
place the rm web2py_src.zip after unzip web2py_src.zip.

I haven't test the above statement.
But i will once you have released an new patch.

greetings Mark Breedveld,




On Mar 12, 1:42 pm, Christopher Steel chris.st...@gmail.com wrote:
 I will check this out for you later today as well.

 Chris

 On Feb 17, 1:41 am, Massimo Di Pierro mdipie...@cs.depaul.edu wrote:

  I am trying to make a web2py appliance forturnkeylinux. Once done  
  this will run on xen, vmware and ec2.

  I could use some help. Try this.

  RUN THIS IN A VIRTUAL MACHINE BECAUSE I AM NOT SURE HOW tkpatch  
  THEREFORE I DO NOT KNOW IF THIS MAY MESS UP YOUR SYSTEM. although  
  probably not.

   From a linux box, possibly a virtual machine, as root type

  mkdir tkl
  cd tkl
  apt-get install squashfs-tools genisoimage tar gzip git
  git clone git://github.com/turnkeylinux/tklpatch.git
  cd tklpatch
  make install
  cd ..
  rm -r tkpatch
  wgethttp://downloads.sourceforge.net/project/turnkeylinux/turnkey-lapp/20...
  unzip web2py_patch.zip   the attached file
  tklpatchturnkey-lapp-2009.10-hardy-x86.iso web2py_patch

  This should make a new ISO image that starts up with web2py,  
  phppgadmin, webmin, web based os shell, etc.

  Let me know if you manage to try.

  More detailed explanations are 
  here:http://www.turnkeylinux.org/docs/tklpatch

  Massimo

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: trunkeylinux help

2010-03-20 Thread Mark Breedveld
I also have an other suggestion.
Is it nog possible to search a community member to make a debian
package of web2py.

My suggestions are to make the following package structure.
- web2py_core.deb //Just web2py
- web2py_app_name.deb // A web2py app package example
(web2py_cookbook.deb)
- mod_apache_wsgi_web2py.deb // Configurates web2py as wsgi server
- mod_apache_proxy_web2py.deb // Configurates web2py as proxy server

This will make web2py much easier to install, maintain and
distrubute.

I'm not an debian packager, but i'll wil dive into it.
In the mean while you could find a debian packager.
And publish improved patches.

I would like to hear your opinion on this topic.

greetings Mark Breedveld,

On Mar 3, 2:38 pm, Mark Breedveld m.breedv...@solcon.nl wrote:
 I've done some research onturnkey.
 And its much better than the thing a made.

 I will test it in the coming week.
 and the results will come as soon as possible.

 regards,

 Mark Breedveld,

 On 17 feb, 07:41, Massimo Di Pierro mdipie...@cs.depaul.edu wrote:

  I am trying to make a web2py appliance forturnkeylinux. Once done  
  this will run on xen, vmware and ec2.

  I could use some help. Try this.

  RUN THIS IN A VIRTUAL MACHINE BECAUSE I AM NOT SURE HOW tkpatch  
  THEREFORE I DO NOT KNOW IF THIS MAY MESS UP YOUR SYSTEM. although  
  probably not.

   From a linux box, possibly a virtual machine, as root type

  mkdir tkl
  cd tkl
  apt-get install squashfs-tools genisoimage tar gzip git
  git clone git://github.com/turnkeylinux/tklpatch.git
  cd tklpatch
  make install
  cd ..
  rm -r tkpatch
  wgethttp://downloads.sourceforge.net/project/turnkeylinux/turnkey-lapp/20...
  unzip web2py_patch.zip   the attached file
  tklpatchturnkey-lapp-2009.10-hardy-x86.iso web2py_patch

  This should make a new ISO image that starts up with web2py,  
  phppgadmin, webmin, web based os shell, etc.

  Let me know if you manage to try.

  More detailed explanations are 
  here:http://www.turnkeylinux.org/docs/tklpatch

  Massimo

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Debian / Ubuntu packager needed!

2010-03-20 Thread Mark Breedveld
The web2py community is searching help on debian / ubuntu packaging.
The are concrete plans to deploy web2py as Turnkey Appliance.

http://groups.google.com/group/web2py/browse_thread/thread/7a90b25eef35660e/215e9080c73c8049?hl=enlnk=gstq=turnkey#215e9080c73c8049

But in order to do this in a structural way,
we need to have web2py packaged.

The first suggestions from our side are as follows.
- web2py-core.deb //Just web2py // automated process ???
  - web2py-example.deb //The example apps in web2py
  - web2py-appname.deb //automated process ???

mod-apache-web2py-wsgi.deb //configurated web2py with apache trough
mod_wsgi (now done by a shell script)

The packages above or something like it, are needed for the Turnkey
Appliance.

Optionaly, could there be made a package for proxy or other webservers
like the example below.
mod-apache-web2py-proxy.deb //configurated web2py with apache trough
mod_proxy
and so on...

If you have advice or a contribution, please react.

Greetings,

Mark Breedveld,

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: trunkeylinux help

2010-03-11 Thread Mark Breedveld
I,ve tried to run the patch, but it stops on the following error.

+ echo 'downloading, installing and starting web2py'
downloading, installing and starting web2py
+ echo ===
===
+ cd /home
+ mkdir www-data
+ cd www-data
+ rm 'web2py_src.zip*'
rm: cannot remove `web2py_src.zip*': No such file or directory

I only don't know where this directory is created.
Because it ain't on the local machine.

Maybe i find some time later on to track the message.
The commando i used was en the core iso.
sudo tklpatch turnkey-core-2009.10-hardy-x86.iso web2py_patch

I ran the commando on a ubuntu machine,
but should it not be a core turnkey machine?
Or doesn't that matter?

regards Mark Breedveld,
www.mbreed.nl

On Mar 3, 5:41 am, mdipierro mdipie...@cs.depaul.edu wrote:
 Thank you Mark.

 On Mar 3, 7:38 am, Mark Breedveld m.breedv...@solcon.nl wrote:

  I've done some research on turnkey.
  And its much better than the thing a made.

  I will test it in the coming week.
  and the results will come as soon as possible.

  regards,

  Mark Breedveld,

  On 17 feb, 07:41, Massimo Di Pierro mdipie...@cs.depaul.edu wrote:

   I am trying to make a web2py appliance for turnkey linux. Once done  
   this will run on xen, vmware and ec2.

   I could use some help. Try this.

   RUN THIS IN A VIRTUAL MACHINE BECAUSE I AM NOT SURE HOW tkpatch  
   THEREFORE I DO NOT KNOW IF THIS MAY MESS UP YOUR SYSTEM. although  
   probably not.

    From a linux box, possibly a virtual machine, as root type

   mkdir tkl
   cd tkl
   apt-get install squashfs-tools genisoimage tar gzip git
   git clone git://github.com/turnkeylinux/tklpatch.git
   cd tklpatch
   make install
   cd ..
   rm -r tkpatch
   wgethttp://downloads.sourceforge.net/project/turnkeylinux/turnkey-lapp/20...
   unzip web2py_patch.zip   the attached file
   tklpatch turnkey-lapp-2009.10-hardy-x86.iso web2py_patch

   This should make a new ISO image that starts up with web2py,  
   phppgadmin, webmin, web based os shell, etc.

   Let me know if you manage to try.

   More detailed explanations are 
   here:http://www.turnkeylinux.org/docs/tklpatch

   Massimo

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: turnkeylinux help

2010-03-11 Thread Mark Breedveld
I have an Turnkey instance ready and try it as soon as possible.

greetings,

Mark,

On 11 mrt, 16:07, Massimo Di Pierro mdipie...@cs.depaul.edu wrote:
 Try this

  web2py_patch.zip
 3KWeergevenDownloaden



-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.



[web2py] Re: trunkeylinux help

2010-03-03 Thread Mark Breedveld
I've done some research on turnkey.
And its much better than the thing a made.

I will test it in the coming week.
and the results will come as soon as possible.

regards,

Mark Breedveld,

On 17 feb, 07:41, Massimo Di Pierro mdipie...@cs.depaul.edu wrote:
 I am trying to make a web2py appliance for turnkey linux. Once done  
 this will run on xen, vmware and ec2.

 I could use some help. Try this.

 RUN THIS IN A VIRTUAL MACHINE BECAUSE I AM NOT SURE HOW tkpatch  
 THEREFORE I DO NOT KNOW IF THIS MAY MESS UP YOUR SYSTEM. although  
 probably not.

  From a linux box, possibly a virtual machine, as root type

 mkdir tkl
 cd tkl
 apt-get install squashfs-tools genisoimage tar gzip git
 git clone git://github.com/turnkeylinux/tklpatch.git
 cd tklpatch
 make install
 cd ..
 rm -r tkpatch
 wgethttp://downloads.sourceforge.net/project/turnkeylinux/turnkey-lapp/20...
 unzip web2py_patch.zip   the attached file
 tklpatch turnkey-lapp-2009.10-hardy-x86.iso web2py_patch

 This should make a new ISO image that starts up with web2py,  
 phppgadmin, webmin, web based os shell, etc.

 Let me know if you manage to try.

 More detailed explanations are here:http://www.turnkeylinux.org/docs/tklpatch

 Massimo

-- 
You received this message because you are subscribed to the Google Groups 
web2py-users group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.