You know what... You may consider using an older web2py version... If possible the version which saw this contrib be added, that way you should raise your chance to make it works properly...
This guy : https://groups.google.com/d/msg/web2py/5GNG-g1M8T8/fq8UN1fqumMJ Report it was working, back to jully 2014... So go to github select the proper tag version and download an older web2py version anterior to july 2014. Richard On Sun, Apr 26, 2015 at 12:56 AM, Ron Chatterjee <achatterjee...@gmail.com> wrote: > I got the code to run half way. I am saying, if we can bypass > subprocess.Popen by: > > cat_str = 'SELECT *From' + " " + table_name[0] > > get_table = cursor.execute(cat_str) > > sql_create_stmnt = cursor.fetchall() > > > I may not need to have mysqldump or anything. I just don't know what > subprocess.Popen does that we can't do with cursor. > > > > On Saturday, April 25, 2015 at 7:57:56 PM UTC-7, Richard wrote: >> >> I never try it... I may try it for you, but not now, I am working late >> tonight to push a new app version in production :( >> >> From the script doc : >> >> This plugin needs:mysqlmysqldumpinstalled and globally available.Under >> Windows you will probably need to add the mysql executable directory to the >> PATH variable,you will also need to modify mysql to mysql.exe and >> mysqldump to mysqldump.exe below.Just guessing here :)Access your tables >> with:legacy_db(legacy_db.mytable.id>0).select()If the script crashes >> this is might be due to that fact that the data_type_map dictionary below >> is incomplete.Please complete it, improve it and continue. >> >> >> 1) Do you have mysqldump installed?? >> https://dev.mysql.com/doc/refman/5.1/en/mysqldump.html >> 2) Is it globally available (You talk about some LAMP setup so I guess >> you are under windows in a virtual LAMP stack?? if so, this has to be check) >> 3) Under windows? ... (same thing goes here...) >> 4) Are you able to create a dummy app define a connection string and >> define one of your model (one table of your mysql db) and then do a simple >> db().select(db.yourTableName.ALL)?? >> 5) If the answer to 4 is yes I guess your are neer to make it works if >> the precedent point are cover... >> >> Richard >> >> >> >> >> >> On Sat, Apr 25, 2015 at 10:41 PM, Ron Chatterjee <achatte...@gmail.com> >> wrote: >> >>> I very simple question. Have you tried? Does the script works for you? >>> Because it didn't work for me. Idk what you don't understand that I am >>> doing. Its all the same code. someone can just step through it and figure >>> out that its failing on subprocess.Popen. Idk why its so hard to >>> understand. Specially someone as good as you. And I mean it the good way:-). >>> >>> >>> >>> On Saturday, April 25, 2015 at 6:40:14 PM UTC-7, Richard wrote: >>>> >>>> I don't know what you are doing... As far as I can see the only thing >>>> you have to do is to is that you call the script with as argument a valid >>>> web2py db connection string... >>>> >>>> a database dump is what is say you dump your db into a file... But I >>>> don't think this script work like that, I thought it could work over a >>>> file, but it seems to work against a web2py live db connection string... >>>> >>>> Richard >>>> >>>> On Sat, Apr 25, 2015 at 2:21 AM, Ron Chatterjee <achatte...@gmail.com> >>>> wrote: >>>> >>>>> Thanks for all the help Richard. I tried to work around the code >>>>> extract_mysql_models.py (attached is the code). Basically, I installed >>>>> XAMP/WAMP and in the phpmyadmin I have the sql database. I am running this >>>>> code but it fails in line #74: >>>>> >>>>> p = subprocess.Popen(['mysqldump','--user=%s' % >>>>> username,'--password=%s' % password,'--skip-add-drop-table','--no-data', >>>>> database_name,table_name[0]], stdin=subprocess.PIPE, >>>>> stdout=subprocess.PIPE, stderr=subprocess.PIPE) >>>>> >>>>> sql_create_stmnt, stderr = p.communicate() >>>>> >>>>> >>>>> I don't know what a mysql dump is. Wondering if the above two lines >>>>> can be written like, >>>>> >>>>> >>>>> cat_str = 'SELECT *From' + " " + table_name[0] >>>>> >>>>> get_table = cursor.execute(cat_str) >>>>> >>>>> sql_create_stmnt = cursor.fetchall() >>>>> >>>>> >>>>> And then go on with if 'CREATE' in sql_create_stmnt: >>>>> >>>>> >>>>> Anyway, I am attaching the script if it make it makes it any clear. >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> On Wednesday, April 22, 2015 at 12:44:08 PM UTC-7, Richard wrote: >>>>>> >>>>>> The version in the thread seems not have been included in web2py... >>>>>> >>>>>> Try the one in gluon/scripts/ >>>>>> >>>>>> Richard >>>>>> >>>>>> On Wed, Apr 22, 2015 at 3:41 PM, Richard Vézina < >>>>>> ml.richa...@gmail.com> wrote: >>>>>> >>>>>>> This regex : regex = re.compile('(.*?):(.*?)@(.*)') >>>>>>> >>>>>>> Seems to parse the below command line call!! >>>>>>> >>>>>>> Richard >>>>>>> >>>>>>> On Wed, Apr 22, 2015 at 3:39 PM, Richard Vézina < >>>>>>> ml.richa...@gmail.com> wrote: >>>>>>> >>>>>>>> >>>>>>>> https://github.com/web2py/web2py/blob/master/scripts/extract_mysql_models.py >>>>>>>> >>>>>>>> Ok, it is not working exactly how I thought it was... Do you have >>>>>>>> myslqldump install? >>>>>>>> >>>>>>>> Do you use Linux or Windows... >>>>>>>> >>>>>>>> what if you do >>>>>>>> >>>>>>>> python extract_mysql_models.py username:password@data_basename >>>>>>>> >>>>>>>> On Wed, Apr 22, 2015 at 3:28 PM, Ron Chatterjee < >>>>>>>> achatte...@gmail.com> wrote: >>>>>>>> >>>>>>>>> I used this version (the first one) and change to MySQLdb. >>>>>>>>> >>>>>>>>> https://groups.google.com/forum/#!searchin/web2py/extract_mysql_models.py/web2py/XPoTlzPG7lQ/ngSsMbd6zHAJ >>>>>>>>> >>>>>>>>> It gives me an error: >>>>>>>>> >>>>>>>>> Basically, >>>>>>>>> >>>>>>>>> This worked >>>>>>>>> >>>>>>>>> db = MySQLdb.connect(host = 'localhost',user ='root',passwd = >>>>>>>>> '',db = 'name_of_my_database') >>>>>>>>> >>>>>>>>> But this didn't. >>>>>>>>> >>>>>>>>> extract_mysql_models.py --user 'root' --password '' --host >>>>>>>>> '127.0.0.1' --database 'name_of_my_database' --dalname 'wikidb' >>>>>>>>> --colcomments --singlemigrate > mywiki.py >>>>>>>>> >>>>>>>>> Note, my password is empty. >>>>>>>>> >>>>>>>>> The error I get is simply that it can't connect to the server. So, >>>>>>>>> I am going through the code now. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Wednesday, April 22, 2015 at 2:49:41 PM UTC-4, Richard wrote: >>>>>>>>>> >>>>>>>>>> What do you exactly get out of extract_mysql_models.py applied >>>>>>>>>> over an SQL dump of the schema (only no data inserts)? >>>>>>>>>> >>>>>>>>>> Richard >>>>>>>>>> >>>>>>>>>> On Wed, Apr 22, 2015 at 2:29 PM, Ron Chatterjee < >>>>>>>>>> achatte...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Sorry, wasn't clear. Basically want to create a DAL (db.py) file >>>>>>>>>>> from an existing site that I locally hosted (wAMP) which is php >>>>>>>>>>> front end >>>>>>>>>>> mysql backend. I exported out of my WAMP (phpmysqladmin) the tables >>>>>>>>>>> and >>>>>>>>>>> fields in SQL language. Then I tried to make DAL out of it. As you >>>>>>>>>>> explained, thats not possible, Now I will try to take a stab at >>>>>>>>>>> working >>>>>>>>>>> with extract_mysql_models.py but it will probably will require some >>>>>>>>>>> updates. If nothing works, I can use the MYSQL workbench to connect >>>>>>>>>>> to the >>>>>>>>>>> server to draw me the schema and then write the DAL from that. Hope >>>>>>>>>>> it >>>>>>>>>>> clear things up now. My bad. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Wednesday, April 22, 2015 at 2:04:49 PM UTC-4, Richard wrote: >>>>>>>>>>>> >>>>>>>>>>>> Hello Ron, >>>>>>>>>>>> >>>>>>>>>>>> The more this thread goes the less I understand what you are >>>>>>>>>>>> trying to acheive... Do you want to translate a SQLite DB into a >>>>>>>>>>>> web2py >>>>>>>>>>>> model? or MySQL DB? If you do have a MySQL server instance your >>>>>>>>>>>> connection >>>>>>>>>>>> string seems correct... But then you have to define the table you >>>>>>>>>>>> want to >>>>>>>>>>>> access in this table or you only have DB connection active which >>>>>>>>>>>> give you >>>>>>>>>>>> notting because the DAL don't know the DB structure... >>>>>>>>>>>> >>>>>>>>>>>> Richard >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Apr 22, 2015 at 1:30 PM, Ron Chatterjee < >>>>>>>>>>>> achatte...@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> This is what I was looking for. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> https://groups.google.com/forum/#!searchin/web2py/extract_mysql_models.py/web2py/XPoTlzPG7lQ/ngSsMbd6zHAJ >>>>>>>>>>>>> >>>>>>>>>>>>> But homehow the code didn't work for me even when I followed >>>>>>>>>>>>> the example like it says. So, I am creating a stand alone version >>>>>>>>>>>>> that >>>>>>>>>>>>> works with MySQLdb. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Tuesday, April 21, 2015 at 4:58:52 PM UTC-4, Ron Chatterjee >>>>>>>>>>>>> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>> I have sqlite browser. I am guessing its the same like SQlite >>>>>>>>>>>>>> Manager where someone can import, export csv or sql file. I >>>>>>>>>>>>>> don't have >>>>>>>>>>>>>> password in that database and work externally to the python >>>>>>>>>>>>>> >>>>>>>>>>>>>> *I guess one possibility will be:* >>>>>>>>>>>>>> >>>>>>>>>>>>>> import MySQLdb >>>>>>>>>>>>>> >>>>>>>>>>>>>> import sys >>>>>>>>>>>>>> >>>>>>>>>>>>>> try: >>>>>>>>>>>>>> >>>>>>>>>>>>>> db = MySQLdb.connect(host = 'localhost',user ='root',passwd = >>>>>>>>>>>>>> ' ',db = 'my_dabasename') >>>>>>>>>>>>>> >>>>>>>>>>>>>> except Exception as e: >>>>>>>>>>>>>> >>>>>>>>>>>>>> sys.exit('we cant get into the db'); >>>>>>>>>>>>>> >>>>>>>>>>>>>> cursor = db.cursor() >>>>>>>>>>>>>> >>>>>>>>>>>>>> cursor.execute('SELECT *FROM table') >>>>>>>>>>>>>> >>>>>>>>>>>>>> results = cursor.fetchall() >>>>>>>>>>>>>> >>>>>>>>>>>>>> print results >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> Once the table is fetched then use the insert_into_table >>>>>>>>>>>>>> option to create db object. >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> But I agree with Niphlod, import, export csv is probably the >>>>>>>>>>>>>> only way to go around, if it works:-). And also agree with >>>>>>>>>>>>>> richard. >>>>>>>>>>>>>> sqlbroser does take the storage object as input and can export >>>>>>>>>>>>>> csv table >>>>>>>>>>>>>> and then use that back to create the database. I was just hoping >>>>>>>>>>>>>> to >>>>>>>>>>>>>> directly connect to my local server (WAMP) where I have the >>>>>>>>>>>>>> mysql database >>>>>>>>>>>>>> defined. I was under the impression, db = DAL('mysql:// >>>>>>>>>>>>>> root@127.0.0.1:8000/my_database_name',migrate_enabled=False, >>>>>>>>>>>>>> pool_size=20) is the way to go about it. >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tuesday, April 21, 2015 at 4:07:02 PM UTC-4, Richard wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> And what would be the utility since you already have INSERT >>>>>>>>>>>>>>> INTO TABLE... Someone can just use something like SQLite >>>>>>>>>>>>>>> Manager ( >>>>>>>>>>>>>>> https://addons.mozilla.org/en-us/firefox/addon/sqlite-manager/) >>>>>>>>>>>>>>> to import it... Once in SQLite DB (which anyway it should) he >>>>>>>>>>>>>>> can use >>>>>>>>>>>>>>> web2py csv export import if he want to migrate from SQLite to >>>>>>>>>>>>>>> Postgres for >>>>>>>>>>>>>>> instance... >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Richard >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Apr 21, 2015 at 3:55 PM, Niphlod <nip...@gmail.com> >>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Tuesday, April 21, 2015 at 9:39:14 PM UTC+2, Ron >>>>>>>>>>>>>>>> Chatterjee wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> I tried this: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> db = >>>>>>>>>>>>>>>>> DAL('mysql://root@127.0.0.1:8000/my_database_name',migrate_enabled=False, >>>>>>>>>>>>>>>>> pool_size=20) >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> It didn't work either. I guess someone needs to look at >>>>>>>>>>>>>>>>> how to connect to legacy database. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> where is the password ?! >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> BTW: I think there's a bit of misunderstandings going on in >>>>>>>>>>>>>>>> this thread. >>>>>>>>>>>>>>>> There are two separate concept at play: schema (structure) >>>>>>>>>>>>>>>> AND data. >>>>>>>>>>>>>>>> Every script/extract_***_models.py can "inspect" an >>>>>>>>>>>>>>>> existing database and figure out (with limitations) the model >>>>>>>>>>>>>>>> you should >>>>>>>>>>>>>>>> write to access that database --> schema (or structure) >>>>>>>>>>>>>>>> translated to nifty >>>>>>>>>>>>>>>> "db.define_table(....)" >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Exporting and importing a csv (compatible with what web2py >>>>>>>>>>>>>>>> generates) instead - again, with limitations - is the way to >>>>>>>>>>>>>>>> transfer data >>>>>>>>>>>>>>>> around. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> If you have a long list of SQL statements in a file, those >>>>>>>>>>>>>>>> are NOT going to work. >>>>>>>>>>>>>>>> There's virtually nothing that reverse-engineers table >>>>>>>>>>>>>>>> definitions such as "CREATE TABLE ....." to a model file, nor >>>>>>>>>>>>>>>> something >>>>>>>>>>>>>>>> that turns "INSERT INTO TABLE..." to a db.table.insert(), >>>>>>>>>>>>>>>> although it can >>>>>>>>>>>>>>>> be fun to create one (with lots of headaches). >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>> Resources: >>>>>>>>>>>>>>>> - http://web2py.com >>>>>>>>>>>>>>>> - http://web2py.com/book (Documentation) >>>>>>>>>>>>>>>> - http://github.com/web2py/web2py (Source code) >>>>>>>>>>>>>>>> - https://code.google.com/p/web2py/issues/list (Report >>>>>>>>>>>>>>>> Issues) >>>>>>>>>>>>>>>> --- >>>>>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>>>>> Google Groups "web2py-users" group. >>>>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails >>>>>>>>>>>>>>>> from it, send an email to web2py+un...@googlegroups.com. >>>>>>>>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>> Resources: >>>>>>>>>>>>> - http://web2py.com >>>>>>>>>>>>> - http://web2py.com/book (Documentation) >>>>>>>>>>>>> - http://github.com/web2py/web2py (Source code) >>>>>>>>>>>>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>>>>>>>>>>>> --- >>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>> Google Groups "web2py-users" group. >>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>>> it, send an email to web2py+un...@googlegroups.com. >>>>>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>> Resources: >>>>>>>>>>> - http://web2py.com >>>>>>>>>>> - http://web2py.com/book (Documentation) >>>>>>>>>>> - http://github.com/web2py/web2py (Source code) >>>>>>>>>>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>>>>>>>>>> --- >>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>> Google Groups "web2py-users" group. >>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>> it, send an email to web2py+un...@googlegroups.com. >>>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>> Resources: >>>>>>>>> - http://web2py.com >>>>>>>>> - http://web2py.com/book (Documentation) >>>>>>>>> - http://github.com/web2py/web2py (Source code) >>>>>>>>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>>>>>>>> --- >>>>>>>>> You received this message because you are subscribed to the Google >>>>>>>>> Groups "web2py-users" group. >>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>> send an email to web2py+un...@googlegroups.com. >>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>> -- >>>>> Resources: >>>>> - http://web2py.com >>>>> - http://web2py.com/book (Documentation) >>>>> - http://github.com/web2py/web2py (Source code) >>>>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "web2py-users" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to web2py+un...@googlegroups.com. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>> Resources: >>> - http://web2py.com >>> - http://web2py.com/book (Documentation) >>> - http://github.com/web2py/web2py (Source code) >>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "web2py-users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to web2py+un...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- > Resources: > - http://web2py.com > - http://web2py.com/book (Documentation) > - http://github.com/web2py/web2py (Source code) > - https://code.google.com/p/web2py/issues/list (Report Issues) > --- > You received this message because you are subscribed to the Google Groups > "web2py-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to web2py+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Resources: - http://web2py.com - http://web2py.com/book (Documentation) - http://github.com/web2py/web2py (Source code) - https://code.google.com/p/web2py/issues/list (Report Issues) --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
