[web2py] Select with text field
Hello all, I have a table with two text fields. I'm trying to make a select with about 7,000 records in a console. My memory goes up, until full, and then the process is killed If I comment those text fields in the table definition and try again, it run the select without problem. In the select, I don't use those fields What cat I do to solve this ?? Thanks Marcello
Re: [web2py] Select with text field
What the nature of the data in size? Could you show us your select statment? Richard On Fri, Jul 6, 2012 at 8:41 AM, Marcello parro...@gmail.com wrote: Hello all, I have a table with two text fields. I'm trying to make a select with about 7,000 records in a console. My memory goes up, until full, and then the process is killed If I comment those text fields in the table definition and try again, it run the select without problem. In the select, I don't use those fields What cat I do to solve this ?? Thanks Marcello
Re: [web2py] Select with text field
Hello, Richard, I save 2 HTML pages. SELECT processo.id, processo.na, processo.na_limpo, processo.nu, processo.nu_limpo, processo.html, processo.html1, processo.processado, processo.processado2, processo.processado_dia, processo.origem, processo.classe, processo.fase, processo.assunto, processo.instancia, processo.json, processo.conferido, processo.autuado_dia, processo.orgao_julgador, processo.relator, processo.autor, processo.reu, processo.advs, processo.autor1, processo.reu1, processo.acompanhando_dia, processo.encerrado_dia, processo.vara, processo.numero_origem, processo.ultimo_andamento_dia, processo.ultimo_andamento, processo.sentenca, processo.sentenca_dia, processo.sentenca_crc, processo.1_crc, processo.2_crc, processo.enviado_dia, processo.created_at FROM processo WHERE (processo.encerrado_dia IS NULL); One solution is select just the fields I need and not the TEXT ones... But I found that should be an easier way Thanks... On Fri, Jul 6, 2012 at 10:30 AM, Richard Vézina ml.richard.vez...@gmail.com wrote: What the nature of the data in size? Could you show us your select statment? Richard On Fri, Jul 6, 2012 at 8:41 AM, Marcello parro...@gmail.com wrote: Hello all, I have a table with two text fields. I'm trying to make a select with about 7,000 records in a console. My memory goes up, until full, and then the process is killed If I comment those text fields in the table definition and try again, it run the select without problem. In the select, I don't use those fields What cat I do to solve this ?? Thanks Marcello
Re: [web2py] Select with text field
Are you running this request as raw SQL with executesql?? http://web2py.com/books/default/chapter/29/6#executesql If your request is slow at backend level, maybe you have a problem with your design... What is your backend? Richard On Fri, Jul 6, 2012 at 11:12 AM, Marcello Parra parro...@gmail.com wrote: Hello, Richard, I save 2 HTML pages. SELECT processo.id, processo.na, processo.na_limpo, processo.nu, processo.nu_limpo, processo.html, processo.html1, processo.processado, processo.processado2, processo.processado_dia, processo.origem, processo.classe, processo.fase, processo.assunto, processo.instancia, processo.json, processo.conferido, processo.autuado_dia, processo.orgao_julgador, processo.relator, processo.autor, processo.reu, processo.advs, processo.autor1, processo.reu1, processo.acompanhando_dia, processo.encerrado_dia, processo.vara, processo.numero_origem, processo.ultimo_andamento_dia, processo.ultimo_andamento, processo.sentenca, processo.sentenca_dia, processo.sentenca_crc, processo.1_crc, processo.2_crc, processo.enviado_dia, processo.created_at FROM processo WHERE (processo.encerrado_dia IS NULL); One solution is select just the fields I need and not the TEXT ones... But I found that should be an easier way Thanks... On Fri, Jul 6, 2012 at 10:30 AM, Richard Vézina ml.richard.vez...@gmail.com wrote: What the nature of the data in size? Could you show us your select statment? Richard On Fri, Jul 6, 2012 at 8:41 AM, Marcello parro...@gmail.com wrote: Hello all, I have a table with two text fields. I'm trying to make a select with about 7,000 records in a console. My memory goes up, until full, and then the process is killed If I comment those text fields in the table definition and try again, it run the select without problem. In the select, I don't use those fields What cat I do to solve this ?? Thanks Marcello
Re: [web2py] Select with text field
I'm not using executesql... I'm trying just: query = q_processos.select() It seems to load all data from database... On Fri, Jul 6, 2012 at 12:40 PM, Richard Vézina ml.richard.vez...@gmail.com wrote: Are you running this request as raw SQL with executesql?? http://web2py.com/books/default/chapter/29/6#executesql If your request is slow at backend level, maybe you have a problem with your design... What is your backend? Richard On Fri, Jul 6, 2012 at 11:12 AM, Marcello Parra parro...@gmail.comwrote: Hello, Richard, I save 2 HTML pages. SELECT processo.id, processo.na, processo.na_limpo, processo.nu, processo.nu_limpo, processo.html, processo.html1, processo.processado, processo.processado2, processo.processado_dia, processo.origem, processo.classe, processo.fase, processo.assunto, processo.instancia, processo.json, processo.conferido, processo.autuado_dia, processo.orgao_julgador, processo.relator, processo.autor, processo.reu, processo.advs, processo.autor1, processo.reu1, processo.acompanhando_dia, processo.encerrado_dia, processo.vara, processo.numero_origem, processo.ultimo_andamento_dia, processo.ultimo_andamento, processo.sentenca, processo.sentenca_dia, processo.sentenca_crc, processo.1_crc, processo.2_crc, processo.enviado_dia, processo.created_at FROM processo WHERE (processo.encerrado_dia IS NULL); One solution is select just the fields I need and not the TEXT ones... But I found that should be an easier way Thanks... On Fri, Jul 6, 2012 at 10:30 AM, Richard Vézina ml.richard.vez...@gmail.com wrote: What the nature of the data in size? Could you show us your select statment? Richard On Fri, Jul 6, 2012 at 8:41 AM, Marcello parro...@gmail.com wrote: Hello all, I have a table with two text fields. I'm trying to make a select with about 7,000 records in a console. My memory goes up, until full, and then the process is killed If I comment those text fields in the table definition and try again, it run the select without problem. In the select, I don't use those fields What cat I do to solve this ?? Thanks Marcello
Re: [web2py] Select with text field
How much data (in KB ou MB) are loaded into these text fields? Could you show us your model file where you execute this define_table()? (aka db.py) On 07/06/2012 02:04 PM, Marcello Parra wrote: I'm not using executesql... I'm trying just: query = q_processos.select() It seems to load all data from database... On Fri, Jul 6, 2012 at 12:40 PM, Richard Vézina ml.richard.vez...@gmail.com mailto:ml.richard.vez...@gmail.com wrote: Are you running this request as raw SQL with executesql?? http://web2py.com/books/default/chapter/29/6#executesql If your request is slow at backend level, maybe you have a problem with your design... What is your backend? Richard On Fri, Jul 6, 2012 at 11:12 AM, Marcello Parra parro...@gmail.com mailto:parro...@gmail.com wrote: Hello, Richard, I save 2 HTML pages. SELECT processo.id http://processo.id, processo.na http://processo.na, processo.na_limpo, processo.nu http://processo.nu, processo.nu_limpo, processo.html, processo.html1, processo.processado, processo.processado2, processo.processado_dia, processo.origem, processo.classe, processo.fase, processo.assunto, processo.instancia, processo.json, processo.conferido, processo.autuado_dia, processo.orgao_julgador, processo.relator, processo.autor, processo.reu, processo.advs, processo.autor1, processo.reu1, processo.acompanhando_dia, processo.encerrado_dia, processo.vara, processo.numero_origem, processo.ultimo_andamento_dia, processo.ultimo_andamento, processo.sentenca, processo.sentenca_dia, processo.sentenca_crc, processo.1_crc, processo.2_crc, processo.enviado_dia, processo.created_at FROM processo WHERE (processo.encerrado_dia IS NULL); One solution is select just the fields I need and not the TEXT ones... But I found that should be an easier way Thanks... On Fri, Jul 6, 2012 at 10:30 AM, Richard Vézina ml.richard.vez...@gmail.com mailto:ml.richard.vez...@gmail.com wrote: What the nature of the data in size? Could you show us your select statment? Richard On Fri, Jul 6, 2012 at 8:41 AM, Marcello parro...@gmail.com mailto:parro...@gmail.com wrote: Hello all, I have a table with two text fields. I'm trying to make a select with about 7,000 records in a console. My memory goes up, until full, and then the process is killed If I comment those text fields in the table definition and try again, it run the select without problem. In the select, I don't use those fields What cat I do to solve this ?? Thanks Marcello
