Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Richard Hipp]

On Mon, Jun 30, 2014 at 12:14 PM, Nick Eubank  wrote:

> Sorry, I wasn't clear: I have 64 bit R and Windows, but since there are no
> 64 bit binaries for SQLite I started with 32 bit SQLite.
>
> So now I'm wondering if I could fix this memory problem by installing the
> 64-bit version of SQLite.
>

Probably so, yes.  We are working on providing a 64-bit DLL on the download
site now.

-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Richard Hipp]

A 64-bit Windows DLL is now available at http://www.sqlite.org/download.html


On Mon, Jun 30, 2014 at 12:26 PM, Richard Hipp  wrote:

>
>
>
> On Mon, Jun 30, 2014 at 12:14 PM, Nick Eubank 
> wrote:
>
>> Sorry, I wasn't clear: I have 64 bit R and Windows, but since there are no
>> 64 bit binaries for SQLite I started with 32 bit SQLite.
>>
>> So now I'm wondering if I could fix this memory problem by installing the
>> 64-bit version of SQLite.
>>
>
> Probably so, yes.  We are working on providing a 64-bit DLL on the
> download site now.
>
> --
> D. Richard Hipp
> d...@sqlite.org
>



-- 
D. Richard Hipp
d...@sqlite.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Nick Eubank]

Richard, you are my hero. :)


On Mon, Jun 30, 2014 at 9:31 AM, Richard Hipp  wrote:

> A 64-bit Windows DLL is now available at
> http://www.sqlite.org/download.html
>
>
> On Mon, Jun 30, 2014 at 12:26 PM, Richard Hipp  wrote:
>
> >
> >
> >
> > On Mon, Jun 30, 2014 at 12:14 PM, Nick Eubank 
> > wrote:
> >
> >> Sorry, I wasn't clear: I have 64 bit R and Windows, but since there are
> no
> >> 64 bit binaries for SQLite I started with 32 bit SQLite.
> >>
> >> So now I'm wondering if I could fix this memory problem by installing
> the
> >> 64-bit version of SQLite.
> >>
> >
> > Probably so, yes.  We are working on providing a 64-bit DLL on the
> > download site now.
> >
> > --
> > D. Richard Hipp
> > d...@sqlite.org
> >
>
>
>
> --
> D. Richard Hipp
> d...@sqlite.org
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Nelson, Erik - 2]

Simon Slavin wrote on Monday, June 30, 2014 12:21 PM
> 
> SQLite isn't a thing, it's an API.  There's no SQLite server.  There's
> no particular installation of SQLite on a computer that Windows expects
> to be in a particular place.  You can have many copies of many
> different versions of SQLite in different folders on your computer.
> You can have twenty different apps on your computer with twenty
> different versions of SQLite compiled into them, some 32-bit, some 64-
> bit, and they'll all work fine.
> 

I'd say it's a 'thing'... it's something you can find somewhere on your hard 
drive, maybe twenty different things, in the case.

I think what the OP is trying to find out is if a 64-bit compiled version of 
SQLite properly accesses the 64-bit (ish) memory space, or is it still 
effectively limited to 32-bit addressing.

In my experience, 64-bit SQLite is cleanly addressing the larger space.

Erik

--
This message, and any attachments, is for the intended recipient(s) only, may 
contain information that is privileged, confidential and/or proprietary and 
subject to important terms and conditions available at 
http://www.bankofamerica.com/emaildisclaimer.   If you are not the intended 
recipient, please delete this message.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Simon Slavin]

On 30 Jun 2014, at 5:14pm, Nick Eubank  wrote:

> So now I'm wondering if I could fix this memory problem by installing the
> 64-bit version of SQLite.

SQLite isn't a thing, it's an API.  There's no SQLite server.  There's no 
particular installation of SQLite on a computer that Windows expects to be in a 
particular place.  You can have many copies of many different versions of 
SQLite in different folders on your computer.  You can have twenty different 
apps on your computer with twenty different versions of SQLite compiled into 
them, some 32-bit, some 64-bit, and they'll all work fine.

What you're concerned about is what your copy of R is using to talk to your 
SQLite databases.  Which is probably an ODBC driver.  I don't know much about 
them, but I found this page which is relevant:



Maybe someone who uses ODBC drivers more than me can suggest a better source.

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Nick Eubank]

Sorry, I wasn't clear: I have 64 bit R and Windows, but since there are no
64 bit binaries for SQLite I started with 32 bit SQLite.

So now I'm wondering if I could fix this memory problem by installing the
64-bit version of SQLite.

(I know that this wouldn't fix the problem in postgres, for example,
because they never updated the addressing code when they built a 64bit
version -- a lesson I learned the hard way. )

On Monday, June 30, 2014, Simon Slavin  wrote:

>
> On 30 Jun 2014, at 4:58pm, Nick Eubank  > wrote:
>
> > Thanks Cory -- is this fixed in 64 bit versions of SQLite? I know
> postgres
> > never changed memory address variable storage in the 64 bit so the
> problem
> > persists.
>
> You are misunderstanding the problem.  There is no bug to be fixed.  It is
> in the nature of 32-bit Windows that no process has access to more than
> 4Gig of memory.  In your case, with your version of Windows, it's 2Gig.
>  Only Microsoft can fix this and they did that by releasing a 64-bit
> version of Windows.
>
> So you need a 64-bit version of R, 64-bit ODBC drivers (which means 64-bit
> version of Office if you have it), and a 64-bit version of Windows.
>
> > Also: any advice on getting a 64bit installation for someone who doesn't
> > really know how to compile C?
>
> I don't know much about that, but this page might be relevant:
>
> 
>
> Simon.
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org 
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Simon Slavin]

On 30 Jun 2014, at 4:58pm, Nick Eubank  wrote:

> Thanks Cory -- is this fixed in 64 bit versions of SQLite? I know postgres
> never changed memory address variable storage in the 64 bit so the problem
> persists.

You are misunderstanding the problem.  There is no bug to be fixed.  It is in 
the nature of 32-bit Windows that no process has access to more than 4Gig of 
memory.  In your case, with your version of Windows, it's 2Gig.  Only Microsoft 
can fix this and they did that by releasing a 64-bit version of Windows.

So you need a 64-bit version of R, 64-bit ODBC drivers (which means 64-bit 
version of Office if you have it), and a 64-bit version of Windows.

> Also: any advice on getting a 64bit installation for someone who doesn't
> really know how to compile C?

I don't know much about that, but this page might be relevant:



Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Nick Eubank]

Thanks Cory -- is this fixed in 64 bit versions of SQLite? I know postgres
never changed memory address variable storage in the 64 bit so the problem
persists.

Also: any advice on getting a 64bit installation for someone who doesn't
really know how to compile C?

Thanks!

Nick

On Monday, June 30, 2014, Cory Nelson  wrote:

> Without special handling, any 32-bit Windows process is limited to a 2GB
> user address space. Due to fragmentation during allocation, you'll never
> reach a full 2GB.
>
>
> On Mon, Jun 30, 2014 at 10:31 AM, Nick Eubank  > wrote:
>
> > Hi All,
> >
> > I'm a social scientist wrestling with SQLite in Windows 8 (through R
> using
> > the RSQLite library) for some data manipulation and querying.
> >
> > No matter what I do to cache_size (or R's memory settings), SQLite never
> > seems to be using more than about ~1900 mb of RAM. Is that a result of
> the
> > 32 bit build (on another project I discovered 32bit windows is limited to
> > 1900 mb per thread due to how memory addresses are stored)?
> >
> > If so, any advice on installing 64bit version on Windows 8 for someone
> with
> > zero experience compiling C?
> >
> > Thank you so much!
> >
> > Nick
> > ___
> > sqlite-users mailing list
> > sqlite-users@sqlite.org 
> > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
> >
>
>
>
> --
> Cory Nelson
> http://int64.org
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org 
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Is 32bit SQLite limited to 1900mb RAM in windows?

[Cory Nelson]

Without special handling, any 32-bit Windows process is limited to a 2GB
user address space. Due to fragmentation during allocation, you'll never
reach a full 2GB.


On Mon, Jun 30, 2014 at 10:31 AM, Nick Eubank  wrote:

> Hi All,
>
> I'm a social scientist wrestling with SQLite in Windows 8 (through R using
> the RSQLite library) for some data manipulation and querying.
>
> No matter what I do to cache_size (or R's memory settings), SQLite never
> seems to be using more than about ~1900 mb of RAM. Is that a result of the
> 32 bit build (on another project I discovered 32bit windows is limited to
> 1900 mb per thread due to how memory addresses are stored)?
>
> If so, any advice on installing 64bit version on Windows 8 for someone with
> zero experience compiling C?
>
> Thank you so much!
>
> Nick
> ___
> sqlite-users mailing list
> sqlite-users@sqlite.org
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>



-- 
Cory Nelson
http://int64.org
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users