Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-10-09 Thread Mark
I'm thinking that the sync call > is causing the device to write its memory contents back out to disk (ie to be > persisted). Just a thought... > > > > --- On Wed, 9/23/09, Pavel Ivanov wrote: > >> From: Pavel Ivanov >> Subject: Re: [sqlite] SQLite datab

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-24 Thread Kosenko Max
Mark Parker-4 wrote: > This isn't an "SSD". It's connected directly to the PCI Express bus, and > "low cost" it certainly is NOT. It's much more valuable than the server > it's plugged into. Check page size. It might be less than cluster of your ioExtreme. You should also think about actually t

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-23 Thread Ken
ie to be persisted). Just a thought... --- On Wed, 9/23/09, Pavel Ivanov wrote: > From: Pavel Ivanov > Subject: Re: [sqlite] SQLite database on a certain high-performance "SSD" > To: "General Discussion of SQLite Database" > Date: Wednesday, September 23, 2009

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-23 Thread Pavel Ivanov
> Is the only change the absence of a call to "fsync()" when turning > synchronous off? If so, I can conclusively say that fsync() is very slow > on this storage device. Yes, the only action of synchronous = off is to turn off calls to fsync() which is called at least twice during each commit. Pa

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-23 Thread Mark
On a RAID-5 array of 4x SAS disks, turning the sync off made it about 2x faster, give or take. On the "SSD", it was about 150x faster. Is the only change the absence of a call to "fsync()" when turning synchronous off? If so, I can conclusively say that fsync() is very slow on this storage de

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-23 Thread Pavel Ivanov
If you execute pragma synchronous = off; you'll be able to compare performance with syncs and without them. So if you make this comparison on standard spinning disk and on SSD you'll see if syncs on SSD indeed extra-ordinary slow. Pavel On Wed, Sep 23, 2009 at 10:09 AM, Mark wrote: > It's very

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-23 Thread Mark
It's very possible, but I don't know how to tell. Is there an easy way to know if the sync() calls are taking inordinately long? Mark Thomas Briggs wrote: >Is the sync necessary to commit a transaction slow? Performance of > that sync depends on the OS, file system, hardwar, etc. IIRC, so

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-22 Thread Thomas Briggs
Is the sync necessary to commit a transaction slow? Performance of that sync depends on the OS, file system, hardwar, etc. IIRC, so IOs may be fast but it's possible that the syncs are killing you. -T On Tue, Sep 22, 2009 at 5:14 PM, Mark wrote: > Lothar Scholz wrote: >> Hello Mark, >> >>

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-22 Thread Mark
Lothar Scholz wrote: > Hello Mark, > > Tuesday, September 22, 2009, 3:53:48 AM, you wrote: > > M> I've currently got a loaner high-performance flash-based "SSD" (let's > M> just say it doesn't connect to any disk controllers) that I'm testing > M> for performance. I've run my application agains

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-22 Thread Mark
Simon Slavin wrote: > On 22 Sep 2009, at 3:07pm, Ken wrote: > >> How is the SSD connected? Could it be an issue with the transport >> layer to the device? > > Also, do you have a storage driver that /knows/ its talking to an > SSD ? Because some operating systems do all sorts of clever stuff

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-22 Thread Lothar Scholz
Hello Mark, Tuesday, September 22, 2009, 3:53:48 AM, you wrote: M> I've currently got a loaner high-performance flash-based "SSD" (let's M> just say it doesn't connect to any disk controllers) that I'm testing M> for performance. I've run my application against it, and I believe that M> I shoul

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-22 Thread Simon Slavin
On 22 Sep 2009, at 3:07pm, Ken wrote: > How is the SSD connected? Could it be an issue with the transport > layer to the device? Also, do you have a storage driver that /knows/ its talking to an SSD ? Because some operating systems do all sorts of clever stuff (write-queueing, read-ahead

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-22 Thread Ken
How is the SSD connected? Could it be an issue with the transport layer to the device? --- On Mon, 9/21/09, Dave Toll wrote: > From: Dave Toll > Subject: Re: [sqlite] SQLite database on a certain high-performance "SSD" > To: "General Discussion of SQLite Database&quo

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-21 Thread Jim Showalter
SSDs aren't necessarily faster than disks: http://en.wikipedia.org/wiki/Solid-state_drive#Disadvantages - Original Message - From: "Mark" To: Sent: Monday, September 21, 2009 1:53 PM Subject: [sqlite] SQLite database on a certain high-performance "SSD" >

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-21 Thread Cory Nelson
On Mon, Sep 21, 2009 at 1:53 PM, Mark wrote: > I've currently got a loaner high-performance flash-based "SSD" (let's > just say it doesn't connect to any disk controllers) that I'm testing > for performance. I've run my application against it, and I believe that > I should see numbers MUCH higher

Re: [sqlite] SQLite database on a certain high-performance "SSD"

2009-09-21 Thread Dave Toll
al Message- From: Mark [mailto:godef...@gmail.com] Sent: 21 September 2009 13:54 To: sqlite-users@sqlite.org Subject: [sqlite] SQLite database on a certain high-performance "SSD" I've currently got a loaner high-performance flash-based "SSD" (let's just say it doesn

[sqlite] SQLite database on a certain high-performance "SSD"

2009-09-21 Thread Mark
I've currently got a loaner high-performance flash-based "SSD" (let's just say it doesn't connect to any disk controllers) that I'm testing for performance. I've run my application against it, and I believe that I should see numbers MUCH higher than I do. When I run my test app on a normal SATA