> Why aren't you measuring the time spent only in the SQLite writing thread?
>
> That would eliminate the overhead from the read-thread(s) and the queue in
> the middle,
> measuring only work by SQLite, instead of including the *waiting* for work
> in the queue.
>
> I wrote a similarly "piped" ETL
On Tue, Oct 2, 2018 at 6:56 PM dmp wrote:
> >> On Sep 25, 2018, at 11:14 AM, dmp
> wrote:
> The timing given takes place at the beginning of the transfer
> process and stops when completed, threads join.
>
Why aren't you measuring the time spent only in the SQLite writing thread?
That would
>> On Sep 25, 2018, at 11:14 AM, dmp wrote:
>>
>> The result for the 50K file db test of SQLite was 370.184
>> seconds. Is this a reasonable transfer speed, given the
>> conditions noted?
> You haven't specified how much of that time was spent in SQLite. For all
we know,
> 370 seconds was spent
> On Sep 25, 2018, at 11:14 AM, dmp wrote:
>
> The result for the 50K file db test of SQLite was 370.184
> seconds. Is this a reasonable transfer speed, given the
> conditions noted?
You haven’t specified how much of that time was spent in SQLite. For all we
know, 370 seconds was spent in
Hello,
Thank you for the responses, Stephen and Dominique.
I was generally looking for an idea if the transaction
time seemed reasonable, given a low end MariaDB server,
standard 100Mb LAN, and mid range user processing desktop
machine.
I realize that the question as answered is; Hard to say!
On Tue, Sep 25, 2018 at 8:41 PM dmp wrote:
> The result for the 50K file db test of SQLite was 370.184
> seconds. Is this a reasonable transfer speed, given the conditions noted?
>
As Stephen already wrote, impossible to say.
Start by contrasting this DB-copy you wrote to other methods:
1)
You're kind of asking if a 4 cylinder engine can outrun an 8 cylinder
engine by just physically looking at the engines. The answer is yes. It
can. Given the right circumstances.
Your transfer rates are going to be subjective based on your hardware, network
speeds at the source and destination
Hello,
I have created a database to database transfer plugin for
my application. The plugin is functional and I have
collected a log of testing results stored in a SQLite db.
The links below are of the database and definition of
parameters fields. The main exception, dbTypeMemory,
meaning memory
8 matches
Mail list logo
