Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Pepijn Van Eeckhoudt]

Ah ok, I thought the Xerial driver no longer supported the nestedvm 
stuff. What you'll need to do is compile the Xerial binary for Solaris. 
See https://bitbucket.org/xerial/sqlite-jdbc/wiki/Home#BuildfromSource 
for details.


Pepijn

On 11/26/2013 06:48 AM, Liang Kunming wrote:
Hi, Pepijn, After confirm and compare the content, the jdbc driver 
which we are using to access sqlite is from Xerial fork 
(https://bitbucket.org/xerial/sqlite-jdbc): 
sqlite-jdbc-3.7.2.jar<https://bitbucket.org/xerial/sqlite-jdbc/downloads/sqlite-jdbc-3.7.2.jar>. 
Do you have any other suggestion for this issue? Thanks. 
sqlite-jdbc-3.7.2.jar<https://bitbucket.org/xerial/sqlite-jdbc/downloads/sqlite-jdbc-3.7.2.jar> 
3.1 MB 2013-01-23 48150 Regards, Liang Kunming. -Original 
Message- From: sqlite-users-boun...@sqlite.org 
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Liang Kunming 
Sent: 2013年11月25日 17:29 To: General Discussion of SQLite Database 
Subject: Re: [sqlite] Does sqlite has db file-size restriction on 
Solaris 10? Hi, Pepijn, Thanks. Please help me to do some testing and 
check whether the 2GB restrict issue be solved if use new driver. 
Regards, Liang Kunming. -Original Message- From: 
sqlite-users-boun...@sqlite.org 
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Pepijn Van 
Eeckhoudt Sent: 2013年11月25日 16:09 To: sqlite-users@sqlite.org 
Subject: Re: [sqlite] Does sqlite has db file-size restriction on 
Solaris 10? On 2013-11-23 02:03, Liang Kunming wrote:
java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database 
(no such table: tasks) 
at org.sqlite.DB.newSQLException(DB.java:383) 
at org.sqlite.DB.newSQLException(DB.java:387) 
at org.sqlite.DB.throwex(DB.java:374) 
at org.sqlite.NestedDB.prepare(NestedDB.java:134) 
at org.sqlite.DB.prepare(DB.java:123) 
NestedDB in the stack trace indicates you're using the old Zentus JDBC 
driver in NestedVM (http://nestedvm.ibex.org/) mode. I would first try 
to take that out of the equation and see if it solves the problem. To 
do that you'll need to compile the native library part of the Zentus 
driver for Solaris, but since the source code is no longer available 
that might be hard to do (unless you have a copy somewhere). Using the 
Xerial fork (https://bitbucket.org/xerial/sqlite-jdbc) is probably 
easier. It doesn't ship with a Solaris binary though, so you'll still 
need to compile that first. Pepijn 
___ sqlite-users mailing 
list sqlite-users@sqlite.org 
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users 
___ sqlite-users mailing 
list sqlite-users@sqlite.org 
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users 
___ sqlite-users mailing 
list sqlite-users@sqlite.org 
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users


___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Liang Kunming]

Hi, Pepijn,



After confirm and compare the content, the jdbc driver which we are using to 
access sqlite is from Xerial fork (https://bitbucket.org/xerial/sqlite-jdbc): 
sqlite-jdbc-3.7.2.jar<https://bitbucket.org/xerial/sqlite-jdbc/downloads/sqlite-jdbc-3.7.2.jar>.
 Do you have any other suggestion for this issue?

Thanks.

sqlite-jdbc-3.7.2.jar<https://bitbucket.org/xerial/sqlite-jdbc/downloads/sqlite-jdbc-3.7.2.jar>


3.1 MB


2013-01-23


48150




Regards,

Liang Kunming.



-Original Message-
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of Liang Kunming
Sent: 2013年11月25日 17:29
To: General Discussion of SQLite Database
Subject: Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?



Hi, Pepijn,







Thanks. Please help me to do some testing and check whether the 2GB restrict 
issue be solved if use new driver.







Regards,



Liang Kunming.







-Original Message-

From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of Pepijn Van Eeckhoudt

Sent: 2013年11月25日 16:09

To: sqlite-users@sqlite.org

Subject: Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?







On 2013-11-23 02:03, Liang Kunming wrote:



>  java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database



> (no such table: tasks)



>  at org.sqlite.DB.newSQLException(DB.java:383)



>  at org.sqlite.DB.newSQLException(DB.java:387)



>  at org.sqlite.DB.throwex(DB.java:374)



>  at org.sqlite.NestedDB.prepare(NestedDB.java:134)



>  at org.sqlite.DB.prepare(DB.java:123)







NestedDB in the stack trace indicates you're using the old Zentus JDBC



driver in NestedVM (http://nestedvm.ibex.org/) mode. I would first try



to take that out of the equation and see if it solves the problem. To do



that you'll need to compile the native library part of the Zentus driver



for Solaris, but since the source code is no longer available that might



be hard to do (unless you have a copy somewhere). Using the Xerial fork



(https://bitbucket.org/xerial/sqlite-jdbc)



is probably easier. It doesn't ship with a Solaris binary though, so



you'll still need to compile that first.







Pepijn



___



sqlite-users mailing list



sqlite-users@sqlite.org



http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

___

sqlite-users mailing list

sqlite-users@sqlite.org

http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Liang Kunming]

Hi, Pepijn,



Thanks. Please help me to do some testing and check whether the 2GB restrict 
issue be solved if use new driver.



Regards,

Liang Kunming.



-Original Message-
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of Pepijn Van Eeckhoudt
Sent: 2013年11月25日 16:09
To: sqlite-users@sqlite.org
Subject: Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?



On 2013-11-23 02:03, Liang Kunming wrote:

>  java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database

> (no such table: tasks)

>  at org.sqlite.DB.newSQLException(DB.java:383)

>  at org.sqlite.DB.newSQLException(DB.java:387)

>  at org.sqlite.DB.throwex(DB.java:374)

>  at org.sqlite.NestedDB.prepare(NestedDB.java:134)

>  at org.sqlite.DB.prepare(DB.java:123)



NestedDB in the stack trace indicates you're using the old Zentus JDBC

driver in NestedVM (http://nestedvm.ibex.org/) mode. I would first try

to take that out of the equation and see if it solves the problem. To do

that you'll need to compile the native library part of the Zentus driver

for Solaris, but since the source code is no longer available that might

be hard to do (unless you have a copy somewhere). Using the Xerial fork

(https://bitbucket.org/xerial/sqlite-jdbc)

is probably easier. It doesn't ship with a Solaris binary though, so

you'll still need to compile that first.



Pepijn

___

sqlite-users mailing list

sqlite-users@sqlite.org

http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Pepijn Van Eeckhoudt]

On 2013-11-23 02:03, Liang Kunming wrote:

 java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database
(no such table: tasks)
 at org.sqlite.DB.newSQLException(DB.java:383)
 at org.sqlite.DB.newSQLException(DB.java:387)
 at org.sqlite.DB.throwex(DB.java:374)
 at org.sqlite.NestedDB.prepare(NestedDB.java:134)
 at org.sqlite.DB.prepare(DB.java:123)


NestedDB in the stack trace indicates you're using the old Zentus JDBC 
driver in NestedVM (http://nestedvm.ibex.org/) mode. I would first try 
to take that out of the equation and see if it solves the problem. To do 
that you'll need to compile the native library part of the Zentus driver 
for Solaris, but since the source code is no longer available that might 
be hard to do (unless you have a copy somewhere). Using the Xerial fork 
(https://bitbucket.org/xerial/sqlite-jdbc)
is probably easier. It doesn't ship with a Solaris binary though, so 
you'll still need to compile that first.


Pepijn
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Liang Kunming]

Hi, Simon,

The running server and sqlite database are run in same server; it is not access 
by network. It is local query and writes.

Regards,
Liang Kunming.

-Original Message-
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of Simon Slavin
Sent: 2013年11月25日 10:27
To: General Discussion of SQLite Database
Subject: Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?


On 25 Nov 2013, at 2:08am, Liang Kunming <kunming.li...@utstar.com> wrote:

> Based on my test, create a >3GB files on my Solaris 10 is ok, do you have any 
> others suggestions?

Sorry, no.  I am intrigued, however, but the fact that your trace shows IP 
calls when you didn't mention you were accessing the storage medium over a 
network.

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Simon Slavin]

On 25 Nov 2013, at 2:08am, Liang Kunming  wrote:

> Based on my test, create a >3GB files on my Solaris 10 is ok, do you have any 
> others suggestions?

Sorry, no.  I am intrigued, however, but the fact that your trace shows IP 
calls when you didn't mention you were accessing the storage medium over a 
network.

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Liang Kunming]

Hi, Simon,

Based on my test, create a >3GB files on my Solaris 10 is ok, do you have any 
others suggestions?

bash-3.00# du -hs logs/*
 7.0G   logs/SilentAlarm.log
  25K   logs/SilentAlarmError.log
  10M   logs/systemErr1.txt
 4.4M   logs/systemErr10.txt
  10M   logs/systemErr2.txt
  10M   logs/systemErr3.txt
  10M   logs/systemErr4.txt
  10M   logs/systemErr5.txt
  10M   logs/systemErr6.txt
  10M   logs/systemErr7.txt
  10M   logs/systemErr8.txt
  10M   logs/systemErr9.txt
 256K   logs/systemOut1.txt
bash-3.00# ls -lt database/*
-rw-r--r--   1 root root1544 Nov 25 15:25 
database/silentalarm.db-journal
-rw-r--r--   1 root root 2147483648 Nov 25 15:25 database/silentalarm.db
bash-3.00# ulimit -a
core file size(blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
open files(-n) 8192
pipe size  (512 bytes, -p) 10
stack size(kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes(-u) 29995
virtual memory(kbytes, -v) unlimited
bash-3.00#

Regards,
Liang Kunming.
-Original Message-
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of Liang Kunming
Sent: 2013年11月23日 9:52
To: General Discussion of SQLite Database
Subject: Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

Hi, Simon,



I use the 64bit Solaris 10 and the fs type is ufs. The trace as below:



bash-3.00# df -v

Mount Dir  Filesystemblocks used free  %used

/dev/dsk/c0t5000CCA01286BB88d0s0

/  94601683  4847315 88808352 6%

/devices   /devices   000 0%

/system/co ctfs   000 0%

/proc  proc   000 0%

/etc/mntta mnttab 000 0%

/etc/svc/v swap 4676759  211  4676548 1%

/system/ob objfs  000 0%

/etc/dfs/s sharefs000 0%

/platform/sun4v/lib/libc_psr/libc_psr_hwcap2.so.1

/platform/ 94601683  4847315 88808352 6%

/platform/sun4v/lib/sparcv9/libc_psr/libc_psr_hwcap2.so.1

/platform/ 94601683  4847315 88808352 6%

/dev/fdfd 000 0%

/tmp   swap 4679532 2984  4676548 1%

/var/run   swap 4676558   10  4676548 1%

/dev/dsk/c0t5000CCA01286BB88d0s1

/opt   161363185 80324957 7942459751%

bash-3.00# fstyp /dev/dsk/c0t5000CCA01286BB88d0s1

ufs

bash-3.00# isainfo -v

64-bit sparcv9 applications

hpc vis3 fmaf asi_blk_init vis2 vis popc

32-bit sparc applications

hpc vis3 fmaf asi_blk_init vis2 vis popc v8plus div32 mul32



I will test the case if can create a 3GB file on this file system and share the 
result here. Thanks.



Regards,

Liang Kunming.



-Original Message-
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of Simon Slavin
Sent: 2013年11月23日 9:23
To: General Discussion of SQLite Database
Subject: Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?





On 23 Nov 2013, at 1:03am, Liang Kunming <kunming.li...@utstar.com> wrote:



> I meet some issue when use the sqlite on Solaris 10. The db file is made by 
> the sqlite R3.4.2 version and the sqlite3 is compiled on Solaris 10 platform 
> (has attached). When the db file meet 2147483648 bytes (2Gigabytes), the file 
> size can not increase anymore, and query/write also error. When query or 
> write the data, the exception as below. Who know the solution of this issue 
> and can share me, thanks very much.



Your trace indicates that you are using a network file system (perhaps the one 
called NFS) to access the drive your database is on.  Which file system and/or 
network file system are you using to access that drive ?



Can you please test that it is possible to make a 3GB file of any kind on that 
drive.  A long text file would do fine, but not a file completely filled with 
hex zeros (0x00).



Simon.

___

sqlite-users mailing list

sqlite-users@sqlite.org

http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Liang Kunming]

Hi, Simon,



I use the 64bit Solaris 10 and the fs type is ufs. The trace as below:



bash-3.00# df -v

Mount Dir  Filesystemblocks used free  %used

/dev/dsk/c0t5000CCA01286BB88d0s0

/  94601683  4847315 88808352 6%

/devices   /devices   000 0%

/system/co ctfs   000 0%

/proc  proc   000 0%

/etc/mntta mnttab 000 0%

/etc/svc/v swap 4676759  211  4676548 1%

/system/ob objfs  000 0%

/etc/dfs/s sharefs000 0%

/platform/sun4v/lib/libc_psr/libc_psr_hwcap2.so.1

/platform/ 94601683  4847315 88808352 6%

/platform/sun4v/lib/sparcv9/libc_psr/libc_psr_hwcap2.so.1

/platform/ 94601683  4847315 88808352 6%

/dev/fdfd 000 0%

/tmp   swap 4679532 2984  4676548 1%

/var/run   swap 4676558   10  4676548 1%

/dev/dsk/c0t5000CCA01286BB88d0s1

/opt   161363185 80324957 7942459751%

bash-3.00# fstyp /dev/dsk/c0t5000CCA01286BB88d0s1

ufs

bash-3.00# isainfo -v

64-bit sparcv9 applications

hpc vis3 fmaf asi_blk_init vis2 vis popc

32-bit sparc applications

hpc vis3 fmaf asi_blk_init vis2 vis popc v8plus div32 mul32



I will test the case if can create a 3GB file on this file system and share the 
result here. Thanks.



Regards,

Liang Kunming.



-Original Message-
From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] 
On Behalf Of Simon Slavin
Sent: 2013年11月23日 9:23
To: General Discussion of SQLite Database
Subject: Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?





On 23 Nov 2013, at 1:03am, Liang Kunming <kunming.li...@utstar.com> wrote:



> I meet some issue when use the sqlite on Solaris 10. The db file is made by 
> the sqlite R3.4.2 version and the sqlite3 is compiled on Solaris 10 platform 
> (has attached). When the db file meet 2147483648 bytes (2Gigabytes), the file 
> size can not increase anymore, and query/write also error. When query or 
> write the data, the exception as below. Who know the solution of this issue 
> and can share me, thanks very much.



Your trace indicates that you are using a network file system (perhaps the one 
called NFS) to access the drive your database is on.  Which file system and/or 
network file system are you using to access that drive ?



Can you please test that it is possible to make a 3GB file of any kind on that 
drive.  A long text file would do fine, but not a file completely filled with 
hex zeros (0x00).



Simon.

___

sqlite-users mailing list

sqlite-users@sqlite.org

http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Simon Slavin]

On 23 Nov 2013, at 1:03am, Liang Kunming  wrote:

> I meet some issue when use the sqlite on Solaris 10. The db file is made by 
> the sqlite R3.4.2 version and the sqlite3 is compiled on Solaris 10 platform 
> (has attached). When the db file meet 2147483648 bytes (2Gigabytes), the file 
> size can not increase anymore, and query/write also error. When query or 
> write the data, the exception as below. Who know the solution of this issue 
> and can share me, thanks very much.

Your trace indicates that you are using a network file system (perhaps the one 
called NFS) to access the drive your database is on.  Which file system and/or 
network file system are you using to access that drive ?

Can you please test that it is possible to make a 3GB file of any kind on that 
drive.  A long text file would do fine, but not a file completely filled with 
hex zeros (0x00).

Simon.
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Re: [sqlite] Does sqlite has db file-size restriction on Solaris 10?

[Liang Kunming]

Hi, everyone,

I meet some issue when use the sqlite on Solaris 10. The db file is made by the 
sqlite R3.4.2 version and the sqlite3 is compiled on Solaris 10 platform (has 
attached). When the db file meet 2147483648 bytes (2Gigabytes), the file size 
can not increase anymore, and query/write also error. When query or write the 
data, the exception as below. Who know the solution of this issue and can share 
me, thanks very much.
bash-3.00# more /etc/release
   Oracle Solaris 10 9/10 s10s_u9wos_14a SPARC
 Copyright (c) 2010, Oracle and/or its affiliates. All rights reserved.
Assembled 11 August 2010
bash-3.00# ls -lt database/
total 4196372
-rw-r--r--   1 root root1544 Nov 23 14:54 silentalarm.db-journal
-rw-r--r--   1 root root 2147483648 Nov 23 14:54 silentalarm.db

2013-11-23 14:55:41 -
 java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database (no such 
table: tasks)
 at org.sqlite.DB.newSQLException(DB.java:383)
 at org.sqlite.DB.newSQLException(DB.java:387)
 at org.sqlite.DB.throwex(DB.java:374)
 at org.sqlite.NestedDB.prepare(NestedDB.java:134)
 at org.sqlite.DB.prepare(DB.java:123)
 at org.sqlite.PrepStmt.(PrepStmt.java:42)
 at org.sqlite.Conn.prepareStatement(Conn.java:404)
 at org.sqlite.Conn.prepareStatement(Conn.java:399)
 at org.sqlite.Conn.prepareStatement(Conn.java:383)
 at 
com.utstar.silentalarm3.server.database.impl.TaskDataImpl.getAllTasks(TaskDataImpl.java:456)
 at 
com.utstar.silentalarm3.server.database.impl.TaskDataImpl.getTaskByNameAndStatus(TaskDataImpl.java:347)
 at 
com.utstar.silentalarm3.common.impl.TaskOperationImpl.getTaskByNameAndStatus(TaskOperationImpl.java:86)
 at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
 at java.lang.reflect.Method.invoke(Unknown Source)
 at sun.rmi.server.UnicastServerRef.dispatch(Unknown Source)
 at sun.rmi.transport.Transport$1.run(Unknown Source)
 at java.security.AccessController.doPrivileged(Native Method)
 at sun.rmi.transport.Transport.serviceCall(Unknown Source)
 at sun.rmi.transport.tcp.TCPTransport.handleMessages(Unknown Source)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(Unknown 
Source)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(Unknown 
Source)
 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown 
Source)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
 at java.lang.Thread.run(Unknown Source)




Regards,
Liang Kunming.

___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users