On Tue, Apr 5, 2011 at 11:49 AM, Filip Navara <filip.nav...@gmail.com> wrote: > Hello, > > we are having problem with database that originated on computer of one > of our customers. > > The database is used in WAL mode with auto_vacuum=1 and page_size=1024. > > When running the "pragma incremental_vacuum(1);" command the WAL file > grows to 14Mb, while we would expect it to grow only to about 4Kb (1Kb > per page + some overhead). This causes the transaction to run for much > longer time than expected and eventually the WAL file grows to several > gigabytes when we try to run incremental_vacuum for 4096 pages. > > Additional facts: > - The database was created with SQLite 3.7.5 running on Windows > - "pragma integrity_check;" reports ok > - Some free trunk list pages contain weird values in the "number of > entries" field > > I have attached most of the dumps that I could create with the regular > SQLite tools (showdb dbheader, sqlite3_analyzer output, beginning of > the free list dump). I'm willing to send the whole database file > (~5Gb) to sqlite developers on request. > > My questions are: > - Is is expected behavior that "pragma incremental_vacuum(1);" can > create 14Mb WAL file even though the page size is just 1Kb? > - If not, is it a know bug? If yes, in what circumstances? > - Is the free list corrupted? And if it is, how could this happen and > should "pragma integrity_check;" verify it? > > Best regards, > Filip Navara
Also the free list trunk pages seem to filled with 3-byte patterns. Each page has different pattern, but they look very similar. I'm not sure if these patterns come from the original data or not. 02D1E6000 00 0B 47 9A B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC ..Gť¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6010 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6020 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6030 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6040 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6050 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6060 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6070 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6080 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6090 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E60A0 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E60B0 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E60C0 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E60D0 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E60E0 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E60F0 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6100 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6110 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6120 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6130 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6140 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6150 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6160 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6170 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6180 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6190 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E61A0 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E61B0 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E61C0 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E61D0 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E61E0 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E61F0 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6200 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6210 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6220 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6230 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6240 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6250 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6260 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6270 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6280 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6290 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E62A0 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E62B0 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E62C0 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E62D0 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E62E0 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E62F0 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6300 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6310 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6320 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6330 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6340 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6350 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6360 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E6370 B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾ 02D1E6380 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 ¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡ 02D1E6390 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC B5 B7 BC Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ¾¡Ľ 02D1E63A0 B5 B7 BC B5 B7 BC B5 B5 B9 B3 B5 BA B4 D4 D5 C8 ¾¡Ľ¾¡Ľ¾¾Ä?Ĺ?ÂľĹ?´Ă?Ĺ?Ä? 02D1E63B0 F3 EE DC F1 ED DB EB E8 D8 EC E9 D8 EC E9 D8 EC óÎĂ?Ĺ?ĂĹ°ĂŤÄ?Ĺ?Ä?ĂŠĹ?Ä?ĂŠĹ?Ä? 02D1E63C0 E9 D8 EC E9 D8 EC E9 D8 EC E9 D8 EC E9 D8 EE EA ĂŠĹ?Ä?ĂŠĹ?Ä?ĂŠĹ?Ä?ĂŠĹ?Ä?ĂŠĹ?ĂŽÄ? 02D1E63D0 D9 F6 F0 DC E1 E1 D3 A5 B5 B9 73 90 A4 64 85 9E ĹŽĂśÄ?Ă?ĂĄĂĄĂ?Ä?ÂľÄ?s.¤dâ?ŚĹž 02D1E63E0 64 85 9E 65 86 9F 65 86 9F 65 86 9F 65 86 9F 65 dâ?ŚĹžeâ? Ĺşeâ? Ĺşeâ? Ĺşeâ? Ĺşe 02D1E63F0 86 9F 65 86 9F 65 86 9F 65 86 9F 65 86 9F 65 86 â? Ĺşeâ? Ĺşeâ? Ĺşeâ? Ĺşeâ? Ĺşeâ? Best regards, Filip Navara _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
