GitHub user ltagliamonte-dd added a comment to the discussion: About backup and recovery
After few tests my understanding is that: - both `BGSAVE` and `COMPACT` are async and that I can use `INFO rocksdb` to poll and check. However when i execute `COMPACT` it generates every time a new set of sstables so it seems hard to create any diff policy between the prev uploaded sstables and the new one. First COMPACT + BGSAVE: ``` ll backup total 512 -rw-r--r-- 2 luigi.tagliamonte staff 182123 May 7 17:04 000040.sst -rw-r--r-- 2 luigi.tagliamonte staff 10994 May 7 17:04 000042.sst -rw-r--r-- 1 luigi.tagliamonte staff 16 May 7 17:05 CURRENT -rw-r--r-- 1 luigi.tagliamonte staff 6636 May 7 17:05 MANIFEST-000011 -rw-r--r-- 2 luigi.tagliamonte staff 36036 May 7 17:00 OPTIONS-000013 ll db total 9384 -rw-r--r-- 1 luigi.tagliamonte staff 0 May 7 17:04 000029.log -rw-r--r-- 2 luigi.tagliamonte staff 182123 May 7 17:04 000040.sst -rw-r--r-- 2 luigi.tagliamonte staff 10994 May 7 17:04 000042.sst -rw-r--r-- 1 luigi.tagliamonte staff 16 May 7 17:00 CURRENT -rw-r--r-- 1 luigi.tagliamonte staff 36 May 7 17:00 IDENTITY -rw-r--r-- 1 luigi.tagliamonte staff 0 May 7 17:00 LOCK -rw-r--r-- 1 luigi.tagliamonte staff 203660 May 7 17:05 LOG -rw-r--r-- 1 luigi.tagliamonte staff 89766 May 7 17:00 LOG.old.1715126427310129 -rw-r--r-- 1 luigi.tagliamonte staff 6636 May 7 17:04 MANIFEST-000011 -rw-r--r-- 1 luigi.tagliamonte staff 35454 May 7 17:00 OPTIONS-000009 -rw-r--r-- 2 luigi.tagliamonte staff 36036 May 7 17:00 OPTIONS-000013 drwxr-xr-x 4 luigi.tagliamonte staff 128 May 7 17:04 archive ``` second COMPACT + BGSAVE: ``` ll backup total 528 -rw-r--r-- 2 luigi.tagliamonte staff 182123 May 7 17:06 000052.sst -rw-r--r-- 2 luigi.tagliamonte staff 10994 May 7 17:06 000054.sst -rw-r--r-- 1 luigi.tagliamonte staff 16 May 7 17:06 CURRENT -rw-r--r-- 1 luigi.tagliamonte staff 9305 May 7 17:06 MANIFEST-000011 -rw-r--r-- 2 luigi.tagliamonte staff 36036 May 7 17:00 OPTIONS-000013 ll db total 9520 -rw-r--r-- 1 luigi.tagliamonte staff 0 May 7 17:04 000029.log -rw-r--r-- 2 luigi.tagliamonte staff 182123 May 7 17:06 000052.sst -rw-r--r-- 2 luigi.tagliamonte staff 10994 May 7 17:06 000054.sst -rw-r--r-- 1 luigi.tagliamonte staff 16 May 7 17:00 CURRENT -rw-r--r-- 1 luigi.tagliamonte staff 36 May 7 17:00 IDENTITY -rw-r--r-- 1 luigi.tagliamonte staff 0 May 7 17:00 LOCK -rw-r--r-- 1 luigi.tagliamonte staff 253768 May 7 17:06 LOG -rw-r--r-- 1 luigi.tagliamonte staff 89766 May 7 17:00 LOG.old.1715126427310129 -rw-r--r-- 1 luigi.tagliamonte staff 9305 May 7 17:06 MANIFEST-000011 -rw-r--r-- 1 luigi.tagliamonte staff 35454 May 7 17:00 OPTIONS-000009 -rw-r--r-- 2 luigi.tagliamonte staff 36036 May 7 17:00 OPTIONS-000013 drwxr-xr-x 4 luigi.tagliamonte staff 128 May 7 17:04 archive ``` Am I missing something? GitHub link: https://github.com/apache/kvrocks/discussions/1357#discussioncomment-9348183 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
