Sphinx rotation and deleted messages

[Konstantin]

Hello,

I have index file with size over 200Gb and want to rotate main1 to main2
according to the wiki
http://www.mailpiler.org/wiki/current:administering-piler

Will sphinx clean data from main1 (old index) based on killist if i make
change in indexer-main.sh ?

Thank you.
-- 
*This message was delivered using 100% recycled electrons*.

Sphinx sql_query_killlist not applied ?

[Konstantin]

Hello,

I found that in my archive purged messages not removed from main1 index.
Here are the query examples:

# Get data from sphinx
# mysql -h 127.0.0.1 -P 9306
mysql> show tables;
+-+---+
| Index   | Type  |
+-+---+
| dailydelta1 | local |
| delta1  | local |
| main1   | local |
| main2   | local |
| main3   | local |
| main4   | local |
| note1   | local |
| tag1| local |
+-+---+
8 rows in set (0.00 sec)
mysql> select * from main1 where id = 11;
+--+++--+---++-+
| id   | arrived| sent   | size | direction | folder | attachments |
+--+++--+---++-+
|   11 | 1383038432 | 1352945411 |0 | 3 |  0 |   1 |
+--+++--+---++-+
1 row in set (0.00 sec)


# Get data from Mysql server
select `id`, arrived, retained, deleted from metadata where id = 11
Output
id arrived  retained deleted
111383038432  13871598111

So the same id still available in sphinx...

sphinxsearch version is 2.0.4-1.1

sql_query_killlist is enabled at sphinx.conf,  indexer.*sh scripts active
in piler cron.

Do you know if there any problems / known bugs with this sphinx version?

Thank you.

-- 
*This message was delivered using 100% recycled electrons*.

Re: Sphinx sql_query_killlist not applied ?

[sj]

Hello,

On 2018-01-24 19:06, Konstantin wrote:


I found that in my archive purged messages not removed from main1
index.
Here are the query examples:

# Get data from sphinx

# mysql -h 127.0.0.1 -P 9306
mysql> show tables;
+-+---+
| Index   | Type  |
+-+---+
| dailydelta1 | local |
| delta1  | local |
| main1   | local |
| main2   | local |
| main3   | local |
| main4   | local |
| note1   | local |
| tag1| local |
+-+---+
8 rows in set (0.00 sec)
mysql> select * from main1 where id = 11;
+--+++--+---++-+
| id   | arrived| sent   | size | direction | folder |
attachments |
+--+++--+---++-+
|   11 | 1383038432 | 1352945411 |0 | 3 |  0 |
  1 |
+--+++--+---++-+
1 row in set (0.00 sec)


try the following query:

select * from main1,dailydelta1,delta1 where id = 11;



sphinxsearch version is 2.0.4-1.1

sql_query_killlist is enabled at sphinx.conf,  indexer.*sh scripts
active in piler cron.

Do you know if there any problems / known bugs with this sphinx
version?


this sphinx version is very old. However, the issue is with your query,
check out the query I gave you, and you'll see.

Janos

Re: Sphinx rotation and deleted messages

[sj]

Hello,

On 2018-01-24 13:30, Konstantin wrote:


I have index file with size over 200Gb and want to rotate main1 to
main2 according to the wiki
http://www.mailpiler.org/wiki/current:administering-piler

Will sphinx clean data from main1 (old index) based on killist if i
make change in indexer-main.sh ?


no. If you fixed the main index from main1 to main2 it wouldn't touch
the main1 data. The sphinx killlist works in a different way.

Janos