Re: real world testing of Redis as a bayes backend?

[Jan Hejl]

Whups. 62M :-D Sorry, my mistake. But still ...

Dne 13.2.2015 v 08:35 Axb napsal(a):

Jan,

could you please post your "# Memory"  section of

"redis-cli info"

and

sa-learn --dump magic


On 02/13/2015 08:29 AM, Jan Hejl wrote:

Hi Quannah,

we use it on heavy loaded infrstructure - 10M messsages per day and the
RES is 62k VIRT 130M. There has to be something "wrong" with his
configuration.

Jan

Dne 12.2.2015 v 23:04 Quanah Gibson-Mount napsal(a):

Has anyone done any real testing of Redis as a bayes backend?  Talking
with one of our customer, with a trivial <60,000 accounts, they are
seeing:

PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+ COMMAND


28GB purely for a bayes DB for < 60k accounts is insanity.

--Quanah

--

Quanah Gibson-Mount
Platform Architect
Zimbra, Inc.
--------------------
Zimbra ::  the leader in open source messaging and collaboration

22452 redis 20 0 28.7g 28g 740 S 9.6 72.4 1139:38 redis-server

0.000          0          3          0  non-token data: bayes db version
0.000          0    5843148          0  non-token data: nspam
0.000          0    3125700          0  non-token data: nham
0.000          0          0          0  non-token data: ntokens
0.000          0          0          0  non-token data: oldest atime
0.000          0          0          0  non-token data: newest atime
0.000          0          0          0  non-token data: last journal sync atime
0.000          0          0          0  non-token data: last expiry atime
0.000          0          0          0  non-token data: last expire atime delta
0.000          0          0          0  non-token data: last expire reduction 
count

# Server
redis_version:2.8.17
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:fbe70622e0c20ea6
redis_mode:standalone
os:Linux 3.18.5-hardened x86_64
arch_bits:64
multiplexing_api:epoll
gcc_version:4.8.3
process_id:2262
run_id:18482d63a4de42ace6d164cfb166409efb9e4f43
tcp_port:6379
uptime_in_seconds:431236
uptime_in_days:4
hz:10
lru_clock:14527454
config_file:/etc/redis.conf

# Clients
connected_clients:22
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0

# Memory
used_memory:52110432
used_memory_human:49.70M
used_memory_rss:61550592
used_memory_peak:65623176
used_memory_peak_human:62.58M
used_memory_lua:172032
mem_fragmentation_ratio:1.18
mem_allocator:jemalloc-3.6.0

smime.p7s
Description: Elektronicky podpis S/MIME