V
V
Vitali2012-03-01 12:34:21
Redis
Vitali, 2012-03-01 12:34:21

Redis losing data?

We are using Node.JS in conjunction with Redis and we have data loss issues.
We are making a statistics system where every request sent to the server should be logged. At 1000 or more concurrent requests, Redis starts losing data.
We log each request using Node.JS and Redis, and while Node.js shows exactly as many requests as were sent, and by the way, Redis Monitor also shows exactly as many requests as were sent, DBSIZE and KEYS always show 40-50 % less than expected.
Server configuration:
Intel® Core™ i7-920
24 GB DDR3 RAM
DC Hetzner
Debian Squeeze
The following settings were made in sysctl:
net.ipv4.conf.all.rp_filter=1
net.ipv4.icmp_echo_ignore_broadcasts=1
net.core.somaxconn = 1280
fs.file-max = 50000
vm.overcommit_memory=1
The load on the server is zero and there is enough free memory.
Any help is highly appreciated.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
V
Vitali, 2012-03-02
@Screatch

Seems to be sorted out.
The fault of the crooked driver for Node.JS is node_redis Abandoned
Redis in favor of mysql memory, performance pleases

I
iStyx, 2012-03-02
@iStyx

Don't you have a ring?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question