Problem with Spread dropping messages
Dave Walker <[email protected]>
| Newsgroups | gmane.network.spread.user |
|---|---|
| Message-ID | <OF56258F28.C1B041CD-ON80257856.005F2395-80257856.00603444@sizecreative.com> |
Hi All
I'm new to the list, and I've got a question about message handling.
We are using spread to handle statistics from a cluster of webservers,
aggregate them and save for processing on some back end servers.
We see that whenever there is load on the server, the spread setup seems
to be dropping about 45% of all of the messages that have been sent from
the webservers to the processors. The behavious is consistent, as all of
the back-end processors see exactly the same amount of messages, and the
messages that are seen on the processors are seen as spread between the
webservers
Here's an example of what we're seeing - this is a load of CSV values for
time(hours),total number of messages sent , number of messages received
0,0,0
1,0,0
2,0,0
3,0,0
4,2,2
5,3,3
6,0,0
7,30,17
8,93,50
9,421,226
10,228,124
11,372,202
12,615,334
13,661,358
14,13759,7552
15,4533,2484
16,2916,1590
17,1599,874
18,586,319
19,428,234
20,361,194
21,328,178
22,118,65
23,120,66
Spread conf file below
Spread_Segment 10.0.0.255:4803 {
# localhost 127.0.0.1
103-Chewer1 10.0.0.103
113-Chewer1 10.0.0.113
114-CDE2 10.0.0.114
104-CDE1 10.0.0.104
}
#DebugFlags = { PRINT EXIT }
#EventPriority = INFO
EventTimeStamp = "[%a %d %b %Y %H:%M:%S]"
RuntimeDir = /var/run/spread
DaemonUser = spread
DaemonGroup = spread
#RequiredAuthMethods = " "
#AllowedAuthMethods = "NULL"
We are picking up messages using spreadlogd and a custom script using the
php module, and both of these see exactly the same messages on the back
end servers
If anyone has any pointers, it would be much appreciated
Thanks in advance
Dave
This message has been scanned for viruses by Websence Hosted Security - www.websence.com
_______________________________________________
Spread-users mailing list
[email protected]
http://lists.spread.org/mailman/listinfo/spread-users