chris
Joined: 13 Jun 2012 Posts: 15
|
Posted: Fri Dec 06, 2013 10:58 am Post subject: Volume-Calculation / Logsize |
|
|
Hi there
I am losing hope... There is a big gap between the NetworkIF's measured outgoing traffic and the content of the Logfile:
- We have two Masterservers
- Edgeservers are connecting to one master as ondemand = no, to the other with ondemand = yes
- Edgeservers are logging to the Masterservers with syslog-ng
- There is an external healthcheck to the edgeserver
I did the following:
- Reboot the Server to reset ifconfig-counters
- Deleting the access.log
- Start icecast and let it run for one hour
- Stop icecast, download log and open it in excel
- summarize "bytes transfered" and cross-check with ifconfig-outgoing-counter
I did this process twice, the first time only 10mins, the second time for almost 24h. And it shows the same result:
only 75% of the total-outgoing-traffic are in the icecast logs.
I did some research, found out that i can "assign" about 5% of this missing traffic to monitoring and loadbalancing-things.
It also looks like - and that's the intresting part - that quite a bit goes out to the master-server which is delivering audio to the edge. I understand why i have a constant ingoing-traffic from the master, but why out?
Does anyone has an idea, or do i miss something?
Chris |
|
karlH Code Warrior
Joined: 13 Jun 2005 Posts: 5476 Location: UK
|
Posted: Sun Dec 08, 2013 10:18 pm Post subject: |
|
|
A few items that I can think of, whether they apply is a question.
Bytes transferred does not include headers iirc
some clients issue multiple requests
The streamlist, that is a regular update requested by the slave.
if you are comparing against network counters then how much is in the acknowledgement of the data feed. The master may send a little over a k in a packet but there is an ack going back. May be that is what you are missing.
karl. |
|