u can try write some script to automate processing of huge logs. we have this problem too.
After investigating trouble we write solution for our needs:
1. move one-day(original) log to some tempora ...
for example source client (libshout mp3 stream) pass stream_name and stream_url. In server i want to override this to variables to my own.
I go to icecast.x ...