Another project worth mentioning (although "as a service") is http://www.graylog2.org/ The web interface is not there yet (no complicated queries, or easy drilldown), but it definitely performs well and has an interesting design.
Interesting project, but I was hoping that it was something that it isn't. I've been looking around for something that would do ad hoc querying and graphing of 'stuff' frm the debug and production logs that I have on had, stuff like page gen time statistics vs time, or split by heaviest pages, or split by web app machine. And then follow that till I find something actionable.
I've taken a look at statsd+graphite, but that seems to be much more of a realtime solution, and I want to mine the logs I have on hand.
Statsd takes realtime info and dumps it in. You have to at least know what you're measuring when you start. I
Ve got a month or two of debug logs, and I dont know whee the gems are yet, touugh I'd probably start with timings and go from there.
