Satisfying server story
For one of my clients, they drive an enormous amount of traffic via advertising to their product funnels. My contact who is there told me they're in fact buying a second dedicated server because their first one is slowing down way too much.
I had to double check with him that was indeed their plan and that I wasn't hearing incorrectly. Currently their team is paying upwards of $400+ a month for a good dedicated server, and there would be no reason it couldn't handle their current traffic. They have no sql, no dynamic code, simply static pages.. I was somewhat baffled how their server could be slowing down.
So, I told them before they buy a new server they should have me take a look. They agree, and I log into their server not expecting what to find.
After only a minute, I figure out the problem. I was in disbelief at first, I thought there must be an error or that I was reading it wrong...
I ran top and first on the list I see a process that has been running TWO YEARS... that is utilizing 99% CPU nonstop. I was astounded.. furthermore, I go to investigate the process. It turns out to be a rogue wordpress plugin on a blog that hasn't been updated since 2009.
After getting confirmation, I killed the process and their load average goes from 3.5 steady to < .1...
How it could ever get to that point, I have no idea, but it was probably the most satisfying thing I've done recently to kill that cancerous process :D