Thanks GT3 Tim and Feyd!
This looks exactly like the problem. I remembered seeing the putty was starting to crack into small pieces when I used to live there.
Looks pretty simple to do from watching the video. I'm going to fix it today and I'll let you know how it goes.