I don't believe loose screws are the cause, at least not in my case. I am more inclined to think the plastic cover on the side of the seat is the cause, because when I press on it after hearing the noise it stops then continues after I let go.