You're not wrong obviously, but a modestly priced cooler that makes little to no noise can help with piece of mind. I'm still leery if my CPU's get over 70c even though the spec is much higher. Theoretically if the CPU runs cooler it "should" last longer.
If you feel like a bit of research check this site for recommendations. They have a huge comparison chart with delta over ambient associated with noise level.
This link if for the top 5 in cooling as well as db level.