Noisy fan and overheating problem!

Hi all, my notebook's CPU temp when I run Edge only around 50C, and if I run more apps it starts to get higher and exceeds 60C. In general, fan sounds annoying after 40C 'most time', and it gets worse while the heat is increasing. What could be the possible problem? Does changing the fan solve the issue?

Note:

1) "I cleaned the fan and placed a thermal paste on the CPU".

2) I need the fan to be quiet because I want to record my voice on the PC. At this time I realized that I have a really noisy fan.

Thanks in advance!