Caller/Callee hears load noise, sometimes.

Sometimes when I call someone or someone calls me all they hear is load, grinding, robotic noise; yet I can hear them talking just fine with no weird noises. It happens to a few calls a day. Usually if I call back or they call me back a couple of times, the noise will be gone.