Vibrations/notifications while on a call

While on a call, I continue to receive sounds and vibrations. The person on the other end also hears them. It is very annoying. I have already tried the settings - call - call alerts - notify during calls. I have tried checked and unchecked but the sound and vibrations still happen in either setting. Anyone have a solution?