Compass working after I restart my phone only a day or two

I bought an iPhone 11 Pro Max about 2 months ago and recently noticed that the compass isn’t working so I can’t use directions on maps.

Compass calibration is turned on, tried restarting my phone and the compass will work a day or two after it freezes until I restart my phone again. Things like location and elevation are working. And I don’t have a magnetic case.

Also tried reseting the iPhone with a backup. After that it still only worked for a day.

Do you have any suggestions what I could try?