yes, at first I just replaced the battery but the battery would slide around. There is plastic all around the battery housing so it probably wouldn’t damage anything. I went back in and added a small piece of 3M double sided tape and have not had any issues.
it would be worth noting that Nintendo has put some kind of thermal paste between the heat shield and the heatpipe/cooler on the chip. This thermal paste is much thicker than PC thermal paste and my switch was fine just pressing the 2 back together.