Yes it should. When I went to an apple store to replace my battery that started to inflate, they asked if I wanted to juste completely remove it or get it replaced.
But don’t forget that without the battery, once you unplug the laptop it is like removing the plug of a desktop computer: everything goes off instantly.
