iPhone not charging when turned on, but charges when turned off

Hey all, I found my old iPhone 4, and I used it for a bit, and I realized that I had some very cool and fond memories on the device, I was gonna export the pictures and videos from the device until I noticed that plugging the device in did nothing. It won't charge, but when you plug it in, turn it off, and leave it, it will charge (I did that before I went to work, and I came back after work and I turned it on, and it was fully charged) but plugging it into a computer will cause Windows to say "USB device not recognized" saying that it malfunctioned. And no, the battery works fine, it does drain a bit fast, but no sudden shut down issues, before it broke, 3uTools reported that it had 88% battery health, the battery I replaced it with was also a used one at 85% health, same as the original one, drains a bit fast but no sudden shut downs.

I have replaced the battery, and the dock connector, I grabbed the charging flex assembly from an iPhone that was locked but I did test it and yeah, that phone did get detected and did charge properly, I put it in to the iPhone that has the issue, not only did it not fix it, but now, when I returned the charging flex assembly back to it's original device, that same device now exhibits the same issue; not charging when turned on, charges when powered off, and is not recognized by the computer when you plug it in to one.

Update (47 minutes after this was posted), I left it plugged in, and I have noticed it charges as fast as it would, only problem is again, it doesn't show that it's charging, and it still can't get detected by a computer.