Does the orange light turn off after the Tiny Arcade is finished charging?

No worries about the question - it should turn off once the battery is fully charged. Sorry if you already got an answer!

Yes, it did. This post was actually for a defective model, a new one was sent to me and it works fine.