Yes, for the TinyTV DIY Kit you can replace the battery with a switched 3-5V supply connected to the JST SH connector. Note that 5V should absolutely not be exceeded on this input! It can damage the battery charging circuit. Less than 5V will not damage the battery charging circuit.
Thanks,
Ben