I ran into the same issue with my Tiny Video Player a while back.
In my case, I had to make sure the USB cable was a data cable (not just charging) and that I was using the latest TinyScreen firmware update tool. Once connected, the boot loader screen stayed on, and the update started immediately after selecting the correct COM port.
You might also try holding the button until after the power switch is fully on – sometimes timing makes a difference.