That's pretty much what the current firmware does, the RP2040(and any reasonable low power microcontroller) only has USB full speed, 12Mbit/s. We have some firmware changes we're testing that result in about 1MByte/s, that seems to be about the max that this hardware/USB stack will do. We really underestimated how many people would want to fully load up the storage!