The world intentionally "pauses" while switching, but Patty does retain all of her momentum when the switch is complete. For example, if you were to switch almost immediately after jumping, you will still continue your upward arc in your jump (and may need to use this in a few areas of the game.) It can take a little getting used to, but keep trying and I'm sure you'll get the hang of it.