You don't have to scroll to the edges. If you fully zoom in on the planet/ship you want to handle first next turn, you still do get a bit of lag as ships enter or move through the screen area, but most of the galaxy still gets handled invisibly.
Zooming in and out, though, became almost as tedious as watching ships move. Most of the time I'll have some ships with movement points left over, so I process those at that time.