Just tested again to check where the different experience might come from. Panning indeed works when editing a mask. When not masking, it works differently by using three fingers on the trackpad or by klick-drag the mouse (but not by using the scroll-pad (magic mouse)). Using two fingers on the track pad or scrolling horizontally via mouse moves to the next/previous image.