It may also depend on where you touch the control. For example, if the control is at the far right edge, it’s easy to place your finger on the right edge of the device (but not actually over the control). If that happens, then the drag won’t be detected.
