Stable optical lateral forces from inhomogeneities of the sp