It is quite a common finding to people who investigate shot peening and fatigue. Becuase you increase the roughness of the material you are basically decrease it's endurance limit. That means that if your residual stresses are not enough to compensate for that or they are not stable you will end up with a lower limit.
