No, it's not catching, but it can be a problem. Some rifles, the first shot out of a clean barrel can hit way off from the aiming point. Example:
This was shot with a Savage .308 bolt rifle at 100 yards. The first shot is that one two inches above and one inch left of the aiming point. Enough time was taken between shots that the barrel didn't warm up(this was a hunting load being tested). That's quite a difference in POI; enough to cause a miss at longer ranges, or (worse)to make a hit outside the vitals.
If you haven't before, something to check on with your rifles.