Inpaint
Fix the shadow, keep the set
One wrong shadow used to mean staging the whole set again. Paint over the part that is wrong, say what belongs there instead, and the rest of the shot stands. The fold you spent the morning on is still the fold in the picture.
What an inpaint leaves alone