Out of the 2003 owners Manual
Driving in the 4HI Lock or 4LO Lock positions
for a long time on dry or wet pavement could
shorten the life of your vehicle’s drivetrain
and tires.
I think the key phrase is "long time", if it was a short distance/time I would not worry about it.