Not at all, I practice with a driver a lot less than I practice my short game.
For me, it's about playing the full course. I want to play whatever is the longest yardage on the card.
It's not a distance thing (I'm probably a bit shorter than average for a 3 handicapper). I know most people will have different views on this, but I feel like if I have a good score it's tarnished if it's not from the fullest possible yardage of the course.
It's also more challenging, and I like challenging myself, it's how I get better.
On a similar but unrelated matter, the most annoying thing I can find on a golf course is if the tee markers are 15-20 yards in front of the measured plate on each hole. If the card says the colour tees I am using is a x,xxx yard course, that's the distance I want to play, not 270-360 yards less.