I think I'll side with you on this one! If it says Private property. you should respect that!
I agree, My Gramps (RIP) had the same problem. The fact that the road is on a map is no more significant than say having your complex's road on your map-set. Will you ride through a estate just because it it on the map?? A little respect goes a long way.