Generally, yes; troughs of low pressure will help steer the storm, gradually recurving it out to sea. The Virginia coastline is also spared to some degree by the Outer Banks & eastern North Carolina as well as the Gulf stream starting to curve out to sea around that latitude. Impacts can and do happen, they are just usually somewhat diluted by land beforehand, making rain a much greater threat than anything else -- especially as you head westward toward the mountains, coincidentally enough.