A survey is a legal document that cannot be altered, so check to see if there are any "sketch" lines drawn on it. Your neighbor could have altered their survey. Often people will draw, use correction fluid, or make personal notes on a survey. Even though you would expect building departments to refuse altered surveys, they rarely do, so look at their copy closely, also. If you suspect foul play or a discrepancy, ask your surveyor, for a fee, to check and stake your line.
You could wait until your neighbor has put in the driveway, then have a surveyor jam a steel stake right through the pavement, sticking up about 8 inches to a foot high. Then, demand the driveway be removed or you will sue for damages. Then, wait about three to five years for our justice system to render a decision, purchase a fence, go through several bouts of name-calling and garbage can tipping, buy a mean dog, have the police visit you or your neighbor a few times a week, park a car in front of the driveway, develop an eye twitch, take up kung-fu...
Or just stake your property now and put in a low fence, less than 4 feet tall, along your property line. Remember what poet Robert Frost once said, "good fences make good neighbors." Good luck, neighbor!