If you don't want to add duplicate phone numbers, you will need to change the area settings on the Phone mapping (please note that this does need to happen for every Phone/Email mapping in your template). 


To access the Area settings, you will need to click the red/green radio button on that mapping in the template:


Next, change the match settings to include the Number (you may want both Type and Number depending upon your internal policies).