Security for who can add/change to Communication Address Book- Faxing

We just implemented Communications Center faxing and noticed that everyone in the entire facility has access to add to the address book. Now we have multiple entries for the same recipient. I would like to control who has access to add to the address book.