To make your diary available to only particular group of members choose suitable option from “View Privacy” field while creating your diary.
You can even change the view privacy by editing your diary.