Can we control mail sending in a publication workflow?

In a PWF, if a moderator refuses the mail is being sent entirely to all the contributors, is there a way to send mail only to the contributor who started the workflow, same for the moderators and the publishers instead of the whole group?