Anyone who is not on the channel access list can send a memo to any channel. Have an Option where you need to be on the channel access list to send a memo to the channel - and not let anyone who is not on the channel access list to send a memo to the channel.