Restrict access to conversations in the shared inbox, similar to standard object restrictions

It will be create if we can also customise limit the communication to certain users but still have them be able to see the conversation but not able to respond to them.