Restrict access to conversations in the shared inbox, similar to standard object restrictions

Restrict view to shared inbox would be great. *push*