Right now it only seems possible to grant someone access to the list functionality entirely or not at all.
It would be great to give Users / Teams access to just specific lists. A little dropdown if you click on a list which says "assign list to..." would be perfect and from there we should be able to choose an individual Team or User.