To remove team member section on contacts, if the team member is not given the access for team member section

So we do have a section for team members under the contacts section, which should be disabled when a user creates a custom role and does not give access to the team member section, the current process is that you cannot access the team member section but when you click on contacts you will be able to view the team members.