Removing a user from your community is a more permanent way and you would need to send an invitation to the user if you wanted to allow them access again.
DO NOT remove yourself from your own community!
Find the user(s) and select the checkbox next to their avatar
Click on More to see the dropdown menu and choose Delete from community
You will need to invite the user again if you wish to restore access.