You can disable access to your forum to all users and hide it from the user portal, without removing user permissions.
When you deactivate a forum:
To deactivate the forum:
To re-activate the forum click visibility Activate.
You can deactivate and activate the forums as often as you need.