Permissions based on the release environment

Hi, we are using Matrix-based security with one group haveing build and release rights. We would like to further lock down that by allowing that group to do releases only to a specific environment. For example for each release we have a drop down that let’s us select where we want to deploy.
Is this really possible or do we need to build different jenkins servers that can only release to one environment (with appropriate permissions).
Thank you.