Definition of "Authorizer" :

noun: an authority who authorizes (people or actions)

"The agents report back to their authorizers."