No, you don't. Either I have the authority or I don't. You can't have it both ways.
Even though Jesus says to Peter, “I will give
you the keys of the kingdom of heaven, and whatever you bind on earth shall be bound in heaven, and whatever you loose on earth shall be loosed in heaven,” that very same thing Jesus says to Christians in general, with the very same words, two chapters later in
Matthew 18:18: “Truly, I say to you [plural — not you,
Peter, but you, plural, who are gathered in my name], whatever you bind on earth shall be bound in heaven, and whatever you loose on earth shall be loosed in heaven."
The bedrock on which the church is built is the bedrock of Jesus’s teachings, with the rock-solid core of his identity — “you are the Messiah; you are the Son of God” — at the center of those teachings.
So, it’s these teachings of Jesus that are the keys of the kingdom.
When any faithful Christian who speaks the words with the bedrock of Jesus’s identity at the center — when you speak those words faithfully, you are using the keys of the kingdom to open the kingdom in people’s lives.
It's not about any individual having the keys, but all the faithful.