If you lost RDP access after setting your inbound rule to another IP. You can get it back by setting the RDP back to 3389 and then “redeploying” You can get the box to give you access again. This is a work around to get access back only if you tried using the Inbound rule to “port forward as a different port” through the Azure Security Group and didn’t change it internally on the VM itself.
Azure Security Group
ARM Azure Resource Manager