My good friend Brady Gaster, has written up a great blog post at Managing Multiple Windows Azure Web Site Environments using Visual Studio Publishing Profiles. In that post he shows how you can create publish profiles and have profile specific web.config transforms as well as a bunch of other info. Its a great read, the content applies to any host which supports Web Deploy not just Azure Web Sites.

Thanks,
Sayed Ibrahim Hashimi | @SayedIHashimi