Limit Bandwidth but Allow Selected Sites Full Bandwidth

I have successfully created an address group that contains IP addresses of machines on my network that I want to limit their bandwidth. I have created a policy and successfully limit their bandwidth. Unfortunately this applies to all of their traffic. Is there a way to allow unlimited bandwidth to these users for a specific FQDN while restricting their bandwidth on everything else?