FortiClient VPN 7.4.X just doesn't work for all other internet connections

I upgraded to FortiClient VPN 7.4 (whatever the latest download is) from 7.2.10.1217 and it just flat doesn't work. I can VPN into our foritgate and connect as normal, however every other application that tries to connect to the internet on my client computer just fails. Fix was to downgrade back to 7.2.10.1217. Uhm, is this a thing?

I was trying to get our IT department to allow us to use Windows standard VPN client instead of this proprietary vpn client, but they can't seem to figure out how to do that with our fortigate firewall.