Since the issue happens and stays for few minutes. Your best option is
to place captures on the endpoint having the issue and on the FortiGate
firewall. Check out the followings: 1) is there any issue at TCP level
2) Any packet drop that you can spot...