By default, a Fortigate firewall uses stateful inspection of each connection. Since several gateways are involved, I very much suspect asymmetric routing, with the reverse path bypassing the Fortigate. This makes stateful inspection fail, resetting the connection.
You need to either switch off stateful inspection (reverse path forwarding) or make sure that the routing path matches in both directions.