No, that is our customer serial IP from the carrier that is assigned to our router. I am talking about the public IP in the firewall. With the firewall disconnected it should work. I can go to my browser on my phone and connect to the public IP that the FQDN resolves to and get the Apps server login screen. But the phone will not connect.
OK, I was able to connect, finally. Bonehead me didn't put the IPO on a public IP for testing. Once I did that and changed all necessary info then it connected. So, it must be a firewall issue now. At least I know where the problem is.