Since your paging is connected to a CO port on the 50 try adjusting the open loop duration in programming (on the 50). I had a similar issue with a phone line coming from a Comcast EMTA over ESI-Link. The line worked correctly from the local side but from other ESI-Linked locations there was a huge delay or it wouldn't connect at all. Adjusting the open loop duration resolved the issue for me.