It's funny cuz I always figured the Internet was busier during working hours, then at night.

Since phone have their own internet, and you or someone in your home isn't streaming a new music video, then it could be the internet provider.

We had to take back an IP phone because we just could not get the one phone to work at all over a DSL connection. The bandwith it just one factor. Delay and jitter are at least as important considerations.

I downloaded the free version of ping plotter. That looks like a very usefull tool to track connection problems. I would keep that running al the time, then look at it if you have a problem with a call. It doesn't look like the free version will keep logs or statistics. I didn't check to see if the other versions had a time trial.