It's probably already been said before this post but you can only go by what the divorce settlement stipulates for visitation. Any other arrangements/agreements between you and the ex will not hold up in court. If it becomes a legal battle, the original visitation agreement will prevail unless there are extraodinary circumstances to justify otherwise. I've been in situations where I was given extra visitation through mutual agreement and then had the tables turn to deny visitation during what was stipulated as my time. My attorney was aggressive as a pitbull with rabies and loves the challenge when that happens so it was squashed immediately. Extra visitation in the past is not considered when it comes to what is in the legal agreement. It is in the best interest of all to try and maintain a reasonable relationship with the ex but, typically, that tends to be difficult when you are involved with a significant other or your ex perceives that your children are really enjoying their time with you...the latter in my case anyway. I don't know the details of your divorce but I have seen where the one of wrongdoing is very protective and insecure with the parent/child relationship out of guilt.