No, you are not, you have reasons for feeling frustrated and you stuck between the devil and deep blue sea.
Do what you think is best for you and your daughter.
I know you must be disappointed with only one phone call but when guys get together they lose all track of time, not that I'm making excuses for him. You may be right not asking him to come home if he might be a little grumpy, that's the last thing you need right now.
Are you able to reach him if you need to? Do you know where he is?