I can't say I disagree with anything people have said. It's your property and it should be your rules, but......how does your wife feel about this?Is she willing to go along with talking to her father or is it going to cause a major rift between the two of you?
I don't envy your situation, but hopefully you can all talk it out without a problem.
Good luck to you.