That's a tough one then. If you can get them feeding in your plot, they may not abandon it but I suspect they have something better to eat somewhere else. It is very easy to run deer off 4 acres.

I have a similar 20 acre plot that gets burned out fast if the deer know I am there. It is a transition path from food to bed. I usually save it for the kids or if I need a deer or two.

Are they used to human movement on the property? I'd set up a permanent blind. Make sure you don't walk on their trails and don't let them see you get in the blind. Cut a path and rake away the leaves. Don't use a light to get into it. Mind the wind. You might set up a couple blinds for different winds. Creek bottoms are notorious for making otherwise dependable winds very swirly. Stay on top if you can.