Swampy gives good advice. Those big bucks and even the smart does will either sneak back around the pushers or hunker down and let them walk right past. It's amazing how a full grown deer can turn invisible right under your feet.
In one of our draws it gets really, really thick down in there. There are even some places you can't even walk through and that's where they bed.
That sounds like the perfect area to be watching, especially during the rut! There has got to be at least one funnel leading into that draw. You need to find a spot where you can sit quietly and watch where the deer come in and out of that draw. Don't go down in the draw!!!
I like to plan my hunt where I arrive at my chosen posting site right at first legal light. Sneak in slow even if you are running a little "late". Deer don't use clocks. There just might be some there when you arrive. Then sit quietly and watch as the deer come to the bedding area.
There should be activity for the first hour or two of light, then it usually tapers off until late morning when the other guys start moving around, going to another stand, heading to the truck for lunch, etc. You have a real good chance of shooting a deer between 9:30-11:30 if you just stay put and eat a lunch that you packed in.
Then relax and read a book or something until around 2:00 when the other hunters start going back to their stands and moving the deer around again. Most hunters don't even realize they are bumping deer.
There will be another burst of activity the last couple hours of daylight.
...unless they do a drive and screw up the deers patterns and make 'em get all spooky.