And if ya do spook him out of this area and he goes 1/8 mile or so away.........

IMO,the only thing that can ruin a stand
is overuse(which could lead to extra scent being left,deer seing you move in the stand,etc.) If a deer is used to using an area and is comfortable in that area,any slight difference may make him cautious but not make him move out,he's there for a reason.
Alex