This subject can get wildly political very quickly. My opinion is that I should be allowed to go wherever I damn well please when I please to do it, and no government agency or worker should be able to tell me no. Seriously.
Of course: Go wherever I damn well please when I please to do it. But why stop there? Clear cut the woods, build a cabin (or a 37 room house), dam the stream (or just crap in it), and... (ok, I'll stop before getting more colorful).
