Then you'd be a prisoner even if you escaped. Unless you were the last, lonely being in the universe you still have to live in the same world as everyone else, and that means living on their terms as well. Whether you know them or not. They're the ones that decide you have food. They're the ones that sell everyday products. They're the ones that act in TV shows and write recipes and build new businesses.

They don't take your abilities or compromise your freedoms because they don't want you to defend yourself, they do it because you can't tell when you're hurting them.