I find it very counter-intuitive that a field I create somewhere just pops up in all entity views..
Usually you create an entity view with a specific purpose. If I want to edit an entity view, I will do just that. Just because I created a new field it doesn’t mean it belongs to all entity views.
In my opinion default behavior should always be to enable the field only in the view where it was created.