Sometimes when you establish boundaries, everyone won't be on board and they will want to leave. That's ok.
