As a general (though not absolute) rule, I think the answer to “Can the . . . social norms be compactly formalized?” is “no.” People are complicated.
Actually answering the question: I plan to keep modeling people in whatever depth I can. I think having better predictions of what someone is about to do is just straightforwardly useful, even if they don’t endorse it. Is model the word you mean to use there?
Can the relevant social norms be compactly formalized? It might sound vaguely like: “Only model people in ways they endorse.”
As a general (though not absolute) rule, I think the answer to “Can the . . . social norms be compactly formalized?” is “no.” People are complicated.
Actually answering the question: I plan to keep modeling people in whatever depth I can. I think having better predictions of what someone is about to do is just straightforwardly useful, even if they don’t endorse it. Is model the word you mean to use there?